Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Quality-aware Online Task Assignment in Mobile Crowdsourcing

Published: 21 July 2020 Publication History

Abstract

In recent years, mobile crowdsourcing has emerged as a powerful computation paradigm to harness human power to perform spatial tasks such as collecting real-time traffic information and checking product prices in a specific supermarket. A fundamental problem of mobile crowdsourcing is: When both tasks and crowd workers appear in the platforms dynamically, how to assign an appropriate set of tasks to each worker. Most existing studies focus on efficient assignment algorithms based on bipartite graph matching. However, they overlook an important fact that crowd workers might be unreliable. Thus, their task assignment schemes cannot ensure the overall quality. In this article, we investigate the Quality-aware Online Task Assignment (QAOTA) problem in mobile crowdsourcing. We propose a probabilistic model to measure the quality of tasks and a hitchhiking model to characterize workers’ behavior patterns. We model task assignment as a quality maximization problem and derive a polynomial-time online assignment algorithm. Through rigorous analysis, we prove that the proposed algorithm approximates the offline optimal solution with a competitive ratio of 10/7. Finally, we demonstrate the efficiency and effectiveness of our solution through intensive experiments.

References

[1]
2020. Clickworker. https://www.clickworker.com/.
[2]
2020. EasyShift. http://easyshiftapp.com/.
[3]
2020. Field Agent. http://www.fieldagent.net/.
[4]
2020. Gigwalk. http://www.gigwalk.com/.
[5]
2020. Meituan. http://www.meituan.com/.
[6]
2018. Meituan Dianping Global Offering. http://alturl.com/vq9nj.
[7]
Avrim Blum, Shuchi Chawla, David R. Karger, Terran Lane, Adam Meyerson, and Maria Minkoff. 2007. Approximation algorithms for orienteering and discounted-reward TSP. SIAM J. Comput. 37, 2 (2007), 653--670.
[8]
Caleb Chen Cao, Jieying She, Yongxin Tong, and Lei Chen. 2012. Whom to ask?: Jury selection for decision making tasks on micro-blog services. Proc. VLDB Endow.
[9]
Caleb Chen Cao, Jieying She, Yongxin Tong, and Lei Chen. 2012. Whom to ask?: Jury selection for decision making tasks on micro-blog services. Proceedings of the VLDB Endowment 5, 11 (2012), 1495--1506.
[10]
Chandra Chekuri and Amit Kumar. 2004. Maximum coverage problem with group budget constraints and applications. In Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques. Springer, 72--83.
[11]
Yohan Chon, Nicholas D Lane, Yunjong Kim, Feng Zhao, and Hojung Cha. 2013. Understanding the coverage and scalability of place-centric crowdsensing. In Proceedings of Ubicomp.
[12]
Xiaochen Fan, Panlong Yang, and Qingyu Li. 2015. Fairness counts: Simple task allocation scheme for balanced crowdsourcing networks. In Proceedings of MSN. IEEE, 258--263.
[13]
Zhenni Feng, Yanmin Zhu, Qian Zhang, Lionel M. Ni, and Athanasios V. Vasilakos. 2014. TRAC: Truthful auction for location-aware collaborative sensing in mobile crowdsourcing. In Proceedings of INFOCOM.
[14]
Jinyang Gao, Xuan Liu, Beng Chin Ooi, Haixun Wang, and Gang Chen. 2013. An online cost sensitive decision-making method in crowdsourcing systems. In Proceedings of SIGMOD.
[15]
Yanmin Gong, Lingbo Wei, Yuanxiong Guo, Chi Zhang, and Yuguang Fang. 2015. Optimal task recommendation for mobile crowdsourcing with privacy control. IEEE Internet Things J. 3, 5 (2015), 745--756.
[16]
Aakar Gupta, William Thies, Edward Cutrell, and Ravin Balakrishnan. 2012. mClerk: Enabling mobile crowdsourcing in developing regions. In Proceedings of SIGCHI. 1843--1852.
[17]
Shibo He, Dong-Hoon Shin, Junshan Zhang, and Jiming Chen. 2014. Toward optimal allocation of location dependent tasks in crowdsensing. In Proceedings of INFOCOM.
[18]
Jessica Heinzelman and Carol Waters. 2010. Crowdsourcing Crisis Information in Disaster-affected Haiti. U.S. Institute of Peace.
[19]
Chien-Ju Ho, Shahin Jabbari, and Jennifer W. Vaughan. 2013. Adaptive task assignment for crowdsourced classification. In Proceedings of ICML.
[20]
Jian Hou, Shuyun Luo, Weiqiang Xu, and Lili Wang. 2019. Fairness-based multi-task reward allocation in mobile crowdsourcing system. IET Commun. 13, 16 (2019), 2506--2511.
[21]
Boutsis Ioannis and kalogerki Vana. 2014. On task assignment for real-time reliable crowdsourcing. In Proceedings of ICDCS.
[22]
Michael Kapralov, Ian Post, and Jan Vondrák. 2013. Online submodular welfare maximization: Greedy is optimal. In Proceedings of SODA.
[23]
David R. Karger, Sewoong Oh, and Devavrat Shah. 2011. Iterative learning for reliable crowdsourcing systems. In Proceedings of NIPS.
[24]
David R. Karger, Sewoong Oh, and Devavrat Shah. 2013. Efficient crowdsourcing for multi-class labeling. In Proceedings of SIGMETRICS.
[25]
Leyla Kazemi and Cyrus Shahabi. 2012. Geocrowd: Enabling query answering with spatial crowdsourcing. In Proceedings of GIS.
[26]
Leyla Kazemi, Cyrus Shahabi, and Lei Chen. 2013. Geotrucrowd: Trustworthy query answering with spatial crowdsourcing. In Proceedings of GIS.
[27]
Emmanouil Koukoumidis, Li-Shiuan Peh, and Margaret Rose Martonosi. 2011. Signalguru: Leveraging mobile phones for collaborative traffic signal schedule advisory. In Proceedings of MobiSys.
[28]
Ioannis Koukoutsidis. 2018. Estimating spatial averages of environmental parameters based on mobile crowdsensing. ACM Trans. Sensor Netw. 14, 1 (2018), 2.
[29]
Ming Li, Jian Weng, Anjia Yang, Wei Lu, Yue Zhang, Lin Hou, Jia-Nan Liu, Yang Xiang, and Robert H. Deng. 2018. CrowdBC: A blockchain-based decentralized framework for crowdsourcing. IEEE Trans. Parallel Distrib. Syst. 30, 6 (2018), 1251--1266.
[30]
Kebin Liu, Minglu Li, Yunhao Liu, Xiang-Yang Li, and Huadong Ma. 2010. Exploring the hidden connectivity in urban vehicular networks. In Proceedings of ICNP.
[31]
Xuan Liu, Meiyu Lu, Beng Chin Ooi, Yanyan Shen, Sai Wu, and Meihui Zhang. 2012. Cdas: A crowdsourcing data analytics system. In Proceedings of the VLDB Endowment.
[32]
Zhidan Liu, Zhenjiang Li, and Kaishun Wu. 2019. UniTask: A unified task assignment design for mobile crowdsourcing based urban sensing. IEEE Internet of Things Journal 6, 4 (2019), 6629--6641.
[33]
Prashanth Mohan, Venkata N Padmanabhan, and Ramachandran Ramjee. 2008. Nericell: Rich monitoring of road and traffic conditions using mobile smartphones. In Proceedings of SenSys.
[34]
Prayag Narula, Philipp Gutheim, David Rolnitzky, Anand Kulkarni, and Bjoern Hartmann. 2011. Mobileworks: A mobile crowdsourcing platform for workers at the bottom of the pyramid. In Proceedings of AAAI.
[35]
Zhengxiang Pan, Han Yu, Chunyan Miao, and Cyril Leung. 2016. Efficient collaborative crowdsourcing. In Proceedings of AAAI.
[36]
Layla Pournajaf, Li Xiong, Vaidy Sunderam, and Slawomir Goryczka. 2014. Spatial task assignment for crowd sensing with cloaked locations. In Proceedings of MDM.
[37]
Chuan Wu Ruiting Zhou, Zongpeng Li. 2017. A truthful online mechanism for location-aware tasks in mobile crowd sensing. IEEE Trans. Mobile Comput. 17 (2017), 1737--1749.
[38]
Guobin Shen, Zhuo Chen, Peichao Zhang, Thomas Moscibroda, and Yongguang Zhang. 2013. Walkie-markie: Indoor pathway mapping made easy. In Proceedings of NSDI.
[39]
Amarjeet Singh, Andreas Krause, Carlos Guestrin, William J Kaiser, and Maxim A Batalin. 2007. Efficient planning of informative paths for multiple robots. In Proceedings of IJCAI.
[40]
Xiaoqiang Teng, Deke Guo, Yulan Guo, Xiaolei Zhou, Zeliu Ding, and Zhong Liu. 2017. IONavi: An indoor-outdoor navigation service via mobile crowdsensing. ACM Trans. Sensor Netw. 13, 2 (2017), 12.
[41]
Arvind Thiagarajan, Lenin Ravindranath, Katrina LaCurts, Samuel Madden, Hari Balakrishnan, Sivan Toledo, and Jakob Eriksson. 2009. VTrack: Accurate, energy-aware road traffic delay estimation using mobile phones. In Proceedings of SenSys.
[42]
Hien To, Liyue Fan, Luan Tran, and Cyrus Shahabi. 2016. Real-time task assignment in hyperlocal spatial crowdsourcing under budget constraints. In Proceedings of PerCom. IEEE, 1--8.
[43]
Yongxin Tong, Jieying She, Bolin Ding, Libin Wang, and Lei Chen. 2016. Online mobile micro-task allocation in spatial crowdsourcing. In Proceedings of ICDE.
[44]
Jiayang Tu, Peng Cheng, and Lei Chen. 2018. Quality-assured synchronized task assignment in crowdsourcing. CoRR abs/1806.00637 (2018). http://arxiv.org/abs/1806.00637.
[45]
Dong Wang, Tarek Abdelzaher, Lance Kaplan, and Charu C Aggarwal. 2013. Recursive fact-finding: A streaming approach to truth estimation in crowdsourcing applications. In Proceedings of ICDCS.
[46]
Liang Wang, Zhiwen Yu, Dingqi Yang, Tao Ku, Bin Guo, and Huadong Ma. 2019. Collaborative mobile crowdsensing in opportunistic D2D networks: A graph-based approach. ACM Trans. Sensor Netw. 15, 3 (2019), 30.
[47]
Yingjie Wang, Zhipeng Cai, Zhi-Hui Zhan, Yue-Jiao Gong, and Xiangrong Tong. 2019. An optimization and auction-based incentive mechanism to maximize social welfare for mobile crowdsourcing. IEEE Transactions on Computational Social Systems 6, 3 (2019), 414--429.
[48]
Yin Wang, Xuemei Liu, Hong Wei, George Forman, Chao Chen, and Yanmin Zhu. 2013. Crowdatlas: Self-updating maps for cloud and personal use. In Proceeding of MobiSys.
[49]
Cheng Li Wei Gong, Baoxian Zhang. 2017. Location-based online task scheduling in mobile crowdsensing. In Proceedings of IEEE GLOBECOM. 1--6.
[50]
Hai-Qin Wu, Liangmin Wang, and Guoliang Xue. 2018. Privacy-aware task allocation and data aggregation in fog-assisted spatial crowdsourcing. IEEE Transactions on Network Science and Engineering 7, 1 (2018), 589--602.
[51]
Xingyou Xia, Lin Xue, Jie Li, and Ruiyun Yu. 2018. A quality-validation task assignment mechanism in mobile crowdsensing systems. In Proceedings of WASA. Springer, 786--792.
[52]
Jingweijia Tan Shang Gao Xiaohui Wei, Yongfang Wang. 2018. Data quality-aware task allocation with budget constraint in mobile crowdsensing. IEEE Access 6 (2018), 48010--48020.
[53]
Tingxin Yan, Matt Marzilli, Ryan Holmes, Deepak Ganesan, and Mark Corner. 2009. mCrowd: A platform for mobile crowdsourcing. In Proceedings of SenSys.
[54]
Dejun Yang, Guoliang Xue, Xi Fang, and Jian Tang. 2012. Crowdsourcing to smartphones: Incentive mechanism design for mobile phone sensing. In Proceedings of Mobicom.
[55]
Kan Yang, Kuan Zhang, Ju Ren, and Xuemin Shen. 2015. Security and privacy in mobile crowdsourcing networks: Challenges and opportunities. IEEE Commun. Mag. 53, 8 (2015), 75--81.
[56]
Zheng Yang, Chenshu Wu, and Yunhao Liu. 2012. Locating in fingerprint space: Wireless indoor localization with little human intervention. In Proceedings of Mobicom.
[57]
Xiaomei Zhang, Yibo Wu, Lifu Huang, Heng Ji, and Guohong Cao. 2017. Expertise-aware truth analysis and task allocation in mobile crowdsourcing. In Proceedings of ICDCS.
[58]
Dong Zhao, Xiang-Yang Li, and Huadong Ma. 2014. How to crowdsource tasks truthfully without sacrificing utility: Online incentive mechanisms with budget constraint. In Proceedings of INFOCOM.
[59]
Yan Zhao, Yang Li, Yu Wang, Han Su, and Kai Zheng. 2017. Destination-aware task assignment in spatial crowdsourcing. In Proceedings of CIKM.
[60]
Yudian Zheng, Jiannan Wang, Guoliang Li, Reynold Cheng, and Jianhua Feng. 2015. QASCA: A quality-aware task assignment system for crowdsourcing applications. In Proceedings of SIGMOD.
[61]
Yanmin Zhu, Qian Zhang, Hongzi Zhu, Jiadi Yu, Jian Cao, and Lionel M. Ni. 2014. Towards truthful mechanisms for mobile crowdsourcing with dynamic smartphones. In Proceedings of ICDCS.

Cited By

View all
  • (2024)Task Assignment and Path Planning Mechanism Based on Grade-Matching Degree and Task Similarity in Participatory CrowdsensingSensors10.3390/s2402065124:2(651)Online publication date: 19-Jan-2024
  • (2024)Clustering Based Priority Queue Algorithm for Spatial Task Assignment in CrowdsourcingIEEE Transactions on Services Computing10.1109/TSC.2024.335329317:2(452-465)Online publication date: Mar-2024
  • (2024)Federated Submodular Maximization With Differential PrivacyIEEE Internet of Things Journal10.1109/JIOT.2023.332480111:2(1827-1839)Online publication date: 15-Jan-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Sensor Networks
ACM Transactions on Sensor Networks  Volume 16, Issue 3
August 2020
263 pages
ISSN:1550-4859
EISSN:1550-4867
DOI:10.1145/3399417
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

Publication History

Published: 21 July 2020
Online AM: 07 May 2020
Accepted: 01 April 2020
Revised: 01 April 2020
Received: 01 November 2019
Published in TOSN Volume 16, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Crowdsourcing
  2. task assignment

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • National Key Research and Development Project
  • NSFC

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)49
  • Downloads (Last 6 weeks)6
Reflects downloads up to 13 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Task Assignment and Path Planning Mechanism Based on Grade-Matching Degree and Task Similarity in Participatory CrowdsensingSensors10.3390/s2402065124:2(651)Online publication date: 19-Jan-2024
  • (2024)Clustering Based Priority Queue Algorithm for Spatial Task Assignment in CrowdsourcingIEEE Transactions on Services Computing10.1109/TSC.2024.335329317:2(452-465)Online publication date: Mar-2024
  • (2024)Federated Submodular Maximization With Differential PrivacyIEEE Internet of Things Journal10.1109/JIOT.2023.332480111:2(1827-1839)Online publication date: 15-Jan-2024
  • (2024)Optimizing Worker Selection in Collaborative Mobile CrowdsourcingIEEE Internet of Things Journal10.1109/JIOT.2023.331528811:4(7172-7185)Online publication date: 15-Feb-2024
  • (2024)Online quality-based privacy-preserving task allocation in mobile crowdsensingComputer Networks10.1016/j.comnet.2024.110613251(110613)Online publication date: Sep-2024
  • (2023)Preference-Matched Multitask Assignment for Group Socialization under Mobile CrowdsensingSensors10.3390/s2304227523:4(2275)Online publication date: 17-Feb-2023
  • (2023)Non-Rejection Aware Online Task Assignment in Spatial CrowdsourcingIEEE Transactions on Services Computing10.1109/TSC.2023.332785816:6(4540-4553)Online publication date: Nov-2023
  • (2022)Selecting Workers Wisely for Crowdsourcing When Copiers and Domain Experts Co-existFuture Internet10.3390/fi1402003714:2(37)Online publication date: 24-Jan-2022
  • (2022)Enhancing Task Assignment in Crowdsensing Systems Based on Sensing Intervals and LocationComputers, Materials & Continua10.32604/cmc.2022.02371671:3(5619-5638)Online publication date: 2022
  • (2022)Incentive Mechanism Design for Truth Discovery in Crowdsourcing With CopiersIEEE Transactions on Services Computing10.1109/TSC.2021.307574115:5(2838-2853)Online publication date: 1-Sep-2022
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media