Skip to main content

2019 | OriginalPaper | Buchkapitel

Worker Recommendation with High Acceptance Rates in Collaborative Crowdsourcing Systems

verfasst von : Mingchu Li, Xiaomei Sun, Xing Jin, Linlin Tian

Erschienen in: Collaborative Computing: Networking, Applications and Worksharing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Crowdsourcing has emerged as a popular Internet-based collaboration paradigm, in which tasks published by requesters can be economically and efficiently accomplished by crowd workers. To ensure the quality of service (QoS) provided by crowd workers, requesters are more likely to assign tasks to trustworthy workers, therefore, trust have played an important role in the design of worker recommendation mechanisms in crowdsourcing systems. Most existing studies focus on the trust that requesters place on workers, however, which would suffer the low-acceptance problem because crowd workers would refuse to participate in tasks published by low-trustworthy requesters with a great probability. In order to address the low-acceptance problem, in this paper, by using biased matrix factorization, we proposed a novel worker recommendation mechanism which can evaluate mutual trust relationship between requesters and workers. And also, to accurately measure the matching degree between tasks and workers, a comprehensive and practical task matching mechanism has been presented by incorporating time matching, skill matching, payment matching, and location matching. Finally, extensive simulations and real data experiments highlight the performance of our proposed worker recommendation mechanism.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abhinav, K., Dubey, A., Jain, S., Virdi, G., Kass, A., Mehta, M.: CrowdAdvisor: a framework for freelancer assessment in online marketplace. In: ICSE, pp. 93–102. IEEE (2017) Abhinav, K., Dubey, A., Jain, S., Virdi, G., Kass, A., Mehta, M.: CrowdAdvisor: a framework for freelancer assessment in online marketplace. In: ICSE, pp. 93–102. IEEE (2017)
2.
Zurück zum Zitat Alsayasneh, M., et al.: Personalized and diverse task composition in crowdsourcing. TKDE 30(1), 128–141 (2018) Alsayasneh, M., et al.: Personalized and diverse task composition in crowdsourcing. TKDE 30(1), 128–141 (2018)
3.
Zurück zum Zitat Difallah, D.E., Demartini, G., Cudré-Mauroux, P.: Pick-a-crowd: tell me what you like, and I’ll tell you what to do. In: WWW, pp. 367–374. ACM (2013) Difallah, D.E., Demartini, G., Cudré-Mauroux, P.: Pick-a-crowd: tell me what you like, and I’ll tell you what to do. In: WWW, pp. 367–374. ACM (2013)
5.
Zurück zum Zitat Gaikwad, S.N.S., et al.: Boomerang: rebounding the consequences of reputation feedback on crowdsourcing platforms. In: UIST, pp. 625–637. ACM (2016) Gaikwad, S.N.S., et al.: Boomerang: rebounding the consequences of reputation feedback on crowdsourcing platforms. In: UIST, pp. 625–637. ACM (2016)
6.
Zurück zum Zitat Goel, G., Nikzad, A., Singla, A.: Matching workers expertise with tasks: incentives in heterogeneous crowdsourcing markets. In: NIPS (2013) Goel, G., Nikzad, A., Singla, A.: Matching workers expertise with tasks: incentives in heterogeneous crowdsourcing markets. In: NIPS (2013)
7.
Zurück zum Zitat ul Hassan, U., Curry, E.: Efficient task assignment for spatial crowdsourcing: a combinatorial fractional optimization approach with semi-bandit learning. Expert Syst. Appl. 58, 36–56 (2016)CrossRef ul Hassan, U., Curry, E.: Efficient task assignment for spatial crowdsourcing: a combinatorial fractional optimization approach with semi-bandit learning. Expert Syst. Appl. 58, 36–56 (2016)CrossRef
8.
Zurück zum Zitat He, X., Zhang, H., Kan, M.Y., Chua, T.S.: Fast matrix factorization for online recommendation with implicit feedback. In: SIGIR, pp. 549–558. ACM (2016) He, X., Zhang, H., Kan, M.Y., Chua, T.S.: Fast matrix factorization for online recommendation with implicit feedback. In: SIGIR, pp. 549–558. ACM (2016)
9.
Zurück zum Zitat Jabeur, N., Karam, R., Melchiori, M., Renso, C.: A comprehensive reputation assessment framework for volunteered geographic information in crowdsensing applications. Ubiquit. Comput. 1–17 (2018) Jabeur, N., Karam, R., Melchiori, M., Renso, C.: A comprehensive reputation assessment framework for volunteered geographic information in crowdsensing applications. Ubiquit. Comput. 1–17 (2018)
10.
Zurück zum Zitat Kamvar, S.D., Schlosser, M.T., Garcia-Molina, H.: The Eigentrust algorithm for reputation management in P2P networks. In: WWW, pp. 640–651. ACM (2003) Kamvar, S.D., Schlosser, M.T., Garcia-Molina, H.: The Eigentrust algorithm for reputation management in P2P networks. In: WWW, pp. 640–651. ACM (2003)
11.
Zurück zum Zitat Koren, Y.: Factor in the neighbors: scalable and accurate collaborative filtering. TKDD 4(1), 1–24 (2010)CrossRef Koren, Y.: Factor in the neighbors: scalable and accurate collaborative filtering. TKDD 4(1), 1–24 (2010)CrossRef
12.
Zurück zum Zitat Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)CrossRef Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)CrossRef
13.
Zurück zum Zitat Kurve, A., Miller, D.J., Kesidis, G.: Multicategory crowdsourcing accounting for variable task difficulty, worker skill, and worker intention. TKDE 27(3), 794–809 (2015) Kurve, A., Miller, D.J., Kesidis, G.: Multicategory crowdsourcing accounting for variable task difficulty, worker skill, and worker intention. TKDE 27(3), 794–809 (2015)
14.
Zurück zum Zitat Liu, H., Zhang, X., Zhang, X.: Possible world based consistency learning model for clustering and classifying uncertain data. Neural Netw. 102, 48–66 (2018)CrossRef Liu, H., Zhang, X., Zhang, X.: Possible world based consistency learning model for clustering and classifying uncertain data. Neural Netw. 102, 48–66 (2018)CrossRef
15.
Zurück zum Zitat Liu, H., Zhang, X., Zhang, X., Cui, Y.: Self-adapted mixture distance measure for clustering uncertain data. Knowl.-Based Syst. 126, 33–47 (2017)CrossRef Liu, H., Zhang, X., Zhang, X., Cui, Y.: Self-adapted mixture distance measure for clustering uncertain data. Knowl.-Based Syst. 126, 33–47 (2017)CrossRef
16.
Zurück zum Zitat Lu, K., Wang, J., Li, M.: An Eigentrust dynamic evolutionary model in P2P file-sharing systems. Peer Peer Netw. Appl. 9(3), 599–612 (2016)CrossRef Lu, K., Wang, J., Li, M.: An Eigentrust dynamic evolutionary model in P2P file-sharing systems. Peer Peer Netw. Appl. 9(3), 599–612 (2016)CrossRef
17.
Zurück zum Zitat Pu, L., Chen, X., Xu, J., Fu, X.: Crowdlet: optimal worker recruitment for self-organized mobile crowdsourcing. In: INFOCOM, pp. 1–9. IEEE (2016) Pu, L., Chen, X., Xu, J., Fu, X.: Crowdlet: optimal worker recruitment for self-organized mobile crowdsourcing. In: INFOCOM, pp. 1–9. IEEE (2016)
18.
Zurück zum Zitat Qiao, L., Tang, F., Liu, J.: Feedback based high-quality task assignment in collaborative crowdsourcing. In: AINA, pp. 1139–1146. IEEE (2018) Qiao, L., Tang, F., Liu, J.: Feedback based high-quality task assignment in collaborative crowdsourcing. In: AINA, pp. 1139–1146. IEEE (2018)
19.
Zurück zum Zitat Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, pp. 452–461. AUAI Press (2009) Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, pp. 452–461. AUAI Press (2009)
20.
Zurück zum Zitat Safran, M., Che, D.: Real-time recommendation algorithms for crowdsourcing systems. Appl. Comput. Inform. 13(1), 47–56 (2017)CrossRef Safran, M., Che, D.: Real-time recommendation algorithms for crowdsourcing systems. Appl. Comput. Inform. 13(1), 47–56 (2017)CrossRef
21.
Zurück zum Zitat Schall, D., Satzger, B., Psaier, H.: Crowdsourcing tasks to social networks in BPEL4People. World Wide Web 17(1), 1–32 (2014)CrossRef Schall, D., Satzger, B., Psaier, H.: Crowdsourcing tasks to social networks in BPEL4People. World Wide Web 17(1), 1–32 (2014)CrossRef
22.
Zurück zum Zitat Schnitzer, S., Neitzel, S., Schmidt, S., Rensing, C.: Perceived task similarities for task recommendation in crowdsourcing systems. In: WWW, pp. 585–590 (2016) Schnitzer, S., Neitzel, S., Schmidt, S., Rensing, C.: Perceived task similarities for task recommendation in crowdsourcing systems. In: WWW, pp. 585–590 (2016)
23.
Zurück zum Zitat Song, T., et al.: Trichromatic online matching in real-time spatial crowdsourcing. In: ICDE, pp. 1009–1020. IEEE (2017) Song, T., et al.: Trichromatic online matching in real-time spatial crowdsourcing. In: ICDE, pp. 1009–1020. IEEE (2017)
24.
Zurück zum Zitat Tong, Y., She, J., Ding, B., Wang, L., Chen, L.: Online mobile micro-task allocation in spatial crowdsourcing. In: ICDE, pp. 49–60. IEEE (2016) Tong, Y., She, J., Ding, B., Wang, L., Chen, L.: Online mobile micro-task allocation in spatial crowdsourcing. In: ICDE, pp. 49–60. IEEE (2016)
25.
Zurück zum Zitat Wang, J., Wang, F., Wang, Y., Zhang, D., Lim, B.Y., Wang, L.: Allocating heterogeneous tasks in participatory sensing with diverse participant-side factors Wang, J., Wang, F., Wang, Y., Zhang, D., Lim, B.Y., Wang, L.: Allocating heterogeneous tasks in participatory sensing with diverse participant-side factors
26.
Zurück zum Zitat Wang, L., Yu, Z., Han, Q., Guo, B., Xiong, H.: Multi-objective optimization based allocation of heterogeneous spatial crowdsourcing tasks. TMC 17(17), 1637–1650 (2018) Wang, L., Yu, Z., Han, Q., Guo, B., Xiong, H.: Multi-objective optimization based allocation of heterogeneous spatial crowdsourcing tasks. TMC 17(17), 1637–1650 (2018)
27.
Zurück zum Zitat Wang, Y., Tong, X., He, Z., Gao, Y., Wang, K.: A task recommendation model for mobile crowdsourcing systems based on dwell-time. In: BDCloud-SocialCom-SustainCom, pp. 170–177. IEEE (2016) Wang, Y., Tong, X., He, Z., Gao, Y., Wang, K.: A task recommendation model for mobile crowdsourcing systems based on dwell-time. In: BDCloud-SocialCom-SustainCom, pp. 170–177. IEEE (2016)
28.
Zurück zum Zitat Wu, C., Luo, T., Wu, F., Chen, G.: EndorTrust: an endorsement-based reputation system for trustworthy and heterogeneous crowdsourcing. In: GLOBECOM, pp. 1–6. IEEE (2015) Wu, C., Luo, T., Wu, F., Chen, G.: EndorTrust: an endorsement-based reputation system for trustworthy and heterogeneous crowdsourcing. In: GLOBECOM, pp. 1–6. IEEE (2015)
29.
Zurück zum Zitat Xiang, Q., Zhang, J., Nevat, I., Zhang, P.: A trust-based mixture of Gaussian processes model for reliable regression in participatory sensing. In: IJCAI, pp. 3866–3872 (2017) Xiang, Q., Zhang, J., Nevat, I., Zhang, P.: A trust-based mixture of Gaussian processes model for reliable regression in participatory sensing. In: IJCAI, pp. 3866–3872 (2017)
30.
Zurück zum Zitat Ye, B., Wang, Y.: CrowdRec: trust-aware worker recommendation in crowdsourcing environments. In: ICWS, pp. 1–8. IEEE (2016) Ye, B., Wang, Y.: CrowdRec: trust-aware worker recommendation in crowdsourcing environments. In: ICWS, pp. 1–8. IEEE (2016)
31.
Zurück zum Zitat Ye, B., Wang, Y., Liu, L.: Crowd trust: a context-aware trust model for worker selection in crowdsourcing environments. In: ICWS, pp. 121–128. IEEE (2015) Ye, B., Wang, Y., Liu, L.: Crowd trust: a context-aware trust model for worker selection in crowdsourcing environments. In: ICWS, pp. 121–128. IEEE (2015)
32.
Zurück zum Zitat Yu, H., Shen, Z., Miao, C., An, B.: A reputation-aware decision-making approach for improving the efficiency of crowdsourcing systems. In: AAMAS, pp. 1315–1316 (2013) Yu, H., Shen, Z., Miao, C., An, B.: A reputation-aware decision-making approach for improving the efficiency of crowdsourcing systems. In: AAMAS, pp. 1315–1316 (2013)
33.
Zurück zum Zitat Yuan, F., Gao, X., Lindqvist, J.: How busy are you?: Predicting the interruptibility intensity of mobile users. In: CHI, pp. 5346–5360. ACM (2017) Yuan, F., Gao, X., Lindqvist, J.: How busy are you?: Predicting the interruptibility intensity of mobile users. In: CHI, pp. 5346–5360. ACM (2017)
34.
Zurück zum Zitat Yuen, M.C., King, I., Leung, K.S.: TaskRec: a task recommendation framework in crowdsourcing systems. NPL 41(2), 223–238 (2015) Yuen, M.C., King, I., Leung, K.S.: TaskRec: a task recommendation framework in crowdsourcing systems. NPL 41(2), 223–238 (2015)
35.
Zurück zum Zitat Zhang, X., Liu, H., Zhang, X.: Novel density-based and hierarchical density-based clustering algorithms for uncertain data. Neural Netw. 93, 240–255 (2017)CrossRef Zhang, X., Liu, H., Zhang, X.: Novel density-based and hierarchical density-based clustering algorithms for uncertain data. Neural Netw. 93, 240–255 (2017)CrossRef
36.
Zurück zum Zitat Zhang, X., Liu, H., Zhang, X., Liu, X.: Novel density-based clustering algorithms for uncertain data. In: AAAI, pp. 2191–2197 (2014) Zhang, X., Liu, H., Zhang, X., Liu, X.: Novel density-based clustering algorithms for uncertain data. In: AAAI, pp. 2191–2197 (2014)
37.
Zurück zum Zitat Zhang, X., Xue, G., Yu, R., Yang, D., Tang, J.: Truthful incentive mechanisms for crowdsourcing. In: INFOCOM, pp. 2830–2838. IEEE (2015) Zhang, X., Xue, G., Yu, R., Yang, D., Tang, J.: Truthful incentive mechanisms for crowdsourcing. In: INFOCOM, pp. 2830–2838. IEEE (2015)
Metadaten
Titel
Worker Recommendation with High Acceptance Rates in Collaborative Crowdsourcing Systems
verfasst von
Mingchu Li
Xiaomei Sun
Xing Jin
Linlin Tian
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-12981-1_4

Neuer Inhalt