Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
An Empirical Evaluation of RDF Graph Partitioning Techniques Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Interplay of Game Incentives, Player Profiles and Task Difficulty in Games with a Purpose

Authors : Gloria Re Calegari, Irene Celino

Published in: Knowledge Engineering and Knowledge Management

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

How to take multiple factors into account when evaluating a Game with a Purpose? How is player behaviour or participation influenced by different incentives? How does player engagement impact their accuracy in solving tasks? In this paper, we present a detailed investigation of multiple factors affecting the evaluation of a GWAP and we show how they impact on the achieved results. We inform our study with the experimental assessment of a GWAP designed to solve a multinomial classification task.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Comparative Preferences in SPARQL
next chapter Inferring Types on Large Datasets Applying Ontology Class Hierarchy Classifiers: The DBpedia Case
Footnotes
2
Data is available with a CC-BY license at http://​ckan.​stars4all.​eu/​.
 
Literature
1.
Von Ahn, L., Dabbish, L.: Designing games with a purpose. Commun. ACM 51(8), 58–67 (2008)
2.
Law, E., Ahn, L.v.: Human Computation. Synthesis Lectures on Artificial Intelligence and Machine Learning, vol. 5, no. 3, pp. 1–121 (2011)CrossRef
3.
Von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 319–326. ACM (2004)
4.
Singh, A., Ahsan, F., Blanchette, M., Waldispuhl, J.: Lessons from an online massive genomics computer game. In: Proceedings of the Fifth Conference on Human Computation and Crowdsourcing (HCOMP 2017) (2017)
5.
Sauermann, H., Franzoni, C.: Crowd science user contribution patterns and their implications. Proc. Natl. Acad. Sci. 112(3), 679–684 (2015)CrossRef
6.
Yang, J., Redi, J., Demartini, G., Bozzon, A.: Modeling task complexity in crowdsourcing. In: Fourth AAAI Conference on Human Computation and Crowdsourcing (2016)
7.
Ryan, R.M., Deci, E.L.: Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp. Educ. Psychol. 25(1), 54–67 (2000)CrossRef
8.
Prestopnik, N., Crowston, K., Wang, J.: Gamers, citizen scientists, and data: exploring participant contributions in two games with a purpose. Comput. Hum. Behav. 68, 254–268 (2017)CrossRef
9.
Thaler, S., Simperl, E., Wolger, S.: An experiment in comparing human-computation techniques. IEEE Internet Comput. 16, 52–58 (2012)CrossRef
10.
Feyisetan, O., Simperl, E., Van Kleek, M., Shadbolt, N.: Improving paid microtasks through gamification and adaptive furtherance incentives. In: Proceedings of the 24th International Conference on World Wide Web, WWW 2015, pp. 333–343, Republic and Canton of Geneva, Switzerland, International World Wide Web Conferences Steering Committee (2015)
11.
Feyisetan, O., Simperl, E.: Social incentives in paid collaborative crowdsourcing. ACM Trans. Intell. Syst. Technol. 8(6), 73:1–73:31 (2017)CrossRef
12.
Re Calegari, G., Nasi, G., Celino, I.: Human computation vs. machine learning: an experimental comparison for image classification. Hum. Comput. J. 5(1), 13–30 (2018)
13.
Siu, K., Zook, A., Riedl, M.O.: Collaboration versus competition: design and evaluation of mechanics for games with a purpose. In: Proceedings of Foundations of Digital Games Conference (2014)
14.
Reeves, N., West, P., Simperl, E.: “A game without competition is hardly a game”: the impact of competitions on player activity in a human computation game. In: Proceedings of Human Computation Conference (2018)
15.
Reeves, N., Tinati, R., Zerr, S., Van Kleek, M., Simperl, E.: From crowd to community: a survey of online community features in citizen science projects. In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, CSCW 2017, pp. 2137–2152 (2017)
16.
Celino, I., Corcho, Ó., Hölker, F., Simperl, E.: Citizen science: design and engagement (dagstuhl seminar 17272). Dagstuhl Reports 7(7), 22–43 (2017)
17.
Ponciano, L., Brasileiro, F.: Finding volunteers’ engagement profiles in human computation for citizen science projects. Hum. Comput. J. 1(2), 247–266 (2015)
18.
Aristeidou, M., Scanlon, E., Sharples, M.: Profiles of engagement in online communities of citizen science participation. Comput. Hum. Behav. 74, 246–256 (2017)CrossRef
19.
Allahbakhsh, M., Benatallah, B., Ignjatovic, A., Motahari-Nezhad, H.R., Bertino, E., Dustdar, S.: Quality control in crowdsourcing systems: issues and directions. IEEE Internet Comput. 17(2), 76–81 (2013)CrossRef
20.
Karger, D.R., Oh, S., Shah, D.: Budget-optimal task allocation for reliable crowdsourcing systems. Oper. Res. 62(1), 1–24 (2014)CrossRef
21.
Han, T., Sun, H., Song, Y., Wang, Z., Liu, X.: Budgeted task scheduling for crowdsourced knowledge acquisition. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 1059–1068. ACM (2017)
22.
Sheng, V.S., Provost, F., Ipeirotis, P.G.: Get another label? Improving data quality and data mining using multiple, noisy labelers. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 614–622. ACM (2008)
23.
24.
Celino, I., Re Calegari, G.: An Incremental Truth Inference Approach to Aggregate Crowdsourcing Contributions in GWAPs. In: currently under revision (2018)
25.
26.
Zheng, Y., Li, G., Li, Y., Shan, C., Cheng, R.: Truth inference in crowdsourcing: is the problem solved? Proc. VLDB Endow. 10(5), 541–552 (2017)CrossRef
27.
Anable, A.: Casual games, time management, and the work of affect (2013)
28.
Hwong, C.: Leveling up your mobile game: using audience measurement data to boost user acquisition and engagement (2016)
Metadata
Title
Interplay of Game Incentives, Player Profiles and Task Difficulty in Games with a Purpose
Authors
Gloria Re Calegari
Irene Celino
Copyright Year
2018
Book
Knowledge Engineering and Knowledge Management

Print ISBN: 978-3-030-03666-9

Electronic ISBN: 978-3-030-03667-6

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-030-03667-6_20

Premium Partner

    Image Credits