Edith Law
Luis von Ahn
ABSTRACT
Since its introduction at CHI 2004, the ESP Game has inspired many similar games that share the goal of gathering data from players. This paper introduces a new mechanism for collecting labeled data using "games with a purpose." In this mechanism, players are provided with either the same or a different object, and asked to describe that object to each other. Based on each other's descriptions, players must decide whether they have the same object or not. We explain why this new mechanism is superior for input data with certain characteristics, introduce an enjoyable new game called "TagATune" that collects tags for music clips via this mechanism, and present findings on the data that is collected by this game.
- Hacker, S. and von Ahn, L. Matchin: Eliciting User Preferences with an Online Game. To appear in Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (Boston, April 4-9). ACM, New York, 2009. Google Scholar
Digital Library
- Healey, P., Swoboda, N., Umata, I., and King, J. Graphical language games: interactional constraints on representational form. Cognitive Science, 31:285--309, 2007.Google Scholar
- Kim, Y.E., Schmidt, E., and Emelle, L. MoodSwings: A collaborative game for music mood label collection. In Proc. 9th Intl. Conf. on Music Information Retrieval (Philadelphia, September 14-18). 231--236, 2008.Google Scholar
- Lamere, P. Social tagging and music information retrieval. Journal of New Music Research. 37(2):101--104, 2008.Google ScholarCross Ref
- Law, E., von Ahn L., Dannenberg, R., and Crawford M. TagATune: a game for music and sound annotation. In Proc. 8th Intl. Conf. on Music Information Retrieval (Vienna, September 23-27). 361--364, 2007.Google Scholar
- Law, E., Mityagin, A., and Chickering, M. Intentions: A game for classifying search query intent. In submission.Google Scholar
- Lee, B. and von Ahn, L. Squigl: A Web game to generate datasets for object detection algorithms. In submission.Google Scholar
- Ma, H., Gupta, A., and Chandrasekar, R. Page hunt, page race and page match: using competitive and collaborative games to improve Web search and understand user behavior. In submission.Google Scholar
- Mandel, M. and Ellis, D. A Web-based game for collecting music metadata. Journal of New Music Research. 37(2):151--165, 2009.Google ScholarCross Ref
- Mityagin, A. and Chickering, M. PictureThis. http://club.live.com/Pages/Games/GameList.aspx?game=Picture_ThisGoogle Scholar
- Siorpaes, K. and Hepp, M. Games with a purpose for the semantic Web. IEEE Intelligent Systems, 23(3):50--60, 2008. Google ScholarDigital Library
- Turnbull, D., Liu, R., Barrington, L., and Lanckriet, G. A game-based approach for collecting semantic annotations of music. In Proc. 8th Intl. Conf. on Music Information Retrieval (Vienna, September 23-27). 535--538, 2007.Google Scholar
- von Ahn, L. Games with a purpose. IEEE Computer Magazine, 39(6):96--98, 2006. Google ScholarDigital Library
- von Ahn, L. and Dabbish, L. Labeling images with a computer game. In Proc. SIGCHI Conf. on Human Factors in Computing Systems (Vienna, April 24-29). ACM, New York, 319--326, 2004. Google ScholarDigital Library
- von Ahn, L. and Dabbish, L. Designing games with a purpose. Communications of the ACM, 51(8):58--67, 2008. Google ScholarDigital Library
- Weinberger, D. How tagging changes peoples relationship to information and each other. Pew Internet&American Life Project. http://www.pewinternet.org/ pdfs/PIP_Tagging.pdfGoogle Scholar
Index Terms
- Input-agreement: a new mechanism for collecting data using human computation games
Recommendations
Input-evaluation: A new mechanism for collecting data using games with a purpose
ISCC '12: Proceedings of the 2012 IEEE Symposium on Computers and Communications (ISCC)Collecting data through a game with a purpose (GWAP) has become a popular approach due to its numerous benefits. However, lack of diversity in game mechanisms puts some limitations on the areas of application of GWAPs. In this paper, we introduce a new ...
An analytical model for generalized ESP games
The ESP game belongs to the genre called Games With A Purpose (GWAP), which leverage people's desire to be entertained and also outsource certain steps of the computational process to humans. The games have shown promise in solving a variety of problems,...
Exploiting Puzzle Diversity in Puzzle Selection for ESP-Like GWAP Systems
WI-IAT '10: Proceedings of the 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01The ESP game belongs to the genre called Games with a Purpose (GWAP), which leverage people's desire to be entertained and also outsource certain steps of the computational process to humans. The productivity of ESP-like GWAP systems depends to a great ...
Comments