Advertisement
Published in:
2011 | OriginalPaper | Chapter
Guess What? A Game for Affective Annotation of Video Using Crowd Sourcing
Authors : Laurel D. Riek, Maria F. O’Connor, Peter Robinson
Published in: Affective Computing and Intelligent Interaction
Publisher: Springer Berlin Heidelberg
Activate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by
One of the most time consuming and laborious problems facing researchers in Affective Computing is annotation of data, particularly with the recent adoption of multimodal data. Other fields, such as Computer Vision, Language Processing and Information Retrieval have successfully used crowd sourcing (or human computation) games to label their data sets. Inspired by their work, we have developed a Facebook game called
Guess What?
for labeling multimodal, affective video data. This paper describes the game and an initial evaluation of it for social context labeling. In our experiment, 33 participants used the game to label 154 video/question pairs over the course of a few days, and their overall inter-rater reliability was good (Krippendorff’s
α
= .70). We believe this game will be a useful resource for other researchers and ultimately plan to make
Guess What?
open source and available to anyone who is interested.