skip to main content
10.1145/3167132.3167347acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

Does gamification matter?: a systematic mapping about the evaluation of gamification in educational environments

Published:09 April 2018Publication History

ABSTRACT

Gamification is a technique that reuses game design and elements in others contexts, such as in e-commerces systems and virtual learning environments. When applied in the educational area, the gamification purpose is to promote a better user experience by improving students' motivation and engagement. There are already several studies applying gamification in the educational systems, and many ways to evaluate its effects on students. Thus, the aim of this work is to investigate how these studies evaluate gamification and compare its usage in educational environments through a systematic mapping. From the 832 studies returned by the search engines, only 20 of them met the defined selection criteria. As a result, these studies compared and evaluated gamification through students' interaction, performance, and user experience, based on their activities and answers in satisfaction surveys and tests.

References

  1. A. Amriani, A. F. Aji, A. Y. Utomo, and K. M. Junus. 2013. An empirical study of gamification impact on e-Learning environment. In Proceedings of 2013 3rd International Conference on Computer Science and Network Technology. 265--269.Google ScholarGoogle Scholar
  2. Paul E. Anderson, Thomas Nash, and Renée McCauley. 2015. Facilitating Programming Success in Data Science Courses Through Gamified Scaffolding and Learn2Mine. In Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE '15). ACM Press, New York, 99--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Yigal Attali and Meirav Arieli-Attali. 2015. Gamification in assessment: Do points affect test performance? Computers & Education 83 (2015), 57--63.Google ScholarGoogle ScholarCross RefCross Ref
  4. T. Auvinen, L. Hakulinen, and L. Malmi. 2015. Increasing Students' Awareness of Their Behavior in Online Learning Environments with Visualizations and Achievement Badges. IEEE Transactions on Learning Technologies 8, 3 (July 2015), 261--273.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Gabriel Barata, Sandra Gama, Joaquim Jorge, and Daniel Gonçalves. 2013. Improving Participation and Learning with Gamification. In Proceedings of the First International Conference on Gameful Design, Research, and Applications (Gamification '13). ACM Press, New York, 10--17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Kevin Browne and Christopher Anand. 2013. Gamification and Serious Game Approaches for Introductory Computer Science Tablet Software. In Proceedings of the First International Conference on Gameful Design, Research, and Applications (Gamification '13). ACM Press, New York, 50--57. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Achilleas L. D. Buisman and Marko C. J. D. van Eekelen. 2014. Gamification in Educational Software Development. In Proceedings of the Computer Science Education Research Conference (CSERC '14). ACM Press, New York, 9--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Luis de Marcos, AdriÃąn Domínguez, Joseba Saenz de Navarrete, and Carmen Pagés. 2014. An empirical study comparing gamification and social networking on e-learning. Computers & Education 75 (2014), 82--91.Google ScholarGoogle ScholarCross RefCross Ref
  9. Simone de Sousa Borges, Vinicius H. S. Durelli, Helena Macedo Reis, and Seiji Isotani. 2014. A Systematic Mapping on Gamification Applied to Education. In Proceedings of the 29th Annual ACM Symposium on Applied Computing (SAC '14). ACM Press, New York, 216--222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Paul Denny. 2013. The Effect of Virtual Achievements on Student Engagement. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM Press, New York, 763--772. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. S. Deterding, M. Sicart, L. Nacke, K. O'Hara, and D. Dixon. 2011. Gamification. Using Game-design Elements in Non-gaming Contexts. In CHI '11 Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York, 2425--2428. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Darina Dicheva, Christo Dichev, Gennady Agre, and Galia Angelova. 2015. Gamification in Education: A Systematic Mapping Study. Journal of Educational Technology & Society 18, 3 (2015), 75--88.Google ScholarGoogle Scholar
  13. Usef Faghihi, Albert Brautigam, Kris Jorgenson, David Martin, Angela Brown, Elizabeth Measures, and Sioui Maldonado-Bouchard. 2014. How Gamification Applies for Educational Purpose Specially with College Algebra. Procedia Computer Science 41 (2014), 182 -- 187.Google ScholarGoogle ScholarCross RefCross Ref
  14. Michael Filsecker and Daniel Thomas Hickey. 2014. A multilevel analysis of the effects of external rewards on elementary students' motivation, engagement and learning in an educational game. Computers & Education 75 (2014), 136--148.Google ScholarGoogle ScholarCross RefCross Ref
  15. L. Hakulinen, T. Auvinen, and A. Korhonen. 2013. Empirical Study on the Effect of Achievement Badges in TRAKLA2 Online Learning Environment. In 2013 Learning and Teaching in Computing and Engineering. 47--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Michael D. Hanus and Jesse Fox. 2015. Assessing the Effects of Gamification in the Classroom. Computers & Education 80 (Jan. 2015), 152--161. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Marc Hassenzahl. 2008. User Experience (UX): Towards an Experiential Perspective on Product Quality. In Proceedings of the 20th Conference on L'Interaction Homme-Machine (IHM '08). ACM Press, New York, 11--15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Paul Hekkert. 2006. Design aesthetics: principles of pleasure in design. Psychology science 48, 2 (2006), 157.Google ScholarGoogle Scholar
  19. Khe Foon Hew, Biyun Huang, Kai Wah Samuel Chu, and Dickson K.W. Chiu. 2016. Engaging Asian students through game mechanics: Findings from two experiment studies. Computers & Education 92 (2016), 221 -- 236. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. K. M. Kapp. 2012. The Gamification of Learning and Instruction. John Wiley & Sons, San Francisco. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Markus Krause, Marc Mogalle, Henning Pohl, and Joseph Jay Williams. 2015. A Playful Game Changer: Fostering Student Retention in Online Education with Social Gamification. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale (L@S '15). ACM Press, New York, 95--102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. M. Laskowski. 2015. Implementing gamification techniques into university study path - A case study. In 2015 IEEE Global Engineering Education Conference (EDUCON). 582--586.Google ScholarGoogle ScholarCross RefCross Ref
  23. Alberto Mora, Daniel Riera, Carina Gonzalez, and Joan Arnedo-Moreno. 2015. A literature review of gamification design frameworks. In Games and virtual worlds for serious applications (VS-Games), 2015 7th international conference on. IEEE, 1--8.Google ScholarGoogle Scholar
  24. Siobhan O'Donovan, James Gain, and Patrick Marais. 2013. A Case Study in the Gamification of a University-level Games Development Course. In Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference (SAICSIT '13). ACM Press, New York, 242--251. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Oscar Pedreira, FÃl'lix García, Nieves Brisaboa, and Mario Piattini. 2015. Gamification in software engineering âĂŞ A systematic mapping. Information and Software Technology 57 (2015), 157--168.Google ScholarGoogle ScholarCross RefCross Ref
  26. Lais Z. Pedro, Aparecida M. Z. Lopes, Bruno G. Prates, Julita Vassileva, and Seiji Isotani. 2015. Does Gamification Work for Boys and Girls?: An Exploratory Study with a Virtual Learning Environment. In Proceedings of the 30th Annual ACM Symposium on Applied Computing (SAC '15). ACM Press, New York, 214--219. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Mariana Peixoto and Carla Silva. 2017. A Gamification Requirements Catalog for Educational Software: Results from a Systematic Literature Review and a Survey with Experts. In Proceedings of the Symposium on Applied Computing (SAC '17). ACM Press, New York, 1108--1113. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic Mapping Studies in Software Engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering (EASE'08). BCS Learning & Development Ltd., Swindon, UK, 68--77. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kai Petersen, Sairam Vakkalanka, and Ludwik Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology 64 (2015), 1--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Yvonne Rogers, Helen Sharp, and Jenny Preece. 2011. Interaction Design: Beyond Human - Computer Interaction (3rd ed.). Wiley Publishing. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Jorge Simões, Rebeca Diaz Redondo, and Ana FernÃąndez Vilas. 2013. A social gamification framework for a K-6 learning platform. Computers in Human Behavior 29, 2 (2013), 345--353. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. C-H. Su and C-H. Cheng. 2015. A mobile gamification learning system for improving the learning motivation and achievements. Journal of Computer Assisted Learning 31, 3 (2015), 268--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. A. Vaibhav and P. Gupta. 2014. Gamification of MOOCs for increasing user engagement. In 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE). 290--295.Google ScholarGoogle Scholar

Index Terms

  1. Does gamification matter?: a systematic mapping about the evaluation of gamification in educational environments

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing
        April 2018
        2327 pages
        ISBN:9781450351911
        DOI:10.1145/3167132

        Copyright © 2018 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 9 April 2018

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate1,650of6,669submissions,25%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader