Skip to main content
Top
Published in: Education and Information Technologies 6/2020

22-05-2020

Gamification of student peer review in education: A systematic literature review

Authors: Theresia Devi Indriasari, Andrew Luxton-Reilly, Paul Denny

Published in: Education and Information Technologies | Issue 6/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present the first systematic review of the use of gamification in educational peer review activities. The goal of this work is to understand how gamification has been used to engage students in peer review activities and to summarize the empirical evidence for its effectiveness. Our main contribution is the presentation of a general model of the peer review process that captures the students’ activities and an examination of the specific actions within this model that have been gamified in the current literature. We also summarize the commonly used game mechanics and the context and year level of courses in which prior research has been conducted, along with the reported effects on student behavior. We find that artifact assessment and artifact creation are the two most commonly gamified actions with respect to our peer review model and that the quantity and quality of both the artifacts and the generated feedback are the most popular reward criteria. In addition, Science, Technology, Engineering and Mathematics (STEM) are the discipline areas in which gamified peer review activities are most often reported. In general, while the existing peer review literature reports mostly positive effects of gamification on student engagement, the range of student actions which have been incentivized remains narrow. Key activities, such as student reflection on the feedback received, have been largely unexplored with respect to gamification and thus present useful avenues for future work.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Adaji, I., & Vassileva, J. (2017). A gamified system for influencing healthy E-commerce shopping habits. WPPG: Fifty Shades of Personalization - Workshop on Personalization in Serious and Persuasive Games and Gameful Interaction, 398–401. https://doi.org/10.1145/3099023.3099110. Adaji, I., & Vassileva, J. (2017). A gamified system for influencing healthy E-commerce shopping habits. WPPG: Fifty Shades of Personalization - Workshop on Personalization in Serious and Persuasive Games and Gameful Interaction, 398–401. https://​doi.​org/​10.​1145/​3099023.​3099110.
go back to reference Antin, J., & Churchill, E. F. (2011). Badges in social media: A social psychological perspective. CHI 2011 Gamification Workshop Proceedings, 1–4. Antin, J., & Churchill, E. F. (2011). Badges in social media: A social psychological perspective. CHI 2011 Gamification Workshop Proceedings, 1–4.
go back to reference Anvari, F., Richards, D., Hitchens, M., & Tran, H. M. T. (2019). Teaching user centered conceptual design using cross-cultural personas and peer reviews for a large cohort of students. Proceedings of the 41st international conference on software engineering: Software engineering education and training, 62–73. https://doi.org/10.1109/ICSE-SEET.2019.00015. Anvari, F., Richards, D., Hitchens, M., & Tran, H. M. T. (2019). Teaching user centered conceptual design using cross-cultural personas and peer reviews for a large cohort of students. Proceedings of the 41st international conference on software engineering: Software engineering education and training, 62–73. https://​doi.​org/​10.​1109/​ICSE-SEET.​2019.​00015.
go back to reference Britton, B. K., & Tesser, A. (1991). Effects of time-management practices on college grades. Journal of Educational Psychology, 83(3), 405–410.CrossRef Britton, B. K., & Tesser, A. (1991). Effects of time-management practices on college grades. Journal of Educational Psychology, 83(3), 405–410.CrossRef
go back to reference Bunchball, I. (2010). Gamification 101: An introduction to the use of game dynamics to influence behavior. White Paper, 9. Bunchball, I. (2010). Gamification 101: An introduction to the use of game dynamics to influence behavior. White Paper, 9.
go back to reference Conaway, R., & Garay, M. C. (2014). Gamification and service marketing. SpringerPlus, 3(1), 653.CrossRef Conaway, R., & Garay, M. C. (2014). Gamification and service marketing. SpringerPlus, 3(1), 653.CrossRef
go back to reference De-Marcos, L., García-López, E., García-Cabot, A., Medina-Merodio, J.-A., Domínguez, A., Martínez-Herráiz, J.-J., & Diez-Folledo, T. (2016b). Social network analysis of a gamified e-learning course: Small-world phenomenon and network metrics as predictors of academic performance. Computers in Human Behavior, 60, 312–321. https://doi.org/10.1016/j.chb.2016.02.052.CrossRef De-Marcos, L., García-López, E., García-Cabot, A., Medina-Merodio, J.-A., Domínguez, A., Martínez-Herráiz, J.-J., & Diez-Folledo, T. (2016b). Social network analysis of a gamified e-learning course: Small-world phenomenon and network metrics as predictors of academic performance. Computers in Human Behavior, 60, 312–321. https://​doi.​org/​10.​1016/​j.​chb.​2016.​02.​052.CrossRef
go back to reference De-Marcos, L., García-Cabot, A., & García-López, E. (2017). Towards the social gamification of e-learning: A practical experiment. International Journal of Engineering Education, 33(1), 66–73. De-Marcos, L., García-Cabot, A., & García-López, E. (2017). Towards the social gamification of e-learning: A practical experiment. International Journal of Engineering Education, 33(1), 66–73.
go back to reference Denny, P., McDonald, F., Empson, R., Kelly, P., & Petersen, A. (2018). Empirical support for a causal relationship between gamification and learning outcomes. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 311:1--311:13. https://doi.org/10.1145/3173574.3173885. Denny, P., McDonald, F., Empson, R., Kelly, P., & Petersen, A. (2018). Empirical support for a causal relationship between gamification and learning outcomes. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 311:1--311:13. https://​doi.​org/​10.​1145/​3173574.​3173885.
go back to reference Handelsman, M. M., Briggs, W. L., Sullivan, N., & Towler, A. (2005). A measure of college student course engagement. The Journal of Educational Research, 98(3), 184–192.CrossRef Handelsman, M. M., Briggs, W. L., Sullivan, N., & Towler, A. (2005). A measure of college student course engagement. The Journal of Educational Research, 98(3), 184–192.CrossRef
go back to reference Kumar, J. (2013). Gamification at work: Designing engaging business software. International conference of design, user experience, and usability, 528–537. Kumar, J. (2013). Gamification at work: Designing engaging business software. International conference of design, user experience, and usability, 528–537.
go back to reference Macan, T. H., Shahani, C., Dipboye, R. L., & Phillips, A. P. (1990). College students’ time management: Correlations with academic performance and stress. Journal of Educational Psychology, 82(4), 760–768.CrossRef Macan, T. H., Shahani, C., Dipboye, R. L., & Phillips, A. P. (1990). College students’ time management: Correlations with academic performance and stress. Journal of Educational Psychology, 82(4), 760–768.CrossRef
go back to reference MacCann, C., Fogarty, G. J., & Roberts, R. D. (2012). Strategies for success in education: Time management is more important for part-time than full-time community college students. Learning and Individual Differences, 22(5), 618–623.CrossRef MacCann, C., Fogarty, G. J., & Roberts, R. D. (2012). Strategies for success in education: Time management is more important for part-time than full-time community college students. Learning and Individual Differences, 22(5), 618–623.CrossRef
go back to reference Marks, H. M. (2000). Student engagement in instructional activity: Patterns in the elementary, middle, and high school years. American Educational Research Journal, 37(1), 153–184.CrossRef Marks, H. M. (2000). Student engagement in instructional activity: Patterns in the elementary, middle, and high school years. American Educational Research Journal, 37(1), 153–184.CrossRef
go back to reference Morales, M., & Amado-salvatierra, H. R. (2016). A practical experience on the use of gamification in MOOC courses as a strategy to increase motivation. International Workshop on Learning Technology for Education in Cloud, LTEC 2016 Springer, Cham., CCIS 620, 139–149. https://doi.org/10.1007/978-3-319-42147-6_12. Morales, M., & Amado-salvatierra, H. R. (2016). A practical experience on the use of gamification in MOOC courses as a strategy to increase motivation. International Workshop on Learning Technology for Education in Cloud, LTEC 2016 Springer, Cham., CCIS 620, 139–149. https://​doi.​org/​10.​1007/​978-3-319-42147-6_​12.
go back to reference Morschheuser, B., Hamari, J., & Koivisto, J. (2016). Gamification in crowdsourcing: A review. 2016 49th Hawaii international conference on system sciences (HICSS), 4375–4384. Morschheuser, B., Hamari, J., & Koivisto, J. (2016). Gamification in crowdsourcing: A review. 2016 49th Hawaii international conference on system sciences (HICSS), 4375–4384.
go back to reference Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education : A peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102–122.CrossRef Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education : A peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102–122.CrossRef
go back to reference Papadopoulos, P. M., Lagkas, T., & Demetriadis, S. N. (2016). How revealing rankings affects student attitude and performance in a peer review learning environment. International conference on computer supported education (CSEDU 2015), CCIS 583, 225–240. https://doi.org/10.1007/978-3-319-29585-5_13. Papadopoulos, P. M., Lagkas, T., & Demetriadis, S. N. (2016). How revealing rankings affects student attitude and performance in a peer review learning environment. International conference on computer supported education (CSEDU 2015), CCIS 583, 225–240. https://​doi.​org/​10.​1007/​978-3-319-29585-5_​13.
go back to reference Rizzardini, R. H., Gütl, C., Chang, V., & Morales, M. (2014). MOOC in Latin America: Implementation and lessons learned. In L. Uden, Y.-H. Tao, H.-C. Yang, & I.-H. Ting (Eds.), The 2nd International Workshop on Learning Technology for Education in Cloud (pp. 147–158). Springer Netherlands. https://doi.org/10.1007/978-94-007-7308-0_16. Rizzardini, R. H., Gütl, C., Chang, V., & Morales, M. (2014). MOOC in Latin America: Implementation and lessons learned. In L. Uden, Y.-H. Tao, H.-C. Yang, & I.-H. Ting (Eds.), The 2nd International Workshop on Learning Technology for Education in Cloud (pp. 147–158). Springer Netherlands. https://​doi.​org/​10.​1007/​978-94-007-7308-0_​16.
go back to reference Rojas, J. M., White, T. D., Clegg, B. S., & Fraser, G. (2017). Code defenders: Crowdsourcing effective tests and subtle mutants with a mutation testing game. Proceedings - 2017 IEEE/ACM 39th international conference on software engineering, ICSE 2017, 677–688. https://doi.org/10.1109/ICSE.2017.68. Rojas, J. M., White, T. D., Clegg, B. S., & Fraser, G. (2017). Code defenders: Crowdsourcing effective tests and subtle mutants with a mutation testing game. Proceedings - 2017 IEEE/ACM 39th international conference on software engineering, ICSE 2017, 677–688. https://​doi.​org/​10.​1109/​ICSE.​2017.​68.
go back to reference Shernoff, D. J., Csikszentmihalyi, M., Schneider, B., & Shernoff, E. S. (2014). Student engagement in high school classrooms from the perspective of flow theory. In Applications of flow in human development and education (pp. 475–494). Springer. Shernoff, D. J., Csikszentmihalyi, M., Schneider, B., & Shernoff, E. S. (2014). Student engagement in high school classrooms from the perspective of flow theory. In Applications of flow in human development and education (pp. 475–494). Springer.
go back to reference Skinner, E. A., & Belmont, M. J. (1993). Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85(4), 571–581.CrossRef Skinner, E. A., & Belmont, M. J. (1993). Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85(4), 571–581.CrossRef
go back to reference Søndergaard, H., & Mulder, R. A. (2012). Collaborative learning through formative peer review: Pedagogy, programs and potential. Computer Science Education, 22(4), 343–367.CrossRef Søndergaard, H., & Mulder, R. A. (2012). Collaborative learning through formative peer review: Pedagogy, programs and potential. Computer Science Education, 22(4), 343–367.CrossRef
go back to reference Sripada, S., Reddy, Y. R., & Sureka, A. (2015). In support of peer code review and inspection in an undergraduate software engineering course. 2015 IEEE 28th conference on software engineering education and training, 3–6. Sripada, S., Reddy, Y. R., & Sureka, A. (2015). In support of peer code review and inspection in an undergraduate software engineering course. 2015 IEEE 28th conference on software engineering education and training, 3–6.
go back to reference Sunikova, D., Kubincova, Z., Simionescu, S., & Popescu, E. (2017). Peer assessment augmented with digital badges: A first experience report. 2017 16th international conference on information technology based higher education and training, ITHET 2017, 1–5. https://doi.org/10.1109/ITHET.2017.8067799. Sunikova, D., Kubincova, Z., Simionescu, S., & Popescu, E. (2017). Peer assessment augmented with digital badges: A first experience report. 2017 16th international conference on information technology based higher education and training, ITHET 2017, 1–5. https://​doi.​org/​10.​1109/​ITHET.​2017.​8067799.
go back to reference Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249–276.CrossRef Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249–276.CrossRef
go back to reference Turner, S. A., Quintana-Castillo, R., Pérez-Quiñones, M. A., & Edwards, S. H. (2008). Misunderstandings about object-oriented design: Experiences using code reviews. ACM SIGCSE Bulletin, 40(1), 97–101.CrossRef Turner, S. A., Quintana-Castillo, R., Pérez-Quiñones, M. A., & Edwards, S. H. (2008). Misunderstandings about object-oriented design: Experiences using code reviews. ACM SIGCSE Bulletin, 40(1), 97–101.CrossRef
go back to reference Turner, S., Pérez-Quiñones, M. A., Edwards, S., & Chase, J. (2011). Student attitudes and motivation for peer review in CS2. Proceedings of the 42nd ACM Technical Symposium on Computer Science Education, 347–352. Turner, S., Pérez-Quiñones, M. A., Edwards, S., & Chase, J. (2011). Student attitudes and motivation for peer review in CS2. Proceedings of the 42nd ACM Technical Symposium on Computer Science Education, 347–352.
go back to reference Wang, M.-T., & Eccles, J. S. (2013). School context, achievement motivation, and academic engagement: A longitudinal study of school engagement using a multidimensional perspective. Learning and Instruction, 28, 12–23.CrossRef Wang, M.-T., & Eccles, J. S. (2013). School context, achievement motivation, and academic engagement: A longitudinal study of school engagement using a multidimensional perspective. Learning and Instruction, 28, 12–23.CrossRef
go back to reference Wang, C. H., Hsu, Y. C., Yeh, P. C., Lin, C. Y., & Lai, I. W. (2016). Edventure: Gamification for collaborative problem design and solving. 2016 15th international conference on information technology based higher education and training, ITHET 2016, 8–12. https://doi.org/10.1109/ITHET.2016.7760719. Wang, C. H., Hsu, Y. C., Yeh, P. C., Lin, C. Y., & Lai, I. W. (2016). Edventure: Gamification for collaborative problem design and solving. 2016 15th international conference on information technology based higher education and training, ITHET 2016, 8–12. https://​doi.​org/​10.​1109/​ITHET.​2016.​7760719.
go back to reference Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering. Proceedings of the 18th international conference on evaluation and assessment in software engineering, 38. Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering. Proceedings of the 18th international conference on evaluation and assessment in software engineering, 38.
go back to reference Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. “ O’Reilly Media, Inc.” Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. “ O’Reilly Media, Inc.”
Metadata
Title
Gamification of student peer review in education: A systematic literature review
Authors
Theresia Devi Indriasari
Andrew Luxton-Reilly
Paul Denny
Publication date
22-05-2020
Publisher
Springer US
Published in
Education and Information Technologies / Issue 6/2020
Print ISSN: 1360-2357
Electronic ISSN: 1573-7608
DOI
https://doi.org/10.1007/s10639-020-10228-x

Other articles of this Issue 6/2020

Education and Information Technologies 6/2020 Go to the issue

Premium Partner