Michael A. Miljanovic
Jeremy S. Bradbury
ABSTRACT
Serious games have become a popular alternative learning tool for computer programming education. Research has shown that serious games provide benefits including the development of problem solving skills and increased engagement in the learning process. Despite the benefits, a major challenge of developing serious games is their ability to accommodate students with different educational backgrounds and levels of competency. Learners with a high-level of competence may find a serious games to be too easy or boring, while learners with low-level competence may be frequently frustrated or find it difficult to progress through the game. One solution to this challenge is to use automated adaptation that can alter game content and adjust game tasks to a level appropriate for the learner. The use of adaptation has been successfully utilized in educational domains outside of Software Engineering, but has not been applied to serious programming games. This paper presents GidgetML, an adaptive version of the Gidget programming game, that uses machine learning to modify game tasks based on assessing and predicting learners' competencies. To assess the benefits of adaptation, we have conducted a study involving 100 students in a first-year university programming course. Our study compared the use of Gidget (non-adaptive) with GidgetML (adaptive) and found that students who played Gidget during lab sessions varied significantly in their performance while this variance was significantly reduced for students who played GidgetML.
- Francesco Bellotti, Riccardo Berta, Alessandro De Gloria, and Ludovica Primavera. 2009. Adaptive experience engine for serious games. IEEE Transactions on Computational Intelligence and AI in Games 1, 4 (2009), 264--280.Google Scholar
Cross Ref
- Jeanne H Brockmyer, Christine M Fox, Kathleen A Curtiss, Evan McBroom, Kimberly M Burkhart, and Jacquelyn N Pidruzny. 2009. The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45, 4 (2009), 624--634.Google ScholarCross Ref
- Mihaly Csikszentmihalyi. 1997. Finding flow: The psychology of engagement with everyday life. Basic Books.Google Scholar
- Stefan Göbel, Florian Mehm, Sabrina Radke, and Ralf Steinmetz. 2009. 80days: Adaptive digital storytelling for digital educational games. In Proceedings of the Second International Workshop on Story-Telling and Educational Games (STEG'09), Vol. 498.Google Scholar
- Andrew Gonczi. 1999. Competency-based learning. Understanding learning at work (1999), 180--195.Google Scholar
- Maurice Hendrix, Tyrone Bellamy-Wood, Sam McKay, Victoria Bloom, and Ian Dunwell. 2018. Implementing adaptive game difficulty balancing in serious games. IEEE Transactions on Games (2018).Google Scholar
- Michael D Kickmeier-Rust and Dietrich Albert. 2010. Micro-adaptivity: Protecting immersion in didactically adaptive digital educational games. Journal of Computer Assisted Learning 26, 2 (2010), 95--105.Google ScholarCross Ref
- Michael J Lee, Faezeh Bahmani, Irwin Kwan, Jilian LaFerte, Polina Charters, Amber Horvath, Fanny Luor, Jill Cao, Catherine Law, Michael Beswetherick, et al. 2014. Principles of a debugging-first puzzle game for computing education. In Proceedings of the 2014 IEEE symposium on visual languages and human-centric computing (VL/HCC). IEEE, 57--64.Google ScholarCross Ref
- Michael J Lee and Amy J Ko. 2011. Personifying programming tool feedback improves novice programmers' learning. In Proceedings of the Seventh International Workshop on Computing Education Research ACM, 109--116.Google ScholarDigital Library
- Michael J Lee and Amy J Ko. 2012. Investigating the role of purposeful goals on novices' engagement in a programming game. In Proceedings of the 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 163--166.Google ScholarCross Ref
- Michael J. Lee, Amy J. Ko, and Irwin Kwan. 2013. In-game assessments increase novice programmers' engagement and level completion speed. In Proceedings of the Ninth Annual International ACM Conference on International Computing Education Research (ICER '13). ACM, New York, NY, USA, 153--160. Google ScholarDigital Library
- Dan Li, Jitender Deogun, William Spaulding, and Bill Shuart. 2004. Towards missing data imputation: a study of fuzzy k-means clustering method. In Proceedings of the International Conference on Rough Sets and Current Trends in Computing. Springer, 573--579.Google ScholarCross Ref
- Michael A Miljanovic and Jeremy S Bradbury. 2018. Making Serious Programming Games Adaptive. In Proceedings of the Joint International Conference on Serious Games. Springer, 253--259.Google ScholarCross Ref
- Michael A Miljanovic and Jeremy S Bradbury. 2018. A review of serious games for programming. In Proceedings of the Joint International Conference on Serious Games. Springer, 204--216.Google ScholarCross Ref
- Georg Rasch. 1960. Studies in mathematical psychology: I. Probabilistic models for some intelligence and attainment tests. (1960).Google Scholar
- Valerie Shute, Fengfeng Ke, and Lubin Wang. 2017. Assessment and adaptation in games. In Instructional techniques to facilitate learning and motivation of serious games. Springer, 59--78.Google Scholar
- Adilson Vahldick, António José Mendes, and Maria José Marcelino. 2014. A review of games designed to improve introductory computer programming competencies. In 2014 IEEE Frontiers in Education Conference (FIE) proceedings. IEEE.Google ScholarCross Ref
- D Zhao, AE Chis, GM Muntean, and CH Muntean. 2018. A large-scale pilot study on game-based learning and blended learning methodologies in undergraduate programming courses. In Proceedings of the EDULEARN Conference, Palma de Mallorca, Spain.Google ScholarCross Ref
Index Terms
- GidgetML: an adaptive serious game for enhancing first year programming labs
Recommendations
RoboBUG: A Serious Game for Learning Debugging Techniques
ICER '17: Proceedings of the 2017 ACM Conference on International Computing Education ResearchDebugging is an essential but challenging task that can present a great deal of confusion and frustration to novice programmers. It can be argued that Computer Science education does not sufficiently address the challenges that students face when ...
Enhancing Computer Science Education with Adaptive Serious Games
ICER '19: Proceedings of the 2019 ACM Conference on International Computing Education ResearchThe use of games for education has shown effectiveness in engaging students to learn. Computer Science is one of the most heavily targeted fields of study for educational games. A major challenge for serious games is the need for them to be suitable for ...
Robot on!: a serious game for improving programming comprehension
GAS '16: Proceedings of the 5th International Workshop on Games and Software EngineeringA number of educational games have been created to help students programming. Many of these games focus on problem solving and the actual act of writing programs, while very few focus on programming comprehension. We introduce a serious game called ...
Comments