B. Marín
Abstract
Context: Programming courses are compulsory for most engineering degrees, but students’ performance on these courses is often not as good as expected. Programming is difficult for students to learn, given that it includes a lot of new, complex, and abstract topics. All of this has led experts to the conclusion that new teaching techniques are required if students are to be motivated and engaged in learning on programming courses. Gamification has come to be an effective technique in education in general, and is especially useful in programming courses. This motivated us to develop an open source gamified platform, called UDPiler, for use in a programming course.
Objective: The main goal of this article is to obtain empirical evidence on the improvement of students’ learning performance when using UDPiler in comparison to a non-gamified compiler.
Method: A quasi-experiment was performed with two groups of first-year engineering students at Diego Portales University in Chile, using a non-gamified compiler and a gamified platform, respectively.
Results: The results reveal that the students obtained better marks when the gamified platform was used to learn C programming. In addition, there is statistical significance in favor of there being a positive effect on the learning performance of those students who used the gamified platform.
Conclusions: The results allow us to conclude that gamification is an encouraging approach with which to teach C programming, a finding that is aligned with previous empirical studies concerning gamification on programming courses, carried out in academic contexts. Nonetheless, we are aware that further validation is also required to corroborate and strengthen the findings obtained and to investigate whether the kind of gamified elements (mechanics, dynamics, and aesthetics) used have any influence on students’ performance, among other issues that deserve further investigation and that are explained throughout this article.
- Y. Qian and J. Lehman. 2017. Students’ misconceptions and other difficulties in introductory programming: A literature review. ACM Trans. Comput. Educ. 18, 1, Article 1 (2017), 24. Google Scholar
Digital Library
- S. O'Donovan, J. Gain, and P. Marais. 2013. A case study in the gamification of a university-level games development course. In Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference (SAICSIT’13). 242--251. Google ScholarDigital Library
- T. Reis da Silva, T. Medeiros, and E. da Silva Aranha. 2015. The use of games on the teaching of programming: A systematic review. In Proceedings of the Workshop on Experimental Software Engineering (ESELAW’15). 474--487.Google Scholar
- J. D. Bayliss. 2009. Using games in introductory courses: Tips from the trenches. In Proceedings of the ACM Technical Symposium on Computer Science Education (SIGSE’09). Google ScholarDigital Library
- E. Michael and B. Tiffany. 2009. Experimental evaluation of an educational game for improved learning in introductory computing. In Proceedings of the ACM Technical Symposium on Computer Science Education (SIGSE’09). Google ScholarDigital Library
- T. M. Connolly, E. A. Boyle, E. MacArthur, T. Hainey, and J. M. Boyle. 2012. A systematic literature review of empirical evidence on computer games and serious games. Comput. Educ. 59, 2 (2012), 661--686. Google ScholarDigital Library
- A. Calderón and M. Ruiz. 2015. A systematic literature review on serious games evaluation: An application to software project management. Comput. Educ. 87 (2015), 396--422. Google ScholarDigital Library
- Z. Fitz-Walter, D. Tjondronegoro, and P. Wyeth. 2011. Orientation passport: Using gamification to engage university students. In Proceedings of the 23rd Australian Computer-Human Interaction Conference. 122--125. Google ScholarDigital Library
- S. Deterding, D. Dixon, R. Khaled, and L. Nacke. 2011. From game design elements to gamefulness: Defining gamification. In Proceedings of the15th International Academic Mindtrek Conference: Envisioning Future Media Environments. 9--15. Google ScholarDigital Library
- M. Hanus and J. Fox. 2015. Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Comput. Educ. 80 (2015), 152--161. Google ScholarDigital Library
- J. McGonigal. 2011. Reality Is Broken: Why Games Make Us Better and How They Can Change the World. The Penguin Press, New York, NY. Google ScholarDigital Library
- G. Zichermann and J. Linder. 2010. Game-Based Marketing: Inspire Customer Loyalty Through Rewards, Challenges, and Contests. Wiley, Hoboken, NJ.Google Scholar
- D. Dicheva, C. Dichev, G. Agre, and G. Angelova. 2015. Gamification in education: A systematic mapping study. Educ. Technol. Soc. 18, 3 (2015), 1--14.Google Scholar
- S. de Sousa, V. Durelli, H. Macedo Reis, and S. Isotani. 2014. A systematic mapping on gamification applied to education. In Proceedings of the 29th Annual ACM Symposium on Applied Computing (SAC’14). 216--222. Google ScholarDigital Library
- I. Caponetto, J. Earp, and M. Ott. 2014. Gamification and education: A literature review. In Proceedings of the 8th European Conference on Games Based Learning (ECGBL’14). 50--57.Google Scholar
- J. Vargas-Enríquez, L. García-Mundo, M. Genero, and M. Piattini. 2015. Análisis de uso de la gamificación en la enseñanza de la informática. In Actas de las XXI Jornadas de la Enseñanza Universitaria de la Informática (JENUI’15). 105--112.Google Scholar
- Y. Attali and M. Arieli-Attali. 2015. Gamification in assessment: Do points affect test performance? Comput. Educ. 83 (2015), 57--63.Google ScholarCross Ref
- C. Bodnar, D. Anastasio, J. Enszer, and D. Burkey. 2016. Engineers at play: Games as teaching tools for undergraduate engineering students. J. Eng. Educ. 105 (Jan. 2016), 147--200.Google ScholarCross Ref
- J. Hamari, J. Koivisto, and H. Sarsa. 2014. Does gamification work? A literature review of empirical studies on gamification. Proceedings of the 47th Hawaii International Conference on System Science. 3025--3034. Google ScholarDigital Library
- A. Domínguez, J. Saenz-de-Navarrete, L. de-Marcos, L. Fernández-Sanz, C. Pagés, and J. Martínez-Herráiz. 2013. Gamifying learning experiences: Practical implications and outcomes Comput. Educ. 63 (2013), 380--392. Google ScholarDigital Library
- UDPiler code. Retrieved from https://github.com/jfrez/udpiler.Google Scholar
- A. Kirkwood and L. Price. 2005. Learners and learning in the twenty‐first century: What do we know about students’ attitudes towards and experiences of information and communication technologies that will help us design courses? Stud. Higher Educ. 30, 3 (2005), 257--274.Google ScholarCross Ref
- T. Lehtonen, T. Aho, E. Isohanni, and T. Mikkonen. 2015. On the role of gamification and localization in an open online learning environment: Javala experiences. In Proceedings of the 15th Koli Calling Conference on Computing Education Research. 50--59. Google ScholarDigital Library
- D. Dubois and G. Tamburrelli. 2013. Understanding gamification mechanisms for software development. In Proceedings of the ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE’13). Google ScholarDigital Library
- L. Hakulinen, T. Auvinen, and A. Korhonen. 2013. Empirical study on the effect of achievement badges in TRAKLA2 online learning environment. In Proceedings of the Annual Conference on Learning and Teaching in Computing and Engineering (LaTiCE’13). 47--54. Google ScholarDigital Library
- L. Haaranen, P. Ihantola, L. Hakulinen, and A. Korhonen. 2014. How (not) to introduce badges to online exercises. In Proceedings of the Annual Conference of the Special Interest Group on Computer Science Education (SIGCSE’14). Google ScholarDigital Library
- S. Grant and B. Betts. 2013. Encouraging user behaviour with achievements: An empirical study. In Proceedings of the 10th Working Conference on Mining Software Repositories (MSR’13). 65--68 Google ScholarDigital Library
- J. Paiva, J. Leal, and R. Queirós. 2016. Enki: A pedagogical services aggregator for learning programming languages. In Proceedings of the Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE’16). 332--337. Google ScholarDigital Library
- M. Piccioni, E. Estler, and B. Meyer. 2014. SPOC-supported introduction to programming. In Proceedings of the Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE’14). 3--8. Google ScholarDigital Library
- A. Bogdanovych and T. Trescak. 2016. Teaching programming fundamentals to modern university students. In Proceedings of the 8th International Conference on Computer Supported Education (CSEDU’16). 308--317 Google ScholarDigital Library
- J. Shim, D. Kwon, and W. Lee. 2017. The effects of a robot game environment on computer programming education for elementary school students. IEEE Trans. Educ. 60, 2 (2017), 164--172. Google ScholarDigital Library
- R. Landers. 2014. Developing a theory of gamified learning: Linking serious games and gamification of learning. Simul. Gaming 45 (2014), 752--768. Google ScholarDigital Library
- UDPiler. Retrieved from http://udplier.udp.cl/.Google Scholar
- R. Hunicke, M. LeBlanc, and R. Zubek. 2004. MDA: A formal approach to game design and game research. In Proceedings of the AAAI Workshop on Challenges in Game AI.Google Scholar
- H. Hummel, D. Burgos, C. Tattersall, F. Brouns, H. Kurvers, and R. Koper. 2005. Encouraging contributions in learning networks using incentive mechanisms. J. Comput. Assist. Learn. 21, 5 (2005), 355--365.Google ScholarCross Ref
- F. Gutierrez, G. Zurita, S. Ochoa, and N. Baloian. 2013. Analyzing two participation strategies in an undergraduate course community. In Proceedings of the 19th International Conference on Collaboration and Technology (CRIWG’13). 143--158. Google ScholarDigital Library
- J. Vassileva and L. Sun. 2007. Using community visualization to stimulate participation in online communities. E-Serv. J. 6, 1 (2007), 3--39.Google ScholarCross Ref
- W. Shadish, T. Cook, and D. Campbell. 2001. Experimental and Quasi-experimental Designs for Generalized Causal Inference. Wadsworth, London, 2001.Google Scholar
- A. Jedlitschka, M. Ciolkowski, and D. Pfahl. 2008. Reporting experiments in software engineering. In Guide to Advanced Empirical Software Engineering, F. Shull, J. Singer, and D. Sjøberg (Eds.). Springer London, 201--228.Google Scholar
- N. Juristo and A. Moreno. 2001. Basics of Software Engineering Experimentation. Springer, 2001. Google ScholarDigital Library
- C. Wohlin, P. Runeson, M. Host, M. Ohlsson, and B. Regnell, 2012. Experimentation in Software Engineering. Springer. Google ScholarDigital Library
- V. Basili, G. Caldeira, and H. D. Rombach. 1994. The goal question metric paradigm. In Encyclopedia of Software Engineering (2nd ed.). Wiley, New York, NY, 528--532.Google Scholar
- UDP, “Admision scores for careers atUDP,” http://www.udp.cl/admision/adm_reg_carreras.asp2016.Google Scholar
- D. Sheskin. 2007. Handbook of Parametric and Nonparametric Statistical Procedures. Chapman 8 Hall, London. Google Scholar
- IBM. 2018. SPSS v. 24. Retrieved from http://www-03.ibm.com/software/products/es/spss-statistics.Google Scholar
- F. D. Davis. 1989. Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quart. 13 (1989), 319--339. Google ScholarDigital Library
- L. de-Marcos, E. Garcia-Lopez, and A. Garcia-Cabot. 2016. On the effectiveness of game-like and social approaches in learning: Comparing educational gaming, gamification 8 social networking. Comput. Educ. 95 (2016), 99--113. Google ScholarDigital Library
Index Terms
- An Empirical Investigation on the Benefits of Gamification in Programming Courses
Recommendations
Factors at Play in Tertiary Curriculum Gamification
The compulsion to include games and game related mechanism in education is great among educators who want to engage and motivate today's students and the latest buzzword in this domain is gamification. However, without a thorough understanding of what a ...
Exploring Higher Education Teachers’ Attitudes Towards Gamification
Games and Learning AllianceAbstractThe purpose of this study is to gain a better understanding of university teachers’ attitudes toward gamification. A broader goal is to lay the groundwork for a better understanding of how university teachers gaming habits and preferences might be ...
Assessing the benefits of gamification in mathematics for student gameful experience and gaming motivation
AbstractThis study addresses the question of how to use game design elements to raise students' motivation to engage in mathematics learning activities. Four conditions of mathematics learning activities were designed and assessed: 1. a ...
Highlights- Effect of four gamified activities on game experience and motivation was checked.
Comments