skip to main content
research-article

Children Programming Games: A Strategy for Measuring Computational Learning

Published:23 December 2014Publication History
Skip Abstract Section

Abstract

This article reports the results of a study of the relationship of computer game programming to computational learning (CL). The results contribute to the growing body of knowledge about how to define and measure CL among children by proposing a new concept, Game Computational Sophistication (GCS). We analyzed 231 games programmed by 325 11 and 12 year olds with a range of prior computer experience who attended a voluntary technology class during or after school. Findings suggest that students’ games exhibited a range of GCS: programs composed of sequences of simple programming constructs; programs composed of programming constructs, some of which are used to implement higher-order patterns; and programs composed of game mechanics built from combinations of patterns “glued” together with simple programming constructs. We use case studies of students’ games to illustrate how variation in the use and integration of programming constructs, patterns, and game mechanics can be used to demonstrate evidence of CL. The study contributes to an understanding of what CL looks like in middle school, how to assess it, and how game-programming activities might promote CL.

References

  1. D. Arcamone, M. Dickinson, S. Butkus, A. Lim, and K. Shannon. 2011. Analyzing the computational complexity of games created by middle school students. Poster presented at the UCSC Undergraduate Summer Research Experience Symposium.Google ScholarGoogle Scholar
  2. V. Barr and C. Stephenson. 2011. Bringing computational thinking to K-12: What is involved and what is the role of the computer science education community? ACM Inroads 2, 1, 48--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. A. R. Basawapatna, K. H. Koh, and A. Repenning. 2010. Using scalable game design to teach computer science from middle school to graduate school. In Proceedings of the 15th Annual Conference on Innovation and Technology in Computer Science Education. ACM, New York, NY, 224--228. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. A. Baytak and S. M. Land. 2011. An investigation of the artifacts and process of constructing computers games about environmental science in a fifth grade classroom. Educational Technology Research and Development 59, 6, 765--782.Google ScholarGoogle ScholarCross RefCross Ref
  5. K. Brennan and M. Resnick. 2012. New frameworks for studying and assessing the development of computational thinking. In Proceedings of the 2012 Annual Meeting of the American Educational Research Association.Google ScholarGoogle Scholar
  6. R. Brooks. 1977. Towards a theory of the cognitive processes in computer programming. International Journal of Man-Machine Studies 9, 6, 737--751.Google ScholarGoogle ScholarCross RefCross Ref
  7. Q. Burke and Y. B. Kafai. 2012. The writers’ workshop for youth programmers: Digital storytelling with Scratch in middle school classrooms. In Proceedings of the 43rd ACM Technical Symposium on Computer Science Education. ACM, New York, NY, 433--438. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. S. Campe, L. Werner, and J. Denner. 2012. Game programming with Alice: A series of graduated challenges. In Special Issue Computer Science K-8: Building a Strong Foundation, P. Phillips (Ed.). Computer Science Teachers Association.Google ScholarGoogle Scholar
  9. I. H. Caperton. 2010. Toward a theory of game-media literacy: Playing and building as reading and writing. International Journal of Gaming and Computer-Mediated Simulations 2, 1, 1--16.Google ScholarGoogle ScholarCross RefCross Ref
  10. E. Cohen, R. Lotan, B. Scarloss, S. Schultz, and P. Abram. 2002. Can groups learn? Teachers College Record 104, 6, 1045--1068.Google ScholarGoogle Scholar
  11. S. Cooper, L. C. Pérez, and D. Rainey. 2010. K-12 computational learning. Communications of the ACM 53, 11, 27--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Denner. 2007. The Girls Creating Games program: An innovative approach to integrating technology into middle school. Meridian: A Middle School Computer Technologies Journal 1, 10.Google ScholarGoogle Scholar
  13. J. Denner. 2011. What predicts middle school girls’ interest in computing? International Journal of Gender, Science and Technology 3, 1.Google ScholarGoogle Scholar
  14. J. Denner and L. Werner. 2011. Measuring computational thinking in middle school using game programming. In Proceedings of the Annual Meeting of the American Educational Research Association. J. Denner, S. Bean, and J. Martinez. 2009. The Girl Game Company: Engaging Latina girls in information technology. Afterschool Matters 8, 26--35.Google ScholarGoogle Scholar
  15. J. Denner, E. Ortiz, S. Campe, and L. Werner. 2014. Beyond stereotypes of gender and gaming: Video games made by middle school students. In Handbook of Digital Games, H. Agius and M. Angelides (Eds.). John Wiley and Sons, 667--688.Google ScholarGoogle Scholar
  16. J. Denner, L. Werner, and E. Ortiz. 2012. Computer games created by middle school girls: Can they be used to measure understanding of computer science concepts? Computers and Education 58, 1, 240--249. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. M. Dickinson and D. Arcamone. 2011. Investigation of Game Mechanics and Patterns Used by Middle School Programmers. Poster presented at the UCSC Undergraduate Summer Research Experience Symposium.Google ScholarGoogle Scholar
  18. B. Dorn, A. E. Tew, and M. Guzdial. 2007. Introductory computing construct use in an end-user programming community. In Proceedings of the IEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC’07). IEEE, Los Alamitos, CA, 27--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. K. Ehrlich and E. Soloway (Eds.). 1984. An empirical investigation of the tacit plan knowledge in programming. In Human Factors in Computer Systems. Ablex Publishing, Norwood, NJ, 113--133. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. A. Games. 2013. Understanding the evolution of adolescents’ computational thinking skills within the globaloria educational game design environment. Retrieved November 25, 2014, from http://www.worldwideworkshop.org/reports.Google ScholarGoogle Scholar
  21. Gamification Wiki. n.d. Game Mechanics. Retrieved June 25, 2013 from http://gamification.org/wiki/ game_Mechanics.Google ScholarGoogle Scholar
  22. E. Gamma, R. Helm, R. Johnson, and J. Vlissides. 1993. Design Patterns: Abstraction and Reuse of Object-Oriented Design. Springer, Berlin, Heidelberg, 406--431. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. S. Grover and R. Pea. 2013. Computational thinking in K-12: A review of the state of the field. Educational Researcher 42, 1, 38--43.Google ScholarGoogle ScholarCross RefCross Ref
  24. E. R. Hayes and I. A. Games. 2008. Making computer games and design thinking: A review of current software and strategies. Games and Culture 3, 3--4, 309--332.Google ScholarGoogle ScholarCross RefCross Ref
  25. C. E. Hmelo-Silver and R. Azevedo. 2006. Understanding complex systems: Some core challenges. Journal of the Learning Sciences 15, 1, 53--61.Google ScholarGoogle ScholarCross RefCross Ref
  26. C. E. Hmelo-Silver and M. G. Pfeffer. 2004. Comparing expert and novice understanding of a complex system from the perspective of structures, behaviors, and functions. Cognitive Science 28, 1, 127--138.Google ScholarGoogle ScholarCross RefCross Ref
  27. R. Hunicke, M. LeBlanc, and R. Zubek, 2004. MDA: A formal approach to game design and game research. In Proceedings of the AAAI Workshop on Challenges in Game AI. 4.Google ScholarGoogle Scholar
  28. A. Ioannidou, V. Bennett, A. Repenning, K. H. Koh, and A. Basawapatna. 2011. Computational thinking patterns. Paper presented at the American Educational Research Association Conference, New Orleans, LA.Google ScholarGoogle Scholar
  29. Robin Jeffries, A. Turner, P. Polson, and M. Atwood. 1981. The processes involved in designing software. In Cognitive Skills and Their Acquisition, J. R. Anderson (Ed.). Erlbaum, Hillsdale, NJ, 255--283.Google ScholarGoogle Scholar
  30. Y. B. Kafai. 2006. Playing and making games for learning instructionist and constructionist perspectives for game studies. Games and Culture 1, 1, 36--40.Google ScholarGoogle ScholarCross RefCross Ref
  31. Y. S. Lincoln and E. G. Guba. 1985. Naturalistic Inquiry. Sage, Beverly Hills, CA.Google ScholarGoogle Scholar
  32. M. C. Linn. 1985. The cognitive consequences of programming instruction in classrooms. Educational Researcher 14, 5, 14--29.Google ScholarGoogle ScholarCross RefCross Ref
  33. J. H. Maloney, K. Peppler, Y. Kafai, M. Resnick, and N. Rusk. 2008. Programming by choice: Urban youth learning programming with Scratch. In Proceedings of the 39th SIGCSE Technical Symposium on Computer Science Education. ACM, New York, NY, 367--371. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. C. K. Martin, S. Walter, and B. Barron. 2009. Looking at learning through student designed computer games: A rubric approach with novice programming projects. Unpublished paper, Stanford University.Google ScholarGoogle Scholar
  35. O. Meerbaum-Salant, M. Armoni, and M. M. Ben-Ari. 2010. Learning computer science concepts with Scratch. In Proceedings of the 6th International Workshop on Computing Education Research. ACM, New York, NY, 69--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. M. Miles and A. Huberman. 1994. Qualitative Data Analysis: An Expanded Source Book (2nd ed.). Sage, Thousand Oaks, CA.Google ScholarGoogle Scholar
  37. A. J. Onwuegbuzie and N. L. Leech. 2007. Validity and qualitative research: An oxymoron? Quality and Quantity 41, 233--249.Google ScholarGoogle Scholar
  38. R. D. Pea and D. M. Kurland. 1984. On the cognitive effects of learning computer programming. New Ideas in Psychology 2, 2, 137--168.Google ScholarGoogle ScholarCross RefCross Ref
  39. K. A. Peppler and Y. B. Kafai. 2007. From supergoo to scratch: Exploring creative digital media production in informal learning. Leaning, Media, and Technology 32, 2, 149--166.Google ScholarGoogle ScholarCross RefCross Ref
  40. J. Quesada, W. Kintsch, and E. Gomez. 2005. Complex problem-solving: A field in search of a definition? Theoretical Issues in Ergonomics Science 6, 1, 5--33.Google ScholarGoogle Scholar
  41. A. Robins, J. Rountree, and N. Rountree. 2003. Learning and teaching programming: A review. Computer Science Education 13, 2, 137--172.Google ScholarGoogle ScholarCross RefCross Ref
  42. S. H. Rodger, J. Hayes, G. Lezin, H. Qin, D. Nelson, R. Tucker, and D. Slater. 2009. Engaging middle school teachers and students with Alice in a diverse set of subjects. In Proceedings of the 40th ACM Technical Symposium on Computer Science Education. 271--275. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. V. J. Shute and R. Torres. 2012. Where streams converge: Using evidence-centered design to assess Quest to Learn. In Technology-Based Assessments for 21st Century Skills: Theoretical and Practical Implications from Modern Research, M. C. Mayrath, J. Clarke-Midura, D. H. Robinson, and G. Schraw (Eds.). Information Age Publishing, 91--124.Google ScholarGoogle Scholar
  44. V. J. Shute, I. Masduki, and O. Donmez. 2010. Conceptual framework for modeling, assessing, and supporting competencies within game environments. Technology, Instruction, Cognition, and Learning 8, 2, 137--161.Google ScholarGoogle Scholar
  45. M. Sicart. 2008. Defining game mechanics. Game Studies 8, 2.Google ScholarGoogle Scholar
  46. E. Soloway. 1986. Learning to program = learning to construct mechanisms and explanations. Communications of the ACM 29, 9, 850--858. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. J. C. Spohrer, and E. Soloway. 1986. Novice mistakes: Are the folk wisdoms correct? Communications of the ACM 29, 7, 624--632. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. K. Stolee and T. Fristoe. 2011. Expressing computer science concepts through Kodu game lab. In Proceedings of the 42nd ACM Technical Symposium on Computer Science Education. ACM, New York, NY, 99--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. R. Tesch. 1990. Qualitative Research. Falmer Press, New York, NY.Google ScholarGoogle Scholar
  50. P. Van Rosmalen, A. Wilson, and H. Hummel. 2013. Games for and by teachers and learners. In Psychology, Pedagogy, and Assessment in Serious Games, T. M. Connolly, E. Boyle, T. Hainey, G. Baxter, and P. Moreno-Ger (Eds.).Google ScholarGoogle Scholar
  51. L. Werner, S. Campe, J. Denner. 2012a. Children learning computer science concepts via Alice game-programming. In Proceedings of the 43rd ACM Conference on Computer Science Education (SIGCSE’12). Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. L. Werner, J. Denner, S. Campe, and D. C. Kawamoto. 2012b. The fairy performance assessment: Measuring computational thinking in middle school. In Proceedings of the 43rd ACM Conference on Computer Science Education (SIGCSE’12). Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Wikipedia. 2014. Game Mechanics. Retrieved June 25, 2013, from http://en.wikipedia.org/wiki/ Game_mechanicsGoogle ScholarGoogle Scholar
  54. YouTube. 2013. President Obama Participates in a Fireside Hangout on Google+. Retrieved November 25, 2014, from https://www.youtube.com/watch?v=kp_zigxMS-YGoogle ScholarGoogle Scholar

Index Terms

  1. Children Programming Games: A Strategy for Measuring Computational Learning

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Computing Education
      ACM Transactions on Computing Education  Volume 14, Issue 4
      February 2015
      116 pages
      EISSN:1946-6226
      DOI:10.1145/2698235
      Issue’s Table of Contents

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 23 December 2014
      • Revised: 1 March 2014
      • Accepted: 1 March 2014
      • Received: 1 August 2013
      Published in toce Volume 14, Issue 4

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader