Top

Published in:

2018 | OriginalPaper | Chapter

Learning Curve Analysis in a Large-Scale, Drill-and-Practice Serious Math Game: Where Is Learning Support Needed?

Authors : Zhongxiu Peddycord-Liu, Rachel Harred, Sarah Karamarkovich, Tiffany Barnes, Collin Lynch, Teomara Rutherford

Published in: Artificial Intelligence in Education

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This paper applies data-driven methods to understand learning and derives game design insights in a large-scale, drill-and-practice game: Spatial Temporal (ST) Math. In order for serious games to thrive we must develop efficient, scalable methods to evaluate games against their educational goals. Learning models have matured in recent years and have been applied across e-learning platforms but they have not been used widely in serious games. We applied empirical learning curve analyses to ST Math under different assumptions of how knowledge components are defined in the game and map to game contents. We derived actionable game design feedback and educational insights regarding fraction learning. Our results revealed cases where students failed to transfer knowledge between math skills, content, and problem representations. This work stresses the importance of designing games that support students’ comprehension of math concepts, rather than the learning of content- and situation-specific skills to pass games.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Predicting the Temporal and Social Dynamics of Curiosity in Small Group Learning

next chapter Conceptual Issues in Mastery Criteria: Differentiating Uncertainty and Degrees of Knowledge

Adkins, S.: The 2016–2021 Global Game-based Learning Market. In: Serious Play Conference (2016)

Bailey, D.H., Hoard, M.K., Nugent, L., Geary, D.C.: Competence with fractions predicts gains in Mathematics achievement. J. Exp. Child Psychol. 113(3), 447–455 (2012)CrossRef

Baker, R.S.J.D., Jacob Habgood, M.P., Ainsworth, S.E., Corbett, A.T.: Modeling the acquisition of fluent skill in educational action games. In: Conati, C., McCoy, K., Paliouras, G. (eds.) UM 2007. LNCS (LNAI), vol. 4511, pp. 17–26. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73078-1_5CrossRef

Cen, H., Koedinger, K., Junker, B.: Learning factors analysis – a general method for cognitive model evaluation and improvement. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 164–175. Springer, Heidelberg (2006). https://doi.org/10.1007/11774303_17CrossRef

Cen, H., Koedinger, K., Junker, B.: Comparing two IRT models for conjunctive skills. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 796–798. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-69132-7_111CrossRef

Rittle-Johnson, B., Siegler, R., Alibali, M.: Students’ fraction comparison strategies as a window into robust understanding and possible pointers for instruction. Educ. Stud. Math. 72(1), 127–138 (2009)CrossRef

El-Nasr, M.S., Drachen, A., Canossa, A.: Game Analytics. Springer, London (2016). https://doi.org/10.1007/978-1-4471-4769-5CrossRef

Harpstead, E., Aleven, V.: Using empirical learning curve analysis to inform design in an educational game. In: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, pp. 197–207. ACM, October 2015

Hansen, N., Jordan, N.C., Rodrigues, J.: Identifying learning difficulties with fractions: a longitudinal study of student growth from third through sixth grade. Contemp. Educ. Psychol. 50, 45–59 (2017)CrossRef

10.

Mitchell, A., Horne, M.: Fraction number line tasks and the additivity concept of length measurement. In: Proceedings of the 31st Annual Conference of the Mathematics Education Research Group of Australasia, pp. 353–360 (2008)

11.

Jordan, N.C., Resnick, I., Rodrigues, J., Hansen, N., Dyson, N.: Delaware longitudinal study of fraction learning: implications for helping children with mathematics difficulties. J. Learn. Disabil. 50(6), 621–630 (2017)CrossRef

12.

Lehtinen, E., Hannula, M.M.: Attentional processes, abstraction and transfer in early mathematical development. Instructional psychology: past, present and future trends. Fifteen Essays Honour Erik De Corte 49, 39–55 (2006)

13.

Liu, Z., Cody, C., Barnes, T., Lynch, C., Rutherford, T.: The antecedents of and associations with elective replay in an educational game: is replay worth it. In: Proceedings of the 10th International Conference on Educational Data Mining (EDM) (2017)

14.

Loh, C.S., Sheng, Y., Ifenthaler, D. (eds.): Serious Games Analytics. AGL. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-05834-4CrossRef

15.

Lomas, D., Patel, K., Forlizzi, J.L., Koedinger, K.R.: Optimizing challenge in an educational game using large-scale design experiments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 89–98. ACM, April 2013

16.

Murray, R.C., Ritter, S., Nixon, T., Schwiebert, R., Hausmann, R.G.M., Towle, B., Fancsali, S.E., Vuong, A.: Revealing the learning in learning curves. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 473–482. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_48CrossRef

17.

Newell, A., Rosenbloom, P.S.: Mechanisms of skill acquisition and the law of practice. Cognit. Skills Acquis. 1(1981), 1–55 (1981)

18.

Pavlik, P.I., Yudelson, M., Koedinger, K.R.: A measurement model of microgenetic transfer for improving instructional outcomes. Int. J. Artif. Intell. Educ. 25(3), 346–379 (2015)CrossRef

19.

Peddycord-Liu, Z., Cody, C., Kessler, S., Barnes, T., Lynch, C.F., Rutherford, T.: Using serious game analytics to inform digital curricular sequencing: what math objective should students play next? In: Proceedings of the Annual Symposium on Computer-Human Interaction in Play, pp. 195–204. ACM, October 2017

20.

Rau, M.A., Aleven, V., Rummel, N.: Intelligent tutoring systems with multiple representations and self-explanation prompts support learning of fractions. In: AIED, pp. 441–448, July 2009

21.

Rinne, L., Ye, A., Jordan, N.C.: Development of fraction comparison strategies: a latent transition analysis. Dev. Psychol. 53(4), 713–730 (2017)CrossRef

22.

Rittle-Johnson, B., Siegler, R., Alibali, M.: Developing conceptual understanding and procedural skill in mathematics: an iterative process. J. Educ. Psychol. 93(2), 346–362 (2001)CrossRef

23.

Romero, C., Ventura, S.: Educational data mining: a review of the state of the art. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 40(6), 601–618 (2010)

24.

Rutherford, T., Farkas, G., Duncan, G., Burchinal, M., Kibrick, M., Graham, J., Richland, L., Tran, N., Schneider, S., Duran, L., Martinez, M.E.: A randomized trial of an elementary school Mathematics software intervention: spatial-temporal math. J. Res. Educ. Effectiveness 7(4), 358–383 (2014)CrossRef

25.

Siegler, R., Thompson, C., Schneider, M.: An integrated theory of whole number and fractions development. Cogn. Psychol. 62(4), 273–296 (2011)CrossRef

26.

Siegler, R.S., Duncan, G.J., Davis-Kean, P.E., Duckworth, K., Claessens, A., Engel, M., Ines Susperreguy, M., Chen, M.: Early predictors of high school Mathematics achievement. Psychol. Sci. 23(7), 691–697 (2012)CrossRef

27.

Siemens, G., Baker, R.S.D.: Learning analytics and educational data mining: towards communication and collaboration. In: Proceedings of the 2nd International Conference on Learning Analytics And Knowledge, pp. 252–254. ACM, April 2012

28.

Torbeyns, J., Schneider, M., Xin, Z., Siegler, R.S.: Bridging the gap: fraction understanding is central to mathematics achievement in students from three different continents. Learn. Instr. 37, 5–13 (2015)CrossRef

Title: Learning Curve Analysis in a Large-Scale, Drill-and-Practice Serious Math Game: Where Is Learning Support Needed?
Authors: Zhongxiu Peddycord-Liu
Rachel Harred
Sarah Karamarkovich
Tiffany Barnes
Collin Lynch
Teomara Rutherford
Publisher: Springer International Publishing
Book: Artificial Intelligence in Education
Print ISBN: 978-3-319-93842-4

Electronic ISBN: 978-3-319-93843-1

Copyright Year: 2018
DOI: https://doi.org/10.1007/978-3-319-93843-1_32

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner