Andrew Emerson
Roger Azevedo
ABSTRACT
Recent advances in eye-tracking technologies have introduced the opportunity to incorporate gaze into student modeling. Creating student models that leverage gaze information holds significant promise for game-based learning environments. This paper introduces a gaze-enhanced student modeling framework that incorporates student eye tracking to dynamically predict students' performance in a game-based learning environment for microbiology education, CRYSTAL ISLAND. The gaze-enhanced student modeling framework was investigated in a study comparing a gaze-enhanced student model with a baseline student model that does not utilize student eye-tracking. Results of a study conducted with 65 college students interacting with the CRYSTAL ISLAND game-based learning environment indicate that the gaze-enhanced student model significantly outperforms the baseline model in dynamically predicting student problem-solving performance. The findings suggest that incorporating gaze into student modeling can contribute to a new generation of student models for game-based learning environments.
- Alvarez, N., Sanchez-Ruiz, A., Cavazza, M., Shigematsu, M. and Prendinger, H. 2015. Narrative Balance Management in an Intelligent Biosafety Training Application for Improving User Performance. International Journal of Artificial Intelligence in Education. 25, 1, 35--59.Google Scholar
Cross Ref
- Baker, R. 2007. Modeling and Understanding Students' Off-Task Behavior in Intelligent Tutoring Systems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems., 1059. Google ScholarDigital Library
- Baker, R., Corbett, A. and Aleven, V. 2008. More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing. Intelligent Tutoring Systems., 406--415. Google ScholarDigital Library
- Baker, R., K. D'Mello, S., Mercedes T. Rodrigo, M. and Graesser, A. 2010. Better to be Frustrated than Bored: The Incidence, Persistence, and Impact of Learners' Cognitive Affective States during Interactions with three Different Computer-Based Learning Environments. International Journal of Human-Computer Studies. 68, 4, 223--241. Google ScholarDigital Library
- Bergey, B., Ketelhut, D.J., Liang, S., Natarajan, U. and Karakus, M. 2015. Scientific Inquiry Self-Efficacy and Computer Game Self-Efficacy as Predictors and Outcomes of Middle School Boys' and Girls' Performance in a Science Assessment in a Virtual Environment. Journal of Science Education and Technology. 24, 5, 696--708.Google ScholarCross Ref
- Bondareva, D., Conati, C., Feyzi-Behnagh, R., Harley, J.M., Azevedo, R. and Bouchet, F. 2013. Inferring Learning from Gaze Data during Interaction with an Environment to Support Self-Regulated Learning. Proceedings of the 16th International Conference on Artificial Intelligence in Education. 229--238.Google Scholar
- Botelho, A., Baker, R. and Heffernan, N. 2017. Improving Sensor-Free Affect Detection Using Deep Learning. Proceedings of the International Conference on Artificial Intelligence in Education. 40--51.Google Scholar
- Bouchet, F., Harley, J.M., Trevors, G. and Azevedo, R. 2013. Clustering and Profiling Students According to their Interactions with an Intelligent Tutoring System Fostering Self-Regulated Learning. Journal of Educational Data Mining. 5, 1, 104--146.Google Scholar
- Conati, C., Gertner, A. and VanLehn, K. 2002. Using Bayesian Networks to Manage Uncertainty in Student Modeling. User Modeling and User-Adapted Interaction. 12, 4, 371--417. Google ScholarDigital Library
- Conati, C., Jaques, N. and Muir, M. 2013. Understanding attention to adaptive hints in educational games: an eye-tracking study. International Journal of Artificial Intelligence in Education. 23, 1--4, 136--161.Google ScholarCross Ref
- Conati, C. and Merten, C. 2007. Eye-Tracking for User Modeling in Exploratory Learning Environments: an Empirical Evaluation. Knowledge-Based Systems. 20, 6, 557--574. Google ScholarDigital Library
- Desmarais, M. and Baker, R. 2012. A Review of Recent Advances in Learner and Skill Modeling in Intelligent Learning Environments. User Modeling and User-Adapted Interaction. 22, 1, 9--38. Google ScholarDigital Library
- Deubel, H. and Schneider, W. 1996. Saccade Target Selection and Object Recognition: Evidence for a Common Attentional Mechanism. Vision Research. 36, 12, 1827--1837.Google ScholarCross Ref
- Easterday, M., Aleven, V., Scheines, R. and Carver, S. 2017. Using Tutors to Improve Educational Games: A Cognitive Game for Policy Argument. Journal of the Learning Sciences. 26, 2, 226--256.Google ScholarCross Ref
- Elliot, A. and McGregor, H. 2001. A 2 × 2 achievement goal framework. Journal of Personality and Social Psychology. 80, 3, 501--519.Google ScholarCross Ref
- Elliot, A.J. and Murayama, K. 2008. On the Measurement of Achievement Goals: Critique, Illustration, and Application. Journal of Educational Psychology. 100, 3, 613--628.Google ScholarCross Ref
- Grafsgaard, J., Wiggins, J., Boyer, K., Wiebe, E. and Lester, J. 2014. Predicting Learning and Affect from Multimodal Data Streams in Task-Oriented Tutorial Dialogue. Proceedings of the 7th International Conference on Educational Data Mining., 122--129.Google Scholar
- Habgood, J. and Ainsworth, S. 2011. Motivating Children to Learn Effectively: Exploring the Value of Intrinsic Integration in Educational Games. The Journal of the Learning Sciences. 20, 2, 169--206.Google ScholarCross Ref
- Huang, C.-M., Andrist, S., Sauppé, A. and Mutlu, B. 2015. Using gaze patterns to predict task intent in collaboration. Frontiers in Psychology. 6, 1--12.Google ScholarCross Ref
- Hutt, S., Hardey, J., Bixler, R., Stewart, A., Risko, E. and D'Mello, S. 2017. Gaze-based Detection of Mind Wandering during Lecture Viewing. 10th International Conference on Educational Data Mining., 226--231.Google Scholar
- Hutt, S., Mills, C., Bosch, N., Krasich, K., Brockmole, J. and D'Mello, S. 2017. Out of the Fr-"Eye"-ing Pan. Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. 94--103. Google ScholarDigital Library
- Hutt, S., Mills, C., White, S., Donnelly, P. and D 'Mello, S. 2016. The Eyes Have It: Gaze-based Detection of Mind Wandering during Learning with an Intelligent Tutoring System. Proceedings of the 9th International Conference on Educational Data Mining. International Educational Data Mining Society. 86--93.Google Scholar
- Jaques, N., Conati, C., Harley, J. and Azevedo, R. 2014. Predicting Affect from Gaze Data During Interaction with an Intelligent Tutoring System. Intelligent Tutoring Systems. 29--38. Google ScholarDigital Library
- Kardan, S. and Conati, C. 2012. Exploring Gaze Data for Determining User Learning with an Interactive Simulation. Proceedings of 20th International Conference on User Modeling, Adaptation, and Personalization. 126--138. Google ScholarDigital Library
- Khajah, M., V. Lindsey, R. and Mozer, M. 2016. How deep is knowledge tracing? Proceedings of the Ninth International Conference on Educational Data Mining. 94--101.Google Scholar
- Lee, S.J., Liu, Y. and Popovi, Z. 2014. Learning Individual Behavior in an Educational Game?: A Data-Driven Approach. Proceedings of the 7th International Conference on Educational Data Mining. 114--121.Google Scholar
- M. McLaren, B., M. Adams, D., Mayer, R. and Forlizzi, J. 2017. A Computer-Based Game that Promotes Mathematics Learning More than a Conventional Approach. International Journal of Game-Based Learning. 7, 1, 36--56. Google ScholarDigital Library
- Merten, C. and Conati, C. 2006. Eye-Tracking to Model and Adapt to User Meta-cognition in Intelligent Learning Environments. Proceedings of the 11th International Conference on Intelligent User Interfaces. 39. Google ScholarDigital Library
- Mills, C., Bixler, R., Wang, X. and D'Mello, S. 2016. Automatic Gaze-Based Detection of Mind Wandering during Narrative Film Comprehension. Proceedings of the 9th International Conference on Educational Data Mining. 30--37.Google Scholar
- Mills, C., Bosch, N., Graesser, A. and D'Mello, S. 2014. To Quit or Not to Quit: Predicting Future Behavioral Disengagement from Reading Patterns. Proceedings of the 12th International Conference on Intelligent Tutoring Systems. 19--28. Google ScholarDigital Library
- Min, W., Ha, E.Y., Rowe, J., Mott, B. and Lester, J. 2014. Deep Learning-Based Goal Recognition in Open-Ended Digital Games. Proceedings of the Tenth Annual Conference on Artificial Intelligence and Interactive Digital Entertainment. 37--43. Google ScholarDigital Library
- Min, W., Mott, B., Rowe, J., Liu, B. and Lester, J. 2016. Player Goal Recognition in Open-World Digital Games with Long Short-Term Memory Networks. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. 2590--2596. Google ScholarDigital Library
- Min, W., Mott, B., Rowe, J., Taylor, R., Wiebe, E., Boyer, K. and Lester, J. 2017. Multimodal Goal Recognition in Open-World Digital Games. Proceedings of the Thirteenth Annual AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. 80--86.Google Scholar
- Peterson, J., Pardos, Z., Rau, M., Swigart, A., Gerber, C. and McKinsey, J. 2015. Understanding Student Success in Chemistry Using Gaze Tracking and Pupillometry. Proceedings of the 17th International Conference on Artificial Intelligence in Education. 883.Google ScholarCross Ref
- Piech, C., Spencer, J., Huang, J., Ganguli, S., Sahami, M., Guibas, L. and Sohl-Dickstein, J. 2015. Deep Knowledge Tracing. Advances in Neural Information Processing Systems. 505--513. Google ScholarDigital Library
- Randall, J., Oswald, F. and Beier, M. 2014. Mind-Wandering, Cognition, and Performance: A Theory-Driven Meta-Analysis of Attention Regulation. Psychological Bulletin. 140, 6, 1411--1431.Google ScholarCross Ref
- Raptis, G., Katsini, C., Belk, M., Fidas, C., Samaras, G. and Avouris, N. 2017. Using Eye Gaze Data and Visual Activities to Infer Human Cognitive Styles: Method and Feasibility Studies. Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. 164--173. Google ScholarDigital Library
- Rayner, K. 1998. Eye Movements in Reading and Information Processing: 20 Years of Research. Psychological Bulletin. 124, 3, 372--422.Google ScholarCross Ref
- Rowe, J., Shores, L., Mott, B. and Lester, J. 2011. Integrating Learning, problem Solving, and Engagement in Narrative-Centered Learning Environments. International Journal of Artificial Intelligence in Education. 21, 1--2, 115--133. Google ScholarDigital Library
- Sabourin, J. and Lester, J. 2014. Affect and Engagement in Game-Based Learning Environments. IEEE Transactions on Affective Computing. 5, 1, 45--56.Google ScholarCross Ref
- Sabourin, J., Rowe, J., Mott, B. and Lester, J. 2011. When Off-Task is On-Task: The Affective Role of Off-Task Behavior in Narrative-Centered Learning Environments. Proceedings of the Fifteenth International Conference on Artificial Intelligence in Education., 534--536. Google ScholarDigital Library
- Sabourin, J.L. and Lester, J.C. 2014. Affect and Engagement in Game-Based Learning Environments. IEEE Transactions on Affective Computing. 5, 1, 45--56.Google ScholarCross Ref
- Sawyer, R., Smith, A., Rowe, J., Azevedo, R. and Lester, J. 2017. Enhancing Student Models in Game-based Learning with Facial Expression Recognition. Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, 1--10. Google ScholarDigital Library
- Slanzi, G., Balazs, J.A. and Velásquez, J.D. 2017. Combining eye tracking, pupil dilation and EEG analysis for predicting web users click intention. Information Fusion. 35, 51--57. Google ScholarDigital Library
- Taub, M., Mudrick, N., Azevedo, R., Millar, G., Rowe, J. and Lester, J. 2017. Using multi-channel data with multi-level modeling to assess in-game performance during gameplay with CRYSTAL ISLAND. Computers in Human Behavior. 76, 641--655. Google ScholarDigital Library
- Vail, A., Grafsgaard, J., Boyer, K.E., Wiebe, E. and Lester, J. 2016. Gender Differences in Facial Expressions of Affect During Learning. Proceedings of the Twenty-Fourth Conference on User Modeling, Adaptation, and Personalization. 65--73. Google ScholarDigital Library
- Wiburg, K., Chamberlin, B., Valdez, A., Trujillo, K. and Stanford, T. 2016. Impact of Math Snacks Games on Students' Conceptual Understanding. Journal of Computers in Mathematics and Science Teaching. 35, 2, 173--193.Google Scholar
Index Terms
- Gaze-Enhanced Student Modeling for Game-based Learning
Recommendations
Enhancing Student Models in Game-based Learning with Facial Expression Recognition
UMAP '17: Proceedings of the 25th Conference on User Modeling, Adaptation and PersonalizationRecent years have seen a growing recognition of the role that affect plays in learning. Because game-based learning environments elicit a wide range of student affective states, affect-enhanced student modeling for game-based learning holds considerable ...
Adaptive digital game-based learning framework
DIMEA '07: Proceedings of the 2nd international conference on Digital interactive media in entertainment and artsA common teaching and learning methodology involves one that delivers knowledge to learners within a classroom environment. With the enhancement of information technology, Web-based learning has been promoted as an alternative teaching and learning ...
Scaffolding individual and collaborative game-based learning in learning performance and intrinsic motivation
Although the proponents of game-based learning argue that educational games engage students and afford better learning outcomes, the impact of educational games on motivation and learning performance is still unclear. Research suggested that the ...
Comments