Top

Education and Information Technologies

Published in:

18-03-2020

Predicting school performance and early risk of failure from an intelligent tutoring system

Authors: Mithun Haridas, Georg Gutjahr, Raghu Raman, Rudraraju Ramaraju, Prema Nedungadi

Published in: Education and Information Technologies | Issue 5/2020

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In many rural Indian schools, English is a second language for teachers and students. Intelligent tutoring systems have good potential because they enable students to learn at their own pace, in an exploratory manner. This paper describes a 3-year longitudinal study of 2123 Indian students who used the intelligent tutoring system, AmritaITS. The aim of the study was to use the students’ interaction logs with AmritaITS to: (1) predict student performance, in English and Mathematics subjects, via summative and formative assessments, (2) predict students who may be at risk of failing the final examination and (3) screen students who may have reading difficulties. The prediction models for summative assessments were significantly improved by formative assessments scores, along with AmritaITS logs. The receiver operating characteristic (ROC) curve showed that students at risk of failing a class could be identified early, with high sensitivity and specificity. The models also provide recommendations for the amount of time required for students to use the system, and reach the appropriate grade level. Finally, the models demonstrated promise in identifying students who might be at risk of suffering from reading difficulties.

previous article Students’ interaction patterns in different online learning activities and their relationship with motivation, self-regulated learning strategy and learning performance

next article The educational technologist as a variety-handler

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Anozie, N., & Junker, B. W. (2006). Predicting end-of-year accountability assessment scores from monthly student records in an online tutoring system. American Association for Artificial Intelligence Workshop on Educational Data Mining (AAAI-06). Doi: WS-06-05/WS06-05-001.

Ayers, E., & Junker, B. (2008). IRT modeling of tutor performance to predict end-of-year exam scores. Educational and Psychological Measurement. https://doi.org/10.1177/0013164408318758.

Bates, D., Maechler, M., & Bolker, B. (2013). lme4: Linear mixed-effects models using S4 classes. R package version 1.1-7. Doi:Citeulike-article-id:1080437.

Bischl, B., Lang, M., Kotthoff, L., Schiffner, J., Richter, J., Studerus, E., et al. (2016). Mlr: Machine learning in R. The Journal of Machine Learning Research.

Carroll, J. M., Solity, J., & Shapiro, L. R. (2016). Predicting dyslexia using prereading skills: The role of sensorimotor and cognitive abilities. Journal of Child Psychology and Psychiatry, and Allied Disciplines. https://doi.org/10.1111/jcpp.12488.

Cleveland, W. S., & Loader, C. (2012). Smoothing by local Regression: Principles and Methods. https://doi.org/10.1007/978-3-642-48425-4_2.

Conati, C. (2009). Intelligent tutoring systems: New challenges and directions. In IJCAI International Joint Conference on Artificial Intelligence.

Corbett, A. T., & Bhatnagar, A. (1997). Student modeling in the ACT programming Tutor: Adjusting a Procedural Learning Model With Declarative Knowledge. In User Modeling. https://doi.org/10.1007/978-3-7091-2670-7_25.

Cox P. (2011). Comparisons of selected benchmark testing methodologies as predictors of Virginia standards of learning test scores. Virginia Polytechnic Institute.

Dormann, C. F., Elith, J., Bacher, S., Buchmann, C., Carl, G., Carré, G., et al. (2013). Collinearity: A review of methods to deal with it and a simulation study evaluating their performance. Ecography. https://doi.org/10.1111/j.1600-0587.2012.07348.x.

Elsom-Cook, M. (1993). Student modelling in intelligent tutoring systems. Artificial Intelligence Review, 7, 227–240. https://doi.org/10.1007/BF00849556.CrossRef

Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters. https://doi.org/10.1016/j.patrec.2005.10.010.

Feng, M., Heffernan, N. T., & Koedinger, K. R. (2006). Predicting state test scores better with intelligent tutoring Systems: Developing Metrics to Measure Assistance Required. https://doi.org/10.1007/11774303_4.

Feng, M., Heffernan, N. T., Heffernan, C., & Mani, M. (2009a). Using mixed-effects modeling to analyze different grain-sized skill models in an intelligent tutoring system. In IEEE Transactions on Learning Technologies. https://doi.org/10.1109/TLT.2009.17.

Feng, M., Heffernan, N., & Koedinger, K. (2009b). Addressing the assessment challenge with an online system that tutors as it assesses. User Modeling and User-Adapted Interaction. https://doi.org/10.1007/s11257-009-9063-7.

Gaggi, O., Galiazzo, G., Palazzi, C., Facoetti, A., & Franceschini, S. (2012). A serious game for predicting the risk of developmental dyslexia in pre-readers children. In 2012 21st International Conference on Computer Communications and Networks, ICCCN 2012 - Proceedings. https://doi.org/10.1109/ICCCN.2012.6289249.

Gutjahr, G., Menon, K., & Nedungadi, P. (2017). Using an intelligent tutoring system to predict mathematics and English assessments (pp. 135–140). https://doi.org/10.1109/MITE.2017.00030.

Hastie, T., Tibshirani, R., Friedman, J. (2009). The elements of statistical learning the elements of statistical LearningData mining, inference, and prediction, Second Edition. Book. https://doi.org/10.1007/978-0-387-84858-7.

Heffernan, N. T., & Heffernan, C. L. (2014). The ASSISTments ecosystem: Building a platform that brings scientists and teachers together for minimally invasive research on human learning and teaching. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-014-0024-x.

Kamala, R., & Ramganesh, E. (2015). Difficulties in identifying the dyslexics in multilingual context. International Journal of Humanities and Social Science Invention, 4.

Kohli, A., Samita, S., & Padhy, S. K. (2018). Specific learning disabilities: Issues that remain unanswered. Indian Journal of Psychological Medicine, 40(5), 399–405.CrossRef

Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of intelligent tutoring Systems: A Meta-Analytic Review. REVIEW OF EDUCATIONAL RESEARCH. https://doi.org/10.3102/0034654315581420.

Lunardon, N., Menardi, G., & Torelli, N. (2014). {ROSE}: A {P}ackage for {B}inary {I}mbalanced {L}earning. {R} Journal, 6(1), 82–92.

Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology. https://doi.org/10.1037/a0037123.

Mandal, P. K. (2010). Towards positing a paradigm for continuous and comprehensive evaluation in social sciences. Journal of Indian Education, 36, 43–52.

Nedungadi, P. (2015). Framework and models for personalized formative evaluation in adaptive learning systems. Amrita Vishwa Vidyapeetham University.

Nedungadi, P., & Raman, R. (2012). A new approach to personalization: Integrating e-learning and m-learning. Educational Technology Research and Development, 60, 659–678. https://doi.org/10.1007/s11423-012-9250-9.CrossRef

Nedungadi, P., & Remya, M. S. (2015). Incorporating forgetting in the personalized, clustered, Bayesian knowledge tracing (PC-BKT) model. In Proceedings - 2015 International Conference on Cognitive Computing and Information Processing, CCIP 2015. https://doi.org/10.1109/CCIP.2015.7100688.

Pardos, Z., Baker, R., Pedro, M. S., Gowda, S. M., & Gowda, S. M. (2014). Affective states and state tests: Investigating how affect and engagement during the school year predict end-of-year learning outcomes. Journal of Learning Analytics.

Rahman, M. M., & Davis, D. N. (2013). Addressing the class imbalance problem in medical datasets. International Journal of Machine Learning and Computing. https://doi.org/10.7763/ijmlc.2013.v3.307.

Raman, R., & Nedungadi, P. (2010). Adaptive learning methodologies to support reforms in Continuous formative Evaluation. In ICEIT 2010–2010 International Conference on Educational and Information Technology, Proceedings. https://doi.org/10.1109/ICEIT.2010.5607608.

Rello, L., Ballesteros, M., Alarcón Sánchez, D., Serra, M., Ali, A., & Bigham, J. P. (2016). Dytective: Diagnosing risk of dyslexia with a game. ACM. https://doi.org/10.4108/eai.16-5-2016.2263338.

Ritter, S., Joshi, A., Fancsali, S. E., & Nixon, T. (2013). Predicting standardized test scores from cognitive tutor interactions. In Proceedings of the 6th International Conference on Educational Data Mining.

Shaywitz, S. (2003). Overcoming dyslexia: A new and complete science-based program for reading problems at any level. New York: Knopf.

Singer, J. D., & Willett, J. B. (2009). Applied longitudinal data analysis. Applied Longitudinal Data Analysis. https://doi.org/10.1093/acprof:oso/9780195152968.001.0001.

Singleton, C., & Horne, J. (2004). The development and validity of Lucid Adult Dyslexia Screening (LADS). https://pdfs.semanticscholar.org/b2c5/d0de03b8e0c8dfc6d6bb1643fd5c8c4947c0.pdf

Sood, M. R., Toornstra, A., Sereno, M. I., Boland, M., Filaretti, D., & Sood, A. (2018). A Digital App to Aid Detection, Monitoring, and Management of Dyslexia in Young Children (DIMMAND): Protocol for a Digital Health and Education Solution. JMIR Research Protocols, 7(5), e135. https://doi.org/10.2196/resprot.9583.CrossRef

Trivedi, S., Pardos, Z. A., & Heffernan, N. T. (2011). Clustering students to generate an ensemble to improve standard test score predictions. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). https://doi.org/10.1007/978-3-642-21869-9_49.

VanLehn, K. (2006). The behavior of tutoring systems. International Journal of Artifical Intelligence in Education.

Venables, W. N., & Ripley, B. D. (2002). Modern applied statistics with S fourth edition. World. https://doi.org/10.2307/2685660.

Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. New York: Springer-Verlag http://ggplot2.org.CrossRef

Zhang, N., & Henderson, C. N. R. (2014). Can formative quizzes predict or improve summative exam performance?*. Journal of Chiropractic Education. https://doi.org/10.7899/jce-14-12.

Title: Predicting school performance and early risk of failure from an intelligent tutoring system
Authors: Mithun Haridas
Georg Gutjahr
Raghu Raman
Rudraraju Ramaraju
Prema Nedungadi
Publication date: 18-03-2020
Publisher: Springer US
Published in: Education and Information Technologies / Issue 5/2020
Print ISSN: 1360-2357
Electronic ISSN: 1573-7608
DOI: https://doi.org/10.1007/s10639-020-10144-0

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 5/2020

Editorial for EAIT issue 5, 2020

An account of EFL learners’ self-efficacy and gender in the Flipped Classroom Model

Relationship between motivations, personality traits and intention to continue using MOOCs

Participatory design of persuasive technology in a blended learning course: A qualitative study

Exploring the effect of computer-mediated teacher feedback on the writing achievement of Iranian EFL learners: Does motivation count?

Determinants of learning management systems adoption in Nigeria: A hybrid SEM and artificial neural network approach

Premium Partner