Skip to main content
Top

2021 | OriginalPaper | Chapter

Evaluating the Impact of Research-Based Updates to an Adaptive Learning System

Authors : Jeffrey Matayoshi, Eric Cosyn, Hasan Uzun

Published in: Artificial Intelligence in Education

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

ALEKS is an adaptive learning system covering subjects such as math, statistics, and chemistry. Several recent studies have looked in detail at various aspects of student knowledge retention and forgetting within the system. Based on these studies, various enhancements were recently made to the ALEKS system with the underlying goal of helping students learn more and advance further. In this work, we describe how the enhancements were informed by these previous research studies, as well as the process of turning the research findings into practical updates to the system. We conclude by analyzing the potential impact of these changes; in particular, after controlling for several variables, we estimate that students using the updated system learned 9% more on average.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Acharya, A., Blackwell, M., Sen, M.: Explaining causal findings without bias: detecting and assessing direct effects. Am. Polit. Sci. Rev. 110(3), 512 (2016)CrossRef Acharya, A., Blackwell, M., Sen, M.: Explaining causal findings without bias: detecting and assessing direct effects. Am. Polit. Sci. Rev. 110(3), 512 (2016)CrossRef
2.
go back to reference Averell, L., Heathcote, A.: The form of the forgetting curve and the fate of memories. J. Math. Psychol. 55, 25–35 (2011)MathSciNetCrossRef Averell, L., Heathcote, A.: The form of the forgetting curve and the fate of memories. J. Math. Psychol. 55, 25–35 (2011)MathSciNetCrossRef
3.
go back to reference Bae, C.L., Therriault, D.J., Redifer, J.L.: Investigating the testing effect: retrieval as a characteristic of effective study strategies. Learn. Instr. 60, 206–214 (2019)CrossRef Bae, C.L., Therriault, D.J., Redifer, J.L.: Investigating the testing effect: retrieval as a characteristic of effective study strategies. Learn. Instr. 60, 206–214 (2019)CrossRef
4.
go back to reference Choffin, B., Popineau, F., Bourda, Y., Vie, J.J.: DAS3H: modeling student learning and forgetting for optimally scheduling distributed practice of skills. In: Proceedings of the 12th International Conference on Educational Data Mining, pp. 29–38 (2019) Choffin, B., Popineau, F., Bourda, Y., Vie, J.J.: DAS3H: modeling student learning and forgetting for optimally scheduling distributed practice of skills. In: Proceedings of the 12th International Conference on Educational Data Mining, pp. 29–38 (2019)
5.
go back to reference Ebbinghaus, H.: Memory: A Contribution to Experimental Psychology. Originally published by Teachers College, Columbia University, New York (1885). Translated by Henry A Ruger and Clara E Bussenius (1913) Ebbinghaus, H.: Memory: A Contribution to Experimental Psychology. Originally published by Teachers College, Columbia University, New York (1885). Translated by Henry A Ruger and Clara E Bussenius (1913)
6.
go back to reference Goetgeluk, S., Vansteelandt, S., Goetghebeur, E.: Estimation of controlled direct effects. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 70(5), 1049–1066 (2008)MathSciNetCrossRef Goetgeluk, S., Vansteelandt, S., Goetghebeur, E.: Estimation of controlled direct effects. J. Roy. Stat. Soc.: Ser. B (Stat. Methodol.) 70(5), 1049–1066 (2008)MathSciNetCrossRef
7.
8.
go back to reference Kang, S.H.: Spaced repetition promotes efficient and effective learning: policy implications for instruction. Policy Insights Behav. Brain Sci. 3(1), 12–19 (2016)CrossRef Kang, S.H.: Spaced repetition promotes efficient and effective learning: policy implications for instruction. Policy Insights Behav. Brain Sci. 3(1), 12–19 (2016)CrossRef
9.
go back to reference Karpicke, J.D., Roediger, H.L.: The critical importance of retrieval for learning. Science 319(5865), 966–968 (2008)CrossRef Karpicke, J.D., Roediger, H.L.: The critical importance of retrieval for learning. Science 319(5865), 966–968 (2008)CrossRef
10.
go back to reference Lindsey, R.V., Shroyer, J.D., Pashler, H., Mozer, M.C.: Improving students long-term knowledge retention through personalized review. Psychol. Sci. 25(3), 639–647 (2014)CrossRef Lindsey, R.V., Shroyer, J.D., Pashler, H., Mozer, M.C.: Improving students long-term knowledge retention through personalized review. Psychol. Sci. 25(3), 639–647 (2014)CrossRef
11.
go back to reference Matayoshi, J., Granziol, U., Doble, C., Uzun, H., Cosyn, E.: Forgetting curves and testing effect in an adaptive learning and assessment system. In: Proceedings of the 11th International Conference on Educational Data Mining, pp. 607–612 (2018) Matayoshi, J., Granziol, U., Doble, C., Uzun, H., Cosyn, E.: Forgetting curves and testing effect in an adaptive learning and assessment system. In: Proceedings of the 11th International Conference on Educational Data Mining, pp. 607–612 (2018)
12.
go back to reference Matayoshi, J., Uzun, H., Cosyn, E.: Deep (un)learning: using neural networks to model retention and forgetting in an adaptive learning system. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds.) AIED 2019. LNCS (LNAI), vol. 11625, pp. 258–269. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23204-7_22CrossRef Matayoshi, J., Uzun, H., Cosyn, E.: Deep (un)learning: using neural networks to model retention and forgetting in an adaptive learning system. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds.) AIED 2019. LNCS (LNAI), vol. 11625, pp. 258–269. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-23204-7_​22CrossRef
13.
go back to reference Matayoshi, J., Uzun, H., Cosyn, E.: Studying retrieval practice in an intelligent tutoring system. In: Proceedings of the Seventh ACM Conference on Learning @ Scale, pp. 51–62 (2020) Matayoshi, J., Uzun, H., Cosyn, E.: Studying retrieval practice in an intelligent tutoring system. In: Proceedings of the Seventh ACM Conference on Learning @ Scale, pp. 51–62 (2020)
15.
go back to reference Pavlik, P.I., Anderson, J.R.: Using a model to compute the optimal schedule of practice. J. Exp. Psychol. Appl. 14(2), 101 (2008)CrossRef Pavlik, P.I., Anderson, J.R.: Using a model to compute the optimal schedule of practice. J. Exp. Psychol. Appl. 14(2), 101 (2008)CrossRef
16.
go back to reference Qiu, Y., Qi, Y., Lu, H., Pardos, Z.A., Heffernan, N.T.: Does time matter? Modeling the effect of time with Bayesian knowledge tracing. In: Proceedings of the 4th International Conference on Educational Data Mining, pp. 139–148 (2011) Qiu, Y., Qi, Y., Lu, H., Pardos, Z.A., Heffernan, N.T.: Does time matter? Modeling the effect of time with Bayesian knowledge tracing. In: Proceedings of the 4th International Conference on Educational Data Mining, pp. 139–148 (2011)
17.
go back to reference Roediger III, H.L., Butler, A.C.: The critical role of retrieval practice in long-term retention. Trends Cogn. Sci. 15, 20–27 (2011)CrossRef Roediger III, H.L., Butler, A.C.: The critical role of retrieval practice in long-term retention. Trends Cogn. Sci. 15, 20–27 (2011)CrossRef
18.
go back to reference Roediger III, H.L., Karpicke, J.D.: The power of testing memory: basic research and implications for educational practice. Perspect. Psychol. Sci. 1(3), 181–210 (2006)CrossRef Roediger III, H.L., Karpicke, J.D.: The power of testing memory: basic research and implications for educational practice. Perspect. Psychol. Sci. 1(3), 181–210 (2006)CrossRef
19.
go back to reference Roediger III, H.L., Karpicke, J.D.: Test-enhanced learning: taking memory tests improves long-term retention. Psychol. Sci. 17(3), 249–255 (2006)CrossRef Roediger III, H.L., Karpicke, J.D.: Test-enhanced learning: taking memory tests improves long-term retention. Psychol. Sci. 17(3), 249–255 (2006)CrossRef
20.
go back to reference Seabold, S., Perktold, J.: Statsmodels: econometric and statistical modeling with Python. In: 9th Python in Science Conference (2010) Seabold, S., Perktold, J.: Statsmodels: econometric and statistical modeling with Python. In: 9th Python in Science Conference (2010)
21.
go back to reference Settles, B., Meeder, B.: A trainable spaced repetition model for language learning. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1848–1858 (2016) Settles, B., Meeder, B.: A trainable spaced repetition model for language learning. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1848–1858 (2016)
22.
go back to reference Tabibian, B., Upadhyay, U., De, A., Zarezade, A., Schölkopf, B., Gomez-Rodriguez, M.: Enhancing human learning via spaced repetition optimization. Proc. Natl. Acad. Sci. 116(10), 3988–3993 (2019)MathSciNetCrossRef Tabibian, B., Upadhyay, U., De, A., Zarezade, A., Schölkopf, B., Gomez-Rodriguez, M.: Enhancing human learning via spaced repetition optimization. Proc. Natl. Acad. Sci. 116(10), 3988–3993 (2019)MathSciNetCrossRef
23.
go back to reference Vansteelandt, S.: Estimating direct effects in cohort and case-control studies. Epidemiology 851–860 (2009) Vansteelandt, S.: Estimating direct effects in cohort and case-control studies. Epidemiology 851–860 (2009)
24.
go back to reference Vansteelandt, S., et al.: On the adjustment for covariates in genetic association analysis: a novel, simple principle to infer direct causal effects. Genet. Epidemiol.: Off. Publ. Int. Genet. Epidemiol. Soc. 33(5), 394–405 (2009)CrossRef Vansteelandt, S., et al.: On the adjustment for covariates in genetic association analysis: a novel, simple principle to infer direct causal effects. Genet. Epidemiol.: Off. Publ. Int. Genet. Epidemiol. Soc. 33(5), 394–405 (2009)CrossRef
25.
go back to reference Wang, Y., Heffernan, N.T.: Towards modeling forgetting and relearning in ITS: preliminary analysis of ARRS data. In: Proceedings of the 4th International Conference on Educational Data Mining, pp. 351–352 (2011) Wang, Y., Heffernan, N.T.: Towards modeling forgetting and relearning in ITS: preliminary analysis of ARRS data. In: Proceedings of the 4th International Conference on Educational Data Mining, pp. 351–352 (2011)
27.
go back to reference Xiong, X., Wang, Y., Beck, J.B.: Improving students’ long-term retention performance: a study on personalized retention schedules. In: Proceedings of the Fifth International Conference on Learning Analytics And Knowledge, pp. 325–329. ACM (2015) Xiong, X., Wang, Y., Beck, J.B.: Improving students’ long-term retention performance: a study on personalized retention schedules. In: Proceedings of the Fifth International Conference on Learning Analytics And Knowledge, pp. 325–329. ACM (2015)
Metadata
Title
Evaluating the Impact of Research-Based Updates to an Adaptive Learning System
Authors
Jeffrey Matayoshi
Eric Cosyn
Hasan Uzun
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-78270-2_80

Premium Partner