Skip to main content
Erschienen in: Education and Information Technologies 1/2014

01.03.2014

CAT model with personalized algorithm for evaluation of estimated student knowledge

verfasst von: Svetlana Andjelic, Zoran Cekerevac

Erschienen in: Education and Information Technologies | Ausgabe 1/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This article presents the original model of the computer adaptive testing and grade formation, based on scientifically recognized theories. The base of the model is a personalized algorithm for selection of questions depending on the accuracy of the answer to the previous question. The test is divided into three basic levels of difficulty, and the student automatically goes from one level to another according to the current level of the knowledge that he shows. Such examination creates an image to the student that the test was set up just for his level of knowledge. On the basis of responses, by applying Bayes’ theorem and the Maximum a posteriori approach, the evaluation grade is formed. In fact, based on empirical probability values, which correlate with obtaining of a certain final grade and the accuracy of answers to each question individually, model creates a score that corresponds to the current level of student’s knowledge. After each test answer, the empirical probability value is updated. That further contributes to the statistical stability of the evaluation model. Testing stops when the student answers the minimum number of questions, determined by a teacher, or, when evaluations show a clear convergence towards a single value. The research method and some results of the testing of the hypotheses as well as authors’ conclusions about CAT as a tool for evaluation of students are presented at the end of the article.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
One logit is equivalent to the difficulty coefficient of 0.73, or 73 % probability of the correct answers
 
Literatur
Zurück zum Zitat Andjelic, S. (2010). A supplement to objective evaluation of student work using computer adaptive testing, PhD thesis, Defended 10/08/2010, Faculty of Industrial Managment, Union University, Belgrade, Serba. Andjelic, S. (2010). A supplement to objective evaluation of student work using computer adaptive testing, PhD thesis, Defended 10/08/2010, Faculty of Industrial Managment, Union University, Belgrade, Serba.
Zurück zum Zitat Bugbee, A. C., & Bernt, F. M. (1990). Testing by computer: findings in six years of use 1982–1988. Journal of Research on Computing in Education, 23(1), 87–100. Publisher: International Association for Computing in Education Washington, DC, USA. Bugbee, A. C., & Bernt, F. M. (1990). Testing by computer: findings in six years of use 1982–1988. Journal of Research on Computing in Education, 23(1), 87–100. Publisher: International Association for Computing in Education Washington, DC, USA.
Zurück zum Zitat Dawson, B., & Trapp, R. G. (2004). Basic & clinical biostatistics (4th ed.). New York: McGraw-Hill Professional. ISBN 0-0714-1017-1. Dawson, B., & Trapp, R. G. (2004). Basic & clinical biostatistics (4th ed.). New York: McGraw-Hill Professional. ISBN 0-0714-1017-1.
Zurück zum Zitat Guzmán, E., Conejo, R., & Pérez-de-la-Cruz, J.-L. (2007). Adaptive testing for hierarchical student models. User Modeling and User-Adapted Interaction, 17(1–2), 119–157. doi:10.1007/s11257-006-9018-1.CrossRef Guzmán, E., Conejo, R., & Pérez-de-la-Cruz, J.-L. (2007). Adaptive testing for hierarchical student models. User Modeling and User-Adapted Interaction, 17(1–2), 119–157. doi:10.​1007/​s11257-006-9018-1.CrossRef
Zurück zum Zitat Linacre, J. M. (2000). Computer-adaptive testing: A methodology whose time has come. MESA Memorandum No. 69. Seoul: Komesa Press. http://www.rasch.org/memo69.pdf. Accessed 21 March 2012. Linacre, J. M. (2000). Computer-adaptive testing: A methodology whose time has come. MESA Memorandum No. 69. Seoul: Komesa Press. http://​www.​rasch.​org/​memo69.​pdf.​ Accessed 21 March 2012.
Zurück zum Zitat Meijer, R. R., & van Krimpen-Stoop, E. M. (2010). Detecting person misfit in adaptive testing. Elements of Adaptive Testing Statistics for Social and Behavioral Sciences, Part 4, 315–329. doi:10.1007/978-0-387-85461-8_16. Meijer, R. R., & van Krimpen-Stoop, E. M. (2010). Detecting person misfit in adaptive testing. Elements of Adaptive Testing Statistics for Social and Behavioral Sciences, Part 4, 315–329. doi:10.​1007/​978-0-387-85461-8_​16.
Zurück zum Zitat Roobaert, D., Karakoulas, G., & Chawla, N. V. (2006). Information gain, correlation and support vector machines. Feature extraction. Studies in Fuzziness and Soft Computing, 207/2006, 463–470. doi:10.1007/978-3-540-35488-8_23.CrossRef Roobaert, D., Karakoulas, G., & Chawla, N. V. (2006). Information gain, correlation and support vector machines. Feature extraction. Studies in Fuzziness and Soft Computing, 207/2006, 463–470. doi:10.​1007/​978-3-540-35488-8_​23.CrossRef
Zurück zum Zitat Sympson, B.J., & Hetter, R. D. (1985). Controlling item-exposure rates in computerized adaptive testing. Paper presented at the annual conference of the Military Testing Association, San Diego, USA, CA: Navy Personnel Research and Development Center. Sympson, B.J., & Hetter, R. D. (1985). Controlling item-exposure rates in computerized adaptive testing. Paper presented at the annual conference of the Military Testing Association, San Diego, USA, CA: Navy Personnel Research and Development Center.
Zurück zum Zitat Thissen, D., & Mislevy, R. J. (2000). Testing algorithms. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2nd ed., pp. 101–134). Mahwah: Lawrence Erlbaum Associates. ISBN 0-8058-3511-3. Thissen, D., & Mislevy, R. J. (2000). Testing algorithms. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2nd ed., pp. 101–134). Mahwah: Lawrence Erlbaum Associates. ISBN 0-8058-3511-3.
Zurück zum Zitat van der Linden, W. J. (2010). Constrained adaptive testing with shadow tests. Elements of Adaptive Tesing, Statistics for Social and Behavioral Sciences, Part 1, 31–55. doi:10.1007/978-0-387-85461-8_2. van der Linden, W. J. (2010). Constrained adaptive testing with shadow tests. Elements of Adaptive Tesing, Statistics for Social and Behavioral Sciences, Part 1, 31–55. doi:10.​1007/​978-0-387-85461-8_​2.
Zurück zum Zitat Wainer, H., & Mislevy, R. J. (2000). Item response theory. Calibration and estimation. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2nd ed., pp. 61–99). Mahwah: Lawrence Erlbaum Associates. ISBN 0-8058-3511-3. Wainer, H., & Mislevy, R. J. (2000). Item response theory. Calibration and estimation. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2nd ed., pp. 61–99). Mahwah: Lawrence Erlbaum Associates. ISBN 0-8058-3511-3.
Zurück zum Zitat Walter, O., Becker, J., Bjorner, J., Fliege, H., Klapp, B., & Rose, M. (2007). Development and evaluation of a computer adaptive test for ‘Anxiety’ (Anxiety-CAT). Quality of Life Research, 16(Supplement 1), 143–155. doi:10.1007/s11136-007-9191-7.CrossRef Walter, O., Becker, J., Bjorner, J., Fliege, H., Klapp, B., & Rose, M. (2007). Development and evaluation of a computer adaptive test for ‘Anxiety’ (Anxiety-CAT). Quality of Life Research, 16(Supplement 1), 143–155. doi:10.​1007/​s11136-007-9191-7.CrossRef
Zurück zum Zitat Zenisky, A., Hambleton, R. K., & Luecht, R. M. (2010). Multistage testing: issues, designs, and research. Elements of Adaptive Testing Statistics for Social and Behavioral Sciences, Part 5, 355–372. doi:10.1007/978-0-387-85461-8_18. Zenisky, A., Hambleton, R. K., & Luecht, R. M. (2010). Multistage testing: issues, designs, and research. Elements of Adaptive Testing Statistics for Social and Behavioral Sciences, Part 5, 355–372. doi:10.​1007/​978-0-387-85461-8_​18.
Metadaten
Titel
CAT model with personalized algorithm for evaluation of estimated student knowledge
verfasst von
Svetlana Andjelic
Zoran Cekerevac
Publikationsdatum
01.03.2014
Verlag
Springer US
Erschienen in
Education and Information Technologies / Ausgabe 1/2014
Print ISSN: 1360-2357
Elektronische ISSN: 1573-7608
DOI
https://doi.org/10.1007/s10639-012-9208-x

Weitere Artikel der Ausgabe 1/2014

Education and Information Technologies 1/2014 Zur Ausgabe

Premium Partner