Skip to main content

2018 | OriginalPaper | Buchkapitel

Impact of Tutor Errors on Student Engagement in a Dialog Based Intelligent Tutoring System

verfasst von : Shazia Afzal, Vinay Shashidhar, Renuka Sindhgatta, Bikram Sengupta

Erschienen in: Intelligent Tutoring Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Accurate classification of learner responses is a critical component of dialog based tutoring systems (DBT). Errors in identifying the intent and context of responses can have cascading effects on the ongoing interaction thereby affecting the learning experience and outcome. In this paper we attempt to quantify the impact of Tutor misclassifications on student behavior by analyzing differences across our hypothesized conditions namely, no-misclassification vs. misclassification using various dialog metrics. We find that not only are there significant changes in behavior across the two groups but that Tutor errors related to misunderstanding of Intent - although fewer in occurrence, appear to have a higher impact than a misclassification of a valid student answer. We also see some evidence of the effectiveness of scaffolds like FITBs in sustaining dialog thereby mitigating the effects of a Tutor error.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Baker, R.S.: Modeling and understanding students off-task behavior in intelligent tutoring systems. In: Proceedings of SIGCHI Conference Human Factors, Computing Systems, pp. 1059–1068 (2007) Baker, R.S.: Modeling and understanding students off-task behavior in intelligent tutoring systems. In: Proceedings of SIGCHI Conference Human Factors, Computing Systems, pp. 1059–1068 (2007)
2.
Zurück zum Zitat Beck, J.: Engagement tracing: using response times to model student disengagement. In: Proceedings of 12th International Conference Artificial Intelligence in Education (AIED 2005), pp. 88–95 (2005) Beck, J.: Engagement tracing: using response times to model student disengagement. In: Proceedings of 12th International Conference Artificial Intelligence in Education (AIED 2005), pp. 88–95 (2005)
3.
Zurück zum Zitat Cetintas, S., Si, L., Xin, Y.P., Hord, C.: Automatic detection of off-task behaviors in intelligent tutoring systems with machine learning techniques. IEEE Trans. Learn. Technol. 3(3), 228–236 (2010)CrossRef Cetintas, S., Si, L., Xin, Y.P., Hord, C.: Automatic detection of off-task behaviors in intelligent tutoring systems with machine learning techniques. IEEE Trans. Learn. Technol. 3(3), 228–236 (2010)CrossRef
4.
Zurück zum Zitat Dzikovska, M.O., et al.: SemEval-2013 task 7: the joint student response analysis and 8th recognizing textual entailment challenge. In: The First Joint Conference on Lexical and Computational Semantics, SEM 2013, Atlanta, Georgia, USA, 13–14 June. Association for Computational Linguistics (2013) Dzikovska, M.O., et al.: SemEval-2013 task 7: the joint student response analysis and 8th recognizing textual entailment challenge. In: The First Joint Conference on Lexical and Computational Semantics, SEM 2013, Atlanta, Georgia, USA, 13–14 June. Association for Computational Linguistics (2013)
5.
Zurück zum Zitat Graesser, A.C., Lu, S., Jackson, G.T., Mitchell, H.H., Ventura, M., Olney, A., Louwerse, M.M.: AutoTutor: a tutor with dialogue in natural language. Behav. Res. Methods Instrum. Comput. 36(2), 180–192 (2004)CrossRef Graesser, A.C., Lu, S., Jackson, G.T., Mitchell, H.H., Ventura, M., Olney, A., Louwerse, M.M.: AutoTutor: a tutor with dialogue in natural language. Behav. Res. Methods Instrum. Comput. 36(2), 180–192 (2004)CrossRef
6.
Zurück zum Zitat Ma, W., Adesope, O.O., Nesbit, J.C., Liu, Q.: Intelligent tutoring systems and learning outcomes: a meta-analysis. J. Educ. Psychol. 106(4), 901–918 (2014)CrossRef Ma, W., Adesope, O.O., Nesbit, J.C., Liu, Q.: Intelligent tutoring systems and learning outcomes: a meta-analysis. J. Educ. Psychol. 106(4), 901–918 (2014)CrossRef
7.
Zurück zum Zitat VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ. Psychol. 46, 197–221 (2011)CrossRef VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ. Psychol. 46, 197–221 (2011)CrossRef
Metadaten
Titel
Impact of Tutor Errors on Student Engagement in a Dialog Based Intelligent Tutoring System
verfasst von
Shazia Afzal
Vinay Shashidhar
Renuka Sindhgatta
Bikram Sengupta
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91464-0_26