Skip to main content

2019 | OriginalPaper | Buchkapitel

Intelligent On-line Exam Management and Evaluation System

verfasst von : Tsegaye Misikir Tashu, Julius P. Esclamado, Tomas Horvath

Erschienen in: Intelligent Tutoring Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Educational assessment plays a central role in the teaching-learning process as a tool for evaluating students’ knowledge of the concepts associated with the learning objectives. The evaluation and scoring of essay answers is a process, besides being costly in terms of time spent by teachers, what may lead to inequities due to the difficulty in applying the same evaluation criteria to all answers. In this work, we present a system for online essay exam evaluation and scoring which is composed of different modules and helps teachers in creating, evaluating and giving textual feedbacks on essay exam solutions provided by students. The system automatically scores essays, semantically, using pair-wise approach. Using the system, the teacher can also give an unlimited number of textual feedbacks by selecting a phrase, a sentence or a paragraph on a given student’s essay. We performed a survey to assess the usability of the system with regard to the time saved during grading, an overall level of satisfaction, fairness in grading and simplification of essay evaluation. Around 80% of the users responded that the system helps them to grade essays more fairly and easily.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
The developed system is not intended to serve as a learning management system (e.g. Moodle) but, rather, as an e-Testing framework. However, we have implemented this ability to upload course materials for teachers not using any other system.
 
Literatur
1.
Zurück zum Zitat Leckie, G., Baird, J.-A.: Rater effects on essay scoring: a multilevel analysis of severity drift, central tendency, and rater experience. J. Educ. Meas. 48, 399–418 (2011)CrossRef Leckie, G., Baird, J.-A.: Rater effects on essay scoring: a multilevel analysis of severity drift, central tendency, and rater experience. J. Educ. Meas. 48, 399–418 (2011)CrossRef
2.
Zurück zum Zitat Kaya, B.Y., Kaya, G., Dagdeviren, M.: A sample application of web based examination system for distance and formal education. Procedia - Soc. Behav. Sci. 141, 1357–1362 (2014)CrossRef Kaya, B.Y., Kaya, G., Dagdeviren, M.: A sample application of web based examination system for distance and formal education. Procedia - Soc. Behav. Sci. 141, 1357–1362 (2014)CrossRef
3.
Zurück zum Zitat Yağci, M., Ünal, M.: Designing and implementing an adaptive online examination system. Procedia - Soc. Behav. Sci. 116, 3079–3083 (2014)CrossRef Yağci, M., Ünal, M.: Designing and implementing an adaptive online examination system. Procedia - Soc. Behav. Sci. 116, 3079–3083 (2014)CrossRef
4.
Zurück zum Zitat Tashu, T.M., Horvath, T.: Pair-wise: automatic essay evaluation using word mover’s distance. In: The 10th International Conference on Computer Supported Education - Volume 2: CSEDU, pp. 59–66. SciTePress (2018) Tashu, T.M., Horvath, T.: Pair-wise: automatic essay evaluation using word mover’s distance. In: The 10th International Conference on Computer Supported Education - Volume 2: CSEDU, pp. 59–66. SciTePress (2018)
5.
Zurück zum Zitat Attali, Y.: A differential word use measure for content analysis in automated essay scoring. ETS Res. Rep. Ser. 36, 1–19 (2011) Attali, Y.: A differential word use measure for content analysis in automated essay scoring. ETS Res. Rep. Ser. 36, 1–19 (2011)
6.
Zurück zum Zitat Page, E.B.: Grading essays by computer: progress report. In: Invitational Conference on Testing Problems (1966) Page, E.B.: Grading essays by computer: progress report. In: Invitational Conference on Testing Problems (1966)
7.
Zurück zum Zitat Thomas, P., Haley, D., deRoeck, A., Petre, M.: e-Assessment using latent semantic analysis in the computer science domain: a pilot study. In: Proceedings of the Workshop on eLearning for Computational Linguistics and Computational Linguistics for eLearning, pp. 38–44. ACL (2004) Thomas, P., Haley, D., deRoeck, A., Petre, M.: e-Assessment using latent semantic analysis in the computer science domain: a pilot study. In: Proceedings of the Workshop on eLearning for Computational Linguistics and Computational Linguistics for eLearning, pp. 38–44. ACL (2004)
8.
Zurück zum Zitat Foltz, P.W., Laham, D., Landauer, T.K.: Automated essay scoring : applications to educational technology. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-MEDIA) (1999) Foltz, P.W., Laham, D., Landauer, T.K.: Automated essay scoring : applications to educational technology. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-MEDIA) (1999)
9.
Zurück zum Zitat Kusner, M.J., Sun, Y., Kolkin, N.I., Weinberger, K.Q.: From word embeddings to document distances. In: International Conference on Machine Learning (2015) Kusner, M.J., Sun, Y., Kolkin, N.I., Weinberger, K.Q.: From word embeddings to document distances. In: International Conference on Machine Learning (2015)
10.
Zurück zum Zitat Mikolov, T., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositions. In: NIPS (2013) Mikolov, T., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositions. In: NIPS (2013)
Metadaten
Titel
Intelligent On-line Exam Management and Evaluation System
verfasst von
Tsegaye Misikir Tashu
Julius P. Esclamado
Tomas Horvath
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-22244-4_14