Skip to main content

2020 | OriginalPaper | Buchkapitel

CLASS-O, A Cooperative Language Assessment System with Ontology

verfasst von : Chakkrit Snae Namahoot, Michael Brückner, Chayan Nuntawong

Erschienen in: Cooperative Design, Visualization, and Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper describes the design, development and test of a novel Computerized Adaptive Testing (CAT) system for English language based on a testing process using features of Item Response Theory and an Ontology of English Language (ELO). The testing process employs a variable branching procedure to deliver the best next test item to the examinee based on the ability level shown so far. The formative assessment part is based on ELO, which acts as knowledge base for giving efficient and detailed feedback to the examinee. The summative part of the feedback consists of the percentage of correct answers regarding the three sections covered in the test: vocabulary, reading comprehension, and structure. It includes the proficiency level and places examinees into one of three groups: high, medium and low proficiency. After the test has terminated, each examinee contributes to a new version of the item bank by feeding back the individual response parameters, which refines item data for subsequent tests.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sadler, D.R.: Beyond feedback: Developing student capability in complex appraisal. Assessment Eval. High. Educ. 35, 535–550 (2010) Sadler, D.R.: Beyond feedback: Developing student capability in complex appraisal. Assessment Eval. High. Educ. 35, 535–550 (2010)
2.
Zurück zum Zitat Hepplestone, S., Holden, G., Irwin, B., Parkin, H.J., Thorpe, L.: Using technology to encourage student engagement with feedback: a literature review. Res. Learn. Technol. 19(2), 117–127 (2011) Hepplestone, S., Holden, G., Irwin, B., Parkin, H.J., Thorpe, L.: Using technology to encourage student engagement with feedback: a literature review. Res. Learn. Technol. 19(2), 117–127 (2011)
3.
Zurück zum Zitat Evans, G.E., Allen, G., Bender, T., Cluett, W.: We never talk: peer to peer observation and formative feedback as steps to evolving academic culture. In: Proceedings 2017 Canadian Engineering Education Association (CEEA 2017), Paper 174 (2017) Evans, G.E., Allen, G., Bender, T., Cluett, W.: We never talk: peer to peer observation and formative feedback as steps to evolving academic culture. In: Proceedings 2017 Canadian Engineering Education Association (CEEA 2017), Paper 174 (2017)
4.
Zurück zum Zitat Vawter, L., Martens, A.: Categorizing software feedback in current language software. In: 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), pp. 258–260 (2019) Vawter, L., Martens, A.: Categorizing software feedback in current language software. In: 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), pp. 258–260 (2019)
6.
Zurück zum Zitat Rietsche, R., Duss, K., Persch, J.M., Söllner, M.: Design and Evaluation of an IT-based Formative Feedback Tool to Foster Student Performance. In: 39th International Conference on Information Systems, San Francisco, pp. 1–17 (2018) Rietsche, R., Duss, K., Persch, J.M., Söllner, M.: Design and Evaluation of an IT-based Formative Feedback Tool to Foster Student Performance. In: 39th International Conference on Information Systems, San Francisco, pp. 1–17 (2018)
7.
Zurück zum Zitat Van Groen, M.M., Eggen, T.J.H.M.: Educational test approaches: the suitability of computer-based test types for assessment and evaluation in formative and summative contexts. J. Appl. Test. Technol. 21(1), 12–24 (2020) Van Groen, M.M., Eggen, T.J.H.M.: Educational test approaches: the suitability of computer-based test types for assessment and evaluation in formative and summative contexts. J. Appl. Test. Technol. 21(1), 12–24 (2020)
8.
Zurück zum Zitat Hambleton, R.K., Swaminathan, H., Rogers, H.J.: Fundamentals of Item Response Theory. SAGE Publications, Newbury Park, C.A. (1991) Hambleton, R.K., Swaminathan, H., Rogers, H.J.: Fundamentals of Item Response Theory. SAGE Publications, Newbury Park, C.A. (1991)
9.
Zurück zum Zitat de Ayala, R.J.: The Theory and Practice of Item Response Theory, 2nd edn. Guilford Publications, New York (2008) de Ayala, R.J.: The Theory and Practice of Item Response Theory, 2nd edn. Guilford Publications, New York (2008)
10.
Zurück zum Zitat Schalley, A.C.: Ontologies and ontological methods in linguistics. Lang. Linguist. Compass 13(11), 1–19 (2019) Schalley, A.C.: Ontologies and ontological methods in linguistics. Lang. Linguist. Compass 13(11), 1–19 (2019)
12.
Zurück zum Zitat Weiss, D.J.: Strategics of adaptive ability measurement. University of Minnoseta, Mineapolis (1974) Weiss, D.J.: Strategics of adaptive ability measurement. University of Minnoseta, Mineapolis (1974)
13.
Zurück zum Zitat Lord, F.M.: A theoretical study of the measurement effectiveness of flexilevel test. Educ. Psychol. Meas. 31, 805–813 (1971) Lord, F.M.: A theoretical study of the measurement effectiveness of flexilevel test. Educ. Psychol. Meas. 31, 805–813 (1971)
14.
Zurück zum Zitat Urry, V.W.: Tailored testing: A successful application of latent trait theory. J. Educ. Meas. 14, 181–196 (1977) Urry, V.W.: Tailored testing: A successful application of latent trait theory. J. Educ. Meas. 14, 181–196 (1977)
15.
Zurück zum Zitat Reckase, M.D.: An interactive computer program for tailored testing based on the one-parameter logistic model. Behav. Res. Methods Instrum. 6, 208–212 (1974) Reckase, M.D.: An interactive computer program for tailored testing based on the one-parameter logistic model. Behav. Res. Methods Instrum. 6, 208–212 (1974)
16.
Zurück zum Zitat O’Sullivan, B.: Language Testing: Theories and Practices. Palgrave Macmillan, UK (2011) O’Sullivan, B.: Language Testing: Theories and Practices. Palgrave Macmillan, UK (2011)
Metadaten
Titel
CLASS-O, A Cooperative Language Assessment System with Ontology
verfasst von
Chakkrit Snae Namahoot
Michael Brückner
Chayan Nuntawong
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-60816-3_19

Neuer Inhalt