Skip to main content
Erschienen in: Soft Computing 13/2018

17.08.2017 | Focus

Automatic scoring system for short descriptive answer written in Korean using lexico-semantic pattern

verfasst von: Jeong-Eun Kim, Kinam Park, Jeong-Min Chae, Hong-Jun Jang, Byoung-Wook Kim, Soon-Young Jung

Erschienen in: Soft Computing | Ausgabe 13/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The researches on the automatic scoring system for English descriptive answers have been actively performed, but there are not so many researches on the automatic scoring system for Korean descriptive answers. In this paper, we propose an scoring method based on lexico-semantic pattern (LSP), which is known to be a good solution for the morphologically rich Korean language. In the proposed method, postposition information is utilized as an important tool for finding the meaning differences in Korean. In addition to using LSP, we also applied a synonym dictionary as a meaning extension approach to improve recall performance in scoring student’s answer. Our experimental result shows that the proposed system performs better than the existing noun-keyword-based system by 0.137. Also, the best performance could be obtained by using a synonym dictionary.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Burrows S, Gurevych I, Stein B (2015) The eras and trends of automatic short answer grading. Int J Artif Intell Educ 25(1):60–117CrossRef Burrows S, Gurevych I, Stein B (2015) The eras and trends of automatic short answer grading. Int J Artif Intell Educ 25(1):60–117CrossRef
Zurück zum Zitat Burstein J, Chodorow M (1999) Automated essay scoring for nonnative English speakers. In: Proceeding ASSESSEVALNLP ’99 proceedings of a symposium on computer mediated language assessment and evaluation in natural language processing, pp 68–75 Burstein J, Chodorow M (1999) Automated essay scoring for nonnative English speakers. In: Proceeding ASSESSEVALNLP ’99 proceedings of a symposium on computer mediated language assessment and evaluation in natural language processing, pp 68–75
Zurück zum Zitat Bae B-G (2013) Automatic-scoring method for Korean free-text answer through predicate normalization. M.A. dissertation, KookMin University Bae B-G (2013) Automatic-scoring method for Korean free-text answer through predicate normalization. M.A. dissertation, KookMin University
Zurück zum Zitat Callear D, Jerrams-Smith J, Soh V (2001) CAA of short non-MCQ answers. In: Proceeding of the 5th international CAA conference Callear D, Jerrams-Smith J, Soh V (2001) CAA of short non-MCQ answers. In: Proceeding of the 5th international CAA conference
Zurück zum Zitat Chakrabartty S, Cauwenberghs G (2007) Gini support vector machine: quadratic entropy based robust multi-class probability regression. J Mach Learn Res 8:813–839MATH Chakrabartty S, Cauwenberghs G (2007) Gini support vector machine: quadratic entropy based robust multi-class probability regression. J Mach Learn Res 8:813–839MATH
Zurück zum Zitat Cho W, Oh J, Lee J, Kim Y-S (2005) An intelligent marking system based on semantic kernel and Korean WordNet. KIPS Trans Part A 12A(6):539–546CrossRef Cho W, Oh J, Lee J, Kim Y-S (2005) An intelligent marking system based on semantic kernel and Korean WordNet. KIPS Trans Part A 12A(6):539–546CrossRef
Zurück zum Zitat Clariana RB, Wallace P (2007) A computer-based approach for deriving and measuring individual and team knowledge structure from essay questions. J Educ Comput Res 37(3):211–227CrossRef Clariana RB, Wallace P (2007) A computer-based approach for deriving and measuring individual and team knowledge structure from essay questions. J Educ Comput Res 37(3):211–227CrossRef
Zurück zum Zitat Cruse DA (1986) Lexical semantics. Cambridge University Press, Cambridge Cruse DA (1986) Lexical semantics. Cambridge University Press, Cambridge
Zurück zum Zitat Dobrov BV, Loukachevitch NV, Yudina TN (1997) Conceptual indexing using thematic representation of texts. In: TREC-6, pp 403–413 Dobrov BV, Loukachevitch NV, Yudina TN (1997) Conceptual indexing using thematic representation of texts. In: TREC-6, pp 403–413
Zurück zum Zitat ETRI (2013) ETRI Korean phoneme converter. Speech Language Information Research Department ETRI (2013) ETRI Korean phoneme converter. Speech Language Information Research Department
Zurück zum Zitat Jacobs PS, Krupka GR, Rau LF (1991) Lexico-semantic pattern matching as a companion to parsing in text understanding. In: Proceeding HLT ’91 proceedings of the workshop on speech and natural language, pp 337–341 Jacobs PS, Krupka GR, Rau LF (1991) Lexico-semantic pattern matching as a companion to parsing in text understanding. In: Proceeding HLT ’91 proceedings of the workshop on speech and natural language, pp 337–341
Zurück zum Zitat Jadidinejad AH, Mahmoudi F (2014) Unsupervised short answer grading using spreading activation over an associative network of concepts. Can J Inf Library Sci 38:287–303CrossRef Jadidinejad AH, Mahmoudi F (2014) Unsupervised short answer grading using spreading activation over an associative network of concepts. Can J Inf Library Sci 38:287–303CrossRef
Zurück zum Zitat Jang ES, Kang SS, Noh EH, Kim MH, Sung KH, Seong TJ (2014) KASS: Korean automatic scoring system for short-answer questions. In: Proceedings of the 6th international conference on computer supported education: CSEDU, Barcelona, Spain, vol 2, pp 226–230 Jang ES, Kang SS, Noh EH, Kim MH, Sung KH, Seong TJ (2014) KASS: Korean automatic scoring system for short-answer questions. In: Proceedings of the 6th international conference on computer supported education: CSEDU, Barcelona, Spain, vol 2, pp 226–230
Zurück zum Zitat Kim JE, Chae JM, Jung SY (2014) Automatic scoring system based on Korean lexico-semantic pattern. Int J Appl Eng Res 9(22):14499–14510 Kim JE, Chae JM, Jung SY (2014) Automatic scoring system based on Korean lexico-semantic pattern. Int J Appl Eng Res 9(22):14499–14510
Zurück zum Zitat Loukachevitch NV, Dobrov BV (2002) Evaluation of thesaurus on sociopolitical life as information-retrieval tool. In: Gonzalez Rodriguez M, Paz Suarez Araujo C (eds) The third international conference on linguistic resources and evaluation (LREC-2002), Gran Canaria, Spain, vol 1 Loukachevitch NV, Dobrov BV (2002) Evaluation of thesaurus on sociopolitical life as information-retrieval tool. In: Gonzalez Rodriguez M, Paz Suarez Araujo C (eds) The third international conference on linguistic resources and evaluation (LREC-2002), Gran Canaria, Spain, vol 1
Zurück zum Zitat Valenti S, Neri F, Cucchiarelli R (2003) An overview of current research on automated essay grading. J Inf Technol Educ 2:319–330 Valenti S, Neri F, Cucchiarelli R (2003) An overview of current research on automated essay grading. J Inf Technol Educ 2:319–330
Metadaten
Titel
Automatic scoring system for short descriptive answer written in Korean using lexico-semantic pattern
verfasst von
Jeong-Eun Kim
Kinam Park
Jeong-Min Chae
Hong-Jun Jang
Byoung-Wook Kim
Soon-Young Jung
Publikationsdatum
17.08.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 13/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2772-7

Weitere Artikel der Ausgabe 13/2018

Soft Computing 13/2018 Zur Ausgabe