Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Education and Information Technologies
Erschienen in: Education and Information Technologies 5/2017

25.10.2016

Superlative model using word cloud for short answers evaluation in eLearning

verfasst von: Shailaja Jayashankar, R. Sridaran

Erschienen in: Education and Information Technologies | Ausgabe 5/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Teachers are thrown open to abundance of free text answers which are very daunting to read and evaluate. Automatic assessments of open ended answers have been attempted in the past but none guarantees 100 % accuracy. In order to deal with the overload involved in this manual evaluation, a new tool becomes necessary. The unique superlative model discussed in this paper aims at providing improved accuracy by constructing word clouds. The model uses appropriate semantics with a visual appeal to partially automate free text evaluation. The model was applied at a K-12 school setup where the average human agreement rate was found to be 98 % and the accuracy score deviation from the mean was 2.82. This tool can be cast-off at any level starting from K-12 to higher education to evolve the way we view and evaluate answers.
Vorheriger Artikel Understanding student retention in computer science education: The role of environment, gains, barriers and usefulness
Nächster Artikel Analytical study of E-learning resources in national open University of Nigeria

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren
Fußnoten
2
Official Website of National Academy For Learning, India - http://​www.​nafl.​in/​
 
Literatur
Ahearn, L. M. (2013). Commentary: keywords as a literacy practice in the history of anthropological theory. American Ethnologist, 40(1), 6–12.CrossRef
Bailey, S. & Meurers, D., (2008). Diagnosing meaning errors in short answers to reading comprehension questions. In Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications (pp. 107–115). Association for Computational Linguistics.
Baralt, M., Pennestri, S., & Selvandin, M. (2011). Action research: using wordles to teach foreign language writing. Language Learning & Technology, 15(2), 12–22.
Behar-Horenstein, L. S., & Niu, L. (2011). Teaching critical thinking skills in higher education: a review of the literature. Journal of College Teaching and Learning, 8(2), 25.
Bielenberg, K., (2005). Groups in social software: Utilizing tagging to integrate individual contexts for social navigation (Doctoral dissertation, Universität Bremen).
Blin, F., & Munro, M. (2008). Why hasn’t technology disrupted academics’ teaching practices? understanding resistance to change through the lens of activity theory. Computers & Education, 50(2), 475–490.CrossRef
Bloom, B.S. (1956). Taxonomy of educational objectives: The classification of educational goals: Cognitive Domain. Longman.
Brin, S., Motwani, R., Ullman, J.D. & Tsur, S., (1997). Dynamic itemset counting and implication rules for market basket data. In ACM SIGMOD Record (Vol. 26, No. 2, pp. 255–264). ACM.
Burrows, S., Gurevych, I., & Stein, B. (2015). The eras and trends of automatic short answer grading. International Journal of Artificial Intelligence in Education, 25(1), 60–117.CrossRef
Burstein, J., Wolff, S. & Lu, C., (1999). Using lexical semantic techniques to classify free-responses. In Breadth and depth of semantic lexicons (pp. 227–244). Springer Netherlands.
Butcher, P. G., & Jordan, S. E. (2010). A comparison of human and computer marking of short free-text student responses. Computers & Education, 55(2), 489–499.CrossRef
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. (2011). Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12(Aug), 2493–2537.MATH
Concetta, A. DePaolo, Wilkinson, K. (2014). get your head into the clouds: using word clouds for analyzing qualitative assessment data. TechTrends-May/June 2014, Springer, Volume 58, Number 3.
Cook, K. A. & Thomas, J. J. (2005). Illuminating the path: The research and development agenda for visual analytics (No. PNNL-SA-45230). Pacific Northwest National Laboratory (PNNL), Richland, WA (US).
Cook, K., Earnshaw, R., & Stasko, J. (2007). Guest editors’ introduction: Discovering the unexpected. IEEE Computer Graphics and Applications, 27(5), 15–19.CrossRef
deNoyelles, A., & Reyes-Foster, B. (2015). Using word clouds in online discussions to support critical thinking and engagement. Online Learning, 19(4), n4.CrossRef
DePaolo, C. A., & Wilkinson, K. (2014). Get your head into the clouds: using word clouds for analyzing qualitative assessment data. TechTrends, 58(3), 38–44.CrossRef
Dzikovska, M. O., Nielsen, R. D., & Leacock, C. (2016). The joint student response analysis and recognizing textual entailment challenge: making sense of student responses in educational applications. Language Resources and Evaluation, 50(1), 67–93.CrossRef
Feinberg, J. (2010). Wordle. In J. Steele & N. Iliinsky (Eds.), Beautiful visualization (pp. 37–58). Sebastopol: O’Reilly.
Gütl, C. (2007). e-Examiner: towards a fully-automatic knowledge assessment tool applicable in adaptive e-learning systems. In Proceedings of the 2nd international conference on interactive mobile and computer aided learning (pp. 1–10).
Hahn, M. & Meurers, D. (2012). Evaluating the meaning of answers to reading comprehension questions a semantics-based approach. In Proceedings of the Seventh Workshop on Building Educational Applications Using NLP (pp. 326–336). Association for Computational Linguistics.
Hahsler, M., Grün, B. & Hornik, K. (2005). A computational environment for mining association rules and frequent item sets.
Huisman, R., Miller, W., & Trinoskey, J. (2011). We’ve Wordled, have you? digital images in the library classroom. College & Research Libraries News, 72(9), 522–526.CrossRef
Ingo, F & Kurt, H. (2015). tm: Text Mining Package. R package version 0.6-2. http://​CRAN.​R-project.​org/​package=​tm, Accessed 21 January 2016.
Ingoley, S., & Bakal, J. W. (2012). Use of fuzzy logic in evaluating students’ learning achievement. International Journal on Advanced Computer Engineering and Communication Technology (IJACECT), 1(2), 47–54.
Jablon, J.R. & Wilkinson, M. (2006). Using engagement strategies to facilitate children’s learning and success. YC Young Children 12-16.
Jimoyiannis, A., & Komis, V. (2007). Examining teachers’ beliefs about ICT in education: implications of a teacher preparation programme. Teacher Development, 11(2), 149–173.CrossRef
Kao, A. & Poteet, S.R. eds. (2007). Natural language processing and text mining. Springer Science & Business Media.
Kaptein, R., Hiemstra, D. & Kamps, J., (2010). How different are language models andword clouds?. In European Conference on Information Retrieval (pp. 556–568). Springer Berlin Heidelberg.
Kolb, A, Y. (2005). The Kolb Learning Style Inventory—Version 3.1 2005 Technical Specifications. Boston, MA: Hay Resource Direct, 200.
Kragten, J. (1994). Tutorial review. calculating standard deviations and confidence intervals with a universally applicable spreadsheet technique. Analyst, 119(10), 2161–2165.CrossRef
Leacock, C., & Chodorow, M. (2003). C-rater: automated scoring of short-answer questions. Computers and the Humanities, 37(4), 389–405.CrossRef
Liu, V. & Curran, J. R. (2006). Web Text Corpus for Natural Language Processing. In EACL.
Maglogiannis, I. G. (2007). Emerging artificial intelligence applications in computer engineering: real word AI systems with applications in eHealth, HCI, information retrieval and pervasive technologies (Vol. 160). Ios Press.
McNaught, C., & Lam, P. (2010). Using Wordle as a supplementary research tool. The Qualitative Report, 15(3), 630.
Miley, F., & Read, A. (2012). Using word clouds to develop proactive learners. Journal of the Scholarship of Teaching and Learning, 11(2), 91–110.
Miller, G. A. (1995). WordNet: a lexical database for English. Communications of the ACM, 38(11), 39–41.CrossRef
Mitchell, T., Russell, T., Broomhead, P. & Aldridge, N. (2002). Towards robust computerised marking of free-text responses.
Mohler, M. & Mihalcea, R. (2009). Text-to-text semantic similarity for automatic short answer grading. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (pp. 567–575). Association for Computational Linguistics.
Nickell, J. (2012). Word clouds in math classrooms. Mathematics Teaching in the Middle School, 17(9), 564–566.CrossRef
Pérez, D., Gliozzo, A. M., Strapparava, C., Alfonseca, E., Rodríguez, P. & Magnini, B. (2005). Automatic assessment of students’ free-text answers underpinned by the combination of a BLEU-inspired algorithm and latent semantic analysis. In FLAIRS conference (pp. 358–363).
Perry, L. (2012). Using word clouds to teach about speaking style. Communication Teacher, 26(4), 220–223.CrossRef
Pulman, S.G. & Sukkarieh, J. Z. (2005). Automatic short answer marking. In Proceedings of the second workshop on Building Educational Applications Using NLP (pp. 9–16). Association for Computational Linguistics.
Ramsden, A. & Bate, A. (2008). Using word clouds in teaching and learning.
Sag I. A., Baldwin, T., Bond, F., Copestake, A. & Flickinger, D. (2002). Multiword expressions: a pain in the neck for NLP. In International Conference on Intelligent Text Processing and Computational Linguistics (pp. 1–15). Springer Berlin Heidelberg.
Siddiqi, R., Harrison, C. J., & Siddiqi, R. (2010). Improving teaching and learning through automated short-answer marking. IEEE Transactions on Learning Technologies, 3(3), 237–249.CrossRef
Sukkarieh, J. Z., Pulman, S.G. & Raikes, N. (2003). Auto-marking: using computational linguistics to score short, free text responses. In the annual conference of the International Association for Educational Assessment (IAEA), Manchester, UK.
Tsui, L. (2002). Fostering critical thinking through effective pedagogy: evidence from four institutional case studies. The Journal of Higher Education, 73(6), 740–763.
Williamson, D. M., Xi, X., & Breyer, F. J. (2012). A framework for evaluation and use of automated scoring. Educational Measurement: Issues and Practice, 31(1), 2–13.CrossRef
Wing, J. M. (2008). Computational thinking and thinking about computing. Philosophical Transactions of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, 366(1881), 3717–3725.MathSciNetCrossRefMATH
Metadaten
Titel
Superlative model using word cloud for short answers evaluation in eLearning
verfasst von
Shailaja Jayashankar
R. Sridaran
Publikationsdatum
25.10.2016
Verlag
Springer US
Erschienen in
Education and Information Technologies / Ausgabe 5/2017
Print ISSN: 1360-2357
Elektronische ISSN: 1573-7608
DOI
https://doi.org/10.1007/s10639-016-9547-0

Weitere Artikel der Ausgabe 5/2017

Education and Information Technologies 5/2017 Zur Ausgabe

OriginalPaper

School children’s use of digital devices, social media and parental knowledge and involvement – the case of Abu Dhabi

OriginalPaper

Students’ acceptance of file sharing systems as a tool for sharing course materials: The case of Google Drive

OriginalPaper

The effect of theme preference on academic word list use: A case for smartphone video recording feature

OriginalPaper

Texting, reading, and other daily habits associated with adolescents’ literacy levels

OriginalPaper

A new approach to teaching technical subjects in training restoration architects

OriginalPaper

Adopting MOOCs for afforable quality education