Skip to main content

2023 | OriginalPaper | Buchkapitel

Label Embedding Based Scoring Method for Secondary School Essays

verfasst von : Chao Song, Ge Ren, YinZhong Song, JunJie Liu, Yong Yang

Erschienen in: Artificial Intelligence in China

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Automatic essay scoring techniques can automatically evaluate and score essays, and they have become one of the hot issues in the application of natural language processing techniques in education. Current automatic essay scoring methods often use large pre-trained models to obtain semantic features, which do not perform well in the field of automatic essay scoring because the training corpus does not match the content domain of the essay, and the extraction of features for long essays is not effective. We propose a label embedding-based method for scoring secondary school essays, using a modified bidirectional long- and short-term memory network and a BERT model to extract domain features and abstract features of essays, while using a gating mechanism to adjust the influence of both types of features on essay scoring, and finally automatic scoring of essays through feature fusion. The experimental results show that the proposed model performs significantly better on the essay auto-scoring dataset of the Kaggle ASAP competition, with an average QWK value of 81.22%, which verifies the effectiveness of the proposed algorithm in the essay auto-scoring task.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ghasemi, N., Aliannejadi, M., Hiemstra, D.: BERT for Target Apps Selection: Analyzing the Diversity and Performance of BERT in Unified Mobile Search (2021) Ghasemi, N., Aliannejadi, M., Hiemstra, D.: BERT for Target Apps Selection: Analyzing the Diversity and Performance of BERT in Unified Mobile Search (2021)
2.
Zurück zum Zitat Stefanick, M.L., Anderson, G.L., Margolis, K.L., et al.: Effects of conjugated equine estrogens on breast cancer and mammography screening in postmenopausal women with hysterectomy. JAMA 295(14), 1647 (2006)CrossRef Stefanick, M.L., Anderson, G.L., Margolis, K.L., et al.: Effects of conjugated equine estrogens on breast cancer and mammography screening in postmenopausal women with hysterectomy. JAMA 295(14), 1647 (2006)CrossRef
3.
Zurück zum Zitat Rodriguez, P.U., Jafari, A., Ormerod, C.M.: Language models and Automated Essay Scoring (2019) Rodriguez, P.U., Jafari, A., Ormerod, C.M.: Language models and Automated Essay Scoring (2019)
4.
Zurück zum Zitat Chen, M., Li, X.: Relevance-based automated essay scoring via hierarchical recurrent model. In: 2018 International Conference on Asian Language Processing (IALP) (2018) Chen, M., Li, X.: Relevance-based automated essay scoring via hierarchical recurrent model. In: 2018 International Conference on Asian Language Processing (IALP) (2018)
5.
Zurück zum Zitat Alikaniotis, D., Yannakoudakis, H., Rei, M.: Automatic text scoring using neural networks. arXiv e-prints (2016) Alikaniotis, D., Yannakoudakis, H., Rei, M.: Automatic text scoring using neural networks. arXiv e-prints (2016)
6.
Zurück zum Zitat Dong, F., Yue, Z., Jie, Y.: Attention-based recurrent convolutional neural network for automatic essay scoring. In: Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) (2017) Dong, F., Yue, Z., Jie, Y.: Attention-based recurrent convolutional neural network for automatic essay scoring. In: Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) (2017)
7.
Zurück zum Zitat Dong, F., Zhang, Y.: Automatic Features for Essay Scoring -An Empirical Study (2018) Dong, F., Zhang, Y.: Automatic Features for Essay Scoring -An Empirical Study (2018)
8.
Zurück zum Zitat Taghipour, K., Ng, H.T.: A neural approach to automated essay scoring. The 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP 2016) (2016) Taghipour, K., Ng, H.T.: A neural approach to automated essay scoring. The 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP 2016) (2016)
9.
Zurück zum Zitat Zhou, X., Yang, L., Fan, X., et al.: Self-training vs Pre-trained Embeddings for Automatic Essay Scoring (2021) Zhou, X., Yang, L., Fan, X., et al.: Self-training vs Pre-trained Embeddings for Automatic Essay Scoring (2021)
10.
Zurück zum Zitat Yin, W., Schütze, H., Xiang, B., et al.: ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs. Computer Science (2015) Yin, W., Schütze, H., Xiang, B., et al.: ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs. Computer Science (2015)
11.
Zurück zum Zitat Devlin, J., Chang, M.W., Lee, K., et al.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2018) Devlin, J., Chang, M.W., Lee, K., et al.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2018)
12.
Zurück zum Zitat Tay, Y., Phan, M.C., Tuan, L.A., et al.: SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring (2017) Tay, Y., Phan, M.C., Tuan, L.A., et al.: SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring (2017)
13.
Zurück zum Zitat Ormerod, C.M., Malhotra, A., Jafari, A.: Automated Essay Scoring Using Efficient Transformer-Based Language Models (2021) Ormerod, C.M., Malhotra, A., Jafari, A.: Automated Essay Scoring Using Efficient Transformer-Based Language Models (2021)
14.
Zurück zum Zitat Xia, L., Mc, A., Jyn, C.: SEDNN: shared and enhanced deep neural network model for cross-prompt automated essay scoring. Knowledge-Based Systems 210, 106491 (2020) Xia, L., Mc, A., Jyn, C.: SEDNN: shared and enhanced deep neural network model for cross-prompt automated essay scoring. Knowledge-Based Systems 210, 106491 (2020)
15.
16.
Zurück zum Zitat Liu, J., Yang, X., Zhao, L.: Automated Essay Scoring based on Two-Stage Learning (2019) Liu, J., Yang, X., Zhao, L.: Automated Essay Scoring based on Two-Stage Learning (2019)
17.
Zurück zum Zitat Yi, T., Phan, M.C., Tuan, L.A., et al.: SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring (2017) Yi, T., Phan, M.C., Tuan, L.A., et al.: SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring (2017)
18.
Zurück zum Zitat Fei, D., Yue, Z.: Automatic features for essay scoring – an empirical study. In: Conference on Empirical Methods in Natural Language Processing (2016) Fei, D., Yue, Z.: Automatic features for essay scoring – an empirical study. In: Conference on Empirical Methods in Natural Language Processing (2016)
19.
Zurück zum Zitat Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention Is All You Need. arXiv. arXiv (2017) Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention Is All You Need. arXiv. arXiv (2017)
20.
Zurück zum Zitat Page, E.B.: Grading essays by computer: progress report. In: Proceedings of the invitational Conference on Testing Problems (1967) Page, E.B.: Grading essays by computer: progress report. In: Proceedings of the invitational Conference on Testing Problems (1967)
21.
Zurück zum Zitat Shen, D., Wang, G., Wang, W., et al.: On the Use of Word Embeddings Alone to Represent Natural Language Sequences (2018) Shen, D., Wang, G., Wang, W., et al.: On the Use of Word Embeddings Alone to Represent Natural Language Sequences (2018)
22.
Zurück zum Zitat Zupanc, K., Bosnic, Z.: Automated essay evaluation with semantic analysis. Knowledge-Based Systems 120(Mar.15), 118–132 (2017) Zupanc, K., Bosnic, Z.: Automated essay evaluation with semantic analysis. Knowledge-Based Systems 120(Mar.15), 118–132 (2017)
23.
Zurück zum Zitat Clark, K., Luong, M.T., Le, Q.V., et al.: ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (2020) Clark, K., Luong, M.T., Le, Q.V., et al.: ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (2020)
24.
Zurück zum Zitat Li, C., Lin, L., Mao, W., Xiong, L., Lin, Y.: An automated essay scoring model based on stacking method. In: 2022 IEEE 2nd International Conference on Software Engineering and Artificial Intelligence (SEAI), pp. 248–252 (2022) Li, C., Lin, L., Mao, W., Xiong, L., Lin, Y.: An automated essay scoring model based on stacking method. In: 2022 IEEE 2nd International Conference on Software Engineering and Artificial Intelligence (SEAI), pp. 248–252 (2022)
Metadaten
Titel
Label Embedding Based Scoring Method for Secondary School Essays
verfasst von
Chao Song
Ge Ren
YinZhong Song
JunJie Liu
Yong Yang
Copyright-Jahr
2023
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-1256-8_13

Premium Partner