Skip to main content
Erschienen in: Education and Information Technologies 9/2023

04.03.2023

A question–answer generation system for an asynchronous distance learning platform

verfasst von: Hei-Chia Wang, Martinus Maslim, Chia-Hao Kan

Erschienen in: Education and Information Technologies | Ausgabe 9/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Distance learning frees the learning process from spatial constraints. Each mode of distance learning, including synchronous and asynchronous learning, has disadvantages. In synchronous learning, students have network bandwidth and noise concerns, but in asynchronous learning, they have fewer opportunities for engagement, such as asking questions. The difficulties associated with asynchronous learning make it difficult for teachers to determine whether students comprehend the course material. Motivated students will consistently participate in a course and prepare for classroom activities if teachers ask questions and communicate with them during class. As an aid to distance education, we want to automatically generate a sequence of questions based on asynchronous learning content. In this study, we will also generate multiple-choice questions for students to answer and teachers to easily correct. The asynchronous distance teaching-question generation (ADT-QG) model, which includes Sentences-BERT (SBERT) in the model architecture to generate questions from sentences with a higher degree of similarity, is proposed in this work. With the Wiki corpus generation option, it is anticipated that the Transfer Text-to-Text Transformer (T5) model will generate more fluent questions and be more aligned with the instructional topic. The results indicate that the questions created by the ADT-QG model suggested in this work have good fluency and clarity indicators, showing that the questions generated by the ADT-QG model are of a certain quality and relevant to the curriculum.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Agarwal, M., & Mannem, P. (2011). Automatic Gap-Fill Question Generation from Text Books. Paper presented at the the 6th Workshop on Innovative Use of NLP for Building Educational Applications, Portland, Oregon. Agarwal, M., & Mannem, P. (2011). Automatic Gap-Fill Question Generation from Text Books. Paper presented at the the 6th Workshop on Innovative Use of NLP for Building Educational Applications, Portland, Oregon.
Zurück zum Zitat Belkin, M., Hsu, D., Ma, S., & Mandal, S. (2019). Reconciling modern machine-learning practice and the classical bias–variance trade-off. Proceedings of the National Academy of Sciences, 116(32), 15849–15854.MathSciNetCrossRefMATH Belkin, M., Hsu, D., Ma, S., & Mandal, S. (2019). Reconciling modern machine-learning practice and the classical bias–variance trade-off. Proceedings of the National Academy of Sciences, 116(32), 15849–15854.MathSciNetCrossRefMATH
Zurück zum Zitat Blau, I., Weiser, O., and Eshet-Alkalai, Y. (2017). How do medium naturalness and personality traits shape academic achievement and perceived learning? An experimental study of face-to-face and synchronous e-learning. Research in Learning Technology, 25. https://doi.org/10.25304/rlt.v25.1974 Blau, I., Weiser, O., and Eshet-Alkalai, Y. (2017). How do medium naturalness and personality traits shape academic achievement and perceived learning? An experimental study of face-to-face and synchronous e-learning. Research in Learning Technology, 25. https://​doi.​org/​10.​25304/​rlt.​v25.​1974
Zurück zum Zitat Chan, Y.-H., & Fan, Y.-C. (2019). A recurrent BERT-based model for question generation. Paper presented at the Proceedings of the 2nd Workshop on Machine Reading for Question Answering. Hong Kong, China. Chan, Y.-H., & Fan, Y.-C. (2019). A recurrent BERT-based model for question generation. Paper presented at the Proceedings of the 2nd Workshop on Machine Reading for Question Answering. Hong Kong, China.
Zurück zum Zitat Chen, G., Yang, J., & Gasevic, D. (2019). A Comparative Study on Question-Worthy Sentence Selection Strategies for Educational Question Generation. Paper presented at the the International Conference on Artificial Intelligence in Education, Chicago, USA. Chen, G., Yang, J., & Gasevic, D. (2019). A Comparative Study on Question-Worthy Sentence Selection Strategies for Educational Question Generation. Paper presented at the the International Conference on Artificial Intelligence in Education, Chicago, USA.
Zurück zum Zitat Cheng, J., & Lapata, M. (Writers). (2016). Neural Summarization by Extracting Sentences and Words. In the 54th Annual Meeting of the Association for Computational Linguistics.Berlin, Germany Cheng, J., & Lapata, M. (Writers). (2016). Neural Summarization by Extracting Sentences and Words. In the 54th Annual Meeting of the Association for Computational Linguistics.Berlin, Germany
Zurück zum Zitat Debes, G. (2021). Distance learning in higher education during the COVID-19 pandemic: Advantages and disadvantages. International Journal of Curriculum and Instruction, 13, 1109–1118. Debes, G. (2021). Distance learning in higher education during the COVID-19 pandemic: Advantages and disadvantages. International Journal of Curriculum and Instruction, 13, 1109–1118.
Zurück zum Zitat Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. Paper presented at the Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota. Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. Paper presented at the Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota.
Zurück zum Zitat Dhawan, S. (2020). Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1), 5–22.CrossRef Dhawan, S. (2020). Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1), 5–22.CrossRef
Zurück zum Zitat Didenko, B., & Shaptala, J. (2019). Multi-headed architecture based on BERT for grammatical errors correction. Paper presented at the Proceedings of the fourteenth workshop on innovative use of NLP for building educational applications, pp. 246-251. Didenko, B., & Shaptala, J. (2019). Multi-headed architecture based on BERT for grammatical errors correction. Paper presented at the Proceedings of the fourteenth workshop on innovative use of NLP for building educational applications, pp. 246-251.
Zurück zum Zitat d’Inverno, R., Davis, H., & White, S. (2003). Using a personal response system for promoting student interaction. Teaching Mathematics and Its Applications: International Journal of the IMA, 22(4), 163–169.CrossRef d’Inverno, R., Davis, H., & White, S. (2003). Using a personal response system for promoting student interaction. Teaching Mathematics and Its Applications: International Journal of the IMA, 22(4), 163–169.CrossRef
Zurück zum Zitat Du, X., Shao, J., & Cardie, C. (2017). Learning to ask: Neural question generation for reading comprehension. arXiv preprint arXiv:1705.00106. Du, X., Shao, J., & Cardie, C. (2017). Learning to ask: Neural question generation for reading comprehension. arXiv preprint arXiv:​1705.​00106.
Zurück zum Zitat Gaglani, J., Gandhi, Y., Gogate, S., & Halbe, A. (2020). Unsupervised whatsapp fake news detection using semantic search. Paper presented at the 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS). Gaglani, J., Gandhi, Y., Gogate, S., & Halbe, A. (2020). Unsupervised whatsapp fake news detection using semantic search. Paper presented at the 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS).
Zurück zum Zitat Heilman, M., & Smith, N. A. (2010). Good Question! Statistical Ranking for Question Generation. Paper presented at the the Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Los Angeles, California. Heilman, M., & Smith, N. A. (2010). Good Question! Statistical Ranking for Question Generation. Paper presented at the the Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Los Angeles, California.
Zurück zum Zitat Hrastinski, S. (2008). Asynchronous and Synchronous e-Learning. Educause Quarterly, 31(4), 51–55. Hrastinski, S. (2008). Asynchronous and Synchronous e-Learning. Educause Quarterly, 31(4), 51–55.
Zurück zum Zitat Huang, Y.-T., Tseng, Y.-M., Sun, Y. S., & Chen, M. C. (2014). TEDQuiz: automatic quiz generation for TED talks video clips to assess listening comprehension. Paper presented at the 2014 IEEE 14Th international conference on advanced learning technologies. Athens, Greece Huang, Y.-T., Tseng, Y.-M., Sun, Y. S., & Chen, M. C. (2014). TEDQuiz: automatic quiz generation for TED talks video clips to assess listening comprehension. Paper presented at the 2014 IEEE 14Th international conference on advanced learning technologies. Athens, Greece
Zurück zum Zitat Kaplan, A. M., & Haenlein, M. (2016). Higher education and the digital revolution: About MOOCs, SPOCs, social media, and the Cookie Monster. Business Horizons, 59(4), 441–450.CrossRef Kaplan, A. M., & Haenlein, M. (2016). Higher education and the digital revolution: About MOOCs, SPOCs, social media, and the Cookie Monster. Business Horizons, 59(4), 441–450.CrossRef
Zurück zum Zitat Kedia, A., Chinthakindi, S. C., Back, S., Lee, H., & Choo, J. (2019). ASGen: Answer-containing Sentence Generation to Pre-Train Question Generator for Scale-up Data in Question Answering. In International conference on learning representations. Addis Ababa, Ethiopia Kedia, A., Chinthakindi, S. C., Back, S., Lee, H., & Choo, J. (2019). ASGen: Answer-containing Sentence Generation to Pre-Train Question Generator for Scale-up Data in Question Answering. In International conference on learning representations. Addis Ababa, Ethiopia
Zurück zum Zitat Kumari, V., Keshari, S., Sharma, Y., & Goel, L. (2022). Context-Based Question Answering System with Suggested Questions. Paper presented at the 2022 12th International Conference on Cloud Computing, Data Science & Engineering (Confluence). Kumari, V., Keshari, S., Sharma, Y., & Goel, L. (2022). Context-Based Question Answering System with Suggested Questions. Paper presented at the 2022 12th International Conference on Cloud Computing, Data Science & Engineering (Confluence).
Zurück zum Zitat Lahitani, A. R., Permanasari, A. E., & Setiawan, N. A. (2016). Cosine similarity to determine similarity measure: Study case in online essay assessment. Paper presented at the 2016 4th International Conference on Cyber and IT Service Management. Lahitani, A. R., Permanasari, A. E., & Setiawan, N. A. (2016). Cosine similarity to determine similarity measure: Study case in online essay assessment. Paper presented at the 2016 4th International Conference on Cyber and IT Service Management.
Zurück zum Zitat Lai, H., Gierl, M. J., Touchie, C., Pugh, D., Boulais, A.-P., & De Champlain, A. (2016). Using automatic item generation to improve the quality of MCQ distractors. Teaching and Learning in Medicine, 28(2), 166–173.CrossRef Lai, H., Gierl, M. J., Touchie, C., Pugh, D., Boulais, A.-P., & De Champlain, A. (2016). Using automatic item generation to improve the quality of MCQ distractors. Teaching and Learning in Medicine, 28(2), 166–173.CrossRef
Zurück zum Zitat Levy, O., Goldberg, Y., & Dagan, I. (2015). Improving Distributional Similarity with Lessons Learned from Word Embeddings. Transactions of the Association for Computational Linguistics, 3, 211–225.CrossRef Levy, O., Goldberg, Y., & Dagan, I. (2015). Improving Distributional Similarity with Lessons Learned from Word Embeddings. Transactions of the Association for Computational Linguistics, 3, 211–225.CrossRef
Zurück zum Zitat Lin, K.-Y. (2015). Evaluating the effect of a clicker in an information literacy course for college nursing students in Taiwan. CIN: Computers, Informatics, Nursing, 33(3), 115–121. Lin, K.-Y. (2015). Evaluating the effect of a clicker in an information literacy course for college nursing students in Taiwan. CIN: Computers, Informatics, Nursing, 33(3), 115–121.
Zurück zum Zitat Liu, S., Li, Z., Zhang, Y., & Cheng, X. (2019). Introduction of key problems in long-distance learning and training. Mobile Networks and Applications, 24(1), 1–4.CrossRef Liu, S., Li, Z., Zhang, Y., & Cheng, X. (2019). Introduction of key problems in long-distance learning and training. Mobile Networks and Applications, 24(1), 1–4.CrossRef
Zurück zum Zitat Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. In 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Arizona, USA. Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. In 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Arizona, USA.
Zurück zum Zitat Mitkov, R. (2003). Computer-aided generation of multiple-choice tests. Paper presented at the Proceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing. Mitkov, R. (2003). Computer-aided generation of multiple-choice tests. Paper presented at the Proceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing.
Zurück zum Zitat Mostow, J., & Jang, H. (2012). Generating diagnostic multiple choice comprehension cloze questions. Paper presented at the Proceedings of the Seventh Workshop on Building Educational Applications Using NLP. Mostow, J., & Jang, H. (2012). Generating diagnostic multiple choice comprehension cloze questions. Paper presented at the Proceedings of the Seventh Workshop on Building Educational Applications Using NLP.
Zurück zum Zitat Nema, P., & Khapra, M. M. (2018). Towards a Better Metric for Evaluating Question Generation Systems. Paper presented at the the 2018 Conference on Empirical Methods in Natural Language Processing. Nema, P., & Khapra, M. M. (2018). Towards a Better Metric for Evaluating Question Generation Systems. Paper presented at the the 2018 Conference on Empirical Methods in Natural Language Processing.
Zurück zum Zitat Önöral, Ö., & Kurtulmus-Yilmaz, S. (2020). Influence of COVID-19 pandemic on dental education in cyprus: Preclinical and clinical implications with E-learning strategies. Advanced Education, 7, 69–77.CrossRef Önöral, Ö., & Kurtulmus-Yilmaz, S. (2020). Influence of COVID-19 pandemic on dental education in cyprus: Preclinical and clinical implications with E-learning strategies. Advanced Education, 7, 69–77.CrossRef
Zurück zum Zitat Pennington, J., Socher, R., & Manning, C. (2014). Glove: Global Vectors for Word Representation. Paper presented at the Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar. Pennington, J., Socher, R., & Manning, C. (2014). Glove: Global Vectors for Word Representation. Paper presented at the Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar.
Zurück zum Zitat Perveen, A. (2016). Synchronous and asynchronous e-language learning: A case study of virtual university of Pakistan. Open Praxis, 8(1), 21–39.CrossRef Perveen, A. (2016). Synchronous and asynchronous e-language learning: A case study of virtual university of Pakistan. Open Praxis, 8(1), 21–39.CrossRef
Zurück zum Zitat Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., ... & Liu, P. J. (2020). Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140), 1-67. Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., ... & Liu, P. J. (2020). Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research21(140), 1-67.
Zurück zum Zitat Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016). Squad: 100,000+ Questions for Machine Comprehension of Text. Paper presented at the the Empirical Methods in Natural Language Processing (EMNLP), Austin, Texas, USA. Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016). Squad: 100,000+ Questions for Machine Comprehension of Text. Paper presented at the the Empirical Methods in Natural Language Processing (EMNLP), Austin, Texas, USA.
Zurück zum Zitat Rao, P. R., Jhawar, T. N., Kachave, Y. A., & Hirlekar, V. (2022). Generating QA from Rule-based Algorithms. Paper presented at the 2022 International Conference on Electronics and Renewable Systems (ICEARS). Rao, P. R., Jhawar, T. N., Kachave, Y. A., & Hirlekar, V. (2022). Generating QA from Rule-based Algorithms. Paper presented at the 2022 International Conference on Electronics and Renewable Systems (ICEARS).
Zurück zum Zitat Reimers, N., & Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3982–3992, Hong Kong, China. Association for Computational Linguistics. Reimers, N., & Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3982–3992, Hong Kong, China. Association for Computational Linguistics.
Zurück zum Zitat Rodriguez-Torrealba, R., Garcia-Lopez, E., & Garcia-Cabot, A. (2022). End-to-End generation of Multiple-Choice questions using Text-to-Text transfer Transformer models. Expert Systems with Applications, 208, 118258.CrossRef Rodriguez-Torrealba, R., Garcia-Lopez, E., & Garcia-Cabot, A. (2022). End-to-End generation of Multiple-Choice questions using Text-to-Text transfer Transformer models. Expert Systems with Applications, 208, 118258.CrossRef
Zurück zum Zitat Roh, H.-K., & Lee, K.-H. (2017). A Basic Performance Evaluation of the Speech Recognition APP of Standard Language and Dialect using Goolgle, Naver, and Daum KAKAO APIs. Asia-Pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, 7(12), 819–829.CrossRef Roh, H.-K., & Lee, K.-H. (2017). A Basic Performance Evaluation of the Speech Recognition APP of Standard Language and Dialect using Goolgle, Naver, and Daum KAKAO APIs. Asia-Pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, 7(12), 819–829.CrossRef
Zurück zum Zitat Schnabel, T., Labutov, I., Mimno, D., & Joachims, T. (2015). Evaluation methods for unsupervised word embeddings. Paper presented at the Proceedings of the 2015 conference on empirical methods in natural language processing. Lisbon, Portugal Schnabel, T., Labutov, I., Mimno, D., & Joachims, T. (2015). Evaluation methods for unsupervised word embeddings. Paper presented at the Proceedings of the 2015 conference on empirical methods in natural language processing. Lisbon, Portugal
Zurück zum Zitat Söbke, H. (2022). Exploring (Collaborative) Generation and Exploitation of Multiple Choice Questions: Likes as Quality Proxy Metric. Education Sciences, 12(5), 297.CrossRef Söbke, H. (2022). Exploring (Collaborative) Generation and Exploitation of Multiple Choice Questions: Likes as Quality Proxy Metric. Education Sciences, 12(5), 297.CrossRef
Zurück zum Zitat Spector, J. M., Merrill, M. D., Elen, J., & Bishop, M. J. (2014). Handbook of research on educational communications and technology. Springer.CrossRef Spector, J. M., Merrill, M. D., Elen, J., & Bishop, M. J. (2014). Handbook of research on educational communications and technology. Springer.CrossRef
Zurück zum Zitat Wang, Z., Lan, A. S., Nie, W., Waters, A. E., Grimaldi, P. J., & Baraniuk, R. G. (2018). QG-Net: a Data-Driven Question Generation Model for Educational Content. Paper presented at the the Fifth Annual ACM Conference on Learning at Scale, London, United Kingdom. Wang, Z., Lan, A. S., Nie, W., Waters, A. E., Grimaldi, P. J., & Baraniuk, R. G. (2018). QG-Net: a Data-Driven Question Generation Model for Educational Content. Paper presented at the the Fifth Annual ACM Conference on Learning at Scale, London, United Kingdom.
Zurück zum Zitat Westermann, H., Savelka, J., & Benyekhlef, K. (2020). Paragraph similarity scoring and fine-tuned BERT for legal information retrieval and entailment. Paper presented at the JSAI International Symposium on Artificial Intelligence. Westermann, H., Savelka, J., & Benyekhlef, K. (2020). Paragraph similarity scoring and fine-tuned BERT for legal information retrieval and entailment. Paper presented at the JSAI International Symposium on Artificial Intelligence.
Zurück zum Zitat Xu, K., Zhang, M., Li, J., Du, S. S., Kawarabayashi, K.-i., & Jegelka, S. (2020). How neural networks extrapolate: From feedforward to graph neural networks. arXiv preprint arXiv:2009.11848. Xu, K., Zhang, M., Li, J., Du, S. S., Kawarabayashi, K.-i., & Jegelka, S. (2020). How neural networks extrapolate: From feedforward to graph neural networks. arXiv preprint arXiv:​2009.​11848.
Zurück zum Zitat Zhou, W., et al. (2020). "Pre-training text-to-text transformers for concept-centric common sense." arXiv preprint arXiv:2011.07956. Zhou, W., et al. (2020). "Pre-training text-to-text transformers for concept-centric common sense." arXiv preprint arXiv:​2011.​07956.
Metadaten
Titel
A question–answer generation system for an asynchronous distance learning platform
verfasst von
Hei-Chia Wang
Martinus Maslim
Chia-Hao Kan
Publikationsdatum
04.03.2023
Verlag
Springer US
Erschienen in
Education and Information Technologies / Ausgabe 9/2023
Print ISSN: 1360-2357
Elektronische ISSN: 1573-7608
DOI
https://doi.org/10.1007/s10639-023-11675-y

Weitere Artikel der Ausgabe 9/2023

Education and Information Technologies 9/2023 Zur Ausgabe

Premium Partner