Skip to main content
Top

2021 | OriginalPaper | Chapter

Deep Learning Based Question Generation Using T5 Transformer

Authors : Khushnuma Grover, Katinder Kaur, Kartikey Tiwari, Rupali, Parteek Kumar

Published in: Advanced Computing

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Manual construction of questions is a tedious and complicated process. Automatic Question Generation (AQG) methods work towards diminishing these costs and to fulfil the requirement for a persistent supply of new questions. Current AQG techniques utilize complicated architectures, that require intensive computational resources as well as a deeper understanding of the subject. In this paper we propose an end-to-end AQG system that utilises the power of a recently introduced transformer, the Text-to-Text Transfer Transformer (T5). We use the pre-trained T5 model and fine-tune it for our down-stream task of question generation. Our model performs very well on unseen data and generates well-formed and grammatically correct questions. These questions can be used directly by students, to examine their own level of understanding, and teachers, to quickly reinforce key concepts whenever required. The model has also been deployed in the form of a web application for public access. This application serves as an educational tool using which any individual can assess their knowledge and identify areas of improvement.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Das, R., Ray, A., Mondal, S., Das, D.: A rule based question generation framework to deal with simple and complex sentences. In: 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 542–548 (2016) Das, R., Ray, A., Mondal, S., Das, D.: A rule based question generation framework to deal with simple and complex sentences. In: 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 542–548 (2016)
6.
go back to reference Heilman, M.: Automatic factual question generation from text (2011) Heilman, M.: Automatic factual question generation from text (2011)
7.
go back to reference Heilman, M., Smith, N.A.: Good question! statistical ranking for question generation. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 609–617. Association for Computational Linguistics, Los Angeles (2010). https://www.aclweb.org/anthology/N10-1086 Heilman, M., Smith, N.A.: Good question! statistical ranking for question generation. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 609–617. Association for Computational Linguistics, Los Angeles (2010). https://​www.​aclweb.​org/​anthology/​N10-1086
9.
go back to reference Kumar, V., Ramakrishnan, G., Li, Y.F.: Putting the horse before the cart: a generator-evaluator framework for question generation from text (2019) Kumar, V., Ramakrishnan, G., Li, Y.F.: Putting the horse before the cart: a generator-evaluator framework for question generation from text (2019)
10.
go back to reference Lopez, L.E., Cruz, D.K., Cruz, J.C.B., Cheng, C.: Transformer-based end-to-end question generation (2020) Lopez, L.E., Cruz, D.K., Cruz, J.C.B., Cheng, C.: Transformer-based end-to-end question generation (2020)
11.
go back to reference Mitkov, R.: Computer-aided generation of multiple-choice tests. In: International Conference on Natural Language Processing and Knowledge Engineering, Proceedings, p. 15 (2003) Mitkov, R.: Computer-aided generation of multiple-choice tests. In: International Conference on Natural Language Processing and Knowledge Engineering, Proceedings, p. 15 (2003)
13.
go back to reference Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer (2019) Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer (2019)
15.
go back to reference Rus, V., Cai, Z., Graesser, A.: Question generation: example of a multi-year evaluation campaign. In: Proceedings of WS on the QGSTEC (2008) Rus, V., Cai, Z., Graesser, A.: Question generation: example of a multi-year evaluation campaign. In: Proceedings of WS on the QGSTEC (2008)
19.
20.
go back to reference Vaswani, A., et al.: Attention is all you need (2017) Vaswani, A., et al.: Attention is all you need (2017)
21.
go back to reference Vries, B.D., Príncipe, J.: A theory for neural networks with time delays. In: NIPS (1990) Vries, B.D., Príncipe, J.: A theory for neural networks with time delays. In: NIPS (1990)
22.
go back to reference Wolf, T., et al.: Huggingface’s transformers: state-of-the-art natural language processing (2019) Wolf, T., et al.: Huggingface’s transformers: state-of-the-art natural language processing (2019)
Metadata
Title
Deep Learning Based Question Generation Using T5 Transformer
Authors
Khushnuma Grover
Katinder Kaur
Kartikey Tiwari
Rupali
Parteek Kumar
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-16-0401-0_18

Premium Partner