Skip to main content
Top

2018 | OriginalPaper | Chapter

Good-Quality Question Generation for Academic Support

Authors : Manisha Divate, Ambuja Salgaonkar

Published in: Advanced Computational and Communication Paradigms

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The paper presents a metric to automatically compute a score for machine-generated questions and transforms the questions which are having a lower score value, unacceptable, and ungrammatical into a human appealing form. Questions are unacceptable due to the flaws like incorrect grammar, selection of wrong wh-phrase, partial selection of answer phrase, negation, etc. Identifying such infirmities in the question is a challenge. Here, our attempt is to automatically detect and correct the flaws present in the question. We named this system as the Automatic Question Quality Enhancer (AQQE). By employing a multiple linear regression model, AQQE first computes the score (in range of 1–rejected to 5–accepted) for 174 questions. Higher score value tells the acceptance and lower score value shows the rejection of the question. AQQE’s challenge is to enhance the quality of questions having a lower score. Out of 174, human evaluator had identified 84 questions as acceptable and 90 (51.72%) as an unacceptable. Performance of AQQE is judged with precision and recall and it is found well acceptable. AQQE enhanced 79(87.77%) questions are accepted by the human evaluator and 11 (6%) questions can be accepted with further modifications.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Rus, V., Graesser, A.C.: The question generation shared task and evaluation challenge. Natl. Sci. Found. 2009, 1–48 (2009) Rus, V., Graesser, A.C.: The question generation shared task and evaluation challenge. Natl. Sci. Found. 2009, 1–48 (2009)
2.
go back to reference Aist, G.: Towards automatic glossarization: automatically constructing and administering vocabulary assistance factoids and multiple-choice assessment. Int. J. Artif. Intell. Educ. 12, 212–231 (2001) Aist, G.: Towards automatic glossarization: automatically constructing and administering vocabulary assistance factoids and multiple-choice assessment. Int. J. Artif. Intell. Educ. 12, 212–231 (2001)
3.
go back to reference Brown, J.C., Frishkoff, G.A., Eskenazi, M.: Automatic question generation for vocabulary assessment. In: Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, Oct 2005, p. 826 Brown, J.C., Frishkoff, G.A., Eskenazi, M.: Automatic question generation for vocabulary assessment. In: Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, Oct 2005, p. 826
4.
go back to reference Susanti, Y., Iida, R., Tokunaga, T.: Automatic generation of english vocabulary tests. In: Proceedings of the 7th International Conference on Computer Supported Education, CSEDU 2015, vol. 1, pp. 77–87 (2015) Susanti, Y., Iida, R., Tokunaga, T.: Automatic generation of english vocabulary tests. In: Proceedings of the 7th International Conference on Computer Supported Education, CSEDU 2015, vol. 1, pp. 77–87 (2015)
5.
go back to reference Mostow, J., Beck, I.L., Bey, J., Cuneo, A., Sison, J., Tobin, B., Valeri, J.: Using automated questions to assess reading comprehension, vocabulary, and effects of tutorial interventions. Technol. Instr. Cogn. Learn. 2, 103–140 (2004) Mostow, J., Beck, I.L., Bey, J., Cuneo, A., Sison, J., Tobin, B., Valeri, J.: Using automated questions to assess reading comprehension, vocabulary, and effects of tutorial interventions. Technol. Instr. Cogn. Learn. 2, 103–140 (2004)
6.
go back to reference Huang, Y., He, L.: Automatic generation of short answer questions for reading comprehension assessment. Nat. Lang. Eng. 1–33 (2016) Huang, Y., He, L.: Automatic generation of short answer questions for reading comprehension assessment. Nat. Lang. Eng. 1–33 (2016)
7.
go back to reference Kunichika, H., Katayama, T., Hirashima, T., Takeuchi, A.: Automated question generation methods for intelligent english learning systems and its evaluation. In: International Conference on Computers in Education (2004) Kunichika, H., Katayama, T., Hirashima, T., Takeuchi, A.: Automated question generation methods for intelligent english learning systems and its evaluation. In: International Conference on Computers in Education (2004)
8.
go back to reference Chen, W.,Aist, G., Mostow, J.: Generating questions automatically from informational text. In: AIED 2009, 14th International Conference on Artificial Intelligence in Education Workshops Proceedings, no. 1, pp. 17–24 (2009) Chen, W.,Aist, G., Mostow, J.: Generating questions automatically from informational text. In: AIED 2009, 14th International Conference on Artificial Intelligence in Education Workshops Proceedings, no. 1, pp. 17–24 (2009)
9.
go back to reference Hoshino, A., Nakagawa, H.: A real-time multiple-choice question generation for language testing—a preliminary study. In: Proceedings of the second workshop on Building Educational Applications Using NLP, June 2005, pp. 17–20 Hoshino, A., Nakagawa, H.: A real-time multiple-choice question generation for language testing—a preliminary study. In: Proceedings of the second workshop on Building Educational Applications Using NLP, June 2005, pp. 17–20
10.
go back to reference Mitkov, R., An Ha, L., Karamanis, N.: A computer-aided environment for generating multiple-choice test items. Nat. Lang. Eng. 12(2), 177–194 (2006)CrossRef Mitkov, R., An Ha, L., Karamanis, N.: A computer-aided environment for generating multiple-choice test items. Nat. Lang. Eng. 12(2), 177–194 (2006)CrossRef
11.
go back to reference Liu, M., Calvo, R.A., Rus, V.: Automatic question generation for literature review writing support. In: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (2010)CrossRef Liu, M., Calvo, R.A., Rus, V.: Automatic question generation for literature review writing support. In: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (2010)CrossRef
12.
go back to reference Ali, H., Chali, Y., Hasan, S.A.: Automatic question generation from sentences. In: Proceedings of the TALN 2010, pp. 19–23 (2010) Ali, H., Chali, Y., Hasan, S.A.: Automatic question generation from sentences. In: Proceedings of the TALN 2010, pp. 19–23 (2010)
13.
go back to reference Chali, Y., Hasan, S.: Towards automatic topical question generation. In: COLING, Dec 2012, pp. 475–492 (2012) Chali, Y., Hasan, S.: Towards automatic topical question generation. In: COLING, Dec 2012, pp. 475–492 (2012)
14.
go back to reference Heilman, M., Smith, N.A.: Ranking automatically generated questions as a shared task. In: The 2nd Workshop on Question Generation (2009) Heilman, M., Smith, N.A.: Ranking automatically generated questions as a shared task. In: The 2nd Workshop on Question Generation (2009)
15.
go back to reference Lindberg, D.: Automatic Question Generatin from Text for Self-Directed Learning (2013) Lindberg, D.: Automatic Question Generatin from Text for Self-Directed Learning (2013)
16.
go back to reference Wolfe, J.H.: Automatic question generation from text—an aid to independent study. In: ACM SIGCUE Outlook (1976)CrossRef Wolfe, J.H.: Automatic question generation from text—an aid to independent study. In: ACM SIGCUE Outlook (1976)CrossRef
17.
go back to reference Wang, B., Liu, B., Sun, C., Wang, X., Zhang, D.: Generating questions from web community contents. In: Proceedings of COLING 2012: Demonstration Papers, Dec 2012, vol. 2, pp. 467–474 Wang, B., Liu, B., Sun, C., Wang, X., Zhang, D.: Generating questions from web community contents. In: Proceedings of COLING 2012: Demonstration Papers, Dec 2012, vol. 2, pp. 467–474
18.
go back to reference Yao, X.: Question generation with minimal recursion semantics. Communication 1–92 (2010) Yao, X.: Question generation with minimal recursion semantics. Communication 1–92 (2010)
19.
go back to reference Zhao, S., Wang, H., Li, C., Liu, T., Guan, Y.: Automatically generating questions from queries for community-based question answering. In: Proceedings of 5th International Joint Conference on Natural Language Processing, 2011, pp. 929–937 (2008) Zhao, S., Wang, H., Li, C., Liu, T., Guan, Y.: Automatically generating questions from queries for community-based question answering. In: Proceedings of 5th International Joint Conference on Natural Language Processing, 2011, pp. 929–937 (2008)
20.
go back to reference Heilman, M., Smith, N.A.: Question generation via overgenerating transformations and ranking. Framework (2009) Heilman, M., Smith, N.A.: Question generation via overgenerating transformations and ranking. Framework (2009)
21.
go back to reference Mannem, P., Prasad, R., Joshi, A.: Question generation from paragraphs at UPenn: QGSTEC system description. In: Proceedings of the QG 2010 Third Workshop on Question Generation Pittsburg, PA (2010) Mannem, P., Prasad, R., Joshi, A.: Question generation from paragraphs at UPenn: QGSTEC system description. In: Proceedings of the QG 2010 Third Workshop on Question Generation Pittsburg, PA (2010)
22.
go back to reference Divate, M., Salgaonkar, A.: Ranking model with a reduced feature set for an automated question generation system. In: International Conference on Natural Language Processing, pp. 221–230 (2015) Divate, M., Salgaonkar, A.: Ranking model with a reduced feature set for an automated question generation system. In: International Conference on Natural Language Processing, pp. 221–230 (2015)
23.
go back to reference Heilman, M.: Automatic Factual Question Generation from Text. Dissertation (2011) Heilman, M.: Automatic Factual Question Generation from Text. Dissertation (2011)
24.
go back to reference Schuster, S., Manning, C.D.: Enhanced english universal dependencies: an improved representation for natural language understanding tasks. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pp. 2371–2378 (2016) Schuster, S., Manning, C.D.: Enhanced english universal dependencies: an improved representation for natural language understanding tasks. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pp. 2371–2378 (2016)
25.
go back to reference Levy, R., Andrew, G.: Tregex and Tsurgeon: tools for querying and manipulating tree data structures. In: Proceedings of the 5th International Conference on Language Resources and Evaluation. (LREC 2006), pp. 2231–2234 (2006) Levy, R., Andrew, G.: Tregex and Tsurgeon: tools for querying and manipulating tree data structures. In: Proceedings of the 5th International Conference on Language Resources and Evaluation. (LREC 2006), pp. 2231–2234 (2006)
Metadata
Title
Good-Quality Question Generation for Academic Support
Authors
Manisha Divate
Ambuja Salgaonkar
Copyright Year
2018
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-8237-5_75