Skip to main content
Top

2021 | OriginalPaper | Chapter

Question Answering System Using LSTM and Keyword Generation

Authors : Minakshi Tomer, Manoj Kumar

Published in: Advances in Information Communication Technology and Computing

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Question answering system is an area under natural language processing and information retrieval which automatically answers the questions generated by humans. This work represents an approach for building a system that generates answers for the question based on deep learning neural network which has the competence of processing the information present inside the dataset and enables the user to obtain an insight from the SQuAD dataset by inviting questions in natural language form. Key stages of this approach cover corpus pre-processing, question pre-processing, answer generation, deep neural network for answer extraction and keyword generation. The concept of keyword generation is a novel idea implemented to enable naïve user of the system to apprehend the passage. The system is competent in interpreting the question, responding to the user’s query in natural language form along with generating the keywords. The performance was measured on SQuAD dataset using EM and F1 score.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bordes A, Usunier N, Chopra S, Weston J (2015) Large-scale simple question answering with memory networks. ArXiv preprint arXiv:1506.02075 Bordes A, Usunier N, Chopra S, Weston J (2015) Large-scale simple question answering with memory networks. ArXiv preprint arXiv:​1506.​02075
2.
go back to reference Wang L, Xiong Y, Wang Y, Qiao DL, Tang X, Van Gool L (2016) Temporal segment networks: towards good practices for deep action recognition. In: European conference on computer vision, pp 20–36 Wang L, Xiong Y, Wang Y, Qiao DL, Tang X, Van Gool L (2016) Temporal segment networks: towards good practices for deep action recognition. In: European conference on computer vision, pp 20–36
4.
5.
go back to reference Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD international conference on management of data, pp 1247–1250 (2008) Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD international conference on management of data, pp 1247–1250 (2008)
6.
go back to reference Berant J, Chou A, Frostig R, Liang P (2013) Semantic parsing on freebase from question-answer pairs. In: Proceedings of the 2013 conference on empirical methods in natural language processing, pp 1533–1544 (2013) Berant J, Chou A, Frostig R, Liang P (2013) Semantic parsing on freebase from question-answer pairs. In: Proceedings of the 2013 conference on empirical methods in natural language processing, pp 1533–1544 (2013)
7.
go back to reference Fader A, Zettlemoyer L, Etzioni O (2014) Open question answering over curated and extracted knowledge bases. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1156–1165 Fader A, Zettlemoyer L, Etzioni O (2014) Open question answering over curated and extracted knowledge bases. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1156–1165
8.
go back to reference Caruana R (1997) Multitask learning. Machine Learning, 28(1):41–75, Springer Caruana R (1997) Multitask learning. Machine Learning, 28(1):41–75, Springer
9.
go back to reference Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th international conference on machine learning, pp 160–167 (2008) Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th international conference on machine learning, pp 160–167 (2008)
10.
go back to reference Allam A, Haggag M (2012) The question answering systems: a survey. Int J, Res Rev Inf Sci (IJRRIS) 2(3) Allam A, Haggag M (2012) The question answering systems: a survey. Int J, Res Rev Inf Sci (IJRRIS) 2(3)
11.
go back to reference Bhaskar P, Pakray P, Banerjee S, Banerjee S, Bandyopadhyay S, Gelbukh A (2012) Question answering system for QA4MRE CLEF 2012, CLEF (Online Working Notes/Labs/Workshop) Bhaskar P, Pakray P, Banerjee S, Banerjee S, Bandyopadhyay S, Gelbukh A (2012) Question answering system for QA4MRE CLEF 2012, CLEF (Online Working Notes/Labs/Workshop)
12.
go back to reference Tao F, Liu G (2018) (Advanced LSTM: a study about better time dependency modeling in emotion recognition. In: 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 2906–2910 (2018) Tao F, Liu G (2018) (Advanced LSTM: a study about better time dependency modeling in emotion recognition. In: 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 2906–2910 (2018)
13.
go back to reference Ling W, Luis T, Marujo L, Astudillo R, Amir S, Dyer C, Black A, Trancoso, I (2015) Finding function in formc Compositional character models for open vocabulary word representation. ArXiv preprint arXiv:1508.02096 (2015) Ling W, Luis T, Marujo L, Astudillo R, Amir S, Dyer C, Black A, Trancoso, I (2015) Finding function in formc Compositional character models for open vocabulary word representation. ArXiv preprint arXiv:​1508.​02096 (2015)
14.
go back to reference Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. ArXiv preprint arXiv:1409.0473 Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. ArXiv preprint arXiv:​1409.​0473
15.
go back to reference Hill F, Bordes A, Chopra S, Weston J (2015) The goldilocks principle: Reading children’s books with explicit memory representations. ArXiv preprint arXiv:1511.02301 Hill F, Bordes A, Chopra S, Weston J (2015) The goldilocks principle: Reading children’s books with explicit memory representations. ArXiv preprint arXiv:​1511.​02301
17.
go back to reference Rajpurkar P, Zhang J, Lopyrev K, Liang P (2016) Squad: 100,000 + questions for machine comprehension of text. ArXiv preprint arXiv:1606.05250 Rajpurkar P, Zhang J, Lopyrev K, Liang P (2016) Squad: 100,000 + questions for machine comprehension of text. ArXiv preprint arXiv:​1606.​05250
18.
go back to reference Choi E, Hewlett D, Uszkoreit J, Polosukhin I, Lacoste A, Berant J (2017) Coarse-to-fine question answering for long documents. In: Proceedings of the 55th annual meeting of the association for computational linguistics (Volume 1: Long Papers), pp 209–220 Choi E, Hewlett D, Uszkoreit J, Polosukhin I, Lacoste A, Berant J (2017) Coarse-to-fine question answering for long documents. In: Proceedings of the 55th annual meeting of the association for computational linguistics (Volume 1: Long Papers), pp 209–220
19.
go back to reference Iyyer M, Manjunatha V, Boyd-Graber J, Daum III H (2015) Deep unordered composition rivals syntactic methods for text classification. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (Volume 1: Long Papers), vol 1, pp 1681–1691 Iyyer M, Manjunatha V, Boyd-Graber J, Daum III H (2015) Deep unordered composition rivals syntactic methods for text classification. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (Volume 1: Long Papers), vol 1, pp 1681–1691
20.
go back to reference Rocktaschel T, Grefenstette E, Hermann K, Kovcisky T, Blunsom P (2015) Reasoning about entailment with neural attention. ArXiv preprint arXiv:1509.06664 Rocktaschel T, Grefenstette E, Hermann K, Kovcisky T, Blunsom P (2015) Reasoning about entailment with neural attention. ArXiv preprint arXiv:​1509.​06664
21.
go back to reference Cho K, Van Merrienboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. ArXiv preprint arXiv:1406.1078 Cho K, Van Merrienboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. ArXiv preprint arXiv:​1406.​1078
22.
go back to reference Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. ArXiv preprint arXiv:1412.3555 Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. ArXiv preprint arXiv:​1412.​3555
23.
go back to reference Kadlec R, Schmid M, Bajgar O, Kleindienst J (2016) Text understanding with the attention sum reader network. ArXiv preprint arXiv:1603.01547 Kadlec R, Schmid M, Bajgar O, Kleindienst J (2016) Text understanding with the attention sum reader network. ArXiv preprint arXiv:​1603.​01547
24.
go back to reference Cui Y, Chen Z, Wei Z, Wang S, Liu T, Hu G (2016) Attention-over-attention neural networks for reading comprehension. ArXiv preprint arXiv:1607.04423 Cui Y, Chen Z, Wei Z, Wang S, Liu T, Hu G (2016) Attention-over-attention neural networks for reading comprehension. ArXiv preprint arXiv:​1607.​04423
25.
go back to reference Sukhbaatar S, Weston J, Fergus R (2015) End-to-end memory networks. Adv Neural Inf Proc Syst 2440–2448 Sukhbaatar S, Weston J, Fergus R (2015) End-to-end memory networks. Adv Neural Inf Proc Syst 2440–2448
27.
go back to reference Yu Y, Zhang W, Hang C, Xiang B, Zhou B (2015) Empirical study on deep learning models for question answering. ArXiv preprint arXiv:1510.07526 Yu Y, Zhang W, Hang C, Xiang B, Zhou B (2015) Empirical study on deep learning models for question answering. ArXiv preprint arXiv:​1510.​07526
28.
go back to reference Richardson M, Burges C, Renshaw E (2013) Mctest: a challenge dataset for the open-domain machine comprehension of text. In: Proceedings of the 2013 conference on empirical methods in natural language processing, pp 193–203 Richardson M, Burges C, Renshaw E (2013) Mctest: a challenge dataset for the open-domain machine comprehension of text. In: Proceedings of the 2013 conference on empirical methods in natural language processing, pp 193–203
29.
go back to reference Berant J, Srikumar V, Chen P, Vander Linden A, Harding B, Huang B, Clark P, Manning C (2014) Modeling biological processes for reading comprehension. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp. 1499–1510 (2014) Berant J, Srikumar V, Chen P, Vander Linden A, Harding B, Huang B, Clark P, Manning C (2014) Modeling biological processes for reading comprehension. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp. 1499–1510 (2014)
30.
go back to reference Yang Y, Yih W, Meek C (2015) Wikiqa: a challenge dataset for open-domain question answering. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 2013–2018 Yang Y, Yih W, Meek C (2015) Wikiqa: a challenge dataset for open-domain question answering. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 2013–2018
Metadata
Title
Question Answering System Using LSTM and Keyword Generation
Authors
Minakshi Tomer
Manoj Kumar
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-5421-6_28