Skip to main content

2018 | OriginalPaper | Buchkapitel

Research on Question-Answering System Based on Deep Learning

verfasst von : Bo Song, Yue Zhuo, Xiaomei Li

Erschienen in: Advances in Swarm Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the continuous development of the network, Question-Answering system has become a way for people to get information quickly. The QA task aims to provide precise and quick answers to user questions from a collection of documents or a database. In this paper, we introduce an attention based deep learning model to match the question and answer sentence. The proposed model employs a bidirectional long-short term memory(BLSTM) to solve the problem of lack features. And we also use the attention mechanism which allows the question to focus on a certain part of the candidate answer. Finally, we evaluate our model and the results show that our approach outperforms the method of feature construction based on machine learning. And the attention mechanism improves the matching accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abacha, A.B., Zweigenbaum, P.: MEANS: a medical question-answering system combining NLP techniques and semantic web technologies. J. Inf. Process. Manag. 51(5), 570–594 (2015)CrossRef Abacha, A.B., Zweigenbaum, P.: MEANS: a medical question-answering system combining NLP techniques and semantic web technologies. J. Inf. Process. Manag. 51(5), 570–594 (2015)CrossRef
2.
Zurück zum Zitat Mao, X.L., Li, X.M.: A survey on question and answering systems. J. Front. Comput. Sci. Technol. 06(3), 193–207 (2012) Mao, X.L., Li, X.M.: A survey on question and answering systems. J. Front. Comput. Sci. Technol. 06(3), 193–207 (2012)
3.
Zurück zum Zitat Kim, Y.: Convolutional Neural Networks for Sentence Classification. Eprint Arxiv (2014) Kim, Y.: Convolutional Neural Networks for Sentence Classification. Eprint Arxiv (2014)
4.
Zurück zum Zitat Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. Computer Science (2014) Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. Computer Science (2014)
5.
Zurück zum Zitat Cho, K., Merrienboer, B.V., Gulcehre, C., et al.: Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. Computer Science (2014) Cho, K., Merrienboer, B.V., Gulcehre, C., et al.: Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. Computer Science (2014)
6.
Zurück zum Zitat Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to Sequence Learning with Neural Networks. In: NLPS (2014) Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to Sequence Learning with Neural Networks. In: NLPS (2014)
7.
Zurück zum Zitat Rush, A.M., Chopra, S., Weston, J.: A Neural Attention Model for Abstractive Sentence Summarization. Computer Science (2015) Rush, A.M., Chopra, S., Weston, J.: A Neural Attention Model for Abstractive Sentence Summarization. Computer Science (2015)
8.
Zurück zum Zitat Iyyer, M., Boyd-Graber, J., Claudino, L., et al.: A neural network for factoid question answering over paragraphs. In: Conference on Empirical Methods in Natural Language Processing, NIPS (2014) Iyyer, M., Boyd-Graber, J., Claudino, L., et al.: A neural network for factoid question answering over paragraphs. In: Conference on Empirical Methods in Natural Language Processing, NIPS (2014)
9.
Zurück zum Zitat Hu, B., Lu, Z., Li, H., et al.: Convolutional neural network architectures for matching natural language sentences. In: Advances in neural information processing (2015) Hu, B., Lu, Z., Li, H., et al.: Convolutional neural network architectures for matching natural language sentences. In: Advances in neural information processing (2015)
11.
Zurück zum Zitat Zheng, Z.: AnswerBus question answering system. In: International Conference on Human Language Technology Research. pp. 399–404. Morgan Kaufmann Publishers Inc. (2002) Zheng, Z.: AnswerBus question answering system. In: International Conference on Human Language Technology Research. pp. 399–404. Morgan Kaufmann Publishers Inc. (2002)
12.
Zurück zum Zitat Moldovan, D,I., Harabagiu, S.M., Goodrum, R.A., et al.: LASSO: a tool for surfing the answer net. In: National Institute of Standards and Technology (1999) Moldovan, D,I., Harabagiu, S.M., Goodrum, R.A., et al.: LASSO: a tool for surfing the answer net. In: National Institute of Standards and Technology (1999)
15.
Zurück zum Zitat Zhang, W.: Chinese Question Answering System Technology and Application. Electronic Industry Press, Beijing (2016) Zhang, W.: Chinese Question Answering System Technology and Application. Electronic Industry Press, Beijing (2016)
16.
Zurück zum Zitat Li, J.N.: Research and Implementation of IT Domain Question Answering System. South China University of Technology (2015) Li, J.N.: Research and Implementation of IT Domain Question Answering System. South China University of Technology (2015)
17.
Zurück zum Zitat Gers, F.A., Schraudolph, N.N.: Learning precise timing with LSTM recurrent networks. JMLR.org (2003) Gers, F.A., Schraudolph, N.N.: Learning precise timing with LSTM recurrent networks. JMLR.org (2003)
18.
Zurück zum Zitat Graves, A.: Generating Sequences With Recurrent Neural Networks. Computer Science (2013) Graves, A.: Generating Sequences With Recurrent Neural Networks. Computer Science (2013)
19.
Zurück zum Zitat Nie, Y.P., Han, Y., Huang, J.M., et al.: Attention-based encoder-decoder model for answer selection in question answering. J. Front. Inf. Technol. Electr. Eng. 18(4), 535–544 (2017)CrossRef Nie, Y.P., Han, Y., Huang, J.M., et al.: Attention-based encoder-decoder model for answer selection in question answering. J. Front. Inf. Technol. Electr. Eng. 18(4), 535–544 (2017)CrossRef
20.
Zurück zum Zitat Rong, G.H., Huang, Z.H.: Question answer matching method based on deep learning. J. Comput. Appl. 37(10), 286–2865 (2017) Rong, G.H., Huang, Z.H.: Question answer matching method based on deep learning. J. Comput. Appl. 37(10), 286–2865 (2017)
21.
Zurück zum Zitat Yin, W., Schütze, H., Xiang, B., et al.: ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs. Computer Science (2015) Yin, W., Schütze, H., Xiang, B., et al.: ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs. Computer Science (2015)
22.
Zurück zum Zitat Tan, M., Xiang, B., Zhou, B.: LSTM-based Deep Learning Models for non-factoid answer selection. Computer Science (2015) Tan, M., Xiang, B., Zhou, B.: LSTM-based Deep Learning Models for non-factoid answer selection. Computer Science (2015)
Metadaten
Titel
Research on Question-Answering System Based on Deep Learning
verfasst von
Bo Song
Yue Zhuo
Xiaomei Li
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-93818-9_50