Skip to main content

2018 | OriginalPaper | Buchkapitel

Enhanced Embedding Based Attentive Pooling Network for Answer Selection

verfasst von : Zhan Su, Benyou Wang, Jiabin Niu, Shuchang Tao, Peng Zhang, Dawei Song

Erschienen in: Natural Language Processing and Chinese Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Document-based Question Answering tries to rank the candidate answers for given questions, which needs to evaluate matching score between the question sentence and answer sentence. Existing works usually utilize convolution neural network (CNN) to adaptively learn the latent matching pattern between the question/answer pair. However, CNN can only perceive the order of a word in a local windows, while the global order of the windows is ignored due to the window-sliding operation. In this report, we design an enhanced CNN (https://​github.​com/​shuishen112/​pairwise-deep-qa) with extended order information (e.g. overlapping position and global order) into inputting embedding, such rich representation makes it possible to learn an order-aware matching in CNN. Combining with standard convolutional paradigm like attentive pooling, pair-wise training and dynamic negative sample, this end-to-end CNN achieve a good performance on the DBQA task of NLPCC 2017 without any other extra features.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Hu, B., Lu, Z., Li, H., Chen, Q.: Convolutional neural network architectures for matching natural language sentences. In: Advances in Neural Information Processing Systems, pp. 2042–2050 (2014) Hu, B., Lu, Z., Li, H., Chen, Q.: Convolutional neural network architectures for matching natural language sentences. In: Advances in Neural Information Processing Systems, pp. 2042–2050 (2014)
3.
Zurück zum Zitat Yin, W., Schütze, H., Xiang, B., Zhou, B.: ABCNN: attention-based convolutional neural network for modeling sentence pairs. arXiv preprint arXiv:1512.05193 (2015) Yin, W., Schütze, H., Xiang, B., Zhou, B.: ABCNN: attention-based convolutional neural network for modeling sentence pairs. arXiv preprint arXiv:​1512.​05193 (2015)
4.
Zurück zum Zitat Severyn, A.: Automatic feature engineering for answer selection and extraction. In: EMNLP (2013) Severyn, A.: Automatic feature engineering for answer selection and extraction. In: EMNLP (2013)
5.
Zurück zum Zitat Yih, W.T., Chang, M.W., Meek, C., Pastusiak, A.: Question answering using enhanced lexical semantic models. In: Meeting of the Association for Computational Linguistics, pp. 1744–1753 (2013) Yih, W.T., Chang, M.W., Meek, C., Pastusiak, A.: Question answering using enhanced lexical semantic models. In: Meeting of the Association for Computational Linguistics, pp. 1744–1753 (2013)
6.
Zurück zum Zitat Yu, L., Hermann, K.M., Blunsom, P., Pulman, S.: Deep learning for answer sentence selection. arXiv preprint arXiv:1412.1632 (2014) Yu, L., Hermann, K.M., Blunsom, P., Pulman, S.: Deep learning for answer sentence selection. arXiv preprint arXiv:​1412.​1632 (2014)
7.
Zurück zum Zitat Severyn, A., Moschitti, A.: Learning to rank short text pairs with convolutional deep neural networks. In: SIGIR, pp. 373–382. ACM (2015) Severyn, A., Moschitti, A.: Learning to rank short text pairs with convolutional deep neural networks. In: SIGIR, pp. 373–382. ACM (2015)
9.
Zurück zum Zitat Yang, Y., Yih, W.-T., Meek, C.: WikiQA: a challenge dataset for open-domain question answering. In: EMNLP, pp. 2013–2018 (2015) Yang, Y., Yih, W.-T., Meek, C.: WikiQA: a challenge dataset for open-domain question answering. In: EMNLP, pp. 2013–2018 (2015)
10.
Zurück zum Zitat Wang, B., Niu, J., Ma, L., Zhang, Y., Zhang, L., Li, J., Zhang, P., Song, D.: A Chinese question answering approach integrating count-based and embedding-based features. In: Lin, C.-Y., Xue, N., Zhao, D., Huang, X., Feng, Y. (eds.) ICCPOL/NLPCC -2016. LNCS (LNAI), vol. 10102, pp. 934–941. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-50496-4_88 CrossRef Wang, B., Niu, J., Ma, L., Zhang, Y., Zhang, L., Li, J., Zhang, P., Song, D.: A Chinese question answering approach integrating count-based and embedding-based features. In: Lin, C.-Y., Xue, N., Zhao, D., Huang, X., Feng, Y. (eds.) ICCPOL/NLPCC -2016. LNCS (LNAI), vol. 10102, pp. 934–941. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-50496-4_​88 CrossRef
11.
Zurück zum Zitat Severyn, A., Moschitti, A.: Modeling Relational Information in Question-Answer Pairs with Convolutional Neural Networks (2016) Severyn, A., Moschitti, A.: Modeling Relational Information in Question-Answer Pairs with Convolutional Neural Networks (2016)
12.
Zurück zum Zitat Santos, C.D., Tan, M., Xiang, B., Zhou, B.: Attentive Pooling Networks (2016) Santos, C.D., Tan, M., Xiang, B., Zhou, B.: Attentive Pooling Networks (2016)
13.
Zurück zum Zitat Lin, J., Rao, J., He, H.: Noise-contrastive estimation for answer selection with deep neural networks. In: CIKM (2016) Lin, J., Rao, J., He, H.: Noise-contrastive estimation for answer selection with deep neural networks. In: CIKM (2016)
14.
Zurück zum Zitat Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013) Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
Metadaten
Titel
Enhanced Embedding Based Attentive Pooling Network for Answer Selection
verfasst von
Zhan Su
Benyou Wang
Jiabin Niu
Shuchang Tao
Peng Zhang
Dawei Song
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-73618-1_59