Skip to main content

2019 | OriginalPaper | Buchkapitel

Bi-directional Capsule Network Model for Chinese Biomedical Community Question Answering

verfasst von : Tongxuan Zhang, Yuqi Ren, Michael Mesfin Tadessem, Bo Xu, Xikai Liu, Liang Yang, Zhihao Yang, Jian Wang, Hongfei Lin

Erschienen in: Natural Language Processing and Chinese Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the rapid development of the Internet, community question answering (CQA) platforms have attracted increasing attention over recent years, particularly in the biomedical field. On biomedical CQA platforms, patients share information about diseases, drugs and symptoms by communicating with each other. Therefore, the biomedical CQA platforms become particularly valuable resources for information and knowledge acquisition of patients. To accurately acquire relevant information, question answering techniques have been introduced in biomedical CQA. However, existing approaches cannot achieve the ideal performance due to the domain-specific characteristics. For example, biomedical CQA involves more complex interactive information between askers and answerers, while CQA techniques designed for the general field can only deal with single interactions between questions and candidate answers within a similar topic. To address the problem, we propose a novel neural network model for biomedical CQA. Our model adopts the bidirectional capsule network to focus on different aspects of biomedical questions and candidate answers, and merges high-level vector representations of questions and answers to capture abundant semantic information. Furthermore, to capture the meaning of Chinese characters, we incorporate the radical of Chinese characters embedding as auxiliary information to improve the performance of Chinese biomedical CQA. We conduct extensive experiments, and demonstrate that our model achieves significant improvement on the performance of answer selection in the Chinese biomedical CQA task.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bhandwaldar, A., Zadrozny, W.: UNCC QA: biomedical question answering system. In: Proceedings of the 6th BioASQ Workshop A Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering, pp. 66–71 (2018) Bhandwaldar, A., Zadrozny, W.: UNCC QA: biomedical question answering system. In: Proceedings of the 6th BioASQ Workshop A Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering, pp. 66–71 (2018)
2.
Zurück zum Zitat Jin, Z.X., Zhang, B.W., Fang, F., et al.: Health assistant: answering your questions anytime from biomedical literature. Bioinformatics (2019) Jin, Z.X., Zhang, B.W., Fang, F., et al.: Health assistant: answering your questions anytime from biomedical literature. Bioinformatics (2019)
3.
Zurück zum Zitat Chen, L., Jose, J.M., Yu, H., et al.: A semantic graph based topic model for question retrieval in community question answering. In: Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, pp. 287–296. ACM (2016) Chen, L., Jose, J.M., Yu, H., et al.: A semantic graph based topic model for question retrieval in community question answering. In: Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, pp. 287–296. ACM (2016)
4.
Zurück zum Zitat Lai, T.M., Bui, T., Li, S.: A review on deep learning techniques applied to answer selection. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 2132–2144 (2018) Lai, T.M., Bui, T., Li, S.: A review on deep learning techniques applied to answer selection. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 2132–2144 (2018)
5.
Zurück zum Zitat Sequiera, R., Baruah, G., Tu, Z., et al.: Exploring the effectiveness of convolutional neural networks for answer selection in end-to-end question answering. arXiv preprint arXiv:1707.07804 (2017) Sequiera, R., Baruah, G., Tu, Z., et al.: Exploring the effectiveness of convolutional neural networks for answer selection in end-to-end question answering. arXiv preprint arXiv:​1707.​07804 (2017)
6.
Zurück zum Zitat Fang, H., Wu, F., Zhao, Z., et al.: Community-based question answering via heterogeneous social network learning. In: Thirtieth AAAI Conference on Artificial Intelligence (2016) Fang, H., Wu, F., Zhao, Z., et al.: Community-based question answering via heterogeneous social network learning. In: Thirtieth AAAI Conference on Artificial Intelligence (2016)
7.
Zurück zum Zitat Zhao, Z., Lu, H., Zheng, V.W., et al.: Community-based question answering via asymmetric multi-faceted ranking network learning. In: Thirty-First AAAI Conference on Artificial Intelligence (2017) Zhao, Z., Lu, H., Zheng, V.W., et al.: Community-based question answering via asymmetric multi-faceted ranking network learning. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)
8.
Zurück zum Zitat Maleewong, K.: Predicting quality-assured consensual answers in community-based question answering systems. In: Meesad, P., Boonkrong, S., Unger, H. (eds.) Recent Advances in Information and Communication Technology. Advances in Intelligent Systems and Computing, pp. 117–127. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40415-8_12CrossRef Maleewong, K.: Predicting quality-assured consensual answers in community-based question answering systems. In: Meesad, P., Boonkrong, S., Unger, H. (eds.) Recent Advances in Information and Communication Technology. Advances in Intelligent Systems and Computing, pp. 117–127. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-40415-8_​12CrossRef
9.
Zurück zum Zitat Tran, Q.H., Lai, T., Haffari, G., et al.: The context-dependent additive recurrent neural net. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1, pp. 1274–1283 (2018) Tran, Q.H., Lai, T., Haffari, G., et al.: The context-dependent additive recurrent neural net. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1, pp. 1274–1283 (2018)
10.
Zurück zum Zitat Tan, M., Dos Santos, C., Xiang, B., et al.: Improved representation learning for question answer matching. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol. 1, pp. 464–473 (2016) Tan, M., Dos Santos, C., Xiang, B., et al.: Improved representation learning for question answer matching. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol. 1, pp. 464–473 (2016)
11.
Zurück zum Zitat Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef
12.
Zurück zum Zitat Liwei, Y., Lei, S., Peng, S.: Attribute reduction for Chinese question classification. In: 2016 Chinese Control and Decision Conference (CCDC), pp. 5488–5492. IEEE (2016 Liwei, Y., Lei, S., Peng, S.: Attribute reduction for Chinese question classification. In: 2016 Chinese Control and Decision Conference (CCDC), pp. 5488–5492. IEEE (2016
13.
Zurück zum Zitat Yu, L., Hermann, K.M., Blunsom, P., et al.: Deep learning for answer sentence selection. arXiv preprint arXiv:1412.1632 (2014) Yu, L., Hermann, K.M., Blunsom, P., et al.: Deep learning for answer sentence selection. arXiv preprint arXiv:​1412.​1632 (2014)
14.
Zurück zum Zitat Sabour, S., Frosst, N., Hinton, G.E.: Dynamic routing between capsules. In: Advances in Neural Information Processing Systems, pp. 3856–3866 (2017) Sabour, S., Frosst, N., Hinton, G.E.: Dynamic routing between capsules. In: Advances in Neural Information Processing Systems, pp. 3856–3866 (2017)
15.
Zurück zum Zitat Zhao, W., Ye, J., Yang, M., et al.: Investigating capsule networks with dynamic routing for text classification. arXiv preprint arXiv:1804.00538 (2018) Zhao, W., Ye, J., Yang, M., et al.: Investigating capsule networks with dynamic routing for text classification. arXiv preprint arXiv:​1804.​00538 (2018)
16.
Zurück zum Zitat Zhang, X., Li, P., Jia, W., et al.: Multi-labeled relation extraction with attentive capsule network. arXiv preprint arXiv:1811.04354 (2018) Zhang, X., Li, P., Jia, W., et al.: Multi-labeled relation extraction with attentive capsule network. arXiv preprint arXiv:​1811.​04354 (2018)
17.
Zurück zum Zitat Mikolov, T., Chen, K., Corrado, G., et al.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013) Mikolov, T., Chen, K., Corrado, G., et al.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:​1301.​3781 (2013)
18.
19.
Zurück zum Zitat Dong, C., Zhang, J., Zong, C., Hattori, M., Di, H.: Character-based LSTM-CRF with radical-level features for Chinese named entity recognition. In: Lin, C.-Y., Xue, N., Zhao, D., Huang, X., Feng, Y. (eds.) ICCPOL/NLPCC-2016. LNCS (LNAI), vol. 10102, pp. 239–250. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-50496-4_20CrossRef Dong, C., Zhang, J., Zong, C., Hattori, M., Di, H.: Character-based LSTM-CRF with radical-level features for Chinese named entity recognition. In: Lin, C.-Y., Xue, N., Zhao, D., Huang, X., Feng, Y. (eds.) ICCPOL/NLPCC-2016. LNCS (LNAI), vol. 10102, pp. 239–250. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-50496-4_​20CrossRef
20.
Zurück zum Zitat Bengio, Y., Simard, P., Frasconi, P.: Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Networks 5(2), 157–166 (1994)CrossRef Bengio, Y., Simard, P., Frasconi, P.: Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Networks 5(2), 157–166 (1994)CrossRef
23.
Zurück zum Zitat Conneau, A., Kiela, D., Schwenk, H., et al.: Supervised learning of universal sentence representations from natural language inference data. arXiv preprint arXiv:1705.02364 (2017) Conneau, A., Kiela, D., Schwenk, H., et al.: Supervised learning of universal sentence representations from natural language inference data. arXiv preprint arXiv:​1705.​02364 (2017)
24.
Zurück zum Zitat Ren, Y., Zhang, T., Liu, X., et al.: End-to-end answer selection via attention-based Bi-LSTM network. In: 2018 1st IEEE International Conference on Hot Information-Centric Networking (HotICN), pp. 264–265. IEEE (2018) Ren, Y., Zhang, T., Liu, X., et al.: End-to-end answer selection via attention-based Bi-LSTM network. In: 2018 1st IEEE International Conference on Hot Information-Centric Networking (HotICN), pp. 264–265. IEEE (2018)
Metadaten
Titel
Bi-directional Capsule Network Model for Chinese Biomedical Community Question Answering
verfasst von
Tongxuan Zhang
Yuqi Ren
Michael Mesfin Tadessem
Bo Xu
Xikai Liu
Liang Yang
Zhihao Yang
Jian Wang
Hongfei Lin
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-32233-5_9

Premium Partner