Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 2/2021

14.08.2020 | Original Article

Chinese medical relation extraction based on multi-hop self-attention mechanism

verfasst von: Tongxuan Zhang, Hongfei Lin, Michael M. Tadesse, Yuqi Ren, Xiaodong Duan, Bo Xu

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The medical literature is the most important way to demonstrate academic achievements and academic exchanges. Massive medical literature has become a huge treasure trove of knowledge. It is necessary to automatically extract implicit medical knowledge from the medical literature. Medical relation extraction aims to automatically extract medical relations from the medical text for various medical researches. However, there are a few kinds of research in Chinese medical literature. Currently, the popular methods are based on neural networks, which focus on semantic information on one aspect of the sentence. However, complex semantic information in the sentence determines the relation between entities, the semantic information cannot be represented by one sentence vector. In this paper, we propose an attention-based model to extract the multi-aspect semantic information for the Chinese medical relation extraction by multi-hop attention mechanism. The model could generate multiple weight vectors for the sentence through each attention step, therefore, we can generate the different semantic representation of a sentence, respectively. Our model is evaluated by using Chinese medical literature from China National Knowledge Infrastructure (CNKI). It achieves an F1 score of 93.19% for therapeutic relation tasks and 73.47% for causal relation tasks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Wang Y, You ZH, Yang S et al (2019) A high efficient biological language model for predicting protein–protein interactions. Cells 8(2):122CrossRef Wang Y, You ZH, Yang S et al (2019) A high efficient biological language model for predicting protein–protein interactions. Cells 8(2):122CrossRef
2.
Zurück zum Zitat Ryu JY, Kim HU, Lee SY (2018) Deep learning improves prediction of drug–drug and drug–food interactions. Proc Natl Acad Sci 115(18):E4304–E4311CrossRef Ryu JY, Kim HU, Lee SY (2018) Deep learning improves prediction of drug–drug and drug–food interactions. Proc Natl Acad Sci 115(18):E4304–E4311CrossRef
3.
Zurück zum Zitat Kringelum J, Kjaerulff S K, Brunak S et al (2016) ChemProt-3.0: a global chemical biology diseases mapping. Database 2016 Kringelum J, Kjaerulff S K, Brunak S et al (2016) ChemProt-3.0: a global chemical biology diseases mapping. Database 2016
4.
Zurück zum Zitat Wei C H, Peng Y, Leaman R et al (2016) Assessing the state of the art in biomedical relation extraction: overview of the BioCreative V chemical-disease relation (CDR) task. Database 2016 Wei C H, Peng Y, Leaman R et al (2016) Assessing the state of the art in biomedical relation extraction: overview of the BioCreative V chemical-disease relation (CDR) task. Database 2016
5.
Zurück zum Zitat Bunescu R, Ge R, Kate RJ et al (2005) Comparative experiments on learning information extractors for proteins and their interactions. Artif Intell Med 33(2):139–155CrossRef Bunescu R, Ge R, Kate RJ et al (2005) Comparative experiments on learning information extractors for proteins and their interactions. Artif Intell Med 33(2):139–155CrossRef
6.
Zurück zum Zitat Segura Bedmar I, Martínez P, Herrero Zazo M (2013) Semeval-2013 task 9: extraction of drug-drug interactions from biomedical texts (ddiextraction 2013). Association for Computational Linguistics, pp 341–350 Segura Bedmar I, Martínez P, Herrero Zazo M (2013) Semeval-2013 task 9: extraction of drug-drug interactions from biomedical texts (ddiextraction 2013). Association for Computational Linguistics, pp 341–350
7.
Zurück zum Zitat Blaschke C, Valencia A (2002) The frame-based module of the SUISEKI information extraction system. IEEE Intell Syst 17(2):14–20 Blaschke C, Valencia A (2002) The frame-based module of the SUISEKI information extraction system. IEEE Intell Syst 17(2):14–20
8.
Zurück zum Zitat Corney DPA, Buxton BF, Langdon WB et al (2004) BioRAT: extracting biological information from full-length papers. Bioinformatics 20(17):3206–3213CrossRef Corney DPA, Buxton BF, Langdon WB et al (2004) BioRAT: extracting biological information from full-length papers. Bioinformatics 20(17):3206–3213CrossRef
9.
Zurück zum Zitat Alam F, Corazza A, Lavelli A et al (2016) A knowledge-poor approach to chemical-disease relation extraction. Database 071 Alam F, Corazza A, Lavelli A et al (2016) A knowledge-poor approach to chemical-disease relation extraction. Database 071
10.
Zurück zum Zitat Kim S, Liu H, Yeganova L et al (2015) Extracting drug-drug interactions from literature using a rich feature-based linear kernel approach. J Biomed Inform 55:23–30CrossRef Kim S, Liu H, Yeganova L et al (2015) Extracting drug-drug interactions from literature using a rich feature-based linear kernel approach. J Biomed Inform 55:23–30CrossRef
11.
Zurück zum Zitat Peng Y, Lu Z (2017) Deep learning for extracting protein-protein interactions from biomedical literature. arXiv preprint arXiv:1706.01556 Peng Y, Lu Z (2017) Deep learning for extracting protein-protein interactions from biomedical literature. arXiv preprint arXiv:1706.01556
12.
Zurück zum Zitat Zhang Y, Zheng W, Lin H et al (2017) Drug–drug interaction extraction via hierarchical RNNs on sequence and shortest dependency paths. Bioinformatics 34(5):828–835CrossRef Zhang Y, Zheng W, Lin H et al (2017) Drug–drug interaction extraction via hierarchical RNNs on sequence and shortest dependency paths. Bioinformatics 34(5):828–835CrossRef
13.
Zurück zum Zitat Zhang Y, Lin H, Yang Z et al (2018) A hybrid model based on neural networks for biomedical relation extraction. J Biomed Inform 81:83CrossRef Zhang Y, Lin H, Yang Z et al (2018) A hybrid model based on neural networks for biomedical relation extraction. J Biomed Inform 81:83CrossRef
14.
Zurück zum Zitat Lee K, Qadir A, Hasan SA, Datla V, Prakash A, Liu J, Farri O (2017) Adverse drug event detection in tweets with semi-supervised convolutional neural networks. In: Proceedings of the international conference on World Wide Web, pp 705–714 Lee K, Qadir A, Hasan SA, Datla V, Prakash A, Liu J, Farri O (2017) Adverse drug event detection in tweets with semi-supervised convolutional neural networks. In: Proceedings of the international conference on World Wide Web, pp 705–714
15.
Zurück zum Zitat Li F, Zhang M, Fu G, Ji D (2017) A neural joint model for entity and relation extraction from biomedical text. BMC Bioinform 18(1):198CrossRef Li F, Zhang M, Fu G, Ji D (2017) A neural joint model for entity and relation extraction from biomedical text. BMC Bioinform 18(1):198CrossRef
16.
Zurück zum Zitat Alimova I, Solovyev V (2018) Interactive attention network for adverse drug reaction classification. In: Conference on artificial intelligence and natural language. Springer, pp 185–196 Alimova I, Solovyev V (2018) Interactive attention network for adverse drug reaction classification. In: Conference on artificial intelligence and natural language. Springer, pp 185–196
17.
Zurück zum Zitat Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
18.
Zurück zum Zitat Zeng D, Liu K, Lai S et al (2014) Relation classification via convolutional deep neural network. In: Proceedings of the 25th international conference on computational linguistics (COLING), pp 2335–2344 Zeng D, Liu K, Lai S et al (2014) Relation classification via convolutional deep neural network. In: Proceedings of the 25th international conference on computational linguistics (COLING), pp 2335–2344
19.
Zurück zum Zitat Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertain Fuzziness Knowl Based Syst 6:107–116CrossRef Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertain Fuzziness Knowl Based Syst 6:107–116CrossRef
20.
Zurück zum Zitat Dong Y, Liu P, Zhu Z et al (2019) A fusion model-based label embedding and self-interaction attention for text classification. IEEE Access 8:30548–30559CrossRef Dong Y, Liu P, Zhu Z et al (2019) A fusion model-based label embedding and self-interaction attention for text classification. IEEE Access 8:30548–30559CrossRef
21.
Zurück zum Zitat Wu X, Cai Y, Li Q et al (2018) Combining contextual information by self-attention mechanism in convolutional neural networks for text classification. In: International conference on web information systems engineering, Springer, Cham, pp 453–467 Wu X, Cai Y, Li Q et al (2018) Combining contextual information by self-attention mechanism in convolutional neural networks for text classification. In: International conference on web information systems engineering, Springer, Cham, pp 453–467
22.
Zurück zum Zitat Du J, Han J, Way A et al (2018) Multi-level structured self-attentions for distantly supervised relation extraction. arXiv preprint arXiv:1809.00699 Du J, Han J, Way A et al (2018) Multi-level structured self-attentions for distantly supervised relation extraction. arXiv preprint arXiv:1809.00699
23.
Zurück zum Zitat Huang Y, Du J (2019) Self-attention enhanced CNNs and collaborative curriculum learning for distantly supervised relation extraction. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), pp 389–398 Huang Y, Du J (2019) Self-attention enhanced CNNs and collaborative curriculum learning for distantly supervised relation extraction. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), pp 389–398
24.
Zurück zum Zitat Tran NK, Niedereée C (2018) Multihop attention networks for question answer matching. In: The 41st international ACM SIGIR conference on research & development in information retrieval, ACM, pp 325–334 Tran NK, Niedereée C (2018) Multihop attention networks for question answer matching. In: The 41st international ACM SIGIR conference on research & development in information retrieval, ACM, pp 325–334
25.
Zurück zum Zitat Zhou P, Shi W, Tian J et al (2016) Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th annual meeting of the association for computational linguistics (volume 2: short papers), pp 207–212 Zhou P, Shi W, Tian J et al (2016) Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th annual meeting of the association for computational linguistics (volume 2: short papers), pp 207–212
26.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998–6008 Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998–6008
Metadaten
Titel
Chinese medical relation extraction based on multi-hop self-attention mechanism
verfasst von
Tongxuan Zhang
Hongfei Lin
Michael M. Tadesse
Yuqi Ren
Xiaodong Duan
Bo Xu
Publikationsdatum
14.08.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 2/2021
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01176-6

Weitere Artikel der Ausgabe 2/2021

International Journal of Machine Learning and Cybernetics 2/2021 Zur Ausgabe

Neuer Inhalt