Skip to main content
Erschienen in: Automatic Control and Computer Sciences 2/2020

01.03.2020

Identification of Local Adverse Drug Reactions in Xinjiang Based on Attention Mechanism and BiLSTM-CNN Hybrid Network

verfasst von: Xiaozhuo Wang, Shengwei Tian, Long Yu, Qimeng Yang

Erschienen in: Automatic Control and Computer Sciences | Ausgabe 2/2020

Einloggen, um Zugang zu erhalten

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Adverse drug reactions (ADR) include adverse reactions which are caused by drug quality problems or improper medication. In order to solve the issues which are triggered by the lack of research on local adverse drug reactions in Xinjiang and the shortcomings of traditional models in dealing with irregular sentences, this paper proposes a method for adverse drug identification in Xinjiang. The method is combined with BiLSTM-CNN hybrid network which is based on attention mechanism. The method analyzes deeply on the network text context feature and the attention pooling mechanism. These measures can reduce the information loss while acquiring the local convolution feature. The integration of attention mechanism, the addition of weight information make it becomes more sensitive to capture the importance of features which brings improvement of the ability to express features. Finally, the experiment was carried out in the Xinjiang Adverse Drug Reaction Data Set. The accuracy rate of this model in Xinjiang local drug adverse reaction identification was 87.27%, the recall rate was 88.87%, and the F value was 87.65%. Compared with the common convolutional neural network and BiLSTM, it achieves better classification results, and has obvious advantages for irregular grammar and long sentence recognition. Experiments showed that the ATT-BiLSTM-CNN model can rapidly improve the recognition performance of local adverse drug reactions in Xinjiang.
Literatur
1.
Zurück zum Zitat Friedrich, S. and Dalianis, H., Adverse drug event classification of health records using dictionary based pre-processing and machine learning, Proceedings of the Sixth International Workshop on Health Text Mining and Information Analysis, 2015, pp. 121–130. Friedrich, S. and Dalianis, H., Adverse drug event classification of health records using dictionary based pre-processing and machine learning, Proceedings of the Sixth International Workshop on Health Text Mining and Information Analysis, 2015, pp. 121–130.
2.
Zurück zum Zitat Huynh, T., He, Y., Willis, A., and Rüger, S., Adverse drug reaction classification with deep neural networks, Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 2016, pp. 877–887. Huynh, T., He, Y., Willis, A., and Rüger, S., Adverse drug reaction classification with deep neural networks, Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 2016, pp. 877–887.
3.
Zurück zum Zitat Aroyehun, S.T. and Gelbukh, A., Automatic identification of drugs and adverse drug reaction related tweets, Proceedings of the 2018 EMNLP Workshop SMM4H: The 3rd Social Media Mining for Health Applications Workshop and Shared Task, 2018, pp. 54–55. Aroyehun, S.T. and Gelbukh, A., Automatic identification of drugs and adverse drug reaction related tweets, Proceedings of the 2018 EMNLP Workshop SMM4H: The 3rd Social Media Mining for Health Applications Workshop and Shared Task, 2018, pp. 54–55.
4.
Zurück zum Zitat Segura-Bedmar, I., Revert, R., and Martínez, P., Detecting drugs and adverse events from Spanish social media streams, Proceedings of the 5th International Workshop on Health Text Mining and Information Analysis (LOUHI), 2014, pp. 106–115. Segura-Bedmar, I., Revert, R., and Martínez, P., Detecting drugs and adverse events from Spanish social media streams, Proceedings of the 5th International Workshop on Health Text Mining and Information Analysis (LOUHI), 2014, pp. 106–115.
5.
Zurück zum Zitat Leaman, R., Wojtulewicz, L., Sullivan, R., Skariah, A., Yang, J., and Gonzalez, G., Towards internet-age pharmacovigilance: Extracting adverse drug reactions from user posts to health-related social networks, Proceedings of the 2010 Workshop on Biomedical Natural Language Processing, 2010, pp. 117–125. Leaman, R., Wojtulewicz, L., Sullivan, R., Skariah, A., Yang, J., and Gonzalez, G., Towards internet-age pharmacovigilance: Extracting adverse drug reactions from user posts to health-related social networks, Proceedings of the 2010 Workshop on Biomedical Natural Language Processing, 2010, pp. 117–125.
6.
Zurück zum Zitat Sager, N., Lyman, M., Bucknall, C., Nhan, N., and Tick, L.J. Natural language processing and the representation of clinical data, J. Am. Med. Inf. Assoc., 1994, vol. 1, no. 2, pp. 142–160.CrossRef Sager, N., Lyman, M., Bucknall, C., Nhan, N., and Tick, L.J. Natural language processing and the representation of clinical data, J. Am. Med. Inf. Assoc., 1994, vol. 1, no. 2, pp. 142–160.CrossRef
7.
Zurück zum Zitat Tang, D., Qin, B., and Liu, T., Aspect level sentiment classification with deep memory network, arXiv preprint arXiv:1605.08900, 2016. Tang, D., Qin, B., and Liu, T., Aspect level sentiment classification with deep memory network, arXiv preprint arXiv:1605.08900, 2016.
8.
Zurück zum Zitat Chen, Q., Zhu, X., Ling, Z., Wei, S., Jiang, H., and Inkpen, D., Enhanced LSTM for natural language inference, arXiv preprint arXiv:1609.06038, 2016. Chen, Q., Zhu, X., Ling, Z., Wei, S., Jiang, H., and Inkpen, D., Enhanced LSTM for natural language inference, arXiv preprint arXiv:1609.06038, 2016.
9.
Zurück zum Zitat Chua, L.O. and Roska, T., The CNN paradigm, IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., 1993, vol. 40, no. 3, pp. 147–156.CrossRef Chua, L.O. and Roska, T., The CNN paradigm, IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., 1993, vol. 40, no. 3, pp. 147–156.CrossRef
10.
Zurück zum Zitat Hochreiter, S. and Schmidhuber, J., Long short-term memory, Neural Comput., 1997, vol. 9, no. 8, pp. 1735–1780.CrossRef Hochreiter, S. and Schmidhuber, J., Long short-term memory, Neural Comput., 1997, vol. 9, no. 8, pp. 1735–1780.CrossRef
11.
Zurück zum Zitat Mikolov, T., Kopecky, J., Burget, L., and Glembek, O., Neural network based language models for highly inflective languages, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, 2009, pp. 4725–4728. Mikolov, T., Kopecky, J., Burget, L., and Glembek, O., Neural network based language models for highly inflective languages, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, 2009, pp. 4725–4728.
12.
Zurück zum Zitat Hinton, G.E., McClelland, J.L., and Rumelhart, D.E., Distributed Representations, Pittsburgh, PA: Carnegie-Mellon University, 1984, pp. 1–127. Hinton, G.E., McClelland, J.L., and Rumelhart, D.E., Distributed Representations, Pittsburgh, PA: Carnegie-Mellon University, 1984, pp. 1–127.
13.
Zurück zum Zitat Camacho-Collados, J. and Pilehvar, M.T., On the role of text preprocessing in neural network architectures: An evaluation study on text categorization and sentiment analysis, arXiv preprint arXiv:1707.01780, 2017. Camacho-Collados, J. and Pilehvar, M.T., On the role of text preprocessing in neural network architectures: An evaluation study on text categorization and sentiment analysis, arXiv preprint arXiv:1707.01780, 2017.
14.
Zurück zum Zitat Sun, J., 'Jieba' Chinese word segmentation tool, 2012. https://github.com/fxsjy/jieba. Sun, J., 'Jieba' Chinese word segmentation tool, 2012. https://​github.​com/​fxsjy/​jieba.​
15.
Zurück zum Zitat Er, M.J., Zhang, Y., Wang, N., and Pratama, M., Attention pooling-based convolutional neural network for sentence modeling, Inf. Sci., 2016, vol. 373, pp. 388–403.CrossRef Er, M.J., Zhang, Y., Wang, N., and Pratama, M., Attention pooling-based convolutional neural network for sentence modeling, Inf. Sci., 2016, vol. 373, pp. 388–403.CrossRef
16.
Zurück zum Zitat Hochreiter, S. and Schmidhuber, J., Long short-term memory, Neural Comput., 1997, vol. 9, no. 8, pp. 1735–1780.CrossRef Hochreiter, S. and Schmidhuber, J., Long short-term memory, Neural Comput., 1997, vol. 9, no. 8, pp. 1735–1780.CrossRef
17.
Zurück zum Zitat Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J., Distributed representations of words and phrases and their compositionality, in Advances in Neural Information Processing Systems, 2013, pp. 3111–3119. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J., Distributed representations of words and phrases and their compositionality, in Advances in Neural Information Processing Systems, 2013, pp. 3111–3119.
18.
Zurück zum Zitat Mnih, V., Heess, N., and Graves, A., Recurrent models of visual attention, in Advances in Neural Information Processing Systems, 2014, pp. 2204–2212. Mnih, V., Heess, N., and Graves, A., Recurrent models of visual attention, in Advances in Neural Information Processing Systems, 2014, pp. 2204–2212.
19.
Zurück zum Zitat Graves, A., Jaitly, N., and Mohamed, A.R., Hybrid speech recognition with deep bidirectional LSTM, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding, 2013, pp. 273–278. Graves, A., Jaitly, N., and Mohamed, A.R., Hybrid speech recognition with deep bidirectional LSTM, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding, 2013, pp. 273–278.
20.
Zurück zum Zitat Lilleberg, J., Zhu, Y., and Zhang, Y., Support vector machines and word2vec for text classification with semantic features, 2015 IEEE 14th International Conference on Cognitive Informatics and Cognitive Computing (ICCI CC), 2015, pp. 136–140. Lilleberg, J., Zhu, Y., and Zhang, Y., Support vector machines and word2vec for text classification with semantic features, 2015 IEEE 14th International Conference on Cognitive Informatics and Cognitive Computing (ICCI CC), 2015, pp. 136–140.
21.
Zurück zum Zitat Kim, Y., Convolutional neural networks for sentence classification, arXiv preprint arXiv:1408.5882, 2014. Kim, Y., Convolutional neural networks for sentence classification, arXiv preprint arXiv:1408.5882, 2014.
Metadaten
Titel
Identification of Local Adverse Drug Reactions in Xinjiang Based on Attention Mechanism and BiLSTM-CNN Hybrid Network
verfasst von
Xiaozhuo Wang
Shengwei Tian
Long Yu
Qimeng Yang
Publikationsdatum
01.03.2020
Verlag
Pleiades Publishing
Erschienen in
Automatic Control and Computer Sciences / Ausgabe 2/2020
Print ISSN: 0146-4116
Elektronische ISSN: 1558-108X
DOI
https://doi.org/10.3103/S014641162002008X

Weitere Artikel der Ausgabe 2/2020

Automatic Control and Computer Sciences 2/2020 Zur Ausgabe

Neuer Inhalt