Skip to main content
Erschienen in: Cluster Computing 4/2020

03.02.2020

A new method of emotional analysis based on CNN–BiLSTM hybrid neural network

verfasst von: Zi-xian Liu, De-gan Zhang, Gu-zhao Luo, Ming Lian, Bing Liu

Erschienen in: Cluster Computing | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The hybrid neural network model proposed in this paper consists of two main parts: extracting local features of text vectors by convolutional neural network, extracting global features related to text context by BiLSTM, and fusing the features extracted by the two complementary models. In this paper, the pre-processed sentences are put into the hybrid neural network for training. The trained hybrid neural network can automatically classify the sentences. When testing the algorithm proposed in this paper, the training corpus is Word2vec. The test results show that the accuracy rate of text categorization reaches 94.2%, and the number of iterations is 10. The results show that the proposed algorithm has high accuracy and good robustness when the sample size is seriously unbalanced.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Tang, D., Qin, B., Liu, T.: Deep learning for sentiment analysis: successful approaches and future challenges. Wiley Interdiscip Rev 5(6), 292–303 (2015) Tang, D., Qin, B., Liu, T.: Deep learning for sentiment analysis: successful approaches and future challenges. Wiley Interdiscip Rev 5(6), 292–303 (2015)
2.
Zurück zum Zitat Lan, W.F., Xu, W., Wang, T.: Text classification of Chinese news based on convolutional neural network. J. South-Central Univ. Natl. (Nat Sci Edition) 1, 138–143 (2018) Lan, W.F., Xu, W., Wang, T.: Text classification of Chinese news based on convolutional neural network. J. South-Central Univ. Natl. (Nat Sci Edition) 1, 138–143 (2018)
3.
Zurück zum Zitat Gong, Q.J.: A text classification based on the Recurrent Neural Networks. Huazhong University, Wuhan (2016) Gong, Q.J.: A text classification based on the Recurrent Neural Networks. Huazhong University, Wuhan (2016)
4.
Zurück zum Zitat Cui, J.M., Liu, J., Liao, Z.Y.: Research of text categorization based on support vector mechine. Comput. Simul. 30(2), 299–302 (2018) Cui, J.M., Liu, J., Liao, Z.Y.: Research of text categorization based on support vector mechine. Comput. Simul. 30(2), 299–302 (2018)
5.
Zurück zum Zitat Wu, Y.L., Zhao, S.L., Li, C.J.: Text classification method based on TF-IDF and cosine similarity. J. Chin. Inform. Process. 31(5), 138–145 (2017) Wu, Y.L., Zhao, S.L., Li, C.J.: Text classification method based on TF-IDF and cosine similarity. J. Chin. Inform. Process. 31(5), 138–145 (2017)
6.
Zurück zum Zitat Yao, Q.Z., Song, Z.L., Peng, C.: Research on text categorization based on LDA. Comput. Eng. Appl. 47(13), 150–153 (2011) Yao, Q.Z., Song, Z.L., Peng, C.: Research on text categorization based on LDA. Comput. Eng. Appl. 47(13), 150–153 (2011)
7.
Zurück zum Zitat Xia, C.L., Qian, T., Ji, D.H.: Event convolutional feature based news documents classification. Appl. Res. Comput. 4, 991–994 (2017) Xia, C.L., Qian, T., Ji, D.H.: Event convolutional feature based news documents classification. Appl. Res. Comput. 4, 991–994 (2017)
10.
Zurück zum Zitat Zhou, F.Y., Jin, L.P., Dong, J.: Review of convolutional neural network. Chin. J. Comput. 1, 35–38 (2017)MathSciNet Zhou, F.Y., Jin, L.P., Dong, J.: Review of convolutional neural network. Chin. J. Comput. 1, 35–38 (2017)MathSciNet
11.
Zurück zum Zitat Li, Y., Dong, H.B.: Text emotion analysis based on CNN and BiLSTM network feature fusion. Comput. Appl. 38(11), 29–34 (2018) Li, Y., Dong, H.B.: Text emotion analysis based on CNN and BiLSTM network feature fusion. Comput. Appl. 38(11), 29–34 (2018)
12.
Zurück zum Zitat Kalchbrenner, N., Blunsom, P.: Recurrent convolutional neural networks for discourse compositionality. Comput. Sci. 10, 1–2 (2013) Kalchbrenner, N., Blunsom, P.: Recurrent convolutional neural networks for discourse compositionality. Comput. Sci. 10, 1–2 (2013)
13.
Zurück zum Zitat Kim, K., Chung, B.S., Choi, Y.R.: Language independent semantic kernels for short-text classification. Expert Syst. Appl. Int. J. 41(2), 735–743 (2014)CrossRef Kim, K., Chung, B.S., Choi, Y.R.: Language independent semantic kernels for short-text classification. Expert Syst. Appl. Int. J. 41(2), 735–743 (2014)CrossRef
15.
Zurück zum Zitat Zhou, S.: A low duty cycle efficient MAC protocol based on self-adaption and predictive strategy. Mob. Netw. Appl. 23(4), 828–839 (2018)CrossRef Zhou, S.: A low duty cycle efficient MAC protocol based on self-adaption and predictive strategy. Mob. Netw. Appl. 23(4), 828–839 (2018)CrossRef
16.
Zurück zum Zitat Jin, C., Li, W., et al.: Chinese word segmentation based on bidirectional LSTM neural network model. Chin. J. Inform. 32(2), 29–37 (2018) Jin, C., Li, W., et al.: Chinese word segmentation based on bidirectional LSTM neural network model. Chin. J. Inform. 32(2), 29–37 (2018)
17.
Zurück zum Zitat Chen, J., Li, H.F., Ma, L., et al.: Dimensional speech emotion recognition method based on multi-granularity feature fusion. Signal Process. 33(3), 374–382 (2017) Chen, J., Li, H.F., Ma, L., et al.: Dimensional speech emotion recognition method based on multi-granularity feature fusion. Signal Process. 33(3), 374–382 (2017)
18.
Zurück zum Zitat Zhang, D.G., Niu, H.L., Liu, S.: Novel PEECR-based clustering routing approach. Soft. Comput. 21(24), 7313–7323 (2017)CrossRef Zhang, D.G., Niu, H.L., Liu, S.: Novel PEECR-based clustering routing approach. Soft. Comput. 21(24), 7313–7323 (2017)CrossRef
19.
Zurück zum Zitat Tang, Y.M.: Novel reliable routing method for engineering of internet of vehicles based on graph theory. Eng. Comput. 36(1), 226–247 (2019) Tang, Y.M.: Novel reliable routing method for engineering of internet of vehicles based on graph theory. Eng. Comput. 36(1), 226–247 (2019)
20.
Zurück zum Zitat Fan, Y.X., Guo, J.F., Lan, Y.Y., et al.: Context-based deep semantic sentence retrieval model. Chin. J. Inform. Sci. 31(5), 161–167 (2017) Fan, Y.X., Guo, J.F., Lan, Y.Y., et al.: Context-based deep semantic sentence retrieval model. Chin. J. Inform. Sci. 31(5), 161–167 (2017)
21.
Zurück zum Zitat Hatzivassiloglou, V., Mc Keown, K.R.: Predicting the semantic orientation of adjectives In: Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics. Association for Computational Linguistics, pp. 174–181 (1997) Hatzivassiloglou, V., Mc Keown, K.R.: Predicting the semantic orientation of adjectives In: Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics. Association for Computational Linguistics, pp. 174–181 (1997)
22.
Zurück zum Zitat Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: sentiment classification using machine learning techniques. In: Acl-02 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, pp. 79–86 (2002) Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: sentiment classification using machine learning techniques. In: Acl-02 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, pp. 79–86 (2002)
23.
Zurück zum Zitat Turney, P.D.: Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews. In: Proceedings of Annual Meeting of the Association for Computational Linguistics, pp. 417–424 (2002) Turney, P.D.: Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews. In: Proceedings of Annual Meeting of the Association for Computational Linguistics, pp. 417–424 (2002)
24.
Zurück zum Zitat Lin, C., He, Y., Everson, R.: A comparative study of Bayesian models for unsupervised sentiment detection. GRB Coord. Netw. 12255, 144–152 (2010) Lin, C., He, Y., Everson, R.: A comparative study of Bayesian models for unsupervised sentiment detection. GRB Coord. Netw. 12255, 144–152 (2010)
27.
Zurück zum Zitat Simonyan, K., Zisserman, A.: Two-Stream Convolutional Networks for Action Recognition in Videos. University of Oxford, Oxford (2014) Simonyan, K., Zisserman, A.: Two-Stream Convolutional Networks for Action Recognition in Videos. University of Oxford, Oxford (2014)
29.
Zurück zum Zitat Zhang, D.G., Hui, G.: New multi-hop clustering algorithm for vehicular ad hoc networks. IEEE Trans. Intell. Transp. Syst. 20(4), 1517–1530 (2019)CrossRef Zhang, D.G., Hui, G.: New multi-hop clustering algorithm for vehicular ad hoc networks. IEEE Trans. Intell. Transp. Syst. 20(4), 1517–1530 (2019)CrossRef
31.
Zurück zum Zitat Gao, J.X.: Novel approach of distributed & adaptive trust metrics for MANET. Wirel. Netw. 25(6), 3587–3603 (2019)CrossRef Gao, J.X.: Novel approach of distributed & adaptive trust metrics for MANET. Wirel. Netw. 25(6), 3587–3603 (2019)CrossRef
33.
Zurück zum Zitat Hermans, M., Burm, M., Dambre, J.: Trainable and dynamic computing: error backpropagation through physical media. Arxiv 1, 34–39 (2014) Hermans, M., Burm, M., Dambre, J.: Trainable and dynamic computing: error backpropagation through physical media. Arxiv 1, 34–39 (2014)
34.
Zurück zum Zitat Otte, S., Krechel, D., Liwicki, M. et al.: Local Feature Based Online Mode Detection with Recurrent Neural Networks In: International Conference on Frontiers in Handwriting Recognition. IEEE Computer Society, pp. 55–60 (2012) Otte, S., Krechel, D., Liwicki, M. et al.: Local Feature Based Online Mode Detection with Recurrent Neural Networks In: International Conference on Frontiers in Handwriting Recognition. IEEE Computer Society, pp. 55–60 (2012)
35.
Zurück zum Zitat Pérez, Z., Cardona-Escobar, A.F.: Deep Convolutional Neural Networks and Power Spectral Density Features for Motor Imagery Classification of EEG Signals In: International Conference on Augmented Cognition. Springer, Cham, pp. 99–106 (2018) Pérez, Z., Cardona-Escobar, A.F.: Deep Convolutional Neural Networks and Power Spectral Density Features for Motor Imagery Classification of EEG Signals In: International Conference on Augmented Cognition. Springer, Cham, pp. 99–106 (2018)
36.
Zurück zum Zitat Zeng, Y., Ferdous, Z.I., Zhang, W., et al.: Inference with hybrid bio-hardware neural networks. 2019(5), pp. 57–61 Zeng, Y., Ferdous, Z.I., Zhang, W., et al.: Inference with hybrid bio-hardware neural networks. 2019(5), pp. 57–61
37.
Zurück zum Zitat Wang, Y., Zhang, B., Xue, B.: Research on Chinese text classification method based on FOA-SVM. J. Sichuan Univ. (Nat. Sci. Ed.) 53(4), 101–104 (2016) Wang, Y., Zhang, B., Xue, B.: Research on Chinese text classification method based on FOA-SVM. J. Sichuan Univ. (Nat. Sci. Ed.) 53(4), 101–104 (2016)
38.
Zurück zum Zitat Gao, J.P., Zhang, H., Zhao, X.J., et al.: Research on WEB domain knowledge classification based on feature words. Softw. Guide 15(2), 9–11 (2016) Gao, J.P., Zhang, H., Zhao, X.J., et al.: Research on WEB domain knowledge classification based on feature words. Softw. Guide 15(2), 9–11 (2016)
Metadaten
Titel
A new method of emotional analysis based on CNN–BiLSTM hybrid neural network
verfasst von
Zi-xian Liu
De-gan Zhang
Gu-zhao Luo
Ming Lian
Bing Liu
Publikationsdatum
03.02.2020
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 4/2020
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-020-03055-9

Weitere Artikel der Ausgabe 4/2020

Cluster Computing 4/2020 Zur Ausgabe

Premium Partner