Skip to main content
Erschienen in: Neural Computing and Applications 7/2020

04.12.2019 | Deep Learning & Neural Computing for Intelligent Sensing and Control

An emotion classification algorithm based on SPT-CapsNet

verfasst von: Xian Zhong, Jinhang Liu, Lin Li, Shuqin Chen, Wei Lu, Yuyu Dong, Bingqing Wu, Luo Zhong

Erschienen in: Neural Computing and Applications | Ausgabe 7/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recently, the Capsule Network is an emerging neural network structure that is characterized by the ability to maintain high classification accuracy. By analyzing the difference between Capsule Network and traditional convolutional neural network, it is found that the model compression method applied to the traditional neural network cannot be directly used in the Capsule Network. To address the problem, an IPC-CapsNet compression algorithm is proposed based on the structural characteristics of the Capsule Networks. The algorithm can reduce the computational complexity and compress the scale of model computation on the basis of retaining the accuracy of model classification. Considering the deficiency of Capsule Network processing serialized text data separately, we combined with IPC-CapsNet and then come up with a sentiment classification algorithm SPT-CapsNet. It has conducted a sentiment analysis experiment of MicroBlog dataset. Compared to other methods, our SPT-CapsNet obtained the best performance among the metrics. The SPT-CapsNet improves the running speed and maintains the balance between classification accuracy and computational efficiency.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
3.
Zurück zum Zitat Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175–185MathSciNet Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175–185MathSciNet
4.
Zurück zum Zitat Opitz D, Maclin R (1999) Popular ensemble methods: an empirical study. J Artif Intell Res 11:169–198MATHCrossRef Opitz D, Maclin R (1999) Popular ensemble methods: an empirical study. J Artif Intell Res 11:169–198MATHCrossRef
5.
Zurück zum Zitat LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436CrossRef LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436CrossRef
6.
Zurück zum Zitat LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
7.
Zurück zum Zitat Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2008) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868CrossRef Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2008) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868CrossRef
8.
Zurück zum Zitat Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef
9.
Zurück zum Zitat Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. arXiv preprint arXiv:​1406.​1078
10.
Zurück zum Zitat Liou CY, Huang JC, Yang WC (2008) Modeling word perception using the Elman network. Neurocomputing 71(16–18):3150–3157CrossRef Liou CY, Huang JC, Yang WC (2008) Modeling word perception using the Elman network. Neurocomputing 71(16–18):3150–3157CrossRef
11.
Zurück zum Zitat Bengio Y (2009) Learning deep architectures for AI. Found Trends Mach Learn 2(1):1–127MATHCrossRef Bengio Y (2009) Learning deep architectures for AI. Found Trends Mach Learn 2(1):1–127MATHCrossRef
12.
Zurück zum Zitat Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems. pp 2672–2680 Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems. pp 2672–2680
13.
Zurück zum Zitat Guo X, Singh S, Lee H, Lewis RL, Wang X (2014) Deep learning for real-time Atari game play using offline Monte-Carlo tree search planning. In: Advances in neural information processing systems, pp 3338–3346 Guo X, Singh S, Lee H, Lewis RL, Wang X (2014) Deep learning for real-time Atari game play using offline Monte-Carlo tree search planning. In: Advances in neural information processing systems, pp 3338–3346
14.
Zurück zum Zitat Sabour S, Frosst N, Hinton G (2018) Matrix capsules with EM routing. In: 6th international conference on learning representations, ICLR, February 2018 Sabour S, Frosst N, Hinton G (2018) Matrix capsules with EM routing. In: 6th international conference on learning representations, ICLR, February 2018
15.
Zurück zum Zitat Hinton GE, Krizhevsky A, Wang SD (2011) Transforming auto-encoders. In: International conference on artificial neural networks. Springer, Berlin, June 2011, pp 44–51 Hinton GE, Krizhevsky A, Wang SD (2011) Transforming auto-encoders. In: International conference on artificial neural networks. Springer, Berlin, June 2011, pp 44–51
16.
Zurück zum Zitat Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:​1301.​3781
17.
Zurück zum Zitat Yang XP, Zhang ZX, Wang L, Zhang YJ, Ma QF, Wu JN, Zhang Y (2017) Automatic construction and optimization of sentiment lexicon based on Word2Vec. Comput Sci 44(01):42–47 Yang XP, Zhang ZX, Wang L, Zhang YJ, Ma QF, Wu JN, Zhang Y (2017) Automatic construction and optimization of sentiment lexicon based on Word2Vec. Comput Sci 44(01):42–47
19.
Zurück zum Zitat Burger JD, Henderson J, Kim G, Zarrella G (2011) Discriminating gender on Twitter. In: Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, July 2011. pp 1301–1309 Burger JD, Henderson J, Kim G, Zarrella G (2011) Discriminating gender on Twitter. In: Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, July 2011. pp 1301–1309
20.
Zurück zum Zitat Sun Z, Hu Z, Wang M et al (2019) Dictionary learning feature space via sparse representation classification for facial expression recognition. Artif Intell Rev 51(1):1–18CrossRef Sun Z, Hu Z, Wang M et al (2019) Dictionary learning feature space via sparse representation classification for facial expression recognition. Artif Intell Rev 51(1):1–18CrossRef
21.
Zurück zum Zitat Jiang F, Liu YQ, Luan HB, Sun JS, Zhu X, Zhang M, Ma SP (2015) Microblog sentiment analysis with emoticon space model. J Comput Sci Technol 30(5):1120–1129CrossRef Jiang F, Liu YQ, Luan HB, Sun JS, Zhu X, Zhang M, Ma SP (2015) Microblog sentiment analysis with emoticon space model. J Comput Sci Technol 30(5):1120–1129CrossRef
22.
Zurück zum Zitat Dos Santos C, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: technical papers, Aug 2014, pp 69–78 Dos Santos C, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: technical papers, Aug 2014, pp 69–78
23.
Zurück zum Zitat Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing, September 2015. pp 1422–1432 Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing, September 2015. pp 1422–1432
24.
Zurück zum Zitat Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv:1503.00075 Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv:​1503.​00075
25.
Zurück zum Zitat Bollegala D, Mu T, Goulermas JY (2015) Cross-domain sentiment classification using sentiment sensitive embeddings. IEEE Trans Knowl Data Eng 28(2):398–410CrossRef Bollegala D, Mu T, Goulermas JY (2015) Cross-domain sentiment classification using sentiment sensitive embeddings. IEEE Trans Knowl Data Eng 28(2):398–410CrossRef
26.
Zurück zum Zitat Qi R (2017) Identifying chinese microblog author gender based on dependency. Data Anal Knowl Discov 1(2):58–63 Qi R (2017) Identifying chinese microblog author gender based on dependency. Data Anal Knowl Discov 1(2):58–63
27.
Zurück zum Zitat Wang LM, Yan Q, Li SS, Zhou GD (2018) User gender classification with dual-channel LSTM. Comput Sci 2:23 Wang LM, Yan Q, Li SS, Zhou GD (2018) User gender classification with dual-channel LSTM. Comput Sci 2:23
28.
Zurück zum Zitat Li XS, Rao YH, Xie HR, Lau YR, Yin J, Wang FL (2017) Bootstrapping social emotion classification with semantically rich hybrid neural networks. IEEE Trans Affect Comput 8(4):428–442CrossRef Li XS, Rao YH, Xie HR, Lau YR, Yin J, Wang FL (2017) Bootstrapping social emotion classification with semantically rich hybrid neural networks. IEEE Trans Affect Comput 8(4):428–442CrossRef
29.
Zurück zum Zitat Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958MathSciNetMATH Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958MathSciNetMATH
30.
Zurück zum Zitat Yosinski J, Clune J, Bengio Y, Hod Lipson (2014) How transferable are features in deep neural networks? In: Advances in neural information processing systems. MIT Press, Cambridge Yosinski J, Clune J, Bengio Y, Hod Lipson (2014) How transferable are features in deep neural networks? In: Advances in neural information processing systems. MIT Press, Cambridge
31.
Zurück zum Zitat Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27 Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27
Metadaten
Titel
An emotion classification algorithm based on SPT-CapsNet
verfasst von
Xian Zhong
Jinhang Liu
Lin Li
Shuqin Chen
Wei Lu
Yuyu Dong
Bingqing Wu
Luo Zhong
Publikationsdatum
04.12.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 7/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04621-y

Weitere Artikel der Ausgabe 7/2020

Neural Computing and Applications 7/2020 Zur Ausgabe

Deep Learning & Neural Computing for Intelligent Sensing and Control

Research on radar signal recognition based on automatic machine learning

Premium Partner