Skip to main content
Top
Published in: Neural Computing and Applications 7/2020

04-12-2019 | Deep Learning & Neural Computing for Intelligent Sensing and Control

An emotion classification algorithm based on SPT-CapsNet

Authors: Xian Zhong, Jinhang Liu, Lin Li, Shuqin Chen, Wei Lu, Yuyu Dong, Bingqing Wu, Luo Zhong

Published in: Neural Computing and Applications | Issue 7/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recently, the Capsule Network is an emerging neural network structure that is characterized by the ability to maintain high classification accuracy. By analyzing the difference between Capsule Network and traditional convolutional neural network, it is found that the model compression method applied to the traditional neural network cannot be directly used in the Capsule Network. To address the problem, an IPC-CapsNet compression algorithm is proposed based on the structural characteristics of the Capsule Networks. The algorithm can reduce the computational complexity and compress the scale of model computation on the basis of retaining the accuracy of model classification. Considering the deficiency of Capsule Network processing serialized text data separately, we combined with IPC-CapsNet and then come up with a sentiment classification algorithm SPT-CapsNet. It has conducted a sentiment analysis experiment of MicroBlog dataset. Compared to other methods, our SPT-CapsNet obtained the best performance among the metrics. The SPT-CapsNet improves the running speed and maintains the balance between classification accuracy and computational efficiency.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
3.
go back to reference Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175–185MathSciNet Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175–185MathSciNet
4.
go back to reference Opitz D, Maclin R (1999) Popular ensemble methods: an empirical study. J Artif Intell Res 11:169–198MATHCrossRef Opitz D, Maclin R (1999) Popular ensemble methods: an empirical study. J Artif Intell Res 11:169–198MATHCrossRef
5.
6.
go back to reference LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
7.
go back to reference Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2008) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868CrossRef Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2008) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868CrossRef
8.
go back to reference Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef
9.
go back to reference Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. arXiv preprint arXiv:​1406.​1078
10.
go back to reference Liou CY, Huang JC, Yang WC (2008) Modeling word perception using the Elman network. Neurocomputing 71(16–18):3150–3157CrossRef Liou CY, Huang JC, Yang WC (2008) Modeling word perception using the Elman network. Neurocomputing 71(16–18):3150–3157CrossRef
11.
12.
go back to reference Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems. pp 2672–2680 Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems. pp 2672–2680
13.
go back to reference Guo X, Singh S, Lee H, Lewis RL, Wang X (2014) Deep learning for real-time Atari game play using offline Monte-Carlo tree search planning. In: Advances in neural information processing systems, pp 3338–3346 Guo X, Singh S, Lee H, Lewis RL, Wang X (2014) Deep learning for real-time Atari game play using offline Monte-Carlo tree search planning. In: Advances in neural information processing systems, pp 3338–3346
14.
go back to reference Sabour S, Frosst N, Hinton G (2018) Matrix capsules with EM routing. In: 6th international conference on learning representations, ICLR, February 2018 Sabour S, Frosst N, Hinton G (2018) Matrix capsules with EM routing. In: 6th international conference on learning representations, ICLR, February 2018
15.
go back to reference Hinton GE, Krizhevsky A, Wang SD (2011) Transforming auto-encoders. In: International conference on artificial neural networks. Springer, Berlin, June 2011, pp 44–51 Hinton GE, Krizhevsky A, Wang SD (2011) Transforming auto-encoders. In: International conference on artificial neural networks. Springer, Berlin, June 2011, pp 44–51
16.
go back to reference Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:​1301.​3781
17.
go back to reference Yang XP, Zhang ZX, Wang L, Zhang YJ, Ma QF, Wu JN, Zhang Y (2017) Automatic construction and optimization of sentiment lexicon based on Word2Vec. Comput Sci 44(01):42–47 Yang XP, Zhang ZX, Wang L, Zhang YJ, Ma QF, Wu JN, Zhang Y (2017) Automatic construction and optimization of sentiment lexicon based on Word2Vec. Comput Sci 44(01):42–47
19.
go back to reference Burger JD, Henderson J, Kim G, Zarrella G (2011) Discriminating gender on Twitter. In: Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, July 2011. pp 1301–1309 Burger JD, Henderson J, Kim G, Zarrella G (2011) Discriminating gender on Twitter. In: Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, July 2011. pp 1301–1309
20.
go back to reference Sun Z, Hu Z, Wang M et al (2019) Dictionary learning feature space via sparse representation classification for facial expression recognition. Artif Intell Rev 51(1):1–18CrossRef Sun Z, Hu Z, Wang M et al (2019) Dictionary learning feature space via sparse representation classification for facial expression recognition. Artif Intell Rev 51(1):1–18CrossRef
21.
go back to reference Jiang F, Liu YQ, Luan HB, Sun JS, Zhu X, Zhang M, Ma SP (2015) Microblog sentiment analysis with emoticon space model. J Comput Sci Technol 30(5):1120–1129CrossRef Jiang F, Liu YQ, Luan HB, Sun JS, Zhu X, Zhang M, Ma SP (2015) Microblog sentiment analysis with emoticon space model. J Comput Sci Technol 30(5):1120–1129CrossRef
22.
go back to reference Dos Santos C, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: technical papers, Aug 2014, pp 69–78 Dos Santos C, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: technical papers, Aug 2014, pp 69–78
23.
go back to reference Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing, September 2015. pp 1422–1432 Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing, September 2015. pp 1422–1432
24.
go back to reference Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv:1503.00075 Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv:​1503.​00075
25.
go back to reference Bollegala D, Mu T, Goulermas JY (2015) Cross-domain sentiment classification using sentiment sensitive embeddings. IEEE Trans Knowl Data Eng 28(2):398–410CrossRef Bollegala D, Mu T, Goulermas JY (2015) Cross-domain sentiment classification using sentiment sensitive embeddings. IEEE Trans Knowl Data Eng 28(2):398–410CrossRef
26.
go back to reference Qi R (2017) Identifying chinese microblog author gender based on dependency. Data Anal Knowl Discov 1(2):58–63 Qi R (2017) Identifying chinese microblog author gender based on dependency. Data Anal Knowl Discov 1(2):58–63
27.
go back to reference Wang LM, Yan Q, Li SS, Zhou GD (2018) User gender classification with dual-channel LSTM. Comput Sci 2:23 Wang LM, Yan Q, Li SS, Zhou GD (2018) User gender classification with dual-channel LSTM. Comput Sci 2:23
28.
go back to reference Li XS, Rao YH, Xie HR, Lau YR, Yin J, Wang FL (2017) Bootstrapping social emotion classification with semantically rich hybrid neural networks. IEEE Trans Affect Comput 8(4):428–442CrossRef Li XS, Rao YH, Xie HR, Lau YR, Yin J, Wang FL (2017) Bootstrapping social emotion classification with semantically rich hybrid neural networks. IEEE Trans Affect Comput 8(4):428–442CrossRef
29.
go back to reference Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958MathSciNetMATH Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958MathSciNetMATH
30.
go back to reference Yosinski J, Clune J, Bengio Y, Hod Lipson (2014) How transferable are features in deep neural networks? In: Advances in neural information processing systems. MIT Press, Cambridge Yosinski J, Clune J, Bengio Y, Hod Lipson (2014) How transferable are features in deep neural networks? In: Advances in neural information processing systems. MIT Press, Cambridge
31.
go back to reference Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27 Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27
Metadata
Title
An emotion classification algorithm based on SPT-CapsNet
Authors
Xian Zhong
Jinhang Liu
Lin Li
Shuqin Chen
Wei Lu
Yuyu Dong
Bingqing Wu
Luo Zhong
Publication date
04-12-2019
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 7/2020
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04621-y

Other articles of this Issue 7/2020

Neural Computing and Applications 7/2020 Go to the issue

Premium Partner