Skip to main content
Top
Published in: Neural Processing Letters 2/2021

20-02-2021

Emotion Analysis on Text Using Multiple Kernel Gaussian...

Authors: S. Angel Deborah, T. T. Mirnalinee, S. Milton Rajendram

Published in: Neural Processing Letters | Issue 2/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The ability to discern human emotions is critical for making chatbox behave like humans. Gaussian Process (GP) is a non-parametric Bayesian modeling and can be used to predict the presence of either a single emotion (single-task GP) or multiple emotions (multi-task GP) in natural language text. Employing multiple kernels in GP can enhance the performance of the emotion analysis tasks. The particular choice of kernel functions determines the properties such as smoothness, length scales, sharpness, and amplitude, drawn from the GP prior. Using a specific kernel may be a source of bias and can be avoided by using different kernels together. The default kernel used with GP is a Radial Basis Function (RBF). It is infinitely differentiable; GP with this function has mean square derivatives of all orders and is thus very smooth. The sharpness which occurs in the midst of the smoothness can be detected using the exponential kernel. The multi-layer perceptron kernel has greater generalization for each training example and is good for extrapolation. Our experiments show that, for learning the presence of a single emotion in a natural language sentence (single-task), multiple kernel GP with the sum of RBF and multi-layer perceptron kernels performs better than single kernel GP. Likewise, for learning the presence of several different emotions in a sentence (multi-task), multiple kernel GP with the sum of RBF, exponential and multi-layer perceptron kernels performs better than single kernel GP. Multiple Kernel Gaussian Process also outperforms Convolutional Neural Network (CNN).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zhao Y, Qin B, Liu T, Tang D (2016) Social sentiment sensor: a visualization system for topic detection and topic sentiment analysis on microblog. Multimedia Tools Appl Springer 75(15):8843–60CrossRef Zhao Y, Qin B, Liu T, Tang D (2016) Social sentiment sensor: a visualization system for topic detection and topic sentiment analysis on microblog. Multimedia Tools Appl Springer 75(15):8843–60CrossRef
2.
go back to reference Li S, Huang L, Wang R, Zhou G (2015) Sentence-level emotion classification with label and context dependence. Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, vol 1, pp 1045–1053 Li S, Huang L, Wang R, Zhou G (2015) Sentence-level emotion classification with label and context dependence. Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, vol 1, pp 1045–1053
3.
go back to reference Pajupuu H, Kerge K, Altrov R (2012) Lexicon-based detection of emotion in different types of texts: preliminary remarks. Eesti Rakenduslingvistika Ühingu aastaraamat 8:171–84CrossRef Pajupuu H, Kerge K, Altrov R (2012) Lexicon-based detection of emotion in different types of texts: preliminary remarks. Eesti Rakenduslingvistika Ühingu aastaraamat 8:171–84CrossRef
4.
go back to reference Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. arXiv preprint arXiv:cs/0205070. May 28 Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. arXiv preprint arXiv:​cs/​0205070. May 28
5.
go back to reference Salvetti F, Reichenbach C, Lewis S (2006) Opinion polarity identification of movie reviews. In: Computing attitude and affect in text: theory and applications. Springer, Dordrecht, pp 303–316 Salvetti F, Reichenbach C, Lewis S (2006) Opinion polarity identification of movie reviews. In: Computing attitude and affect in text: theory and applications. Springer, Dordrecht, pp 303–316
6.
go back to reference Lewis DD (1992) An evaluation of phrasal and clustered representations on a text categorization task. In: Proceedings of the 15th annual international ACM SIGIR conference on research and development in information retrieval, June 1, pp 37–50 Lewis DD (1992) An evaluation of phrasal and clustered representations on a text categorization task. In: Proceedings of the 15th annual international ACM SIGIR conference on research and development in information retrieval, June 1, pp 37–50
7.
go back to reference Rezaeinia SM, Rahmani R, Ghodsi A, Veisi H (2019) Sentiment analysis based on improved pre-trained word embeddings. Expert Syst Appl 117:139–47CrossRef Rezaeinia SM, Rahmani R, Ghodsi A, Veisi H (2019) Sentiment analysis based on improved pre-trained word embeddings. Expert Syst Appl 117:139–47CrossRef
8.
go back to reference Alm CO, Roth D, Sproat R (2005) Emotions from text: machine learning for text-based emotion prediction. In: Proceedings of human language technology conference and conference on empirical methods in natural language processing, pp 579–586 Alm CO, Roth D, Sproat R (2005) Emotions from text: machine learning for text-based emotion prediction. In: Proceedings of human language technology conference and conference on empirical methods in natural language processing, pp 579–586
9.
go back to reference Beck D, Cohn T, Specia L (2014) Joint emotion analysis via multi-task Gaussian processes. Proceedings of the 2014 conference on empirical methods in natural language processing. ACL, pp 1798–1803 Beck D, Cohn T, Specia L (2014) Joint emotion analysis via multi-task Gaussian processes. Proceedings of the 2014 conference on empirical methods in natural language processing. ACL, pp 1798–1803
10.
go back to reference Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res 20(50):723–62CrossRef Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res 20(50):723–62CrossRef
11.
go back to reference Chatterjee A, Gupta U, Chinnakotla MK, Srikanth R, Galley M, Agrawal P (2019) Understanding emotions in text using deep learning and big data. Comput Hum Behav 93:309–17CrossRef Chatterjee A, Gupta U, Chinnakotla MK, Srikanth R, Galley M, Agrawal P (2019) Understanding emotions in text using deep learning and big data. Comput Hum Behav 93:309–17CrossRef
12.
go back to reference Aman S, Szpakowicz S (2008) Using roget’s thesaurus for fine-grained emotion recognition. In: Proceedings of the third international joint conference on natural language processing: volume-I Aman S, Szpakowicz S (2008) Using roget’s thesaurus for fine-grained emotion recognition. In: Proceedings of the third international joint conference on natural language processing: volume-I
13.
go back to reference Sadr H, Pedram MM, Teshnehlab M (2020) Multi-view deep network: a deep model based on learning features from heterogeneous neural networks for sentiment analysis. IEEE Access 4(8):86984–97CrossRef Sadr H, Pedram MM, Teshnehlab M (2020) Multi-view deep network: a deep model based on learning features from heterogeneous neural networks for sentiment analysis. IEEE Access 4(8):86984–97CrossRef
14.
go back to reference Sadr H, Pedram MM, Teshnehlab M (2019) A robust sentiment analysis method based on sequential combination of convolutional and recursive neural networks. Neural Process Lett 50(3):2745–61CrossRef Sadr H, Pedram MM, Teshnehlab M (2019) A robust sentiment analysis method based on sequential combination of convolutional and recursive neural networks. Neural Process Lett 50(3):2745–61CrossRef
15.
go back to reference Zhang S, Xu X, Pang Y, Han J (2020) Multi-layer attention based CNN for target-dependent sentiment classification. Neural Process Lett 51(3):2089–103CrossRef Zhang S, Xu X, Pang Y, Han J (2020) Multi-layer attention based CNN for target-dependent sentiment classification. Neural Process Lett 51(3):2089–103CrossRef
16.
go back to reference Yang H, Willis A, De Roeck A, Nuseibeh B (2012) A hybrid model for automatic emotion recognition in suicide notes. Biomedical informatics insights. 5:BII-S8948 Yang H, Willis A, De Roeck A, Nuseibeh B (2012) A hybrid model for automatic emotion recognition in suicide notes. Biomedical informatics insights. 5:BII-S8948
17.
go back to reference Chaffar S, Inkpen D (2011) Using a heterogeneous dataset for emotion analysis in text. In: Canadian conference on artificial intelligence, May 25, Springer, Berlin, Heidelberg, pp 62–67 Chaffar S, Inkpen D (2011) Using a heterogeneous dataset for emotion analysis in text. In: Canadian conference on artificial intelligence, May 25, Springer, Berlin, Heidelberg, pp 62–67
18.
go back to reference Strapparava C, Mihalcea R (2008) Learning to identify emotions in text. Proceedings of the 2008 ACM symposium on applied computing. ACM, pp 1556–1560 Strapparava C, Mihalcea R (2008) Learning to identify emotions in text. Proceedings of the 2008 ACM symposium on applied computing. ACM, pp 1556–1560
19.
go back to reference Maas AL, Daly RE, Pham PT, Huang D, Ng AY, Potts C (2011) Learning word vectors for sentiment analysis. Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies. ACL, pp 142-150 Maas AL, Daly RE, Pham PT, Huang D, Ng AY, Potts C (2011) Learning word vectors for sentiment analysis. Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies. ACL, pp 142-150
20.
go back to reference Zhang L (2013) Contextual and active learning-based affect-sensing from virtual drama improvisation. ACM Trans Speech Lang Process (TSLP) 9(4):1–25CrossRef Zhang L (2013) Contextual and active learning-based affect-sensing from virtual drama improvisation. ACM Trans Speech Lang Process (TSLP) 9(4):1–25CrossRef
21.
go back to reference Ahmad SN, Laroche M (2015) How do expressed emotions affect the helpfulness of a product review? Evidence from reviews using latent semantic analysis. Int J Electron Commerce 20(1):76–111CrossRef Ahmad SN, Laroche M (2015) How do expressed emotions affect the helpfulness of a product review? Evidence from reviews using latent semantic analysis. Int J Electron Commerce 20(1):76–111CrossRef
22.
go back to reference Zhe X, Boucouvalas AC (2002) Text-to-emotion engine for real time internet communication. In: Proceedings of international symposium on communication systems, networks and DSPs, July 15, pp 164–168 Zhe X, Boucouvalas AC (2002) Text-to-emotion engine for real time internet communication. In: Proceedings of international symposium on communication systems, networks and DSPs, July 15, pp 164–168
23.
go back to reference Donath J, Karahalios K, Viegas F (1999) Visualizing conversation. J Comput-Mediated Commun 4(4):JCMC442 Donath J, Karahalios K, Viegas F (1999) Visualizing conversation. J Comput-Mediated Commun 4(4):JCMC442
24.
go back to reference Chaumartin FR UPAR7: a knowledge-based system for headline sentiment tagging Chaumartin FR UPAR7: a knowledge-based system for headline sentiment tagging
25.
go back to reference Liu H, Lieberman H, Selker T (2003) A model of textual affect sensing using real-world knowledge. In: Proceedings of the 8th international conference on intelligent user interfaces, January 12, pp 125–132 Liu H, Lieberman H, Selker T (2003) A model of textual affect sensing using real-world knowledge. In: Proceedings of the 8th international conference on intelligent user interfaces, January 12, pp 125–132
26.
go back to reference Gruber TR (1995) Toward principles for the design of ontologies used for knowledge sharing? Int J Hum Comput Stud 43(5–6):907–28CrossRef Gruber TR (1995) Toward principles for the design of ontologies used for knowledge sharing? Int J Hum Comput Stud 43(5–6):907–28CrossRef
27.
go back to reference Grassi M (2009) Developing HEO human emotions ontology. In: European workshop on biometrics and identity management, September 16. Springer, Berlin, Heidelberg, pp 244–251 Grassi M (2009) Developing HEO human emotions ontology. In: European workshop on biometrics and identity management, September 16. Springer, Berlin, Heidelberg, pp 244–251
28.
go back to reference Ma C, Prendinger H, Ishizuka M (2005) Emotion estimation and reasoning based on affective textual interaction. In: International conference on affective computing and intelligent interaction, October 22. Springer, Berlin, Heidelberg, pp 622–628 Ma C, Prendinger H, Ishizuka M (2005) Emotion estimation and reasoning based on affective textual interaction. In: International conference on affective computing and intelligent interaction, October 22. Springer, Berlin, Heidelberg, pp 622–628
29.
go back to reference Pestian JP, Matykiewicz P, Linn-Gust M, South B, Uzuner O, Wiebe J, Cohen KB, Hurdle J, Brew C (2012) Sentiment analysis of suicide notes: a shared task. Biomed Inform Insights 5:BII-S9042CrossRef Pestian JP, Matykiewicz P, Linn-Gust M, South B, Uzuner O, Wiebe J, Cohen KB, Hurdle J, Brew C (2012) Sentiment analysis of suicide notes: a shared task. Biomed Inform Insights 5:BII-S9042CrossRef
30.
go back to reference Nikfarjam A, Emadzadeh E, Gonzalez G (2012) A hybrid system for emotion extraction from suicide notes. Biomed Inform Insights 5:BII-S8981CrossRef Nikfarjam A, Emadzadeh E, Gonzalez G (2012) A hybrid system for emotion extraction from suicide notes. Biomed Inform Insights 5:BII-S8981CrossRef
31.
go back to reference Erşahin B, AktasÖ KD, Erşahİn M (2019) A hybrid sentiment analysis method for Turkish. Turk J Electr Eng Comput Sci 27(3):1780–93CrossRef Erşahin B, AktasÖ KD, Erşahİn M (2019) A hybrid sentiment analysis method for Turkish. Turk J Electr Eng Comput Sci 27(3):1780–93CrossRef
32.
go back to reference Sun X, Zhang C, Ding S, Quan C (2018) Detecting anomalous emotion through big data from social networks based on a deep learning method. Multimedia Tools Appl 1–22 Sun X, Zhang C, Ding S, Quan C (2018) Detecting anomalous emotion through big data from social networks based on a deep learning method. Multimedia Tools Appl 1–22
33.
go back to reference De Albornoz JC, Plaza L, Gervás P, Díaz A (2011) A joint model of feature mining and sentiment analysis for product review rating. In: European conference on information retrieval, Springer, Berlin, Heidelberg, pp 55–66 De Albornoz JC, Plaza L, Gervás P, Díaz A (2011) A joint model of feature mining and sentiment analysis for product review rating. In: European conference on information retrieval, Springer, Berlin, Heidelberg, pp 55–66
34.
go back to reference Bao S, Xu S, Zhang L, Yan R, Su Z, Han D, Yu Y (2009) Joint emotion-topic modeling for social affective text mining. In: 2009 Ninth IEEE international conference on data mining, IEEE, pp 699–704 Bao S, Xu S, Zhang L, Yan R, Su Z, Han D, Yu Y (2009) Joint emotion-topic modeling for social affective text mining. In: 2009 Ninth IEEE international conference on data mining, IEEE, pp 699–704
35.
go back to reference Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retrieval 2(1–2):1–35CrossRef Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retrieval 2(1–2):1–35CrossRef
36.
go back to reference Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. Proceedings of the ACL-02 conference on Empirical methods in natural language processing, Association for Computational Linguistics, vol 10, pp 79–86 Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. Proceedings of the ACL-02 conference on Empirical methods in natural language processing, Association for Computational Linguistics, vol 10, pp 79–86
37.
go back to reference Alm CO, Roth D, Sproat R (2005) Emotions from text: Machine learning for text-based emotion prediction. Proceedings of the conference on human language technology and empirical methods in natural language processing, ACL, 579–586 Alm CO, Roth D, Sproat R (2005) Emotions from text: Machine learning for text-based emotion prediction. Proceedings of the conference on human language technology and empirical methods in natural language processing, ACL, 579–586
38.
go back to reference Williams CK, Rasmussen CE (2006) Gaussian processes for machine learning. MIT press, CambridgeMATH Williams CK, Rasmussen CE (2006) Gaussian processes for machine learning. MIT press, CambridgeMATH
39.
go back to reference Cohn T, Specia L (2013) Modelling annotator bias with multi-task gaussian processes: an application to machine translation quality estimation. Proceedings of the 51st annual meeting of the ACL, vol 1, pp 32–42 Cohn T, Specia L (2013) Modelling annotator bias with multi-task gaussian processes: an application to machine translation quality estimation. Proceedings of the 51st annual meeting of the ACL, vol 1, pp 32–42
41.
go back to reference Angel Deborah S, Milton Rajendram S, Mirnalinee TT (2017) SSN\_MLRG1 at SemEval-2017 task 4: sentiment analysis in twitter using multi-kernel Gaussian process classifier. Proceedings of the 11th international workshop on semantic evaluation. ACL, pp 709–712 Angel Deborah S, Milton Rajendram S, Mirnalinee TT (2017) SSN\_MLRG1 at SemEval-2017 task 4: sentiment analysis in twitter using multi-kernel Gaussian process classifier. Proceedings of the 11th international workshop on semantic evaluation. ACL, pp 709–712
43.
go back to reference Alvarez Mauricio A, Rosasco L, Lawrence Neil D et al (2015) Kernels for vector-valued functions: a review. Found Trends® Mach Learn Now Publishers, Inc 4(3):10177–10194 Alvarez Mauricio A, Rosasco L, Lawrence Neil D et al (2015) Kernels for vector-valued functions: a review. Found Trends® Mach Learn Now Publishers, Inc 4(3):10177–10194
44.
go back to reference Alvarez MA, Rosasco L, Lawrence ND (2012) Kernels for vector-valued functions: a review. Found Trends® Mach Learn 4(3):195–266CrossRef Alvarez MA, Rosasco L, Lawrence ND (2012) Kernels for vector-valued functions: a review. Found Trends® Mach Learn 4(3):195–266CrossRef
45.
46.
go back to reference Wilson A, Adams R (2013) Gaussian process kernels for pattern discovery and extrapolation. International conference on machine learning, pp 1067–1075 Wilson A, Adams R (2013) Gaussian process kernels for pattern discovery and extrapolation. International conference on machine learning, pp 1067–1075
47.
go back to reference Carlo S, Rada M (2007) Semeval-2007 task 14: affective text. Proceedings of the 4th international workshop on semantic evaluation, Association for Computational Linguistics, pp 70–74 Carlo S, Rada M (2007) Semeval-2007 task 14: affective text. Proceedings of the 4th international workshop on semantic evaluation, Association for Computational Linguistics, pp 70–74
48.
go back to reference Cortis K, Freitas A, Daudert T, Huerlimann M, Zarrouk M, Handschuh S, Davis B (2017) SemEval-2017 task 5: fine-grained sentiment analysis on financial microblogs and news. 11th International workshop on semantic evaluations (SemEval-2017). ACL, pp 519–535 Cortis K, Freitas A, Daudert T, Huerlimann M, Zarrouk M, Handschuh S, Davis B (2017) SemEval-2017 task 5: fine-grained sentiment analysis on financial microblogs and news. 11th International workshop on semantic evaluations (SemEval-2017). ACL, pp 519–535
49.
go back to reference Angel Deborah S, Milton Rajendram S, Mirnalinee TT (2017) SSN\_MLRG1 at SemEval-2017 task 5: fine-grained sentiment analysis using multiple kernel Gaussian process regression model. Proceedings of the 11th international workshop on semantic evaluation. ACL, pp 823–826 Angel Deborah S, Milton Rajendram S, Mirnalinee TT (2017) SSN\_MLRG1 at SemEval-2017 task 5: fine-grained sentiment analysis using multiple kernel Gaussian process regression model. Proceedings of the 11th international workshop on semantic evaluation. ACL, pp 823–826
Metadata
Title
Emotion Analysis on Text Using Multiple Kernel Gaussian...
Authors
S. Angel Deborah
T. T. Mirnalinee
S. Milton Rajendram
Publication date
20-02-2021
Publisher
Springer US
Published in
Neural Processing Letters / Issue 2/2021
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10436-7

Other articles of this Issue 2/2021

Neural Processing Letters 2/2021 Go to the issue