Skip to main content
Erschienen in: Neural Processing Letters 2/2021

20.02.2021

Emotion Analysis on Text Using Multiple Kernel Gaussian...

verfasst von: S. Angel Deborah, T. T. Mirnalinee, S. Milton Rajendram

Erschienen in: Neural Processing Letters | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The ability to discern human emotions is critical for making chatbox behave like humans. Gaussian Process (GP) is a non-parametric Bayesian modeling and can be used to predict the presence of either a single emotion (single-task GP) or multiple emotions (multi-task GP) in natural language text. Employing multiple kernels in GP can enhance the performance of the emotion analysis tasks. The particular choice of kernel functions determines the properties such as smoothness, length scales, sharpness, and amplitude, drawn from the GP prior. Using a specific kernel may be a source of bias and can be avoided by using different kernels together. The default kernel used with GP is a Radial Basis Function (RBF). It is infinitely differentiable; GP with this function has mean square derivatives of all orders and is thus very smooth. The sharpness which occurs in the midst of the smoothness can be detected using the exponential kernel. The multi-layer perceptron kernel has greater generalization for each training example and is good for extrapolation. Our experiments show that, for learning the presence of a single emotion in a natural language sentence (single-task), multiple kernel GP with the sum of RBF and multi-layer perceptron kernels performs better than single kernel GP. Likewise, for learning the presence of several different emotions in a sentence (multi-task), multiple kernel GP with the sum of RBF, exponential and multi-layer perceptron kernels performs better than single kernel GP. Multiple Kernel Gaussian Process also outperforms Convolutional Neural Network (CNN).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhao Y, Qin B, Liu T, Tang D (2016) Social sentiment sensor: a visualization system for topic detection and topic sentiment analysis on microblog. Multimedia Tools Appl Springer 75(15):8843–60CrossRef Zhao Y, Qin B, Liu T, Tang D (2016) Social sentiment sensor: a visualization system for topic detection and topic sentiment analysis on microblog. Multimedia Tools Appl Springer 75(15):8843–60CrossRef
2.
Zurück zum Zitat Li S, Huang L, Wang R, Zhou G (2015) Sentence-level emotion classification with label and context dependence. Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, vol 1, pp 1045–1053 Li S, Huang L, Wang R, Zhou G (2015) Sentence-level emotion classification with label and context dependence. Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, vol 1, pp 1045–1053
3.
Zurück zum Zitat Pajupuu H, Kerge K, Altrov R (2012) Lexicon-based detection of emotion in different types of texts: preliminary remarks. Eesti Rakenduslingvistika Ühingu aastaraamat 8:171–84CrossRef Pajupuu H, Kerge K, Altrov R (2012) Lexicon-based detection of emotion in different types of texts: preliminary remarks. Eesti Rakenduslingvistika Ühingu aastaraamat 8:171–84CrossRef
4.
Zurück zum Zitat Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. arXiv preprint arXiv:cs/0205070. May 28 Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. arXiv preprint arXiv:​cs/​0205070. May 28
5.
Zurück zum Zitat Salvetti F, Reichenbach C, Lewis S (2006) Opinion polarity identification of movie reviews. In: Computing attitude and affect in text: theory and applications. Springer, Dordrecht, pp 303–316 Salvetti F, Reichenbach C, Lewis S (2006) Opinion polarity identification of movie reviews. In: Computing attitude and affect in text: theory and applications. Springer, Dordrecht, pp 303–316
6.
Zurück zum Zitat Lewis DD (1992) An evaluation of phrasal and clustered representations on a text categorization task. In: Proceedings of the 15th annual international ACM SIGIR conference on research and development in information retrieval, June 1, pp 37–50 Lewis DD (1992) An evaluation of phrasal and clustered representations on a text categorization task. In: Proceedings of the 15th annual international ACM SIGIR conference on research and development in information retrieval, June 1, pp 37–50
7.
Zurück zum Zitat Rezaeinia SM, Rahmani R, Ghodsi A, Veisi H (2019) Sentiment analysis based on improved pre-trained word embeddings. Expert Syst Appl 117:139–47CrossRef Rezaeinia SM, Rahmani R, Ghodsi A, Veisi H (2019) Sentiment analysis based on improved pre-trained word embeddings. Expert Syst Appl 117:139–47CrossRef
8.
Zurück zum Zitat Alm CO, Roth D, Sproat R (2005) Emotions from text: machine learning for text-based emotion prediction. In: Proceedings of human language technology conference and conference on empirical methods in natural language processing, pp 579–586 Alm CO, Roth D, Sproat R (2005) Emotions from text: machine learning for text-based emotion prediction. In: Proceedings of human language technology conference and conference on empirical methods in natural language processing, pp 579–586
9.
Zurück zum Zitat Beck D, Cohn T, Specia L (2014) Joint emotion analysis via multi-task Gaussian processes. Proceedings of the 2014 conference on empirical methods in natural language processing. ACL, pp 1798–1803 Beck D, Cohn T, Specia L (2014) Joint emotion analysis via multi-task Gaussian processes. Proceedings of the 2014 conference on empirical methods in natural language processing. ACL, pp 1798–1803
10.
Zurück zum Zitat Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res 20(50):723–62CrossRef Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res 20(50):723–62CrossRef
11.
Zurück zum Zitat Chatterjee A, Gupta U, Chinnakotla MK, Srikanth R, Galley M, Agrawal P (2019) Understanding emotions in text using deep learning and big data. Comput Hum Behav 93:309–17CrossRef Chatterjee A, Gupta U, Chinnakotla MK, Srikanth R, Galley M, Agrawal P (2019) Understanding emotions in text using deep learning and big data. Comput Hum Behav 93:309–17CrossRef
12.
Zurück zum Zitat Aman S, Szpakowicz S (2008) Using roget’s thesaurus for fine-grained emotion recognition. In: Proceedings of the third international joint conference on natural language processing: volume-I Aman S, Szpakowicz S (2008) Using roget’s thesaurus for fine-grained emotion recognition. In: Proceedings of the third international joint conference on natural language processing: volume-I
13.
Zurück zum Zitat Sadr H, Pedram MM, Teshnehlab M (2020) Multi-view deep network: a deep model based on learning features from heterogeneous neural networks for sentiment analysis. IEEE Access 4(8):86984–97CrossRef Sadr H, Pedram MM, Teshnehlab M (2020) Multi-view deep network: a deep model based on learning features from heterogeneous neural networks for sentiment analysis. IEEE Access 4(8):86984–97CrossRef
14.
Zurück zum Zitat Sadr H, Pedram MM, Teshnehlab M (2019) A robust sentiment analysis method based on sequential combination of convolutional and recursive neural networks. Neural Process Lett 50(3):2745–61CrossRef Sadr H, Pedram MM, Teshnehlab M (2019) A robust sentiment analysis method based on sequential combination of convolutional and recursive neural networks. Neural Process Lett 50(3):2745–61CrossRef
15.
Zurück zum Zitat Zhang S, Xu X, Pang Y, Han J (2020) Multi-layer attention based CNN for target-dependent sentiment classification. Neural Process Lett 51(3):2089–103CrossRef Zhang S, Xu X, Pang Y, Han J (2020) Multi-layer attention based CNN for target-dependent sentiment classification. Neural Process Lett 51(3):2089–103CrossRef
16.
Zurück zum Zitat Yang H, Willis A, De Roeck A, Nuseibeh B (2012) A hybrid model for automatic emotion recognition in suicide notes. Biomedical informatics insights. 5:BII-S8948 Yang H, Willis A, De Roeck A, Nuseibeh B (2012) A hybrid model for automatic emotion recognition in suicide notes. Biomedical informatics insights. 5:BII-S8948
17.
Zurück zum Zitat Chaffar S, Inkpen D (2011) Using a heterogeneous dataset for emotion analysis in text. In: Canadian conference on artificial intelligence, May 25, Springer, Berlin, Heidelberg, pp 62–67 Chaffar S, Inkpen D (2011) Using a heterogeneous dataset for emotion analysis in text. In: Canadian conference on artificial intelligence, May 25, Springer, Berlin, Heidelberg, pp 62–67
18.
Zurück zum Zitat Strapparava C, Mihalcea R (2008) Learning to identify emotions in text. Proceedings of the 2008 ACM symposium on applied computing. ACM, pp 1556–1560 Strapparava C, Mihalcea R (2008) Learning to identify emotions in text. Proceedings of the 2008 ACM symposium on applied computing. ACM, pp 1556–1560
19.
Zurück zum Zitat Maas AL, Daly RE, Pham PT, Huang D, Ng AY, Potts C (2011) Learning word vectors for sentiment analysis. Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies. ACL, pp 142-150 Maas AL, Daly RE, Pham PT, Huang D, Ng AY, Potts C (2011) Learning word vectors for sentiment analysis. Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies. ACL, pp 142-150
20.
Zurück zum Zitat Zhang L (2013) Contextual and active learning-based affect-sensing from virtual drama improvisation. ACM Trans Speech Lang Process (TSLP) 9(4):1–25CrossRef Zhang L (2013) Contextual and active learning-based affect-sensing from virtual drama improvisation. ACM Trans Speech Lang Process (TSLP) 9(4):1–25CrossRef
21.
Zurück zum Zitat Ahmad SN, Laroche M (2015) How do expressed emotions affect the helpfulness of a product review? Evidence from reviews using latent semantic analysis. Int J Electron Commerce 20(1):76–111CrossRef Ahmad SN, Laroche M (2015) How do expressed emotions affect the helpfulness of a product review? Evidence from reviews using latent semantic analysis. Int J Electron Commerce 20(1):76–111CrossRef
22.
Zurück zum Zitat Zhe X, Boucouvalas AC (2002) Text-to-emotion engine for real time internet communication. In: Proceedings of international symposium on communication systems, networks and DSPs, July 15, pp 164–168 Zhe X, Boucouvalas AC (2002) Text-to-emotion engine for real time internet communication. In: Proceedings of international symposium on communication systems, networks and DSPs, July 15, pp 164–168
23.
Zurück zum Zitat Donath J, Karahalios K, Viegas F (1999) Visualizing conversation. J Comput-Mediated Commun 4(4):JCMC442 Donath J, Karahalios K, Viegas F (1999) Visualizing conversation. J Comput-Mediated Commun 4(4):JCMC442
24.
Zurück zum Zitat Chaumartin FR UPAR7: a knowledge-based system for headline sentiment tagging Chaumartin FR UPAR7: a knowledge-based system for headline sentiment tagging
25.
Zurück zum Zitat Liu H, Lieberman H, Selker T (2003) A model of textual affect sensing using real-world knowledge. In: Proceedings of the 8th international conference on intelligent user interfaces, January 12, pp 125–132 Liu H, Lieberman H, Selker T (2003) A model of textual affect sensing using real-world knowledge. In: Proceedings of the 8th international conference on intelligent user interfaces, January 12, pp 125–132
26.
Zurück zum Zitat Gruber TR (1995) Toward principles for the design of ontologies used for knowledge sharing? Int J Hum Comput Stud 43(5–6):907–28CrossRef Gruber TR (1995) Toward principles for the design of ontologies used for knowledge sharing? Int J Hum Comput Stud 43(5–6):907–28CrossRef
27.
Zurück zum Zitat Grassi M (2009) Developing HEO human emotions ontology. In: European workshop on biometrics and identity management, September 16. Springer, Berlin, Heidelberg, pp 244–251 Grassi M (2009) Developing HEO human emotions ontology. In: European workshop on biometrics and identity management, September 16. Springer, Berlin, Heidelberg, pp 244–251
28.
Zurück zum Zitat Ma C, Prendinger H, Ishizuka M (2005) Emotion estimation and reasoning based on affective textual interaction. In: International conference on affective computing and intelligent interaction, October 22. Springer, Berlin, Heidelberg, pp 622–628 Ma C, Prendinger H, Ishizuka M (2005) Emotion estimation and reasoning based on affective textual interaction. In: International conference on affective computing and intelligent interaction, October 22. Springer, Berlin, Heidelberg, pp 622–628
29.
Zurück zum Zitat Pestian JP, Matykiewicz P, Linn-Gust M, South B, Uzuner O, Wiebe J, Cohen KB, Hurdle J, Brew C (2012) Sentiment analysis of suicide notes: a shared task. Biomed Inform Insights 5:BII-S9042CrossRef Pestian JP, Matykiewicz P, Linn-Gust M, South B, Uzuner O, Wiebe J, Cohen KB, Hurdle J, Brew C (2012) Sentiment analysis of suicide notes: a shared task. Biomed Inform Insights 5:BII-S9042CrossRef
30.
Zurück zum Zitat Nikfarjam A, Emadzadeh E, Gonzalez G (2012) A hybrid system for emotion extraction from suicide notes. Biomed Inform Insights 5:BII-S8981CrossRef Nikfarjam A, Emadzadeh E, Gonzalez G (2012) A hybrid system for emotion extraction from suicide notes. Biomed Inform Insights 5:BII-S8981CrossRef
31.
Zurück zum Zitat Erşahin B, AktasÖ KD, Erşahİn M (2019) A hybrid sentiment analysis method for Turkish. Turk J Electr Eng Comput Sci 27(3):1780–93CrossRef Erşahin B, AktasÖ KD, Erşahİn M (2019) A hybrid sentiment analysis method for Turkish. Turk J Electr Eng Comput Sci 27(3):1780–93CrossRef
32.
Zurück zum Zitat Sun X, Zhang C, Ding S, Quan C (2018) Detecting anomalous emotion through big data from social networks based on a deep learning method. Multimedia Tools Appl 1–22 Sun X, Zhang C, Ding S, Quan C (2018) Detecting anomalous emotion through big data from social networks based on a deep learning method. Multimedia Tools Appl 1–22
33.
Zurück zum Zitat De Albornoz JC, Plaza L, Gervás P, Díaz A (2011) A joint model of feature mining and sentiment analysis for product review rating. In: European conference on information retrieval, Springer, Berlin, Heidelberg, pp 55–66 De Albornoz JC, Plaza L, Gervás P, Díaz A (2011) A joint model of feature mining and sentiment analysis for product review rating. In: European conference on information retrieval, Springer, Berlin, Heidelberg, pp 55–66
34.
Zurück zum Zitat Bao S, Xu S, Zhang L, Yan R, Su Z, Han D, Yu Y (2009) Joint emotion-topic modeling for social affective text mining. In: 2009 Ninth IEEE international conference on data mining, IEEE, pp 699–704 Bao S, Xu S, Zhang L, Yan R, Su Z, Han D, Yu Y (2009) Joint emotion-topic modeling for social affective text mining. In: 2009 Ninth IEEE international conference on data mining, IEEE, pp 699–704
35.
Zurück zum Zitat Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retrieval 2(1–2):1–35CrossRef Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retrieval 2(1–2):1–35CrossRef
36.
Zurück zum Zitat Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. Proceedings of the ACL-02 conference on Empirical methods in natural language processing, Association for Computational Linguistics, vol 10, pp 79–86 Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. Proceedings of the ACL-02 conference on Empirical methods in natural language processing, Association for Computational Linguistics, vol 10, pp 79–86
37.
Zurück zum Zitat Alm CO, Roth D, Sproat R (2005) Emotions from text: Machine learning for text-based emotion prediction. Proceedings of the conference on human language technology and empirical methods in natural language processing, ACL, 579–586 Alm CO, Roth D, Sproat R (2005) Emotions from text: Machine learning for text-based emotion prediction. Proceedings of the conference on human language technology and empirical methods in natural language processing, ACL, 579–586
38.
Zurück zum Zitat Williams CK, Rasmussen CE (2006) Gaussian processes for machine learning. MIT press, CambridgeMATH Williams CK, Rasmussen CE (2006) Gaussian processes for machine learning. MIT press, CambridgeMATH
39.
Zurück zum Zitat Cohn T, Specia L (2013) Modelling annotator bias with multi-task gaussian processes: an application to machine translation quality estimation. Proceedings of the 51st annual meeting of the ACL, vol 1, pp 32–42 Cohn T, Specia L (2013) Modelling annotator bias with multi-task gaussian processes: an application to machine translation quality estimation. Proceedings of the 51st annual meeting of the ACL, vol 1, pp 32–42
41.
Zurück zum Zitat Angel Deborah S, Milton Rajendram S, Mirnalinee TT (2017) SSN\_MLRG1 at SemEval-2017 task 4: sentiment analysis in twitter using multi-kernel Gaussian process classifier. Proceedings of the 11th international workshop on semantic evaluation. ACL, pp 709–712 Angel Deborah S, Milton Rajendram S, Mirnalinee TT (2017) SSN\_MLRG1 at SemEval-2017 task 4: sentiment analysis in twitter using multi-kernel Gaussian process classifier. Proceedings of the 11th international workshop on semantic evaluation. ACL, pp 709–712
43.
Zurück zum Zitat Alvarez Mauricio A, Rosasco L, Lawrence Neil D et al (2015) Kernels for vector-valued functions: a review. Found Trends® Mach Learn Now Publishers, Inc 4(3):10177–10194 Alvarez Mauricio A, Rosasco L, Lawrence Neil D et al (2015) Kernels for vector-valued functions: a review. Found Trends® Mach Learn Now Publishers, Inc 4(3):10177–10194
44.
Zurück zum Zitat Alvarez MA, Rosasco L, Lawrence ND (2012) Kernels for vector-valued functions: a review. Found Trends® Mach Learn 4(3):195–266CrossRef Alvarez MA, Rosasco L, Lawrence ND (2012) Kernels for vector-valued functions: a review. Found Trends® Mach Learn 4(3):195–266CrossRef
45.
Zurück zum Zitat Gönen M, Alpaydın E (2011) Multiple kernel learning algorithms. J Mach Learn Res 12:2211–68MathSciNetMATH Gönen M, Alpaydın E (2011) Multiple kernel learning algorithms. J Mach Learn Res 12:2211–68MathSciNetMATH
46.
Zurück zum Zitat Wilson A, Adams R (2013) Gaussian process kernels for pattern discovery and extrapolation. International conference on machine learning, pp 1067–1075 Wilson A, Adams R (2013) Gaussian process kernels for pattern discovery and extrapolation. International conference on machine learning, pp 1067–1075
47.
Zurück zum Zitat Carlo S, Rada M (2007) Semeval-2007 task 14: affective text. Proceedings of the 4th international workshop on semantic evaluation, Association for Computational Linguistics, pp 70–74 Carlo S, Rada M (2007) Semeval-2007 task 14: affective text. Proceedings of the 4th international workshop on semantic evaluation, Association for Computational Linguistics, pp 70–74
48.
Zurück zum Zitat Cortis K, Freitas A, Daudert T, Huerlimann M, Zarrouk M, Handschuh S, Davis B (2017) SemEval-2017 task 5: fine-grained sentiment analysis on financial microblogs and news. 11th International workshop on semantic evaluations (SemEval-2017). ACL, pp 519–535 Cortis K, Freitas A, Daudert T, Huerlimann M, Zarrouk M, Handschuh S, Davis B (2017) SemEval-2017 task 5: fine-grained sentiment analysis on financial microblogs and news. 11th International workshop on semantic evaluations (SemEval-2017). ACL, pp 519–535
49.
Zurück zum Zitat Angel Deborah S, Milton Rajendram S, Mirnalinee TT (2017) SSN\_MLRG1 at SemEval-2017 task 5: fine-grained sentiment analysis using multiple kernel Gaussian process regression model. Proceedings of the 11th international workshop on semantic evaluation. ACL, pp 823–826 Angel Deborah S, Milton Rajendram S, Mirnalinee TT (2017) SSN\_MLRG1 at SemEval-2017 task 5: fine-grained sentiment analysis using multiple kernel Gaussian process regression model. Proceedings of the 11th international workshop on semantic evaluation. ACL, pp 823–826
Metadaten
Titel
Emotion Analysis on Text Using Multiple Kernel Gaussian...
verfasst von
S. Angel Deborah
T. T. Mirnalinee
S. Milton Rajendram
Publikationsdatum
20.02.2021
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2021
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10436-7

Weitere Artikel der Ausgabe 2/2021

Neural Processing Letters 2/2021 Zur Ausgabe

Neuer Inhalt