Skip to main content
Top
Published in: Cognitive Computation 5/2019

16-07-2019

Cognitive Insights into Sentic Spaces Using Principal Paths

Authors: Edoardo Ragusa, Paolo Gastaldo, Rodolfo Zunino, Marco Jacopo Ferrarotti, Walter Rocchia, Sergio Decherchi

Published in: Cognitive Computation | Issue 5/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The availability of an effective embedding to represent textual information is important in commonsense reasoning. Assessing the quality of an embedding is challenging. In most approaches, embeddings are built using statistical properties of the data that are not directly interpretable by a human user. Numerical methods can be inconsistent with respect to the target problem from a cognitive view point. This paper addresses the issue by developing a protocol for evaluating the coherence between an embedding space and a given cognitive model. The protocol uses the recently introduced notion of principal path, which can support the exploration of a high-dimensional space. The protocol provides a qualitative measure of concept distributions in a graphical format, which allows the embedding properties to be analyzed. As a consequence, the tool mitigates the black-box effect that is typical of automatic inference processes. The experimental section involves the characterization of AffectiveSpace, demonstrating that the proposed approach can be used to describe embeddings. The reference cognitive model is the hourglass model of emotions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cambria E, Poria S, Gelbukh A, Thelwall M. Sentiment analysis is a big suitcase. IEEE Intell Syst 2017;32(6):74–80.CrossRef Cambria E, Poria S, Gelbukh A, Thelwall M. Sentiment analysis is a big suitcase. IEEE Intell Syst 2017;32(6):74–80.CrossRef
2.
go back to reference Li Y, Pan Q, Yang T, Wang S, Tang J, Cambria E. Learning word representations for sentiment analysis. Cogn Comput 2017;9(6):843–851.CrossRef Li Y, Pan Q, Yang T, Wang S, Tang J, Cambria E. Learning word representations for sentiment analysis. Cogn Comput 2017;9(6):843–851.CrossRef
3.
go back to reference Ofek N, Poria S, Rokach L, Cambria E, Hussain A, Shabtai A. Unsupervised commonsense knowledge enrichment for domain-specific sentiment analysis. Cogn Comput 2016;8(3):467–477.CrossRef Ofek N, Poria S, Rokach L, Cambria E, Hussain A, Shabtai A. Unsupervised commonsense knowledge enrichment for domain-specific sentiment analysis. Cogn Comput 2016;8(3):467–477.CrossRef
4.
go back to reference Ma Y, Peng H, Khan T, Cambria E, Hussain A. Sentic lstm: a hybrid network for targeted aspect-based sentiment analysis. Cogn Comput 2018;10(4):639–650.CrossRef Ma Y, Peng H, Khan T, Cambria E, Hussain A. Sentic lstm: a hybrid network for targeted aspect-based sentiment analysis. Cogn Comput 2018;10(4):639–650.CrossRef
5.
go back to reference Yang H-C, Lee C-H, Wu C-Y. Sentiment discovery of social messages using self-organizing maps. Cogn Comput 2018;10(6):1152–1166.CrossRef Yang H-C, Lee C-H, Wu C-Y. Sentiment discovery of social messages using self-organizing maps. Cogn Comput 2018;10(6):1152–1166.CrossRef
6.
go back to reference Peng H, Cambria E, Hussain A. A review of sentiment analysis research in chinese language. Cogn Comput 2017;9(4):423–435.CrossRef Peng H, Cambria E, Hussain A. A review of sentiment analysis research in chinese language. Cogn Comput 2017;9(4):423–435.CrossRef
7.
go back to reference Bengio Y, Ducharme R, Vincent P, Jauvin C. A neural probabilistic language model. J Mach Learn Res 2003;3(Feb):1137–1155. Bengio Y, Ducharme R, Vincent P, Jauvin C. A neural probabilistic language model. J Mach Learn Res 2003;3(Feb):1137–1155.
8.
go back to reference Collobert R, Weston J. A unified architecture for natural language processing: Deep neural networks with multitask learning. In: Proceedings of the 25th International Conference on Machine Learning. ACM; 2008. p. 160–167. Collobert R, Weston J. A unified architecture for natural language processing: Deep neural networks with multitask learning. In: Proceedings of the 25th International Conference on Machine Learning. ACM; 2008. p. 160–167.
9.
go back to reference Huang EH, Socher R, Manning CD, Ng AY. Improving word representations via global context and multiple word prototypes. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1, Association for Computational Linguistics; 2012, p. 873–882. Huang EH, Socher R, Manning CD, Ng AY. Improving word representations via global context and multiple word prototypes. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1, Association for Computational Linguistics; 2012, p. 873–882.
10.
go back to reference Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space, arXiv:1301.3781. Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space, arXiv:1301.​3781.
11.
go back to reference Mnih A, Hinton G. Three new graphical models for statistical language modelling. In: Proceedings of the 24th International Conference on Machine Learning. ACM; 2007. p. 641–648. Mnih A, Hinton G. Three new graphical models for statistical language modelling. In: Proceedings of the 24th International Conference on Machine Learning. ACM; 2007. p. 641–648.
12.
go back to reference Tang J, Qu M, Mei Q. Pte: Predictive text embedding through large-scale heterogeneous text networks. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM; 2015, p. 1165–1174. Tang J, Qu M, Mei Q. Pte: Predictive text embedding through large-scale heterogeneous text networks. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM; 2015, p. 1165–1174.
13.
go back to reference Wang S, Tang J, Aggarwal C, Liu H. Linked document embedding for classification. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. ACM; 2016. p. 115–124. Wang S, Tang J, Aggarwal C, Liu H. Linked document embedding for classification. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. ACM; 2016. p. 115–124.
14.
go back to reference Ma Y, Peng H, Cambria E. Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM. In: AAAI; 2018. p. 5876–5883. Ma Y, Peng H, Cambria E. Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM. In: AAAI; 2018. p. 5876–5883.
16.
go back to reference Wilson T, Wiebe J, Hoffmann P. Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, Association for Computational Linguistics; 2005. p. 347–354. Wilson T, Wiebe J, Hoffmann P. Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, Association for Computational Linguistics; 2005. p. 347–354.
17.
go back to reference Mohammad SM, Turney PD. Crowdsourcing a word–emotion association lexicon. Comput Intell 2013;29 (3):436–465.CrossRef Mohammad SM, Turney PD. Crowdsourcing a word–emotion association lexicon. Comput Intell 2013;29 (3):436–465.CrossRef
18.
go back to reference Cambria E, Poria S, Hazarika D, Kwok K. SenticNet 5: Discovering conceptual primitives for sentiment analysis by means of context embeddings. In: AAAI; 2018. p. 1795–1802. Cambria E, Poria S, Hazarika D, Kwok K. SenticNet 5: Discovering conceptual primitives for sentiment analysis by means of context embeddings. In: AAAI; 2018. p. 1795–1802.
19.
go back to reference Li X, Xie H, Chen L, Wang J, Deng X. News impact on stock price return via sentiment analysis. Knowl-Based Syst 2014;69:14–23.CrossRef Li X, Xie H, Chen L, Wang J, Deng X. News impact on stock price return via sentiment analysis. Knowl-Based Syst 2014;69:14–23.CrossRef
20.
go back to reference Cambria E, Fu J, Bisio F, Poria S. Affectivespace 2: Enabling affective intuition for concept-level sentiment analysis.. In: AAAI; 2015. p. 508–514. Cambria E, Fu J, Bisio F, Poria S. Affectivespace 2: Enabling affective intuition for concept-level sentiment analysis.. In: AAAI; 2015. p. 508–514.
21.
22.
go back to reference Pearson K. Liii. on lines and planes of closest fit to systems of points in space. Lond Edinb Dublin Philos Mag J Sci 1901;2(11):559–572.CrossRef Pearson K. Liii. on lines and planes of closest fit to systems of points in space. Lond Edinb Dublin Philos Mag J Sci 1901;2(11):559–572.CrossRef
23.
go back to reference Schölkopf B, Smola A, Müller K-R. Kernel principal component analysis. In: International Conference on Artificial Neural Networks. Springer; 1997. p. 583–588. Schölkopf B, Smola A, Müller K-R. Kernel principal component analysis. In: International Conference on Artificial Neural Networks. Springer; 1997. p. 583–588.
24.
go back to reference Roweis ST, Saul LK. Nonlinear dimensionality reduction by locally linear embedding. Science 2000;290 (5500):2323–2326.CrossRef Roweis ST, Saul LK. Nonlinear dimensionality reduction by locally linear embedding. Science 2000;290 (5500):2323–2326.CrossRef
25.
go back to reference Kruskal JB. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 1964;29(1):1–27.CrossRef Kruskal JB. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 1964;29(1):1–27.CrossRef
26.
go back to reference Maaten Lvd, Hinton G. Visualizing data using t-sne. J Mach Learn Res 2008;9(Nov):2579–2605. Maaten Lvd, Hinton G. Visualizing data using t-sne. J Mach Learn Res 2008;9(Nov):2579–2605.
27.
go back to reference Liu S, Maljovec D, Wang B, Bremer P-T, Pascucci V. Visualizing high-dimensional data: Advances in the past decade. IEEE Trans Vis Comput Graph 2017;23(3):1249–1268.CrossRef Liu S, Maljovec D, Wang B, Bremer P-T, Pascucci V. Visualizing high-dimensional data: Advances in the past decade. IEEE Trans Vis Comput Graph 2017;23(3):1249–1268.CrossRef
28.
go back to reference Ragusa E, Gastaldo P, Zunino R, Cambria E. Learning with similarity functions: a tensor-based framework. Cogn Comput 2019;11(1):31–49.CrossRef Ragusa E, Gastaldo P, Zunino R, Cambria E. Learning with similarity functions: a tensor-based framework. Cogn Comput 2019;11(1):31–49.CrossRef
29.
go back to reference Peng X, Selvachandran G. Pythagorean fuzzy set: state of the art and future directions. Artif Intell Rev. 2017:1–55. Peng X, Selvachandran G. Pythagorean fuzzy set: state of the art and future directions. Artif Intell Rev. 2017:1–55.
31.
go back to reference Hastie T, Stuetzle W. Principal curves. J Am Stat Assoc 1989;84(406):502–516.CrossRef Hastie T, Stuetzle W. Principal curves. J Am Stat Assoc 1989;84(406):502–516.CrossRef
32.
go back to reference Plutchik R. The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am Sci 2001;89(4):344–350.CrossRef Plutchik R. The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am Sci 2001;89(4):344–350.CrossRef
33.
go back to reference Cambria E, Livingstone A, Hussain A. The hourglass of emotions. In: Cognitive Behavioural Systems. Springer; 2012. p. 144–157. Cambria E, Livingstone A, Hussain A. The hourglass of emotions. In: Cognitive Behavioural Systems. Springer; 2012. p. 144–157.
34.
go back to reference Liu H, Singh P. Conceptnet—a practical commonsense reasoning tool-kit. BT Technol J 2004;22(4):211–226.CrossRef Liu H, Singh P. Conceptnet—a practical commonsense reasoning tool-kit. BT Technol J 2004;22(4):211–226.CrossRef
35.
go back to reference Strapparava C, Valitutti A, et al. Wordnet affect: an affective extension of wordnet. In: Lrec, Vol. 4, Citeseer; 2004. p. 1083–1086. Strapparava C, Valitutti A, et al. Wordnet affect: an affective extension of wordnet. In: Lrec, Vol. 4, Citeseer; 2004. p. 1083–1086.
36.
go back to reference Cambria E, Poria S, Bajpai R, Schuller B. SenticNet 4: A semantic resource for sentiment analysis based on conceptual primitives. In: COLING; 2016. p. 2666–2677. Cambria E, Poria S, Bajpai R, Schuller B. SenticNet 4: A semantic resource for sentiment analysis based on conceptual primitives. In: COLING; 2016. p. 2666–2677.
37.
go back to reference Cambria E, Hussain A. Sentic computing: a Common-Sense-Based framework for Concept-Level sentiment analysis. Cham: Springer; 2015.CrossRef Cambria E, Hussain A. Sentic computing: a Common-Sense-Based framework for Concept-Level sentiment analysis. Cham: Springer; 2015.CrossRef
38.
go back to reference Bottou L, Bengio Y. Convergence properties of the k-means algorithms. In: Advances in Neural Information Processing Systems; 1995. p. 585–592. Bottou L, Bengio Y. Convergence properties of the k-means algorithms. In: Advances in Neural Information Processing Systems; 1995. p. 585–592.
39.
go back to reference Belkin M, Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 2003;15(6):1373–1396.CrossRef Belkin M, Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 2003;15(6):1373–1396.CrossRef
Metadata
Title
Cognitive Insights into Sentic Spaces Using Principal Paths
Authors
Edoardo Ragusa
Paolo Gastaldo
Rodolfo Zunino
Marco Jacopo Ferrarotti
Walter Rocchia
Sergio Decherchi
Publication date
16-07-2019
Publisher
Springer US
Published in
Cognitive Computation / Issue 5/2019
Print ISSN: 1866-9956
Electronic ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-019-09651-1

Other articles of this Issue 5/2019

Cognitive Computation 5/2019 Go to the issue

Premium Partner