Skip to main content
Top
Published in: Neural Computing and Applications 18/2020

11-03-2020 | Original Article

Constructing domain-dependent sentiment dictionary for sentiment analysis

Authors: Murtadha Ahmed, Qun Chen, Zhanhuai Li

Published in: Neural Computing and Applications | Issue 18/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Sentiment dictionary is of great value to sentiment analysis, which is used widely in sentiment analysis compositionality. However, the sentiment polarity and intensity of the word may vary from one domain to another. In this paper, we introduce a novel approach to build domain-dependent sentiment dictionary, SentiDomain. We propose a weak supervised neural model that aims at learning a set of sentiment clusters embedding from the sentence global representation of the target domain. The model is trained on unlabeled data with weak supervision by reconstructing the input sentence representation from the resulting representation. Furthermore, we also propose an attention-based LSTM model to address aspect-level sentiment analysis task based on the sentiment score retrieved from the proposed dictionary. The key idea is to weight-down the non-sentiment parts among aspect-related information in a given sentence. Our extensive experiments on both English and Chinese benchmark datasets have shown that compared to the state-of-the-art alternatives, our proposals can effectively improve polarity detection.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Footnotes
1
Pre-trained model of GloVe is available from www.​stanford.​edu
 
2
Tool for data visualization, it is available on Plotly.
 
Literature
1.
go back to reference Ahmed M, Chen Q, Wang Y, Li Z (2019) Hint-embedding attention-based LSTM for aspect identification sentiment analysis. In: Pacific Rim international conference on artificial intelligence, Springer, pp 569–581 Ahmed M, Chen Q, Wang Y, Li Z (2019) Hint-embedding attention-based LSTM for aspect identification sentiment analysis. In: Pacific Rim international conference on artificial intelligence, Springer, pp 569–581
2.
go back to reference Baccianella S, Esuli A, Sebastiani F (2010) SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the seventh conference on international language resources and evaluation (LREC’10) Baccianella S, Esuli A, Sebastiani F (2010) SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the seventh conference on international language resources and evaluation (LREC’10)
3.
go back to reference Bradley M, Lang P (1997) Affective norms for English words (ANEW): stimuli, instruction manual and affective ratings. Technical report no. c-1, Center for Research in Psychophysiology, University of Florida, Gainesville, FL Bradley M, Lang P (1997) Affective norms for English words (ANEW): stimuli, instruction manual and affective ratings. Technical report no. c-1, Center for Research in Psychophysiology, University of Florida, Gainesville, FL
4.
go back to reference Brody S, Elhadad N (2010) An unsupervised aspect-sentiment model for online reviews. In: Human language technologies: the 2010 annual conference of the North American chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pp 804–812 Brody S, Elhadad N (2010) An unsupervised aspect-sentiment model for online reviews. In: Human language technologies: the 2010 annual conference of the North American chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pp 804–812
5.
go back to reference Cambria E (2016) Affective computing and sentiment analysis. IEEE Intell Syst 31(2):102–107CrossRef Cambria E (2016) Affective computing and sentiment analysis. IEEE Intell Syst 31(2):102–107CrossRef
7.
go back to reference Chen P, Sun Z, Bing L, Yang W (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 452–461 Chen P, Sun Z, Bing L, Yang W (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 452–461
8.
go back to reference Devlin J, Chang MW, Lee K, Toutanova K (2018) BERT: pre-training of deep bidirectional transformers for language understanding. arXiv:181004805 Devlin J, Chang MW, Lee K, Toutanova K (2018) BERT: pre-training of deep bidirectional transformers for language understanding. arXiv:​181004805
9.
go back to reference Ding X, Liu B (2007) The utility of linguistic rules in opinion mining. In: Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval, ACM, pp 811–812 Ding X, Liu B (2007) The utility of linguistic rules in opinion mining. In: Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval, ACM, pp 811–812
10.
go back to reference Eisenstein J (2017) Unsupervised learning for lexicon-based classification. In: Thirty-first AAAI conference on artificial intelligence Eisenstein J (2017) Unsupervised learning for lexicon-based classification. In: Thirty-first AAAI conference on artificial intelligence
11.
go back to reference Fu P, Lin Z, Yuan F, Wang W, Meng D (2018) Learning sentiment-specific word embedding via global sentiment representation. In: Thirty-second AAAI conference on artificial intelligence Fu P, Lin Z, Yuan F, Wang W, Meng D (2018) Learning sentiment-specific word embedding via global sentiment representation. In: Thirty-second AAAI conference on artificial intelligence
12.
go back to reference Gatti L, Guerini M, Turchi M (2016) Sentiwords: deriving a high precision and high coverage lexicon for sentiment analysis. IEEE Trans Affect Comput 7(4):409–421CrossRef Gatti L, Guerini M, Turchi M (2016) Sentiwords: deriving a high precision and high coverage lexicon for sentiment analysis. IEEE Trans Affect Comput 7(4):409–421CrossRef
13.
go back to reference Guerini M, Gatti L, Turchi M (2013) Sentiment analysis: how to derive prior polarities from SentiWordNet. arXiv:13095843 Guerini M, Gatti L, Turchi M (2013) Sentiment analysis: how to derive prior polarities from SentiWordNet. arXiv:​13095843
14.
go back to reference He R, Lee WS, Ng HT, Dahlmeier D (2017) An unsupervised neural attention model for aspect extraction. In: Proceedings of the 55th annual meeting of the Association for Computational Linguistics (volume 1: long papers), vol 1, pp 388–397 He R, Lee WS, Ng HT, Dahlmeier D (2017) An unsupervised neural attention model for aspect extraction. In: Proceedings of the 55th annual meeting of the Association for Computational Linguistics (volume 1: long papers), vol 1, pp 388–397
15.
go back to reference He R, Lee WS, Ng HT, Dahlmeier D (2018) Effective attention modeling for aspect-level sentiment classification. In: Proceedings of the 27th international conference on computational linguistics, pp 1121–1131 He R, Lee WS, Ng HT, Dahlmeier D (2018) Effective attention modeling for aspect-level sentiment classification. In: Proceedings of the 27th international conference on computational linguistics, pp 1121–1131
16.
go back to reference Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 168–177 Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 168–177
17.
go back to reference Iyyer M, Guha A, Chaturvedi S, Boyd-Graber J, Daumé III H (2016) Feuding families and former friends: unsupervised learning for dynamic fictional relationships. In: Proceedings of the 2016 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, pp 1534–1544 Iyyer M, Guha A, Chaturvedi S, Boyd-Graber J, Daumé III H (2016) Feuding families and former friends: unsupervised learning for dynamic fictional relationships. In: Proceedings of the 2016 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, pp 1534–1544
18.
go back to reference Jiang L, Yu M, Zhou M, Liu X, Zhao T (2011) Target-dependent twitter sentiment classification. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: human language technologies—volume 1, Association for Computational Linguistics, pp 151–160 Jiang L, Yu M, Zhou M, Liu X, Zhao T (2011) Target-dependent twitter sentiment classification. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: human language technologies—volume 1, Association for Computational Linguistics, pp 151–160
19.
go back to reference Jindal N, Liu B (2006) Identifying comparative sentences in text documents. In: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval, ACM, pp 244–251 Jindal N, Liu B (2006) Identifying comparative sentences in text documents. In: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval, ACM, pp 244–251
20.
go back to reference Liu B (2012) Sentiment analysis and opinion mining, vol 5. Synthesis lectures on human language technologies. Morgan & Claypool Publishers, San Rafael, pp 1–167 Liu B (2012) Sentiment analysis and opinion mining, vol 5. Synthesis lectures on human language technologies. Morgan & Claypool Publishers, San Rafael, pp 1–167
21.
go back to reference Luo L, Ao X, Song Y, Li J, Yang X, He Q, Yu D (2019) Unsupervised neural aspect extraction with sememes. In: Proceedings of 28th international joint conference on artificial intelligence, pp 5123–5129 Luo L, Ao X, Song Y, Li J, Yang X, He Q, Yu D (2019) Unsupervised neural aspect extraction with sememes. In: Proceedings of 28th international joint conference on artificial intelligence, pp 5123–5129
22.
go back to reference Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. arXiv:170900893 Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. arXiv:​170900893
23.
go back to reference Mikolov T, Yih Wt, Zweig G (2013) Linguistic regularities in continuous space word representations. In: Proceedings of the 2013 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, pp 746–751 Mikolov T, Yih Wt, Zweig G (2013) Linguistic regularities in continuous space word representations. In: Proceedings of the 2013 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, pp 746–751
24.
go back to reference Mohammad SM, Kiritchenko S, Zhu X (2013) NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. arXiv:13086242 Mohammad SM, Kiritchenko S, Zhu X (2013) NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. arXiv:​13086242
25.
go back to reference Mudinas A, Zhang D, Levene M (2018) Bootstrap domain-specific sentiment classifiers from unlabeled corpora. Trans Assoc Comput Linguist 6:269–285CrossRef Mudinas A, Zhang D, Levene M (2018) Bootstrap domain-specific sentiment classifiers from unlabeled corpora. Trans Assoc Comput Linguist 6:269–285CrossRef
26.
go back to reference Nasukawa T, Yi J (2003) Sentiment analysis: capturing favorability using natural language processing. In: Proceedings of the 2nd international conference on knowledge capture, ACM, pp 70–77 Nasukawa T, Yi J (2003) Sentiment analysis: capturing favorability using natural language processing. In: Proceedings of the 2nd international conference on knowledge capture, ACM, pp 70–77
27.
go back to reference Neviarouskaya A, Prendinger H, Ishizuka M (2011) Affect analysis model: novel rule-based approach to affect sensing from text. Nat Lang Eng 17(1):95–135CrossRef Neviarouskaya A, Prendinger H, Ishizuka M (2011) Affect analysis model: novel rule-based approach to affect sensing from text. Nat Lang Eng 17(1):95–135CrossRef
28.
go back to reference Pang B, Lee L et al (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2(1–2):1–135CrossRef Pang B, Lee L et al (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2(1–2):1–135CrossRef
29.
go back to reference Pennington J, Socher R, Manning C (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543 Pennington J, Socher R, Manning C (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543
30.
go back to reference Perez-Rosas V, Banea C, Mihalcea R (2012) Learning sentiment lexicons in Spanish. In: LREC, vol 12, p 73 Perez-Rosas V, Banea C, Mihalcea R (2012) Learning sentiment lexicons in Spanish. In: LREC, vol 12, p 73
31.
go back to reference Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations. arXiv:180205365 Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations. arXiv:​180205365
32.
go back to reference Polanyi L, Zaenen A (2006) Contextual valence shifters. In: Shanahan JG, Qu Y, Wiebe J (eds) Computing attitude and affect in text: theory and applications. Springer, Dordrecht, pp 1–10 Polanyi L, Zaenen A (2006) Contextual valence shifters. In: Shanahan JG, Qu Y, Wiebe J (eds) Computing attitude and affect in text: theory and applications. Springer, Dordrecht, pp 1–10
33.
go back to reference Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (2014) Semeval-2014 task 4: aspect based sentiment analysis. In: Proceedings of 10th international workshop on semantic evaluation (SemEval-2014), pp 27–35 Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (2014) Semeval-2014 task 4: aspect based sentiment analysis. In: Proceedings of 10th international workshop on semantic evaluation (SemEval-2014), pp 27–35
34.
36.
go back to reference Shi C, Chen Q, Sha L, Li S, Sun X, Wang H, Zhang L (2018) Auto-dialabel: Labeling dialogue data with unsupervised learning. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 684–689 Shi C, Chen Q, Sha L, Li S, Sun X, Wang H, Zhang L (2018) Auto-dialabel: Labeling dialogue data with unsupervised learning. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 684–689
37.
go back to reference Socher R, Karpathy A, Le QV, Manning CD, Ng AY (2014) Grounded compositional semantics for finding and describing images with sentences. Trans Assoc Comput Linguist 2(1):207–218CrossRef Socher R, Karpathy A, Le QV, Manning CD, Ng AY (2014) Grounded compositional semantics for finding and describing images with sentences. Trans Assoc Comput Linguist 2(1):207–218CrossRef
38.
go back to reference Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267–307CrossRef Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267–307CrossRef
39.
go back to reference Tang D, Wei F, Yang N, Zhou M, Liu T, Qin B (2014) Learning sentiment-specific word embedding for twitter sentiment classification. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics (volume 1: long papers), pp 1555–1565 Tang D, Wei F, Yang N, Zhou M, Liu T, Qin B (2014) Learning sentiment-specific word embedding for twitter sentiment classification. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics (volume 1: long papers), pp 1555–1565
40.
41.
go back to reference Tang D, Wei F, Qin B, Yang N, Liu T, Zhou M (2015b) Sentiment embeddings with applications to sentiment analysis. IEEE Trans Knowl Data Eng 28(2):496–509CrossRef Tang D, Wei F, Qin B, Yang N, Liu T, Zhou M (2015b) Sentiment embeddings with applications to sentiment analysis. IEEE Trans Knowl Data Eng 28(2):496–509CrossRef
43.
go back to reference Tay Y, Tuan LA, Hui SC (2018) Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: Thirty-second AAAI conference on artificial intelligence Tay Y, Tuan LA, Hui SC (2018) Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: Thirty-second AAAI conference on artificial intelligence
44.
go back to reference Wang Y, Huang M, Zhao L et al (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615 Wang Y, Huang M, Zhao L et al (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615
46.
go back to reference Warriner AB, Kuperman V, Brysbaert M (2013) Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav Res Methods 45(4):1191–1207CrossRef Warriner AB, Kuperman V, Brysbaert M (2013) Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav Res Methods 45(4):1191–1207CrossRef
47.
go back to reference Weston J, Bengio S, Usunier N (2011) Wsabie: scaling up to large vocabulary image annotation. IJCAI 11:2764–2770 Weston J, Bengio S, Usunier N (2011) Wsabie: scaling up to large vocabulary image annotation. IJCAI 11:2764–2770
48.
go back to reference Xing FZ, Pallucchini F, Cambria E (2019) Cognitive-inspired domain adaptation of sentiment lexicons. Inf Process Manag 56(3):554–564CrossRef Xing FZ, Pallucchini F, Cambria E (2019) Cognitive-inspired domain adaptation of sentiment lexicons. Inf Process Manag 56(3):554–564CrossRef
49.
go back to reference Xue W, Li T (2018) Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th annual meeting of the Association for Computational Linguistics Xue W, Li T (2018) Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th annual meeting of the Association for Computational Linguistics
50.
go back to reference Zhang H, Huang W, Liu L, Chow TWW (2019) Learning to match clothing from textual feature-based compatible relationships. IEEE Transactions on Industrial Informatics, Proceedings of the CIKM, ACM, 2018, pp. 843–852 Zhang H, Huang W, Liu L, Chow TWW (2019) Learning to match clothing from textual feature-based compatible relationships. IEEE Transactions on Industrial Informatics, Proceedings of the CIKM, ACM, 2018, pp. 843–852
51.
go back to reference Zhao WX, Jiang J, Yan H, Li X (2010) Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 56–65 Zhao WX, Jiang J, Yan H, Li X (2010) Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 56–65
Metadata
Title
Constructing domain-dependent sentiment dictionary for sentiment analysis
Authors
Murtadha Ahmed
Qun Chen
Zhanhuai Li
Publication date
11-03-2020
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 18/2020
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-04824-8

Other articles of this Issue 18/2020

Neural Computing and Applications 18/2020 Go to the issue

S.I. : Deep Learning Approaches for RealTime Image Super Resolution (DLRSR)

A novel super-resolution CT image reconstruction via semi-supervised generative adversarial network

S.I.: Deep Learning Approaches for RealTime Image Super Resolution (DLRSR)

GAN-Poser: an improvised bidirectional GAN model for human motion prediction

Extreme Learning Machine and Deep Learning Networks

Object affordance detection with relationship-aware network

Premium Partner