Skip to main content
Top

2021 | OriginalPaper | Chapter

Evolution of Sentiment Analysis: Methodologies and Paradigms

Author : Aseer Ahmad Ansari

Published in: Trends of Data Science and Applications

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the advent of the digital age, almost everything has come down to better understanding of the data. Natural language processing is equally in pursuit and is rather among the most researched areas of computer science. Post 1980, a major revolution in NLP embarked with the emergence of machine learning algorithms resulting from steady escalation in computational power. Unlike other data, text semantics becomes more complex both because of its contextual nature and daily evolving language usage. While the continuous efforts of improving language representation for logical units interpretation is still prevalent, much to our realization, traditional, and long established recurrent neural networks which were supposed to grasp a bi-directional context of language have been surpassed by attention models in constructing improved embeddings allowing systems to better understand language. Among numerous applications circumventing, understanding sentiment of text has been widespread in fields including but not limited to customer reviews, stock market, elections, healthcare analytics, online, and social media analytics. From binary classification of it to more challenging cases such as negation handling, sarcasm, toxicity, multiple attitudes, or polarity, this research chapter explores the evolution of sentiment analysis in the light of emerging text processing and the transition of text understanding from rule-based to a statistical one with a comparison of benchmark performance from state-of-the-art models over various applications and datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Pang, Bo, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up? Sentiment classification using machine learning techniques. Pang, Bo, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up? Sentiment classification using machine learning techniques.
2.
go back to reference Jussi Karlgren, and Douglas Cutting. 1994. Recognizing text genres with simple metrics using discriminant analysis, 1071–1075. Jussi Karlgren, and Douglas Cutting. 1994. Recognizing text genres with simple metrics using discriminant analysis, 1071–1075.
6.
go back to reference Janyce Wiebe, Theresa Wilson, and Matthew Bell. 2001. Identifying collocations for recognizing opinions. In Proceedings of ACL/EACL 2001 Workshop on Collocation. Janyce Wiebe, Theresa Wilson, and Matthew Bell. 2001. Identifying collocations for recognizing opinions. In Proceedings of ACL/EACL 2001 Workshop on Collocation.
7.
go back to reference Turney, Peter D.2003. Measuring praise and criticism: Inference of semantic orientation from association. Canada: National Research Council. Turney, Peter D.2003. Measuring praise and criticism: Inference of semantic orientation from association. Canada: National Research Council.
9.
go back to reference Hu, Minqing, and Bing Liu. 2004. Mining opinion features in customer reviews. Chicago: Department of Computer Science, University of Illinois. Hu, Minqing, and Bing Liu. 2004. Mining opinion features in customer reviews. Chicago: Department of Computer Science, University of Illinois.
10.
go back to reference Miller, George A. 1995. WordNet: A lexical database for english. Miller, George A. 1995. WordNet: A lexical database for english.
11.
go back to reference Spertus, E. 1997. Smokey: Automatic recognition of hostile messages. AAAI/IAAI. Spertus, E. 1997. Smokey: Automatic recognition of hostile messages. AAAI/IAAI.
12.
go back to reference Turney, Peter D. 2002. Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. Turney, Peter D. 2002. Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews.
13.
go back to reference Esuli, Andrea, et al. 2006. SENTIWORDNET: A publicly available lexical resource for opinion mining. Esuli, Andrea, et al. 2006. SENTIWORDNET: A publicly available lexical resource for opinion mining.
16.
go back to reference Baccianella, Stefano, Andrea Esuli, and Fabrizio Sebastiani. 2010. SENTIWORDNET 3.0: An enhanced lexical resource for sentiment analysis and opinion mining. Baccianella, Stefano, Andrea Esuli, and Fabrizio Sebastiani. 2010. SENTIWORDNET 3.0: An enhanced lexical resource for sentiment analysis and opinion mining.
17.
go back to reference Taboada, Maite, Julian Brooke, Milan Tofiloski, Kimberly Voll et al. 2014. Supervised sentiment analysis in Twitter using Skipgrams. Taboada, Maite, Julian Brooke, Milan Tofiloski, Kimberly Voll et al. 2014. Supervised sentiment analysis in Twitter using Skipgrams.
18.
go back to reference Wilson, Heresa, Janyce Wiebe, and Paul Hoffmann. 2005. Recognizing contextual polarity in phrase-level sentiment analysis. Wilson, Heresa, Janyce Wiebe, and Paul Hoffmann. 2005. Recognizing contextual polarity in phrase-level sentiment analysis.
19.
go back to reference Cambria, E. 2013. New avenues in opinion mining and sentiment analysis. Cambria, E. 2013. New avenues in opinion mining and sentiment analysis.
20.
go back to reference Dave, Kushal. 2003. Mining the peanut gallery: Opinion extraction and semantic classification of product reviews. USA: NEC Laboratories. Dave, Kushal. 2003. Mining the peanut gallery: Opinion extraction and semantic classification of product reviews. USA: NEC Laboratories.
21.
go back to reference Thelwall, M. 2012. Sentiment strength detection for the social web. Thelwall, M. 2012. Sentiment strength detection for the social web.
22.
go back to reference Pak, Alexander and Patrick Paroubek. 2010. Twitter as a corpus for sentiment analysis and opinion mining. Pak, Alexander and Patrick Paroubek. 2010. Twitter as a corpus for sentiment analysis and opinion mining.
23.
go back to reference Mozetic, Igor, Miha Grcar, and Jasmina Smailovic. 2016. Multilingual twitter sentiment classification: The role of human annotators. Mozetic, Igor, Miha Grcar, and Jasmina Smailovic. 2016. Multilingual twitter sentiment classification: The role of human annotators.
27.
go back to reference Cacholaz, Isabel, Eric Holgatey, Daniel Preotiuc-Pietro, and Junyi Jessy Liy. 2018. Expressively vulgar: The socio-dynamics of vulgarity and its effects on sentiment analysis in social media. Cacholaz, Isabel, Eric Holgatey, Daniel Preotiuc-Pietro, and Junyi Jessy Liy. 2018. Expressively vulgar: The socio-dynamics of vulgarity and its effects on sentiment analysis in social media.
30.
32.
go back to reference MELD: A multimodal multi-party dataset for emotion recognition in conversations. 2018. MELD: A multimodal multi-party dataset for emotion recognition in conversations. 2018.
33.
go back to reference Sheng-Yeh Chen, Chao-Chun Hsu, Chuan-Chun Kuo, Huang Ting-Hao, and Lun-Wei Ku. 2018. EmotionLines: An emotion corpus of multi-party conversations. Sheng-Yeh Chen, Chao-Chun Hsu, Chuan-Chun Kuo, Huang Ting-Hao, and Lun-Wei Ku. 2018. EmotionLines: An emotion corpus of multi-party conversations.
34.
go back to reference Myle, Ott, Claire Cardie, and Jeffrey T. Hancock. 2013. Negative Deceptive Opinion Spam. Myle, Ott, Claire Cardie, and Jeffrey T. Hancock. 2013. Negative Deceptive Opinion Spam.
35.
go back to reference Myle, Ott, Yejin Choi, Claire Cardie, and Jeffrey Hancock. 2011. Finding deceptive opinion spam by any stretch of the imagination. Myle, Ott, Yejin Choi, Claire Cardie, and Jeffrey Hancock. 2011. Finding deceptive opinion spam by any stretch of the imagination.
36.
go back to reference Hochreiter, and Schmidhuber. 1997. Long short-term memory. Hochreiter, and Schmidhuber. 1997. Long short-term memory.
37.
go back to reference Cho, Kyunghyun, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. Cho, Kyunghyun, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation.
38.
go back to reference Yiny, Wenpeng, Katharina Kanny, Mo Yuz, and Hinrich Schutzey. 2017. Comparative study of CNN and RNN for natural language processing. Munich, Germany: CIS, LMU; USA: IBM Research. Yiny, Wenpeng, Katharina Kanny, Mo Yuz, and Hinrich Schutzey. 2017. Comparative study of CNN and RNN for natural language processing. Munich, Germany: CIS, LMU; USA: IBM Research.
39.
go back to reference Socher, Richard, A. Perelygin, J.Y. Wu, J. Chuang, C.D. Manning, A.Y. Ng, and C. Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. EMNLP 1631: 1631–1642. Socher, Richard, A. Perelygin, J.Y. Wu, J. Chuang, C.D. Manning, A.Y. Ng, and C. Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. EMNLP 1631: 1631–1642.
40.
go back to reference Mikolov, Tomas et al. 2013. Efficient estimation of word representations in vector space. Mikolov, Tomas et al. 2013. Efficient estimation of word representations in vector space.
41.
go back to reference Mikolov, Tomas. 2013. Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems. Mikolov, Tomas. 2013. Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems.
42.
go back to reference Pennington, Jeffrey, Richard Socher, and Christopher D. Manning. GloVe: Global vectors for word representation. Pennington, Jeffrey, Richard Socher, and Christopher D. Manning. GloVe: Global vectors for word representation.
43.
go back to reference Zhou, Shusen, Qingcai Chen, and Xiaolong Wang. 2014. Fuzzy deep belief networks for semi-supervised sentiment classification. Neuro-Computing 131: 312–322. Zhou, Shusen, Qingcai Chen, and Xiaolong Wang. 2014. Fuzzy deep belief networks for semi-supervised sentiment classification. Neuro-Computing 131: 312–322.
44.
go back to reference BalaAnand, M., N. Karthikeyan, and S. Karthik. 2018. Designing a frame-work for communal software: Based on the assessment using relational modelling. International Journal of Parallel Program. BalaAnand, M., N. Karthikeyan, and S. Karthik. 2018. Designing a frame-work for communal software: Based on the assessment using relational modelling. International Journal of Parallel Program.
45.
go back to reference Bataa, Enkhbold, and Joshua Wu. An investigation of transfer learning-based sentiment analysis in Japanese. Bataa, Enkhbold, and Joshua Wu. An investigation of transfer learning-based sentiment analysis in Japanese.
47.
go back to reference Ashish, Noam, et al. 2017. Attention is all you need, NIPS. Ashish, Noam, et al. 2017. Attention is all you need, NIPS.
48.
go back to reference Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding.
49.
go back to reference Jeffrey Alec. 2018. Language models are unsupervised multi task learners. Jeffrey Alec. 2018. Language models are unsupervised multi task learners.
52.
go back to reference Turing-NLG: A 17-billion-parameter language model by Microsoft, Turing-NLG: A 17-billion-parameter language model by Microsoft. Turing-NLG: A 17-billion-parameter language model by Microsoft, Turing-NLG: A 17-billion-parameter language model by Microsoft.
53.
54.
55.
56.
go back to reference Alharbi, A.S.M., and E. de Doncker. 2019. Twitter sentiment analysis with a deep neural network: An enhanced approach using user behavioral information. Cognitive Systems Research 54: 50–61.CrossRef Alharbi, A.S.M., and E. de Doncker. 2019. Twitter sentiment analysis with a deep neural network: An enhanced approach using user behavioral information. Cognitive Systems Research 54: 50–61.CrossRef
57.
go back to reference Do, H.H., P. Prasad, A. Maag, and A.J. Alsadoon. 2019. Deep learning for aspect-based sentiment analysis: A comparative review. Expert Systems with Applications 118: 272–299.CrossRef Do, H.H., P. Prasad, A. Maag, and A.J. Alsadoon. 2019. Deep learning for aspect-based sentiment analysis: A comparative review. Expert Systems with Applications 118: 272–299.CrossRef
58.
go back to reference Yang, C., H. Zhang, B. Jiang, and K.J. Li. 2019. Aspect-based sentiment analysis with alternating coattention networks. Information Processing and Management 56: 463–478.CrossRef Yang, C., H. Zhang, B. Jiang, and K.J. Li. 2019. Aspect-based sentiment analysis with alternating coattention networks. Information Processing and Management 56: 463–478.CrossRef
59.
go back to reference Sohangir, S., D. Wang, A. Pomeranets, and T.M. Khoshgoftaar. 2018. Big data: Deep learning for financial sentiment analysis. Journal of Big Data 5: 3.CrossRef Sohangir, S., D. Wang, A. Pomeranets, and T.M. Khoshgoftaar. 2018. Big data: Deep learning for financial sentiment analysis. Journal of Big Data 5: 3.CrossRef
60.
go back to reference Schmitt, M., S. Steinheber, K. Schreiber, B. Roth. 2018. Joint aspect and polarity classification for aspect-based sentiment analysis with end-to-end neural networks. arXiv arXiv:1808.09238. Schmitt, M., S. Steinheber, K. Schreiber, B. Roth. 2018. Joint aspect and polarity classification for aspect-based sentiment analysis with end-to-end neural networks. arXiv arXiv:​1808.​09238.
61.
go back to reference Jeong, B., J. Yoon, and J.-M. Lee. 2019. Social media mining for product planning: A product opportunity mining approach based on topic modeling and sentiment analysis. International Journal of Information and Management 48: 280–290.CrossRef Jeong, B., J. Yoon, and J.-M. Lee. 2019. Social media mining for product planning: A product opportunity mining approach based on topic modeling and sentiment analysis. International Journal of Information and Management 48: 280–290.CrossRef
62.
go back to reference Preethi, G., P.V. Krishna, M.S. Obaidat, V. Saritha, S. Yenduri. 2017. Application of deep learning to sentiment analysis for recommender systems on cloud. In Proceedings of the 2017 International Conference on Computer, Information and Telecommunication Systems (CITS), Dalian, China, 21–23 July 2017, 93–97. Preethi, G., P.V. Krishna, M.S. Obaidat, V. Saritha, S. Yenduri. 2017. Application of deep learning to sentiment analysis for recommender systems on cloud. In Proceedings of the 2017 International Conference on Computer, Information and Telecommunication Systems (CITS), Dalian, China, 21–23 July 2017, 93–97.
63.
go back to reference Vateekul, P., and T. Koomsubha. 2016. A study of sentiment analysis using deep learning techniques on Thai Twitter data. In Proceedings of the 2016 13th International Joint Conference on Computer Science and Software Engineering (JCSSE), Khon Kaen, Thailand, 1–6. Vateekul, P., and T. Koomsubha. 2016. A study of sentiment analysis using deep learning techniques on Thai Twitter data. In Proceedings of the 2016 13th International Joint Conference on Computer Science and Software Engineering (JCSSE), Khon Kaen, Thailand, 1–6.
64.
go back to reference Gao, Y., W. Rong, Y. Shen, and Z. Xiong. 2016. Convolutional neural network based sentiment analysis using Adaboost combination. In Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada, 1333–1338. Gao, Y., W. Rong, Y. Shen, and Z. Xiong. 2016. Convolutional neural network based sentiment analysis using Adaboost combination. In Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada, 1333–1338.
65.
go back to reference Zhang, Xiang, and Yann LeCun. 2017. Which encoding is the best for text classification in Chinese, English, Japanese and Korean? Zhang, Xiang, and Yann LeCun. 2017. Which encoding is the best for text classification in Chinese, English, Japanese and Korean?
Metadata
Title
Evolution of Sentiment Analysis: Methodologies and Paradigms
Author
Aseer Ahmad Ansari
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-33-6815-6_8

Premium Partner