Praphula Kumar Jain
Skip Abstract Section
Abstract
With the fastest growth of information and communication technology (ICT), the availability of web content on social media platforms is increasing day by day. Sentiment analysis from online reviews drawing researchers’ attention from various organizations such as academics, government, and private industries. Sentiment analysis has been a hot research topic in Machine Learning (ML) and Natural Language Processing (NLP). Currently, Deep Learning (DL) techniques are implemented in sentiment analysis to get excellent results. This study proposed a hybrid convolutional neural network-long short-term memory (CNN-LSTM) model for sentiment analysis. Our proposed model is being applied with dropout, max pooling, and batch normalization to get results. Experimental analysis carried out on Airlinequality and Twitter airline sentiment datasets. We employed the Keras word embedding approach, which converts texts into vectors of numeric values, where similar words have small vector distances between them. We calculated various parameters, such as accuracy, precision, recall, and F1-measure, to measure the model’s performance. These parameters for the proposed model are better than the classical ML models in sentiment analysis. Our results analysis demonstrates that the proposed model outperforms with 91.3% accuracy in sentiment analysis.
- Laith Abualigah, Hamza Essam Alfar, Mohammad Shehab, and Alhareth Mohammed Abu Hussein. 2020. Sentiment analysis in healthcare: A brief review. In Recent Advances in NLP: The Case of Arabic Language. Springer, 129–141.Google Scholar
- Ibrahim Said Ahmad, Azuraliza Abu Bakar, and Mohd Ridzwan Yaakub. 2020. Movie revenue prediction based on purchase intention mining using YouTube trailer reviews. Information Processing & Management 57, 5 (2020), 102278.Google ScholarCross Ref
- Mohammad Al-Smadi, Bashar Talafha, Mahmoud Al-Ayyoub, and Yaser Jararweh. 2019. Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews. International Journal of Machine Learning and Cybernetics 10, 8 (2019), 2163–2175.Google ScholarCross Ref
- Oscar Araque, Ignacio Corcuera-Platas, J. Fernando Sánchez-Rada, and Carlos A. Iglesias. 2017. Enhancing deep learning sentiment analysis with ensemble techniques in social applications. Expert Systems with Applications 77 (2017), 236–246. Google ScholarDigital Library
- Snehasish Banerjee and Alton Y. K. Chua. 2016. In search of patterns among travellers’ hotel ratings in TripAdvisor. Tourism Management 53 (2016), 125–131.Google ScholarCross Ref
- Erik Cambria. 2016. Affective computing and sentiment analysis. IEEE Intelligent Systems 31, 2 (2016), 102–107. Google ScholarDigital Library
- Iti Chaturvedi, Erik Cambria, Roy E. Welsch, and Francisco Herrera. 2018. Distinguishing between facts and opinions for sentiment analysis: Survey and challenges. Information Fusion 44 (2018), 65–77.Google ScholarCross Ref
- Liang-Chu Chen, Chia-Meng Lee, and Mu-Yen Chen. 2019. Exploration of social media for sentiment analysis using deep learning. Soft Computing 24 (2019), 8187–8197.Google ScholarCross Ref
- Mu-Yen Chen and Ting-Hsuan Chen. 2019. Modeling public mood and emotion: Blog and news sentiment and socio-economic phenomena. Future Generation Computer Systems 96 (2019), 692–699.Google ScholarCross Ref
- Mu-Yen Chen, Hsiu-Sen Chiang, Edwin Lughofer, and Erol Egrioglu. 2020. Deep learning: Emerging trends, applications and research challenges.Soft Computing 24, 11 (2020), 7835–7838.Google Scholar
- Po-Jen Chen, Jian-Jiun Ding, Hung-Wei Hsu, Chien-Yao Wang, and Jia-Ching Wang. 2017. Improved convolutional neural network based scene classification using long short-term memory and label relations. In Proceedings of the 2017 IEEE International Conference on Multimedia and Expo Workshops (ICMEW’17). IEEE, Los Alamitos, CA, 429–434.Google ScholarCross Ref
- Lopamudra Dey, Sanjay Chakraborty, Anuraag Biswas, Beepa Bose, and Sweta Tiwari. 2016. Sentiment analysis of review datasets using naive Bayes and K-NN classifier. arXiv:1610.09982.Google Scholar
- Jiachen Du, Lin Gui, Ruifeng Xu, and Yulan He. 2017. A convolutional attention model for text classification. In Proceedings of the National CCF Conference on Natural Language Processing and Chinese Computing. 183–195.Google Scholar
- Ashraf Elnagar, Ridhwan Al-Debsi, and Omar Einea. 2020. Arabic text classification using deep learning models. Information Processing & Management 57, 1 (2020), 102121.Google ScholarDigital Library
- Maryam Esmaeili and Alberto Vancheri. 2010. 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology. IEEE/WIC/ACM.Google Scholar
- Imene Guellil and Kamel Boukhalfa. 2015. Social big data mining: A survey focused on opinion mining and sentiments analysis. In Proceedings of the 2015 12th International Symposium on Programming and Systems (ISPS’15). IEEE, Los Alamitos, CA, 1–10.Google ScholarCross Ref
- Antonio Gulli and Sujit Pal. 2017. Deep Learning with Keras. Packt Publishing Ltd. Google ScholarDigital Library
- Yue Guo, Stuart J. Barnes, and Qiong Jia. 2017. Mining meaning from online ratings and reviews: Tourist satisfaction analysis using latent Dirichlet allocation. Tourism Management 59 (2017), 467–483.Google ScholarCross Ref
- Viktor Hangya and Richárd Farkas. 2017. A comparative empirical study on social media sentiment analysis over various genres and languages. Artificial Intelligence Review 47, 4 (2017), 485–505. Google ScholarDigital Library
- Fatemeh Hemmatian and Mohammad Karim Sohrabi. 2019. A survey on classification techniques for opinion mining and sentiment analysis. Artificial Intelligence Review 52 (2019), 1495–1545.Google ScholarDigital Library
- Charles F. Hofacker, Edward Carl Malthouse, and Fareena Sultan. 2016. Big data and consumer behavior: Imminent opportunities. Journal of Consumer Marketing (2016).Google Scholar
- Stefan Jackson and John Tozer. 2020. A vision for data science at British Airways. Impact 2020, 1 (2020), 15–19.Google ScholarCross Ref
- Beakcheol Jang, Inhwan Kim, and Jong Wook Kim. 2019. Word2Vec convolutional neural networks for classification of news articles and tweets. PLoS One 14, 8 (2019), e0220976.Google ScholarCross Ref
- Nal Kalchbrenner, Edward Grefenstette, and Phil Blunsom. 2014. A convolutional neural network for modelling sentences. arXiv:1404.2188.Google Scholar
- Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv:1408.5882.Google Scholar
- Akshi Kumar and Geetanjali Garg. 2019. Systematic literature review on context-based sentiment analysis in social multimedia. Multimedia Tools and Applications 79 (2019), 15349–15380.Google ScholarCross Ref
- Sachin Kumar and Mikhail Zymbler. 2019. A machine learning approach to analyze customer satisfaction from airline tweets. Journal of Big Data 6, 1 (2019), 62.Google ScholarCross Ref
- Jin-Ah Kwak and Sung Kyum Cho. 2018. Analyzing public opinion with social media data during election periods: A selective literature review. Asian Journal for Public Opinion Research 5, 4 (2018), 285–301.Google Scholar
- Pei-Ju Lee, Ya-Han Hu, and Kuan-Ting Lu. 2018. Assessing the helpfulness of online hotel reviews: A classification-based approach. Telematics and Informatics 35, 2 (2018), 436–445.Google ScholarCross Ref
- Xiao-Qin Liu, Qiu-Lin Wu, and Wen-Tsao Pan. 2019. Sentiment classification of micro-blog comments based on randomforest algorithm. Concurrency and Computation: Practice and Experience 31, 10 (2019), e4746.Google ScholarCross Ref
- Kigon Lyu and Hyeoncheol Kim. 2016. Sentiment analysis using word polarity of social media. Wireless Personal Communications 89, 3 (2016), 941–958. Google ScholarDigital Library
- Trupthi Mandhula, Suresh Pabboju, and Narsimha Gugulotu. 2019. Predicting the customer’s opinion on Amazon products using selective memory architecture-based convolutional neural network. Journal of Supercomputing 76 (2019), 5923–5947.Google ScholarCross Ref
- Mika V. Mäntylä, Daniel Graziotin, and Miikka Kuutila. 2018. The evolution of sentiment analysis—A review of research topics, venues, and top cited papers. Computer Science Review 27 (2018), 16–32.Google ScholarCross Ref
- Fenna Miedema. 2018. Sentiment Analysis with Long Short-Term Memory Networks. Vrije Universiteit Amsterdam.Google Scholar
- Xi Ouyang, Pan Zhou, Cheng Hua Li, and Lijun Liu. 2015. Sentiment analysis using convolutional neural network. In Proceedings of the 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing. IEEE, Los Alamitos, CA, 2359–2364.Google Scholar
- Tim O’Reilly and John Battelle. 2004. Opening welcome: State of the internet industry.San Francisco, California, October 5 (2004).Google Scholar
- B. Pang and L. Lee. 2008. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2, 1–2 (2008), 1–135. Google ScholarDigital Library
- Seungwan Seo, Czangyeob Kim, Haedong Kim, Kyounghyun Mo, and Pilsung Kang. 2020. Comparative study of deep learning-based sentiment classification. IEEE Access 8 (2020), 6861–6875.Google ScholarCross Ref
- Eren Sezgen, Keith J. Mason, and Robert Mayer. 2019. Voice of airline passenger: A text mining approach to understand customer satisfaction. Journal of Air Transport Management 77 (2019), 65–74.Google ScholarCross Ref
- Michael Siering, Amit V. Deokar, and Christian Janze. 2018. Disentangling consumer recommendations: Explaining and predicting airline recommendations based on online reviews. Decision Support Systems 107 (2018), 52–63. Google ScholarDigital Library
- Tristan Stérin, Nicolas Farrugia, and Vincent Gripon. 2017. An intrinsic difference between vanilla RNNs and GRU models. In Proceedings of the 9th International Conference on Advanced Cognitive Technologies and Applications (COGNITIVE’17). 76–81.Google Scholar
- Farideh Tavazoee, Claudio Conversano, and Francesco Mola. 2019. Recurrent random forest for the assessment of popularity in social media. Knowledge and Information Systems 62 (2019), 1847–1879.Google ScholarCross Ref
- Chih-Fong Tsai, Kuanchin Chen, Ya-Han Hu, and Wei-Kai Chen. 2020. Improving text summarization of online hotel reviews with review helpfulness and sentiment. Tourism Management 80 (2020), 104122.Google ScholarCross Ref
- Mikalai Tsytsarau and Themis Palpanas. 2012. Survey on mining subjective data on the web. Data Mining and Knowledge Discovery 24, 3 (2012), 478–514. Google ScholarDigital Library
- Ge Wang, Pengbo Pu, and Yongquan Liang. 2018. Topic and sentiment words extraction in cross-domain product reviews. Wireless Personal Communications 102, 2 (2018), 1773–1783. Google ScholarDigital Library
- Haibing Wu and Xiaodong Gu. 2015. Towards dropout training for convolutional neural networks. Neural Networks 71 (2015), 1–10. Google ScholarDigital Library
- Feng Xu, Zhenchun Pan, and Rui Xia. 2020. E-commerce product review sentiment classification based on a naïve Bayes continuous learning framework. Information Processing & Management 57, 5 (2020), 102221.Google ScholarCross Ref
- Qiang Ye, Huiying Li, Zhisheng Wang, and Rob Law. 2014. The influence of hotel price on perceived service quality and value in e-tourism: An empirical investigation based on online traveler reviews. Journal of Hospitality & Tourism Research 38, 1 (2014), 23–39.Google ScholarCross Ref
Index Terms
- A Hybrid CNN-LSTM: A Deep Learning Approach for Consumer Sentiment Analysis Using Qualitative User-Generated Contents
Recommendations
Comparing deep learning architectures for sentiment analysis on drug reviews
AbstractSince the turn of the century, as millions of user’s opinions are available on the web, sentiment analysis has become one of the most fruitful research fields in Natural Language Processing (NLP). Research on sentiment analysis has ...
Graphical abstractDisplay Omitted
Highlights- Drug reviews provide useful information to improve pharmacovigilance systems.
- ...
An Effective Framework for Sentiment Analysis of Hindi Sentiments Using Deep Learning Technique
AbstractSentiment analysis is a way to extract emotion-based information or users' sentiments and opinions from text data. Sentiment analysis uses text analysis, Natural Language Processing (NLP), and computational linguistics. Text mining research has a ...
Automatic Indonesian Sentiment Lexicon Curation with Sentiment Valence Tuning for Social Media Sentiment Analysis
Special issue on Deep Learning for Low-Resource Natural Language Processing, Part 1 and Regular PapersA novel Indonesian sentiment lexicon (SentIL -- Sentiment Indonesian Lexicon) is created with an automatic pipeline; from creating sentiment seed words, adding new words with slang words, emoticons, and from the given dictionary and sentiment corpus, ...
Comments