Top

Arabian Journal for Science and Engineering

Published in:

11-10-2021 | Research Article-Computer Engineering and Computer Science

Improving Sentiment Analysis for Social Media Applications Using an Ensemble Deep Learning Language Model

Author: Ahmed Alsayat

Published in: Arabian Journal for Science and Engineering | Issue 2/2022

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

As data grow rapidly on social media by users’ contributions, specially with the recent coronavirus pandemic, the need to acquire knowledge of their behaviors is in high demand. The opinions behind posts on the pandemic are the scope of the tested dataset in this study. Finding the most suitable classification algorithms for this kind of data is challenging. Within this context, models of deep learning for sentiment analysis can introduce detailed representation capabilities and enhanced performance compared to existing feature-based techniques. In this paper, we focus on enhancing the performance of sentiment classification using a customized deep learning model with an advanced word embedding technique and create a long short-term memory (LSTM) network. Furthermore, we propose an ensemble model that combines our baseline classifier with other state-of-the-art classifiers used for sentiment analysis. The contributions of this paper are twofold. (1) We establish a robust framework based on word embedding and an LSTM network that learns the contextual relations among words and understands unseen or rare words in relatively emerging situations such as the coronavirus pandemic by recognizing suffixes and prefixes from training data. (2) We capture and utilize the significant differences in state-of-the-art methods by proposing a hybrid ensemble model for sentiment analysis. We conduct several experiments using our own Twitter coronavirus hashtag dataset as well as public review datasets from Amazon and Yelp. For concluding results, a statistical study is carried out indicating that the performance of these proposed models surpasses other models in terms of classification accuracy.

previous article High-Accuracy 3D Indoor Visible Light Positioning Method Based on the Improved Adaptive Cuckoo Search Algorithm

next article The Archerfish Hunting Optimizer: A Novel Metaheuristic Algorithm for Global Optimization

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Behera, R.K.; Naik, D.; Rath, S.K.; Dharavath, R.: Genetic algorithm-based community detection in large-scale social networks. Neural Comput. Appl. 32(13), 9649–9665 (2020). https://doi.org/10.1007/s00521-019-04487-0.CrossRef

Zhang, Z.; Sun, R.; Zhao, C.; Wang, J.; Chang, C.K.; Gupta, B.B.: CyVOD: a novel trinity multimedia social network scheme. Multimed. Tools Appl. 76(18), 18513–18529 (2017). https://doi.org/10.1007/s11042-016-4162-z.CrossRef

Gupta, S.; Gupta, B.B.: XSS-secure as a service for the platforms of online social network-based multimedia web applications in cloud. Multimed. Tools Appl. 77(4), 4829–4861 (2018). https://doi.org/10.1007/s11042-016-3735-1.CrossRef

Wang, H.; Li, Z.; Li, Y.; Gupta, B.B.; Choi, C.: Visual saliency guided complex image retrieval. Pattern Recognit. Lett. 130, 64–72 (2020). https://doi.org/10.1016/j.patrec.2018.08.010.CrossRef

Liu, B.: Text sentiment analysis based on CBOW model and deep learning in big data environment. J. Ambient Intell. Human Comput. 11(2), 451–458 (2020). https://doi.org/10.1007/s12652-018-1095-6.CrossRef

Pathak, A.R.; Pandey, M.; Rautaray, S.: Empirical evaluation of deep learning models for sentiment analysis. J. Stat. Manag. Syst. 22(4), 741–752 (2019). https://doi.org/10.1080/09720510.2019.1609554.CrossRef

Gupta, B.B.; Quamara, M.: An overview of Internet of Things (IoT): architectural aspects, challenges, and protocols. Concurr. Comput. Pract. Exper. (2020). https://doi.org/10.1002/cpe.4946.CrossRef

Esposito, C.; Ficco, M.; Gupta, B.B.: Blockchain-based authentication and authorization for smart city applications. Inf. Process. Manag. (2021). https://doi.org/10.1016/j.ipm.2020.102468.CrossRef

Alsayat, A.; Elmitwally, N.: A comprehensive study for Arabic sentiment analysis. Egyptian Inform. J. 21(1), 7–12 (2020). https://doi.org/10.1016/j.eij.2019.06.001.CrossRef

10.

Al-Twairesh, N.; Al-Negheimish, H.: Surface and deep features ensemble for sentiment analysis of Arabic Tweets. IEEE Access 7, 84122–84131 (2019). https://doi.org/10.1109/ACCESS.2019.2924314.CrossRef

11.

Dang, N.C.; Moreno-García, M.N.; De la Prieta, F.: Sentiment analysis based on deep learning: A comparative study. Electronics 9(3), 483 (2020). https://doi.org/10.3390/electronics9030483.CrossRef

12.

Araque, O.; Corcuera-Platas, I.; Sánchez-Rada, J.F.; Iglesias, C.A.: Enhancing deep learning sentiment analysis with ensemble techniques in social applications. Expert Syst. Appl. 77, 236–246 (2017). https://doi.org/10.1016/j.eswa.2017.02.002.CrossRef

13.

Carvalho, A.; Harris, L.: Off-the-Shelf technologies for sentiment analysis of social media data: two empirical studies. In: The Proceedings of 26th Americas Conference on Information Systems (AMCIS2020) 6, Virtual Conference, Association for Information Systems (2020)

14.

Zhang, L.; Wang, S.; Liu, B.: Deep learning for sentiment analysis: a survey. WIREs Data Min. Knowl. Discov. 8(4), e1253 (2018). https://doi.org/10.1002/widm.1253.CrossRef

15.

Kamruzzaman, M.M.: Arabic sign language recognition and generating Arabic speech using convolutional neural network. Wireless Commun. Mob. Comput. 2020, 3685614 (2020). https://doi.org/10.1155/2020/3685614.CrossRef

16.

Behdenna, S.; Barigou, F.; Belalem, G.: Document level sentiment analysis: a survey. EAI Endorsed Trans. Context-Aware Syst. Appl. (2018). https://doi.org/10.4108/eai.14-3-2018.154339.CrossRef

17.

Habimana, O.; Li, Y.; Li, R.; Gu, X.; Yu, G.: Sentiment analysis using deep learning approaches: an overview. Sci. China Inf. Sci. 63(1), 111102 (2019). https://doi.org/10.1007/s11432-018-9941-6.CrossRef

18.

Whitehead, M.; Yaeger, L.: Sentiment mining using ensemble classification models. In: Sobh, T. (ed.) Innovations and Advances in Computer Sciences and Engineering, pp. 509–514. Springer, Dordrecht (2010)CrossRef

19.

Chen, N.; Wang, P.: Advanced combined LSTM-CNN model for Twitter sentiment analysis. In: The Proceedings of 2018 5th IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS), IEEE, pp. 684–687 (2018) https://doi.org/10.1109/CCIS.2018.8691381

20.

Behera, R.K.; Jena, M.; Rath, S.K.; Misra, S.: Co-LSTM: Convolutional LSTM model for sentiment analysis in social big data. Inf. Process. Manag. 58(1), 102435 (2021). https://doi.org/10.1016/j.ipm.2020.102435.CrossRef

21.

Stergiou, C.L.; Psannis, K.E.; Gupta, B.: B: IoT-based big data secure management in the fog over a 6G wireless network. IEEE Internet Things J. 8(7), 5164–5171 (2021). https://doi.org/10.1109/JIOT.2020.3033131.CrossRef

22.

Heikal, M.; Torki, M.; El-Makky, N.: Sentiment analysis of Arabic tweets using deep learning. Proc. Comput. Sci. 142, 114–122 (2018). https://doi.org/10.1016/j.procs.2018.10.466.CrossRef

23.

Cliche, M.: BB\_twtr at SemEval-2017 task 4: twitter sentiment analysis with CNNs and LSTMs. In: The Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), Association for Computational Linguistics, Vancouver, Canada, pp. 573–580 (2017) https://doi.org/10.18653/v1/S17-2094

24.

Wang, X.; Jiang, W.; Luo, Z.: Combination of convolutional and recurrent neural network for sentiment analysis of short texts. In: The Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, The COLING 2016 Organizing Committee, Osaka, Japan, pp. 2428–2437 (2016)

25.

Armand, J.; Edouard, G.; Piotr, B; Tomas, M.: Bag of tricks for efficient text classification. arXiv preprint http://arxiv.org/abs/1607.01759

26.

Luo, T.; Chen, S.; Xu, G.; Zhou, J.: Sentiment analysis. In: Trust-based Collective View Prediction, pp. 53–68. Springer, New York, NY (2013) https://doi.org/10.1007/978-1-4614-7202-5_4

27.

Di Caro, L.; Grella, M.: Sentiment analysis via dependency parsing. Comput. Standards Interfaces 35(5), 442–453 (2013). https://doi.org/10.1016/j.csi.2012.10.005.CrossRef

28.

Mouthami, K.; Devi, N. K.; Bhaskaran, M. V.: Sentiment analysis and classification based on textual reviews. In: The Proceedings of 2013 International Conference on Information Communication and Embedded Systems(ICICES), IEEE, pp. 271–276 (2013) https://doi.org/10.1109/ICICES.2013.6508366

29.

Hu, H.; Phan, N.; Geller, J.; Iezzi, S.; Vo, H. T.; Dou, D.; Chun, S. A.: An ensemble deep learning model for drug abuse detection in sparse twitter-sphere. arXiv preprint https://arxiv.org/abs/1904.02062

30.

Kumari, A.; Behera, R. K.; Sahoo, K. S.; Nayyar, A.; Kumar Luhach, A.; Prakash Sahoo, S.: Supervised link prediction using structured-based feature extraction in social network. Concurrency Computat Pract Exper, e5839(2020) https://doi.org/10.1002/cpe.5839

31.

Alessia, D.; Ferri, F.; Grifoni, P.; Guzzo, T.: Approaches, tools and applications for sentiment analysis implementation. Int. J. Comput. Appl. 125(3), 26–33 (2015). https://doi.org/10.5120/ijca2015905866.CrossRef

32.

Liu, B.; Zhang, L.: A survey of opinion mining and sentiment analysis. In: Aggarwal, C., Zhai, C. (eds.) Mining Text Data, pp. 415–463. Springer, Boston, MA (2012)CrossRef

33.

Yu, Y.; Duan, W.; Cao, Q.: The impact of social and conventional media on firm equity value: a sentiment analysis approach. Decision Support Syst. 55(4), 919–926 (2013). https://doi.org/10.1016/j.dss.2012.12.028.CrossRef

34.

Kumar Behera, R.; Kumar Rath, S.; Misra, S.; Damaševičius, R.; Maskeliūnas, R.: Distributed centrality analysis of social network data using MapReduce. Algorithms (2019). https://doi.org/10.3390/a12080161.CrossRefMATH

35.

Vohra, M.S.; Teraiya, J.: Applications and challenges for sentiment analysis: a survey. Int. J. Eng. Res. Technol. 2(2), 1–6 (2013)

36.

Das, S.; Behera, R.K.; Kumar, M.; Rath, S.K.: Real-time sentiment analysis of twitter streaming data. Proc. Comput. Sci. 132, 956–964 (2018). https://doi.org/10.1016/j.procs.2018.05.111.CrossRef

37.

Wang, C.J.; Tsai, M.F.; Liu, T.; Chang, C.T.: Financial sentiment analysis for risk prediction. In: The Proceedings of the Sixth International Joint Conference on Natural Language Processing, Asian Federation of Natural Language Processing, Nagoya, Japan, pp. 802-808 (2013)

38.

Fan, T.K.; Chang, C.H.: Blogger-centric contextual advertising. Expert Syst. Appl. 38(3), 1777–1788 (2011). https://doi.org/10.1016/j.eswa.2010.07.105.CrossRef

39.

Yin, P.; Kamruzzaman, M.: Animal image retrieval algorithms based on deep neural network. Revista Científica de la Facultad de Ciencias Veterinarias 29(2), 188–199 (2019)

40.

Shukla, S.; Behera, R.K.; Misra, S.; Rath, S.K.: Software reliability assessment using machine learning technique. In: Chakraverty, S., Goel, A., Misra, S. (eds.) Towards Extensible and Adaptable Methods in Computing, pp. 57–68. Springer, Singapore (2018)CrossRef

41.

Chen, X.; Zhang, L.; Liu, T.; Kamruzzaman, M.: Research on deep learning in the field of mechanical equipment fault diagnosis image quality. J. Vis. Commun. Image Represent. 62, 402–409 (2019). https://doi.org/10.1016/j.jvcir.2019.06.007.CrossRef

42.

Kowsari, K.; Jafari Meimandi, K.; Heidarysafa, M.; Mendu, S.; Barnes, L.; Brown, D.: Text classification algorithms: a survey. Information 10(4), 150 (2019). https://doi.org/10.3390/info10040150.CrossRef

43.

Ma, A.; Liu, Y.; Xu, X.; Dong, T.: A deep-learning based citation count prediction model with paper metadata semantic features. Scientometrics 126(8), 6803–6823 (2021). https://doi.org/10.1007/s11192-021-04033-7.CrossRef

44.

Mittal, V.; Gangodkar, D.; Pant, B.: Deep graph-long short-term memory: a deep learning based approach for text classification. Wireless Pers. Commun. 119(3), 2287–2301 (2021). https://doi.org/10.1007/s11277-021-08331-4.CrossRef

45.

Deepika, N.; Nirupama Bhat, M.: An efficient stock market Pprediction method based on kalman filter. J. Inst. Eng. India Ser. B 102(4), 629–644 (2021). https://doi.org/10.1007/s40031-021-00583-9.CrossRef

46.

Hasni, S.; Faiz, S.: Word embeddings and deep learning for location prediction: tracking coronavirus from British and American tweets. Soc. Netw. Anal. Min. 11(1), 66 (2021). https://doi.org/10.1007/s13278-021-00777-5.CrossRef

47.

Johnson, R.; Zhang, T.: Effective use of word order for text categorization with convolutional neural networks. In: The Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, Denver, Colorado, pp. 103–112 (2015) https://doi.org/10.3115/v1/N15-1011

48.

Chen, G.; Wang, L.; Kamruzzaman, M.: Spectral classification of ecological spatial polarization SAR image based on target decomposition algorithm and machine learning. Neural Comput. Appl. 32(10), 5449–5460 (2020). https://doi.org/10.1007/s00521-019-04624-9.CrossRef

49.

Akhtar, M. S.; Kumar, A.; Ghosal, D.; Ekbal, A.; Bhattacharyya, P.: A multilayer perceptron based ensemble technique for fine-grained financial sentiment analysis. In: The Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Copenhagen, Denmark, pp. 540–546 (2017) https://doi.org/10.18653/v1/D17-1057

50.

Yanmei, L.; Yuda, C.: Research on Chinese micro-blog sentiment analysis based on deep learning. In: The Proceedings of 2015 8th International Symposium on Computational Intelligence and Design (ISCID) 1, IEEE, pp. 358–361 (2015) https://doi.org/10.1109/ISCID.2015.217

51.

Rida-E-Fatima, S.; Javed, A.; Banjar, A.; Irtaza, A.; Dawood, H.; Dawood, H.; Alamri, A.: A multi-layer dual attention deep learning model with refined word embeddings for aspect-based sentiment analysis. IEEE Access 7, 114795–114807 (2019). https://doi.org/10.1109/ACCESS.2019.2927281.CrossRef

52.

Rehman, A.U.; Malik, A.K.; Raza, B.; Ali, W.: A Hybrid CNN-LSTM model for improving accuracy of movie reviews sentiment analysis. Multimed. Tools Appl. 78(18), 26597–26613 (2019). https://doi.org/10.1007/s11042-019-07788-7.CrossRef

53.

Al-Makhadmeh, Z.; Tolba, A.: Automatic hate speech detection using killer natural language processing optimizing ensemble deep learning approach. Computing 102(2), 501–522 (2020). https://doi.org/10.1007/s00607-019-00745-0.CrossRef

54.

Wen, L.; Hughes, M.: Coastal wetland mapping using ensemble learning algorithms: a comparative study of bagging, boosting and stacking techniques. Remote Sens. (2020). https://doi.org/10.3390/rs12101683.CrossRef

55.

Altman, N.; Krzywinski, M.: Ensemble methods: bagging and random forests. Nat. Methods 14(10), 933–935 (2017)CrossRef

56.

Zaman, M.F.; Hirose, H.: Classification performance of bagging and boosting type ensemble methods with small training sets. New Gener. Comput. 29(3), 277 (2011). https://doi.org/10.1007/s00354-011-0303-0.CrossRef

57.

Ardabili, S.; Mosavi, A.; Várkonyi-Kóczy, A.R.: Advances in machine learning modeling reviewing hybrid and ensemble methods. In: Várkonyi-Kóczy, A. (ed.) Engineering for Sustainable Future. Lecture Notes in Networks and Systems, pp. 215–227. Springer, Cham (2020)

58.

Sherstinsky, A.: Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. Physica D Nonlinear Phenomena 404, 132306 (2020). https://doi.org/10.1016/j.physd.2019.132306.MathSciNetCrossRef

59.

Palagin, O.; Velychko, V.; Malakhov, K.; Shchurov, O.: Distributional semantic modeling: a revised technique to train term/word vector space models applying the ontology-related approach. arXiv preprint https://arxiv.org/abs/2003.03350v1

60.

Yu, Y.; Si, X.; Hu, C.; Zhang, J.: A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput. 31(7), 1235–1270 (2019). https://doi.org/10.1162/neco_a_01199.MathSciNetCrossRefMATH

61.

Devlin, J.; Chang, M.; Lee, K.; Toutanova, K.: BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint https://arxiv.org/abs/1810.04805

62.

Ferrucci, D.; Levas, A.; Bagchi, S.; Gondek, D.; Mueller, T.E.: Watson: Beyond Jeopardy! Artif. Intell. 199–200, 93–105 (2013). https://doi.org/10.1016/j.artint.2012.06.009.CrossRef

63.

64.

Thelwall, M.: The heart and soul of the web? sentiment strength detection in the social web with sentistrength. In: Holyst, J. (ed.) Cyberemotions. Understanding Complex Systems, pp. 119–134. Springer, Cham (2017)

65.

Salzberg, S.L.: On comparing classifiers: pitfalls to avoid and a recommended approach. Data Min. Knowl. Discov. 1(3), 317–328 (1997). https://doi.org/10.1023/A:1009752403260.CrossRef

Title: Improving Sentiment Analysis for Social Media Applications Using an Ensemble Deep Learning Language Model
Author: Ahmed Alsayat
Publication date: 11-10-2021
Publisher: Springer Berlin Heidelberg
Published in: Arabian Journal for Science and Engineering / Issue 2/2022
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI: https://doi.org/10.1007/s13369-021-06227-w

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 2/2022

A Severity-Based Classification Assessment of Code Smells in Kotlin and Java Application

High Occupancy Itemset Mining with Consideration of Transaction Occupancy

Classification Based on Structural Information in Data

A Novel Cluster Head Selection and Data Aggregation Protocol for Heterogeneous Wireless Sensor Network

The Role of Vertical Elastic Namenode in Handling Big Data in Small Files

Attack-Resistant and Efficient Cancelable Codeword Generation Using Random walk-Based Methods

Premium Partners