Top

Social Network Analysis and Mining

Published in:

01-12-2020 | Original Article

Deep learning CNN–LSTM framework for Arabic sentiment analysis using textual information shared in social networks

Authors: Abubakr H. Ombabi, Wael Ouarda, Adel M. Alimi

Published in: Social Network Analysis and Mining | Issue 1/2020

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Recently, the world has witnessed an exponential growth of social networks which have opened a venue for online users to express and share their opinions in different life aspects. Sentiment analysis has become a hot-trend research topic in the field of natural language processing due to its significant roles in analyzing the public’s opinion and deriving effective opinion-based decisions. Arabic is one of the widely used languages across social networks. However, its morphological complexities and varieties of dialects make it a challenging language for sentiment analysis. Therefore, inspired by the success of deep learning algorithms, in this paper, we propose a novel deep learning model for Arabic language sentiment analysis based on one layer CNN architecture for local feature extraction, and two layers LSTM to maintain long-term dependencies. The feature maps learned by CNN and LSTM are passed to SVM classifier to generate the final classification. This model is supported by FastText words embedding model. Extensive experiments carried out on a multi-domain corpus demonstrate the outstanding classification performance of this model with an accuracy of 90.75%. Furthermore, the proposed model is validated using different embedding models and classifiers. The results show that FastText skip-gram model and SVM classifier are more valuable alternatives for the Arabic sentiment analysis. The proposed model outperforms several well-established state-of-the-art approaches on relevant corpora with up to \(+\,20.71\%\) accuracy improvement.

previous article Mining latent academic social relationships by network fusion of multi-type data

next article FIFA World Cup referees’ networks: a constant-size clique approach

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Ain QT, Ali M, Riaz A, Noureen A, Kamran M, Hayat B, Rehman A (2017) Sentiment analysis using deep learning techniques: a review. Int J Adv Comput Sci 8(6):424

Al-ayyoub M, Nuseir A (2016) Hierarchical classifiers for multi-way sentiment analysis of Arabic reviews. Int J Adv Comput Sci Appl 7(2):531–539

Al-kabi MN, Gigieh AH, Alsmadi IM, Wahsheh HA (2014) Opinion mining and analysis for Arabic language. Int J Adv Comput Sci Appl 5(5):181–195

Al-Smadi M, Talafha B, Al-Ayyoub M, Jararweh Y (2018) Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews. Int J Mach Learn Cybern. https://doi.org/10.1007/s13042-018-0799-4CrossRef

Alayba AM, Palade V, England M, Iqbal R (2018) Improving sentiment analysis in Arabic using word representation. In: 2nd international workshop on Arabic and derived script analysis and recognition (ASAR), pp 13–18

Alowaidi S, Saleh M, Abulnaja O (2017) Semantic sentiment analysis of Arabic texts. Int J Adv Comput Sci Appl 8(2):256–262

Alsmearat K, Shehab M, Al-Ayyoub M, Al-Shalabi R, Kanaan G (2015) Emotion analysis of Arabic articles and its impact on identifying the author’s gender

Altowayan AA (2017) Improving Arabic sentiment analysis with sentiment-specific embeddings. In: IEEE international conference on big data (BIGDATA) improving, pp 4314–4320

Altowayan AA, Tao L (2016) Word embeddings for Arabic sentiment analysis. In: IEEE international conference on big data (big data) word, pp 3820–3825. http://tanzil.net

Altrabsheh N, El-Masri M, Mansour H (2017) Successes and challenges of Arabic sentiment analysis research: a literature review. Soc Netw Anal Min. https://doi.org/10.1007/s13278-017-0474-xCrossRef

Aly M, Atiya A (2013) LABR: a large scale Arabic book reviews dataset. In: Proceedings of the 51st annual meeting of the association for computational linguistics, pp 494–498. https://doi.org/10.13140/2.1.3960.5761. https://www.aclweb.org/anthology-new/P/P13/P13-2088.pdf

Birjali M, Beni-hssane A, Erritali M (2017) Machine learning and semantic sentiment analysis based algorithms for suicide sentiment prediction in social networks. Procedia Comput Sci 113:65–72. https://doi.org/10.1016/j.procs.2017.08.290CrossRef

Blair SJ, Bi Y, Mulvenna MD (2017) Unsupervised sentiment classification: a hybrid sentiment-topic model approach. https://doi.org/10.1109/ICTAI.2017.00076

Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information, vol 5, no 3, pp 729–734. arXiv:160704606. https://doi.org/10.1039/c2ay25919b

Chen Y, Zhang Z (2018) Research on text sentiment analysis based on CNNs and SVM. In: Proceedings of the 13th IEEE conference on industrial electronics and applications, ICIEA 2018, pp 2731–2734. https://doi.org/10.1109/ICIEA.2018.8398173

Chiu JPC, Nichols E (2015) Named entity recognition with bidirectional LSTM-CNNs (2003). https://doi.org/10.3115/1119176.1119204. arXiv:1511.08308

Claypo N, Jaiyen S (2014) Opinion mining for Thai restaurant reviews using neural networks and mRMR feature selection. In: 2014 international computer science and engineering conference. ICSEC 2014, pp 394–397. https://doi.org/10.1109/ICSEC.2014.6978229

Dahou A, Xiong S, Zhou J, Haddoud MH, Duan P (2016) Word embeddings and convolutional neural network for Arabic sentiment classification. In: Proceedings of the COLING 2016, 26th international conference on computational linguistics :technical papers, pp 2418–2427. https://www.aclweb.org/anthology/C/C16/C16-1228.pdf

Dellavale D, Urdapilleta E, Cámpora N, Velarde OM, Kochen S, Mato G (2020) Prediction of epileptic seizures based on mean phase coherence. BioArXiv, pp 1–60

Eirinaki M, Pisal S, Singh J (2012) Feature-based opinion mining and ranking. J Comput Syst Sci 78(4):1175–1184. https://doi.org/10.1016/j.jcss.2011.10.007MathSciNetCrossRef

Elhawary M, Elfeky M (2010) Mining Arabic business reviews.In: Proceedings—IEEE international conference on data mining, ICDM, pp 1108–1113. https://doi.org/10.1109/ICDMW.2010.24

Elouardighi A, Maghfour M, Hammia H, Aazi Fz (2017) Analysis in the standard or dialectal Arabic. In: 2017 3rd international conference of cloud computing technologies and applications (CloudTech)

ElSahar H, El-Beltagy SR (2011) Building large Arabic multi-domain resources for sentiment analysis, vol 9042. Springer, Berlin, pp 23–34. https://doi.org/10.1007/978-3-319-18117-2_2CrossRef

Ghosh R, Ravi K, Ravi V (2016) A novel deep learning architecture for sentiment classification. In: 3rd international conference on recent advances in information technology—RAIT-2016—A, vol 27, pp 1102–1111. https://doi.org/10.1007/978-3-319-68195-5_122. arXiv:1707.05809

Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th international conference on machine learning, no 1, pp 513–520. http://www.icml-2011.org/papers/342_icmlpaper.pdf

Graves A, Rahman Mohamed A, Hinton GE (2013) Speech recognition with deep recurrent neural networks. In: 2013 IEEE international conference on acoustics, speech and signal processing, no 6, pp 6645–6649. https://doi.org/10.1109/ICASSP.2013.6638947

Guellil I, Azouaou F, Mendoza M (2019) Arabic sentiment analysis: studies, resources, and tools. Soc Netw Anal Min 9(1):1–17. https://doi.org/10.1007/s13278-019-0602-xCrossRef

Hassan A, Mahmood A (2017) Deep learning approach for sentiment analysis of short texts. In: 2017 3rd international conference on control, automation and robotics (ICCAR), pp 705–710. https://doi.org/10.1109/ICCAR.2017.7942788. http://ieeexplore.ieee.org/document/7942788/

Hassan A, Mahmood A (2018) Convolutional recurrent deep learning model for sentence classification. IEEE Access 6:13949–13957. https://doi.org/10.1109/ACCESS.2018.2814818CrossRef

Haydar MS, Helal MA, Hossain SA (2018) Sentiment extraction from bangla text: a character level supervised recurrent neural network approach. In: 2018 international conference on computer, communication, chemical, material and electronic engineering (IC4ME2), pp 1–4. https://doi.org/10.1109/IC4ME2.2018.8465606

Hemmatian F, Sohrabi MK (2017) A survey on classification techniques for opinion mining and sentiment analysis. Artif Intell Rev. https://doi.org/10.1007/s10462-017-9599-6CrossRef

Huang F, Zhang S, Zhang J, Yu G (2017a) Multimodal learning for topic sentiment analysis in microblogging. Neurocomputing 253:144–153. https://doi.org/10.1016/j.neucom.2016.10.086CrossRef

Huang Q, Chen R, Zheng X, Dong Z (2017b) Deep sentiment representation based on CNN and LSTM. In: Proceedings—2017 international conference on green informatics, ICGI 2017, pp 30–33. https://doi.org/10.1109/ICGI.2017.45

Keyvanpour M, Karimi Zandian Z, Heidarypanah M (2020) OMLML: a helpful opinion mining method based on lexicon and machine learning in social networks. Soc Netw Anal Min. https://doi.org/10.1007/s13278-019-0622-6CrossRef

Kim Y (2014) Convolutional neural networks for sentence classification, pp 1746–1751. https://doi.org/10.3115/v1/D14-1181. arXiv:1408.5882

Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1–9. https://doi.org/10.1016/j.protcy.2014.09.007

Lalji TK, Deshmukh SN (2016) Twitter sentiment analysis using hybrid approach. Int Res J Eng Technol (IRJET) 3:2887–2890

Li X, Rao Y, Xie H, Lau RYK, Yin J, Wang FL (2017) Bootstrapping social emotion classification with semantically rich hybrid neural networks. IEEE Trans Affect Comput 3045(c):1–16. https://doi.org/10.1109/TAFFC.2017.2716930CrossRef

Lu Y, Kong X, Quan X, Liu W, Xu Y (2010) Exploring the sentiment strength of user reviews. LNCS, vol 6184. Springer, Berlin, pp 471–482. https://doi.org/10.1007/978-3-642-14246-8_46CrossRef

Lu Y, Y Rao, JYang, JYin (2018) Incorporating lexicons into LSTM for sentiment classification. In: 2018 international joint conference on neural networks (IJCNN), p 1. http://mendeley.csuc.cat/fitxers/0f093fd3fff6230dab142add74997c48

Mikolov T, Sutskever I, Chen K, Corrado G, Dean J (2013) Distributed representations of words and phrases and their compositionality, pp 1–9. arXiv:13104546v1. http://arxiv.org/abs/1310.4546

Mikolov T, Grave E, Bojanowski P, Puhrsch C, Joulin A (2017) Advances in pre-training distributed word representations Tomas, vol 28, no 7, pp 2114–2118. arXiv:171209405[csCL]. https://doi.org/10.1589/jpts.28.2114. http://arxiv.org/abs/1712.09405

Mostafa AM (2017) An evaluation of sentiment analysis and classification algorithms for Arabic textual data. Int J Comput Appl 158(3):975–8887

Nabil M, Aly M, Atiya A (2015) ASTD: Arabic sentiment tweets dataset. iN: Proceedings of the 2015 conference on empirical methods in natural language processing (September), pp 2515–2519. https://doi.org/10.18653/v1/D15-1299. http://aclweb.org/anthology/D15-1299

Na A, Na A, Ma S, Al-ayyoub M (2013) Arabic sentiment analysis. In: Jordan conference on applied electrical engineering and computing technologies (AEECT13), vol 6, no 12, pp 1–6. https://doi.org/10.1109/AEECT.2013.6716448

Ombabi AH, Lazzez O, Ouarda W, Alimi AM (2017) Deep learning framework based on Word2Vec and CNN for users interests classification. In: 2017 Sudan conference on computer science and information technology (SCCSIT), pp 1–7

Ouyang X, Zhou P, Li CH, Liu L (2015) Sentiment analysis using convolutional neural network. In: 2015 IEEE international conference on computer and information technology; ubiquitous computing and communications; dependable, autonomic and secure computing; pervasive intelligence and computing, pp 2359–2364. https://doi.org/10.1109/CIT/IUCC/DASC/PICOM.2015.349. http://ieeexplore.ieee.org/document/7363395/

Pal S, Ghosh S, Nag A (2018) Sentiment analysis in the light of LSTM recurrent neural networks. Int J Synth Emot 9(1):33–39. https://doi.org/10.4018/ijse.2018010103CrossRef

Pawar KK, Deshmukh RR (2015) Twitter sentiment classification on sanders data using hybrid approach. IOSR J Comput Eng 17(4):118–123. https://doi.org/10.9790/0661-1741118123CrossRef

Preethi G, Krishna PV (2017) Application of deep learning to sentiment analysis for recommender system on cloud

Ravi K, Ravi V (2015) A survey on opinion mining and sentiment analysis: tasks, approaches and applications, vol 89. Elsevier, Amsterdam. https://doi.org/10.1016/j.knosys.2015.06.015CrossRef

Ravuri S, Stoicke A (2016) A comparative study of neural network models for lexical intent classification. In: 2015 IEEE workshop on automatic speech recognition and understanding, ASRU 2015—proceedings, vol 2, pp 368–374. https://doi.org/10.1109/ASRU.2015.7404818

Sasmita DH, Wicaksono AF, Louvan S, Adriani M (2017) Unsupervised aspect-based sentiment analysis on Indonesian restaurant reviews. In: Proceedings of the 2017 international conference on Asian language processing, IALP 2017 2018-Janua, pp 383–386. https://doi.org/10.1109/IALP.2017.8300623

Shickel B, Tighe PJ, Bihorac A, Rashidi P (2018) Deep EHR: a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis. IEEE J Biomed Health Inform 22(5):1589–1604. https://doi.org/10.1109/JBHI.2017.2767063CrossRef

Sohangir S, Wang D, Pomeranets A, Khoshgoftaar TM (2018) Big data: deep learning for financial sentiment analysis. J Big Data. https://doi.org/10.1186/s40537-017-0111-6CrossRef

Soliman AB, Eissa K, El-Beltagy SR (2017) AraVec: a set of Arabic word embedding models for use in Arabic NLP. Procedia Comput Sci 117:256–265. https://doi.org/10.1016/j.procs.2017.10.117CrossRef

Sze V, Chen YH, Yang TJ, Emer JS (2017) Efficient processing of deep neural networks: a tutorial and survey. Proc IEEE 105(12):2295–2329. https://doi.org/10.1109/JPROC.2017.2761740CrossRef

Taj S, Shaikh BB, Fatemah Meghji A (2019) Sentiment analysis of news articles: a lexicon based approach. In: 2019 2nd international conference on computing, mathematics and engineering technologies, iCoMET 2019, pp 1–5. https://doi.org/10.1109/ICOMET.2019.8673428

Tarwani KM, Edem S (2017) Survey on recurrent neural network in natural language processing. Int J Eng Trends Technol 48(6):301–304CrossRef

Vateekul P, Koomsubha T (2016) A study of sentiment analysis using deep learning techniques on Thai Twitter data. In: 2016 13th international joint conference on computer science and software engineering, JCSSE 2016, pp 1–6. https://doi.org/10.1109/JCSSE.2016.7748849. http://ieeexplore.ieee.org/document/7748849/

Wang J, Cao Z (2017) Chinese text sentiment analysis using LSTM network based on L2 and Nadam, pp 1891–1895

Wint ZZ, Manabe Y, Aritsugi M (2018) Deep learning based sentiment classification in social network services datasets. In: 2018 IEEE international conference on big data, cloud computing, data science & engineering (BCD), pp 91–96. https://doi.org/10.1109/BCD2018.2018.00022. https://ieeexplore.ieee.org/document/8530698/

Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing [review article]. IEEE Comput Intell Mag 13(3):55–75. https://doi.org/10.1109/MCI.2018.2840738CrossRef

Yuan S, Wu X, Xiang Y (2018) Incorporating pre-training in long short-term memory networks for tweet classification. Soc Netw Anal Min. https://doi.org/10.1007/s13278-018-0530-1CrossRef

Title: Deep learning CNN–LSTM framework for Arabic sentiment analysis using textual information shared in social networks
Authors: Abubakr H. Ombabi
Wael Ouarda
Adel M. Alimi
Publication date: 01-12-2020
Publisher: Springer Vienna
Published in: Social Network Analysis and Mining / Issue 1/2020
Print ISSN: 1869-5450
Electronic ISSN: 1869-5469
DOI: https://doi.org/10.1007/s13278-020-00668-1

Accurate link prediction method based on path length between a pair of unlinked nodes and their degree

Original Article

Modeling and analysis of crime prediction and prevention

Original Article

Modeling the impact of Python and R packages using dependency and contributor networks

Original Article

Identification of medical resource tweets using Majority Voting-based Ensemble during disaster

Original Article

Discovering patterns of customer financial behavior using social media data

Original Article

Resilience and coevolution of preferential interdependent networks

Original Article

Springer Professional

Deep learning CNN–LSTM framework for Arabic sentiment analysis using textual information shared in social networks

Abstract

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 1/2020

Accurate link prediction method based on path length between a pair of unlinked nodes and their degree

Modeling and analysis of crime prediction and prevention

Modeling the impact of Python and R packages using dependency and contributor networks

Identification of medical resource tweets using Majority Voting-based Ensemble during disaster

Discovering patterns of customer financial behavior using social media data

Resilience and coevolution of preferential interdependent networks

Premium Partner

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Accurate link prediction method based on path length between a pair of unlinked nodes and their degree

Modeling and analysis of crime prediction and prevention

Modeling the impact of Python and R packages using dependency and contributor networks

Identification of medical resource tweets using Majority Voting-based Ensemble during disaster

Discovering patterns of customer financial behavior using social media data

Resilience and coevolution of preferential interdependent networks