Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 8/2020

09-04-2020 | Research Article-Computer Engineering and Computer Science

Attention Mechanism with Gated Recurrent Unit Using Convolutional Neural Network for Aspect Level Opinion Mining

Authors: Meesala Shobha Rani, Sumathy Subramanian

Published in: Arabian Journal for Science and Engineering | Issue 8/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Deep neural network models are emerging in the area of natural language processing and have become a topic of interest in sentiment analysis. The participation of more social media users provides increased information which has made analysis challenging. Aspect level sentiment analysis is used in the identification of the sentiment polarity of a text in different aspects. This paper presents four deep neural network-based methods with varied input word vector representation for the aspect level opinion mining. A novel approach using an attention mechanism with a gated recurrent unit and a convolutional neural network for aspect level opinion mining with different input vector representations is proposed. This work is an addition to the existing research that includes novel approaches for the assessment of the quality of services based on customer reviews in the restaurant domain. Data accumulated on restaurant opinion have been chosen for experimental study, and the results obtained indicate achievement of good accuracy, precision, recall, and f-measure compared to other approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Rani, M.S.; Sumathy, S.: Online social networking services and spam detection approaches in opinion mining—a review. Int. J. Web Communities 14, 353–378 (2018)CrossRef Rani, M.S.; Sumathy, S.: Online social networking services and spam detection approaches in opinion mining—a review. Int. J. Web Communities 14, 353–378 (2018)CrossRef
2.
go back to reference Rani, M.S.; Sumathy, S.: Perspectives of the performance metrics in lexicon and hybrid based approaches: a review. Int. J. Eng. Technol. 6, 108–115 (2017)CrossRef Rani, M.S.; Sumathy, S.: Perspectives of the performance metrics in lexicon and hybrid based approaches: a review. Int. J. Eng. Technol. 6, 108–115 (2017)CrossRef
3.
go back to reference Song, M.; Park, H.; Shin, K.: Attention-based long short-term memory network using sentiment lexicon embedding for aspect-level sentiment analysis in Korean. Inf. Process. Manag. 56, 637–653 (2019)CrossRef Song, M.; Park, H.; Shin, K.: Attention-based long short-term memory network using sentiment lexicon embedding for aspect-level sentiment analysis in Korean. Inf. Process. Manag. 56, 637–653 (2019)CrossRef
4.
go back to reference Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)CrossRef Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)CrossRef
5.
go back to reference Ravi, K.; Ravi, V.: A survey on opinion mining and sentiment analysis: tasks, approaches and applications. Knowledge-Based Syst. 89, 14–46 (2015)CrossRef Ravi, K.; Ravi, V.: A survey on opinion mining and sentiment analysis: tasks, approaches and applications. Knowledge-Based Syst. 89, 14–46 (2015)CrossRef
6.
go back to reference Liu, Y.; Ji, L.; Huang, R.; Ming, T.; Gao, C.; Zhang, J.: An attention-gated convolutional neural network for sentence classification. Intell. Data Anal. 23, 1091–1107 (2019)CrossRef Liu, Y.; Ji, L.; Huang, R.; Ming, T.; Gao, C.; Zhang, J.: An attention-gated convolutional neural network for sentence classification. Intell. Data Anal. 23, 1091–1107 (2019)CrossRef
7.
go back to reference Pham, D.H.; Nguyen, T.T.T.; Le, A.C.: Fine-tuning word embeddings for aspect-based sentiment analysis. In: International Conference on Text, Speech, and Dialogue, pp. 500–508. Springer, Cham (2017) Pham, D.H.; Nguyen, T.T.T.; Le, A.C.: Fine-tuning word embeddings for aspect-based sentiment analysis. In: International Conference on Text, Speech, and Dialogue, pp. 500–508. Springer, Cham (2017)
8.
go back to reference Pham, D.H.; Le, A.C.: Exploiting multiple word embeddings and one-hot character vectors for aspect-based sentiment analysis. Int. J. Approx. Reason. 103, 1–10 (2018)MathSciNetCrossRef Pham, D.H.; Le, A.C.: Exploiting multiple word embeddings and one-hot character vectors for aspect-based sentiment analysis. Int. J. Approx. Reason. 103, 1–10 (2018)MathSciNetCrossRef
9.
go back to reference Pham, D.H.; Le, A.C.: Learning multiple layers of knowledge representation for aspect based sentiment analysis. Data Knowl. Eng. 114, 26–39 (2018)CrossRef Pham, D.H.; Le, A.C.: Learning multiple layers of knowledge representation for aspect based sentiment analysis. Data Knowl. Eng. 114, 26–39 (2018)CrossRef
10.
go back to reference Pham, D.H.; Le, A.C.; Le, T.K.C.: Learning word embeddings for aspect-based sentiment analysis. Commun. Comput. Inf. Sci. 781, 28–40 (2018)MATH Pham, D.H.; Le, A.C.; Le, T.K.C.: Learning word embeddings for aspect-based sentiment analysis. Commun. Comput. Inf. Sci. 781, 28–40 (2018)MATH
11.
go back to reference Hyun, D.; Park, C.; Yang, M.C.; Song, I.; Lee, J.T.; Yu, H.: Target-aware convolutional neural network for target-level sentiment analysis. Inf. Sci. (NY) 491, 166–178 (2019)CrossRef Hyun, D.; Park, C.; Yang, M.C.; Song, I.; Lee, J.T.; Yu, H.: Target-aware convolutional neural network for target-level sentiment analysis. Inf. Sci. (NY) 491, 166–178 (2019)CrossRef
12.
go back to reference Do, H.H.; Prasad, P.W.C.; Maag, A.; Alsadoon, A.: Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst. Appl. 118, 272–299 (2019)CrossRef Do, H.H.; Prasad, P.W.C.; Maag, A.; Alsadoon, A.: Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst. Appl. 118, 272–299 (2019)CrossRef
13.
go back to reference Liu, N.; Shen, B.; Zhang, Z.; Zhang, Z.; Mi, K.: Attention-based sentiment reasoner for aspect-based sentiment analysis. Human-Centric Comput. Inf. Sci. 9, 35 (2019)CrossRef Liu, N.; Shen, B.; Zhang, Z.; Zhang, Z.; Mi, K.: Attention-based sentiment reasoner for aspect-based sentiment analysis. Human-Centric Comput. Inf. Sci. 9, 35 (2019)CrossRef
14.
go back to reference Ma, X.; Zeng, J.; Peng, L.; Fortino, G.; Zhang, Y.: Modeling multi-aspects within one opinionated sentence simultaneously for aspect-level sentiment analysis. Future Gener. Comput. Syst. 93, 304–311 (2019)CrossRef Ma, X.; Zeng, J.; Peng, L.; Fortino, G.; Zhang, Y.: Modeling multi-aspects within one opinionated sentence simultaneously for aspect-level sentiment analysis. Future Gener. Comput. Syst. 93, 304–311 (2019)CrossRef
15.
go back to reference Yang, C.; Zhang, H.; Jiang, B.; Li, K.: Aspect-based sentiment analysis with alternating coattention networks. Inf. Process. Manag. 56, 463–478 (2019)CrossRef Yang, C.; Zhang, H.; Jiang, B.; Li, K.: Aspect-based sentiment analysis with alternating coattention networks. Inf. Process. Manag. 56, 463–478 (2019)CrossRef
16.
go back to reference Meng, W.; Wei, Y.; Liu, P.; Zhu, Z.; Yin, H.: Aspect based sentiment analysis with feature enhanced attention CNN-BiLSTM. IEEE Access. 7, 167240–167249 (2019)CrossRef Meng, W.; Wei, Y.; Liu, P.; Zhu, Z.; Yin, H.: Aspect based sentiment analysis with feature enhanced attention CNN-BiLSTM. IEEE Access. 7, 167240–167249 (2019)CrossRef
17.
go back to reference Park, H.; Song, M.; Shin, K.S.: Deep learning models and datasets for aspect term sentiment classification: Implementing holistic recurrent attention on target-dependent memories. Knowl.-Based Syst. 187, 104825 (2020)CrossRef Park, H.; Song, M.; Shin, K.S.: Deep learning models and datasets for aspect term sentiment classification: Implementing holistic recurrent attention on target-dependent memories. Knowl.-Based Syst. 187, 104825 (2020)CrossRef
18.
go back to reference Wang, W.; Pan, S.J.; Dahlmeier, D.: Memory networks for fine-grained opinion mining. Artif. Intell. 265, 1–17 (2018)CrossRef Wang, W.; Pan, S.J.; Dahlmeier, D.: Memory networks for fine-grained opinion mining. Artif. Intell. 265, 1–17 (2018)CrossRef
19.
go back to reference Fu, X.; Wei, Y.; Xu, F.; Wang, T.; Lu, Y.; Li, J.; Huang, J.Z.: Semi-supervised aspect-level sentiment classification model based on variational autoencoder. Knowl.-Based Syst. 171, 81–92 (2019)CrossRef Fu, X.; Wei, Y.; Xu, F.; Wang, T.; Lu, Y.; Li, J.; Huang, J.Z.: Semi-supervised aspect-level sentiment classification model based on variational autoencoder. Knowl.-Based Syst. 171, 81–92 (2019)CrossRef
20.
go back to reference Al-Smadi, M.; Qawasmeh, O.; Al-Ayyoub, M.; Jararweh, Y.; Gupta, B.: Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. J. Comput. Sci. 27, 386–393 (2018)CrossRef Al-Smadi, M.; Qawasmeh, O.; Al-Ayyoub, M.; Jararweh, Y.; Gupta, B.: Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. J. Comput. Sci. 27, 386–393 (2018)CrossRef
21.
go back to reference Pasupa, K.; Seneewong Na Ayutthaya, T.: Thai sentiment analysis with deep learning techniques: a comparative study based on word embedding, POS-tag, and sentic features. Sustain. Cities Soc. 50, 101615 (2019)CrossRef Pasupa, K.; Seneewong Na Ayutthaya, T.: Thai sentiment analysis with deep learning techniques: a comparative study based on word embedding, POS-tag, and sentic features. Sustain. Cities Soc. 50, 101615 (2019)CrossRef
22.
go back to reference Yang, M.; Qu, Q.; Chen, X.; Guo, C.; Shen, Y.; Lei, K.: Feature-enhanced attention network for target-dependent sentiment classification. Neurocomputing 307, 91–97 (2018)CrossRef Yang, M.; Qu, Q.; Chen, X.; Guo, C.; Shen, Y.; Lei, K.: Feature-enhanced attention network for target-dependent sentiment classification. Neurocomputing 307, 91–97 (2018)CrossRef
24.
go back to reference Rezaeinia, S.M.; Rahmani, R.; Ghodsi, A.; Veisi, H.: Sentiment analysis based on improved pre-trained word embeddings. Expert Syst. Appl. 117, 139–147 (2019)CrossRef Rezaeinia, S.M.; Rahmani, R.; Ghodsi, A.; Veisi, H.: Sentiment analysis based on improved pre-trained word embeddings. Expert Syst. Appl. 117, 139–147 (2019)CrossRef
25.
go back to reference Luo, L.: Network text sentiment analysis method combining LDA text representation and GRU-CNN. Pers. Ubiquitous Comput. 23, 405–412 (2019)CrossRef Luo, L.: Network text sentiment analysis method combining LDA text representation and GRU-CNN. Pers. Ubiquitous Comput. 23, 405–412 (2019)CrossRef
26.
go back to reference Rani, S.; Kumar, P.: Deep learning based sentiment analysis using convolution neural network. Arab. J. Sci. Eng. 44, 3305–3314 (2019)CrossRef Rani, S.; Kumar, P.: Deep learning based sentiment analysis using convolution neural network. Arab. J. Sci. Eng. 44, 3305–3314 (2019)CrossRef
27.
go back to reference Rehman, A.U.; Malik, A.K.; Raza, B.; Ali, W.: A hybrid CNN-LSTM model for improving accuracy of movie reviews sentiment analysis. Multimed. Tools Appl. 78, 26597–26613 (2019)CrossRef Rehman, A.U.; Malik, A.K.; Raza, B.; Ali, W.: A hybrid CNN-LSTM model for improving accuracy of movie reviews sentiment analysis. Multimed. Tools Appl. 78, 26597–26613 (2019)CrossRef
28.
go back to reference Abdi, A.; Shamsuddin, S.M.; Hasan, S.; Piran, J.: Deep learning-based sentiment classification of evaluative text based on multi-feature fusion. Inf. Process. Manag. 56, 1245–1259 (2019)CrossRef Abdi, A.; Shamsuddin, S.M.; Hasan, S.; Piran, J.: Deep learning-based sentiment classification of evaluative text based on multi-feature fusion. Inf. Process. Manag. 56, 1245–1259 (2019)CrossRef
29.
go back to reference Pergola, G.; Gui, L.; He, Y.: TDAM: a topic-dependent attention model for sentiment analysis. Inf. Process. Manag. 56, 102084 (2019)CrossRef Pergola, G.; Gui, L.; He, Y.: TDAM: a topic-dependent attention model for sentiment analysis. Inf. Process. Manag. 56, 102084 (2019)CrossRef
30.
go back to reference Abid, F.; Alam, M.; Yasir, M.; Li, C.: Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter. Future Gener. Comput. Syst. 95, 292–308 (2019)CrossRef Abid, F.; Alam, M.; Yasir, M.; Li, C.: Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter. Future Gener. Comput. Syst. 95, 292–308 (2019)CrossRef
31.
go back to reference Xiong, S.; Lv, H.; Zhao, W.; Ji, D.: Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings. Neurocomputing 275, 2459–2466 (2018)CrossRef Xiong, S.; Lv, H.; Zhao, W.; Ji, D.: Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings. Neurocomputing 275, 2459–2466 (2018)CrossRef
32.
go back to reference Pennington, J.; Socher, R.; Manning, C.D.: GloVe: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014) Pennington, J.; Socher, R.; Manning, C.D.: GloVe: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
33.
go back to reference Chung, J.; Gulcehre, C.; Cho, K.; Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling, pp. 1–9. arXiv Preprint arXiv:1412.3555 (2014) Chung, J.; Gulcehre, C.; Cho, K.; Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling, pp. 1–9. arXiv Preprint arXiv:​1412.​3555 (2014)
34.
go back to reference Pontiki, M.; Galanis, D.; Pavlopoulos, J.; Papageorgiou, H.; Androutsopoulos, I.; Manandhar, S.: SemEval-2014 Task 4: aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 27–35 (2014) Pontiki, M.; Galanis, D.; Pavlopoulos, J.; Papageorgiou, H.; Androutsopoulos, I.; Manandhar, S.: SemEval-2014 Task 4: aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 27–35 (2014)
Metadata
Title
Attention Mechanism with Gated Recurrent Unit Using Convolutional Neural Network for Aspect Level Opinion Mining
Authors
Meesala Shobha Rani
Sumathy Subramanian
Publication date
09-04-2020
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 8/2020
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-020-04497-4

Other articles of this Issue 8/2020

Arabian Journal for Science and Engineering 8/2020 Go to the issue

Research Article-Computer Engineering and Computer Science

An Ontology-Based Security Risk Management Model for Information Systems

Premium Partners