Skip to main content
Top
Published in: Knowledge and Information Systems 2/2021

24-09-2020 | Regular Paper

A relative position attention network for aspect-based sentiment analysis

Authors: Chao Wu, Qingyu Xiong, Min Gao, Qiude Li, Yang Yu, Kaige Wang

Published in: Knowledge and Information Systems | Issue 2/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Aspect-based sentiment analysis can predict the sentiment polarity of specific aspect terms in the text. Compared to general sentiment analysis, it extracts more useful information and analyzes the sentiment more accurately in the comment text. Many previous approaches use long short-term memory networks with attention mechanisms to directly learn aspect-specific representations and model comment text. However, these methods always ignore the importance of the aspect terms position and interactive information between the aspect terms and other words. To address these issues, we propose an improved model based on convolutional neural networks. First, a novel relative position encode layer can integrate the relative position information of specific aspect terms validly in a text. Second, by using the aspect attention mechanism, the semantic relationship between aspect terms and words in the text is fully considered. To verify the effectiveness of the proposed models, we conduct a large number of experiments and comparisons on seven public datasets. The experimental results show that this model outperforms to other state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
2.
go back to reference Chen P, Sun Z, Bing L, Yang W (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 452–461 Chen P, Sun Z, Bing L, Yang W (2017) Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 452–461
3.
go back to reference Ding X, Liu B, Yu PS (2008) A holistic lexicon-based approach to opinion mining. In: Proceedings of the 2008 international conference on web search and data mining. ACM, pp 231–240 Ding X, Liu B, Yu PS (2008) A holistic lexicon-based approach to opinion mining. In: Proceedings of the 2008 international conference on web search and data mining. ACM, pp 231–240
4.
go back to reference Dong L, Wei F, Tan C, Tang D, Zhou M, Xu K (2014) Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 2: short papers). Association for Computational Linguistics, Baltimore, Maryland, pp 49–54 Dong L, Wei F, Tan C, Tang D, Zhou M, Xu K (2014) Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 2: short papers). Association for Computational Linguistics, Baltimore, Maryland, pp 49–54
5.
go back to reference Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feed forward neural networks. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249–256 Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feed forward neural networks. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249–256
6.
7.
go back to reference Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef
8.
go back to reference Huang B, Carley K (2018) Parameterized convolutional neural networks for aspect level sentiment classification. In: Proceedings of the 2018 conference on empirical methods in natural language processing. pp 1091–1096 Huang B, Carley K (2018) Parameterized convolutional neural networks for aspect level sentiment classification. In: Proceedings of the 2018 conference on empirical methods in natural language processing. pp 1091–1096
9.
go back to reference Huang B, Ou Y, Carley KM (2018) Aspect level sentiment classification with attention-over-attention neural networks. In: Thomson R, Dancy C, Hyder A, Bisgin H (eds) Social, cultural, and behavioral modeling. Springer International Publishing, Cham, pp 197–206CrossRef Huang B, Ou Y, Carley KM (2018) Aspect level sentiment classification with attention-over-attention neural networks. In: Thomson R, Dancy C, Hyder A, Bisgin H (eds) Social, cultural, and behavioral modeling. Springer International Publishing, Cham, pp 197–206CrossRef
10.
go back to reference Jiang L, Yu M, Zhou M, Liu X, Zhao T (2011) Target-dependent twitter sentiment classification. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies-volume 1. Association for Computational Linguistics, pp 151–160 Jiang L, Yu M, Zhou M, Liu X, Zhao T (2011) Target-dependent twitter sentiment classification. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies-volume 1. Association for Computational Linguistics, pp 151–160
11.
go back to reference Kim Y (Oct 2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Doha, Qatar, pp 1746–1751 Kim Y (Oct 2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Doha, Qatar, pp 1746–1751
13.
go back to reference Liu N, Shen B (2019) Aspect-based sentiment analysis with gated alternate neural network. Knowl Based Syst 188:105010CrossRef Liu N, Shen B (2019) Aspect-based sentiment analysis with gated alternate neural network. Knowl Based Syst 188:105010CrossRef
14.
go back to reference Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. In: Proceedings of the 26th international joint conference on artificial intelligence. AAAI Press, pp 4068–4074 Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. In: Proceedings of the 26th international joint conference on artificial intelligence. AAAI Press, pp 4068–4074
15.
go back to reference Ma X, Zeng J, Peng L, Fortino G, Zhang Y (2019) Modeling multi-aspects within one opinionated sentence simultaneously for aspect-level sentiment analysis. Future Gener Comput Syst 93:304–311CrossRef Ma X, Zeng J, Peng L, Fortino G, Zhang Y (2019) Modeling multi-aspects within one opinionated sentence simultaneously for aspect-level sentiment analysis. Future Gener Comput Syst 93:304–311CrossRef
16.
go back to reference Nasukawa T, Yi J (2003) Sentiment analysis: capturing favorability using natural language processing. In: Proceedings of the 2nd international conference on knowledge capture. ACM, pp 70–77 Nasukawa T, Yi J (2003) Sentiment analysis: capturing favorability using natural language processing. In: Proceedings of the 2nd international conference on knowledge capture. ACM, pp 70–77
17.
go back to reference Nguyen TH, Shirai K (2015) Aspect-based sentiment analysis using tree kernel based relation extraction. In: International conference on intelligent text processing and computational linguistics. Springer, pp 114–125 Nguyen TH, Shirai K (2015) Aspect-based sentiment analysis using tree kernel based relation extraction. In: International conference on intelligent text processing and computational linguistics. Springer, pp 114–125
18.
go back to reference Oord A, Li Y, Babuschkin I, Simonyan K, Vinyals O, Kavukcuoglu K, Driessche G, Lockhart E, Cobo L, Stimberg F, et al (2018) Parallel wavenet: fast high-fidelity speech synthesis. In: International conference on machine learning, pp 3915–3923 Oord A, Li Y, Babuschkin I, Simonyan K, Vinyals O, Kavukcuoglu K, Driessche G, Lockhart E, Cobo L, Stimberg F, et al (2018) Parallel wavenet: fast high-fidelity speech synthesis. In: International conference on machine learning, pp 3915–3923
19.
go back to reference Pang B, Lee L et al (2008) Opinion mining and sentiment analysis. Found Trends® Inf Retr 2(1–2):1–135CrossRef Pang B, Lee L et al (2008) Opinion mining and sentiment analysis. Found Trends® Inf Retr 2(1–2):1–135CrossRef
20.
go back to reference Peng H, Ma Y, Li Y, Cambria E (2018) Learning multi-grained aspect target sequence for chinese sentiment analysis. Knowl Based Syst 148:167–176CrossRef Peng H, Ma Y, Li Y, Cambria E (2018) Learning multi-grained aspect target sequence for chinese sentiment analysis. Knowl Based Syst 148:167–176CrossRef
21.
go back to reference Perez-Rosas V, Banea C, Mihalcea R (2012) Learning sentiment lexicons in Spanish. In: LREC, vol 12. p 73 Perez-Rosas V, Banea C, Mihalcea R (2012) Learning sentiment lexicons in Spanish. In: LREC, vol 12. p 73
22.
go back to reference Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (Aug 2014) SemEval-2014 task 4: aspect based sentiment analysis. In: Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014). Association for Computational Linguistics, Dublin, Ireland, pp 27–35 Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (Aug 2014) SemEval-2014 task 4: aspect based sentiment analysis. In: Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014). Association for Computational Linguistics, Dublin, Ireland, pp 27–35
23.
go back to reference Rao D, Ravichandran D (2009) Semi-supervised polarity lexicon induction. In: Proceedings of the 12th conference of the European chapter of the association for computational linguistics. Association for Computational Linguistics, pp 675–682 Rao D, Ravichandran D (2009) Semi-supervised polarity lexicon induction. In: Proceedings of the 12th conference of the European chapter of the association for computational linguistics. Association for Computational Linguistics, pp 675–682
24.
go back to reference Rosenthal S, Farra N, Nakov P (2017) Semeval-2017 task 4: Sentiment analysis in twitter. In: Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), pp 502–518 Rosenthal S, Farra N, Nakov P (2017) Semeval-2017 task 4: Sentiment analysis in twitter. In: Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), pp 502–518
25.
go back to reference Rout JK, Choo KKR, Dash AK, Bakshi S, Jena SK, Williams KL (2018) A model for sentiment and emotion analysis of unstructured social media text. Electron Commer Res 18(1):181–199CrossRef Rout JK, Choo KKR, Dash AK, Bakshi S, Jena SK, Williams KL (2018) A model for sentiment and emotion analysis of unstructured social media text. Electron Commer Res 18(1):181–199CrossRef
26.
go back to reference Rush A.M, Chopra S, Weston J (2015) A neural attention model for abstractive sentence summarization. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 379–389 Rush A.M, Chopra S, Weston J (2015) A neural attention model for abstractive sentence summarization. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 379–389
27.
go back to reference Seki Y, Evans D.K, Ku L.W, Sun L, Chen H.H, Kando N, Lin C.Y (2008) Overview of multilingual opinion analysis task at ntcir-7. In: NTCIR Seki Y, Evans D.K, Ku L.W, Sun L, Chen H.H, Kando N, Lin C.Y (2008) Overview of multilingual opinion analysis task at ntcir-7. In: NTCIR
28.
go back to reference Shen D, Zhang Y, Henao R, Su Q, Carin L (2018) Deconvolutional latent-variable model for text sequence matching. In: Thirty-second AAAI conference on artificial intelligence Shen D, Zhang Y, Henao R, Su Q, Carin L (2018) Deconvolutional latent-variable model for text sequence matching. In: Thirty-second AAAI conference on artificial intelligence
29.
go back to reference Shuang K, Ren X, Yang Q, Li R, Loo J (2019) AELA-DLSTMs: Attention-enabled and location-aware double LSTMs for aspect-level sentiment classification. Neurocomputing 334:25–34CrossRef Shuang K, Ren X, Yang Q, Li R, Loo J (2019) AELA-DLSTMs: Attention-enabled and location-aware double LSTMs for aspect-level sentiment classification. Neurocomputing 334:25–34CrossRef
30.
31.
go back to reference Tang D, Qin B, Feng X, Liu T (2016) Effective LSTMs for target-dependent sentiment classification. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pp 3298–3307 Tang D, Qin B, Feng X, Liu T (2016) Effective LSTMs for target-dependent sentiment classification. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pp 3298–3307
32.
go back to reference Tay Y, Tuan L.A, Hui S.C (2018) Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: Thirty-second AAAI conference on artificial intelligence Tay Y, Tuan L.A, Hui S.C (2018) Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: Thirty-second AAAI conference on artificial intelligence
33.
go back to reference Wang B, Lu W (2018) Learning latent opinions for aspect-level sentiment classification. In: Thirty-second AAAI conference on artificial intelligence Wang B, Lu W (2018) Learning latent opinions for aspect-level sentiment classification. In: Thirty-second AAAI conference on artificial intelligence
34.
go back to reference Wang H, Ester M (2014) A sentiment-aligned topic model for product aspect rating prediction. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1192–1202 Wang H, Ester M (2014) A sentiment-aligned topic model for product aspect rating prediction. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1192–1202
35.
go back to reference Wang Y, Huang M, Zhao L, et al (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615 Wang Y, Huang M, Zhao L, et al (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp 606–615
36.
go back to reference Xu H, Liu B, Shu L, Philip SY (2018) Double embeddings and CNN-based sequence labeling for aspect extraction. In: Proceedings of the 56th annual meeting of the association for computational linguistics (volume 2: short papers), pp 592–598 Xu H, Liu B, Shu L, Philip SY (2018) Double embeddings and CNN-based sequence labeling for aspect extraction. In: Proceedings of the 56th annual meeting of the association for computational linguistics (volume 2: short papers), pp 592–598
37.
go back to reference Xue, W, Li T (2018) Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th annual meeting of the association for computational linguistics (volume 1: long papers), pp 2514–2523 Xue, W, Li T (2018) Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th annual meeting of the association for computational linguistics (volume 1: long papers), pp 2514–2523
38.
go back to reference Zhang S, Wei Z, Wang Y, Liao T (2018) Sentiment analysis of chinese micro-blog text based on extended sentiment dictionary. Future Gener Comput Syst 81:395–403CrossRef Zhang S, Wei Z, Wang Y, Liao T (2018) Sentiment analysis of chinese micro-blog text based on extended sentiment dictionary. Future Gener Comput Syst 81:395–403CrossRef
39.
go back to reference Zhang X, Zhao J, LeCun Y (2015) Character-level convolutional networks for text classification. In: Advances in neural information processing systems, pp 649–657 Zhang X, Zhao J, LeCun Y (2015) Character-level convolutional networks for text classification. In: Advances in neural information processing systems, pp 649–657
Metadata
Title
A relative position attention network for aspect-based sentiment analysis
Authors
Chao Wu
Qingyu Xiong
Min Gao
Qiude Li
Yang Yu
Kaige Wang
Publication date
24-09-2020
Publisher
Springer London
Published in
Knowledge and Information Systems / Issue 2/2021
Print ISSN: 0219-1377
Electronic ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-020-01512-w

Other articles of this Issue 2/2021

Knowledge and Information Systems 2/2021 Go to the issue

Premium Partner