Skip to main content
Top
Published in: Knowledge and Information Systems 5/2022

08-04-2022 | Regular Paper

Span-based relational graph transformer network for aspect–opinion pair extraction

Authors: You Li, Chaoqiang Wang, Yuming Lin, Yongdong Lin, Liang Chang

Published in: Knowledge and Information Systems | Issue 5/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Aspect extraction and opinion extraction are two fundamental subtasks in aspect-based sentiment analysis. Many methods extract aspect terms or opinion terms but ignore the relationships between them. However, such relationships are crucial for downstream tasks, such as sentiment classification and commodity recommendation. Recently, methods have been proposed to extract both terms jointly; however, they fail to extract them as pairs. In this paper, we explore the aspect–opinion pair extraction task that aims to extract aspect and opinion terms in pairs. To carry out this task, we propose a span-based relational graph transformer network that consists of a span generator, a span classifier, and a relation detector. The span generator enumerates all possible spans to generate the candidates for aspect or opinion terms and filters non-aspects or non-opinions terms, while the relation classifier extracts aspect–opinion pairs. We propose a relational graph convolutional network to capture the dependent relationships between aspect and opinion terms. Extensive experiments show that the proposed model achieves the state-of-the-art performance using four benchmark datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cambria E (2016) Affect computing and sentiment analysis. IEEE Intell Syst 31(2):102–107CrossRef Cambria E (2016) Affect computing and sentiment analysis. IEEE Intell Syst 31(2):102–107CrossRef
2.
go back to reference Pontiki M, Galanis D, Pavlopoulos J et al (2014) SemEval-2014 task 4: aspect based sentiment analysis. In: Proceedings of the 8th international workshop on semantic evaluation, pp 27–35 Pontiki M, Galanis D, Pavlopoulos J et al (2014) SemEval-2014 task 4: aspect based sentiment analysis. In: Proceedings of the 8th international workshop on semantic evaluation, pp 27–35
3.
go back to reference Liu K, Xu L, Zhao J (2015) Co-extracting opinion targets and opinion words from online reviews based on the word alignment model. IEEE Trans Knowl Data Eng 27(3):636–650CrossRef Liu K, Xu L, Zhao J (2015) Co-extracting opinion targets and opinion words from online reviews based on the word alignment model. IEEE Trans Knowl Data Eng 27(3):636–650CrossRef
4.
go back to reference He R, Lee WS, Ng HT et al (2017) An unsupervised neural attention model for aspect extraction. In: Proceedings of the 55th annual meeting of the association for computational linguistics, pp 388–397 He R, Lee WS, Ng HT et al (2017) An unsupervised neural attention model for aspect extraction. In: Proceedings of the 55th annual meeting of the association for computational linguistics, pp 388–397
5.
go back to reference Xu H, Liu B, Shu L et al (2018) Double embeddings and CNN-based sequence labeling for aspect extraction. In: Proceedings of the 56th annual meeting of the association for computational linguistics, pp 592–598 Xu H, Liu B, Shu L et al (2018) Double embeddings and CNN-based sequence labeling for aspect extraction. In: Proceedings of the 56th annual meeting of the association for computational linguistics, pp 592–598
6.
go back to reference Fan Z, Wu Z, Dai XY, Huang S et al (2019) Target-oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, pp 2509–2518 Fan Z, Wu Z, Dai XY, Huang S et al (2019) Target-oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, pp 2509–2518
7.
go back to reference Wu Z, Zhao F, Dai XY et al (2020) Latent opinions transfer network for target-oriented opinion words extraction. In: The thirty-fourth AAAI conference on artificial intelligence, pp 9298–9305 Wu Z, Zhao F, Dai XY et al (2020) Latent opinions transfer network for target-oriented opinion words extraction. In: The thirty-fourth AAAI conference on artificial intelligence, pp 9298–9305
8.
go back to reference Veyseh A, Nouri N, Dernoncourt F et al (2020) Introducing syntactic structures into target opinion word extraction with deep learning. In: Proceedings of the 2020 conference on empirical methods in natural language processing, pp 8947–8956 Veyseh A, Nouri N, Dernoncourt F et al (2020) Introducing syntactic structures into target opinion word extraction with deep learning. In: Proceedings of the 2020 conference on empirical methods in natural language processing, pp 8947–8956
9.
go back to reference Liu P, Joty S, Meng H (2015) Fine-grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 1433–1443 Liu P, Joty S, Meng H (2015) Fine-grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 1433–1443
10.
go back to reference Pereg O, Korat D, Wasserblat M (2020) Syntactically aware cross-domain aspect and opinion terms extraction. In: Proceedings of the 28th international conference on computational linguistics, pp 1772–1777 Pereg O, Korat D, Wasserblat M (2020) Syntactically aware cross-domain aspect and opinion terms extraction. In: Proceedings of the 28th international conference on computational linguistics, pp 1772–1777
11.
go back to reference Wang W, Pan SJ (2018) Recursive neural structural correspondence network for cross-domain aspect and opinion co-extraction. In: Proceedings of the 56th annual meeting of the association for computational linguistics, pp 2171–2181 Wang W, Pan SJ (2018) Recursive neural structural correspondence network for cross-domain aspect and opinion co-extraction. In: Proceedings of the 56th annual meeting of the association for computational linguistics, pp 2171–2181
12.
go back to reference Yu J, Jiang J, Xia R (2019) Global inference for aspect and opinion terms co-extraction based on multi-task neural networks. IEEE/ACM Trans Audio Speech Lang Process 27(1):168–177CrossRef Yu J, Jiang J, Xia R (2019) Global inference for aspect and opinion terms co-extraction based on multi-task neural networks. IEEE/ACM Trans Audio Speech Lang Process 27(1):168–177CrossRef
13.
go back to reference Wang W, Pan S, Dahlmeier D et al (2017) Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: Thirty-first AAAI conference on artificial intelligence, pp 3316–3322 Wang W, Pan S, Dahlmeier D et al (2017) Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: Thirty-first AAAI conference on artificial intelligence, pp 3316–3322
14.
go back to reference Zhao H, Huang L, Zhang R et al (2020) SpanMlt: a span-based multi-task learning framework for pair-wise aspect and opinion terms extraction. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 3239–3248 Zhao H, Huang L, Zhang R et al (2020) SpanMlt: a span-based multi-task learning framework for pair-wise aspect and opinion terms extraction. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 3239–3248
15.
go back to reference Wang H, Zhang C, Yin H et al (2016) A unified framework for fine-grained opinion mining from online reviews. In: Hawaii international conference on system sciences. IEEE, pp 1134–1143 Wang H, Zhang C, Yin H et al (2016) A unified framework for fine-grained opinion mining from online reviews. In: Hawaii international conference on system sciences. IEEE, pp 1134–1143
16.
go back to reference Hu M, Peng Y, Huang Z et al (2019) Open-domain targeted sentiment analysis via span-based extraction and classification. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp 537–546 Hu M, Peng Y, Huang Z et al (2019) Open-domain targeted sentiment analysis via span-based extraction and classification. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp 537–546
17.
go back to reference Wu Z, Ying C, Zhao F et al (2020) Grid tagging scheme for end-to-end fine-grained opinion extraction. In: Findings of the association for computational linguistics: EMNLP, pp 2576–2585 Wu Z, Ying C, Zhao F et al (2020) Grid tagging scheme for end-to-end fine-grained opinion extraction. In: Findings of the association for computational linguistics: EMNLP, pp 2576–2585
18.
go back to reference Liu B (2012) Sentiment analysis and opinion mining. Synth Lect Hum Lang Technol 5(1):1–167CrossRef Liu B (2012) Sentiment analysis and opinion mining. Synth Lect Hum Lang Technol 5(1):1–167CrossRef
19.
go back to reference Liang B, Su H, Gui L, Cambria E, Xu R (2022) Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional network. Knowl Based Syst 235:107643CrossRef Liang B, Su H, Gui L, Cambria E, Xu R (2022) Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional network. Knowl Based Syst 235:107643CrossRef
20.
go back to reference Kumar AJ, Trueman TE, Cambria E (2021) A convolutional stacked bidirectional LSTM with a multiplicative attention mechanism for aspect category and sentiment detection. Cogn Comput 13:1423–1432CrossRef Kumar AJ, Trueman TE, Cambria E (2021) A convolutional stacked bidirectional LSTM with a multiplicative attention mechanism for aspect category and sentiment detection. Cogn Comput 13:1423–1432CrossRef
21.
go back to reference Valdivia A, Luzón MV, Cambria E, Herrera F (2018) Consensus vote models for detecting and filtering neutrality in sentiment analysis. Inf Fusion 44:126–135CrossRef Valdivia A, Luzón MV, Cambria E, Herrera F (2018) Consensus vote models for detecting and filtering neutrality in sentiment analysis. Inf Fusion 44:126–135CrossRef
22.
go back to reference Wang Z, Ho SB, Cambria E (2020) Multi-level fine-scaled sentiment sensing with ambivalence handling. Int J Uncertain Fuzziness Knowl Based Syst 28(4):683–697CrossRef Wang Z, Ho SB, Cambria E (2020) Multi-level fine-scaled sentiment sensing with ambivalence handling. Int J Uncertain Fuzziness Knowl Based Syst 28(4):683–697CrossRef
23.
go back to reference Cambria E, Li Y, Xing FZ, Poria S, Kwok K (2020) SenticNet 6: ensemble application of symbolic and subsymbolic AI for sentiment analysis. In: The 29th ACM international conference on information and knowledge management, pp 105–113 Cambria E, Li Y, Xing FZ, Poria S, Kwok K (2020) SenticNet 6: ensemble application of symbolic and subsymbolic AI for sentiment analysis. In: The 29th ACM international conference on information and knowledge management, pp 105–113
24.
go back to reference Li W, Shao W, Ji S, Cambria E (2022) BiERU: bidirectional emotional recurrent unit for conversational sentiment analysis. Neurocomputing 467:73–82CrossRef Li W, Shao W, Ji S, Cambria E (2022) BiERU: bidirectional emotional recurrent unit for conversational sentiment analysis. Neurocomputing 467:73–82CrossRef
25.
go back to reference Liu K, Xu L, Zhao J (2014) Extracting opinion targets and opinion words from online reviews with graph co-ranking. In: Proceedings of the 52nd annual meeting of the association for computational linguistics, pp 314–324 Liu K, Xu L, Zhao J (2014) Extracting opinion targets and opinion words from online reviews with graph co-ranking. In: Proceedings of the 52nd annual meeting of the association for computational linguistics, pp 314–324
26.
go back to reference Kumar A, Kohail S, Kumar A et al (2016) IIT-TUDA at SemEval-2016 task 5: beyond sentiment lexicon: combining domain dependency and distributional semantics features for aspect based sentiment analysis. In: Proceedings of the 10th international workshop on semantic evaluation, pp 1129–1135 Kumar A, Kohail S, Kumar A et al (2016) IIT-TUDA at SemEval-2016 task 5: beyond sentiment lexicon: combining domain dependency and distributional semantics features for aspect based sentiment analysis. In: Proceedings of the 10th international workshop on semantic evaluation, pp 1129–1135
27.
go back to reference Ma Y, Peng H, Cambria E (2018) Targeted aspect-based sentiment analysis via embedding common sense knowledge into an attentive LSTM. In: Proceedings of the thirty-second AAAI conference on artificial intelligence, pp 5876–5883 Ma Y, Peng H, Cambria E (2018) Targeted aspect-based sentiment analysis via embedding common sense knowledge into an attentive LSTM. In: Proceedings of the thirty-second AAAI conference on artificial intelligence, pp 5876–5883
28.
go back to reference Movahedi S, Ghadery E, Faili H et al (2019) Aspect category detection via topic-attention network. Computing Research Repository (CoRR) arXiv:1901.01183 Movahedi S, Ghadery E, Faili H et al (2019) Aspect category detection via topic-attention network. Computing Research Repository (CoRR) arXiv:​1901.​01183
29.
go back to reference Qiu G, Liu B, Bu J et al (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37(1):9–27CrossRef Qiu G, Liu B, Bu J et al (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37(1):9–27CrossRef
30.
go back to reference Chen S, Liu J, Wang Y et al (2020) Synchronous double-channel recurrent network for aspect-opinion pair extraction. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 6515–6524 Chen S, Liu J, Wang Y et al (2020) Synchronous double-channel recurrent network for aspect-opinion pair extraction. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp 6515–6524
31.
go back to reference Li Z, Li X, Wei Y et al (2019) Transferable end-to-end aspect-based sentiment analysis with selective adversarial learning. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing, pp 4589–4599 Li Z, Li X, Wei Y et al (2019) Transferable end-to-end aspect-based sentiment analysis with selective adversarial learning. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing, pp 4589–4599
32.
go back to reference Eberts M, Ulges A (2020) Span-based joint entity and relation extraction with transformer pre-training. In: 24th European conference on artificial intelligence, pp 2006–2013 Eberts M, Ulges A (2020) Span-based joint entity and relation extraction with transformer pre-training. In: 24th European conference on artificial intelligence, pp 2006–2013
33.
go back to reference Velickovic P, Cucurull G, Casanova A et al (2018) Graph attention networks. In: 6th international conference on learning representations Velickovic P, Cucurull G, Casanova A et al (2018) Graph attention networks. In: 6th international conference on learning representations
34.
go back to reference Hamilton LW, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. In: Annual conference on neural information processing systems, pp 1024–1034 Hamilton LW, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. In: Annual conference on neural information processing systems, pp 1024–1034
Metadata
Title
Span-based relational graph transformer network for aspect–opinion pair extraction
Authors
You Li
Chaoqiang Wang
Yuming Lin
Yongdong Lin
Liang Chang
Publication date
08-04-2022
Publisher
Springer London
Published in
Knowledge and Information Systems / Issue 5/2022
Print ISSN: 0219-1377
Electronic ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-022-01675-8

Other articles of this Issue 5/2022

Knowledge and Information Systems 5/2022 Go to the issue

Premium Partner