Skip to main content
Top
Published in: Journal of Intelligent Information Systems 1/2024

23-08-2023 | Research

Prompted and integrated textual information enhancing aspect-based sentiment analysis

Authors: Xuefeng Shi, Min Hu, Fuji Ren, Piao Shi, Jiawen Deng, Yiming Tang

Published in: Journal of Intelligent Information Systems | Issue 1/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Aspect-based Sentiment Analysis (ABSA) aims to automatically predict the sentiment polarity of the written text based on the analysis of specific aspects. By applying various pre-trained language encoders, recent studies have achieved great success in modeling aspect and context features and measuring the word-level correlations. However, the pre-trained language models (PLM) were usually employed as the feature representations generator without any task-oriented guidance. And the syntax dependency tree is also not fully utilized. Besides, simply concatenating usually fails to exploit deep semantic features from multi-source spaces and weakens the representation of context features. In this study, we propose a novel model, namely PRoGCN (Prompted RoBERTa & Graph Convolution Network), which directly tells RoBERTa the goal of the present task by inserting the task-oriented specific prompting word to the raw text. Moreover, the prompted feature representation is also utilized to help generate textual knowledge graph, and strongly enhances the syntactic feature representation. In addition, we first introduce cross attention into our study to integrate semantic representation and syntactic representation, which has been proven to be successful in implementing and fusing multi-source information. Experimental results on five publicly available ABSA datasets validate the effectiveness of our method, and the proposed method achieves state-of-the-art performance on mentioned ABSA benchmarks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Dai J., Yan H., Sun T., et al. (2021). Does syntax matter? a strong baseline for aspect-based sentiment analysis with roberta. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1816–1829. https://doi.org/10.18653/V1/2021.NAACL-MAIN.146 Dai J., Yan H., Sun T., et al. (2021). Does syntax matter? a strong baseline for aspect-based sentiment analysis with roberta. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1816–1829. https://​doi.​org/​10.​18653/​V1/​2021.​NAACL-MAIN.​146
go back to reference Devlin J., Chang M.W., Lee K., et al. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 4171–4186. https://doi.org/10.18653/v1/N19-1423 Devlin J., Chang M.W., Lee K., et al. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 4171–4186. https://​doi.​org/​10.​18653/​v1/​N19-1423
go back to reference Dong L., Wei F., Tan C., et al. (2014). Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 49–54. https://doi.org/10.3115/v1/P14-2009 Dong L., Wei F., Tan C., et al. (2014). Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 49–54. https://​doi.​org/​10.​3115/​v1/​P14-2009
go back to reference Gao T., Fisch A., Chen D. (2021). Making pre-trained language models better few-shot learners. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pp 3816–3830. https://doi.org/10.18653/v1/2021.acl-long.295 Gao T., Fisch A., Chen D. (2021). Making pre-trained language models better few-shot learners. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pp 3816–3830. https://​doi.​org/​10.​18653/​v1/​2021.​acl-long.​295
go back to reference Li R., Chen H., Feng F., et al. (2021). Dual graph convolutional networks for aspect-based sentiment analysis. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 6319–6329. https://doi.org/10.18653/v1/2021.acl-long.494 Li R., Chen H., Feng F., et al. (2021). Dual graph convolutional networks for aspect-based sentiment analysis. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 6319–6329. https://​doi.​org/​10.​18653/​v1/​2021.​acl-long.​494
go back to reference Manning C.D., Surdeanu M., Bauer J., et al. (2014). The stanford corenlp natural language processing toolkit. In Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 55–60. https://doi.org/10.3115/v1/P14-5010 Manning C.D., Surdeanu M., Bauer J., et al. (2014). The stanford corenlp natural language processing toolkit. In Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 55–60. https://​doi.​org/​10.​3115/​v1/​P14-5010
go back to reference Petroni F., Rocktäschel T., Riedel S., et al. (2019). Language models as knowledge bases? In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2463–2473. https://doi.org/10.18653/v1/D19-1250 Petroni F., Rocktäschel T., Riedel S., et al. (2019). Language models as knowledge bases? In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2463–2473. https://​doi.​org/​10.​18653/​v1/​D19-1250
go back to reference Pontiki M., Galanis D., Pavlopoulos J., et al. (2014). Semeval-2014 task 4: Aspect based sentiment analysis. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014). Association for Computational Linguistics, 27–35. https://doi.org/10.3115/v1/S14-2004 Pontiki M., Galanis D., Pavlopoulos J., et al. (2014). Semeval-2014 task 4: Aspect based sentiment analysis. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014). Association for Computational Linguistics, 27–35. https://​doi.​org/​10.​3115/​v1/​S14-2004
go back to reference Zhang C., Li Q., Song D. (2019). Aspect-based sentiment classification with aspect-specific graph convolutional networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 4568–4578. https://doi.org/10.18653/v1/D19-1464 Zhang C., Li Q., Song D. (2019). Aspect-based sentiment classification with aspect-specific graph convolutional networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 4568–4578. https://​doi.​org/​10.​18653/​v1/​D19-1464
go back to reference Zhang W., Li X., Deng Y., et al. (2021). Towards generative aspect-based sentiment analysis. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 504–510. https://doi.org/10.18653/v1/2021.acl-short.64 Zhang W., Li X., Deng Y., et al. (2021). Towards generative aspect-based sentiment analysis. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 504–510. https://​doi.​org/​10.​18653/​v1/​2021.​acl-short.​64
Metadata
Title
Prompted and integrated textual information enhancing aspect-based sentiment analysis
Authors
Xuefeng Shi
Min Hu
Fuji Ren
Piao Shi
Jiawen Deng
Yiming Tang
Publication date
23-08-2023
Publisher
Springer US
Published in
Journal of Intelligent Information Systems / Issue 1/2024
Print ISSN: 0925-9902
Electronic ISSN: 1573-7675
DOI
https://doi.org/10.1007/s10844-023-00805-0

Other articles of this Issue 1/2024

Journal of Intelligent Information Systems 1/2024 Go to the issue

Premium Partner