Skip to main content
Top

2020 | OriginalPaper | Chapter

Structural Position Network for Aspect-Based Sentiment Classification

Authors : Pu Song, Wei Jiang, Fuqing Zhu, Yan Zhou, Jizhong Han, Songlin Hu

Published in: Artificial Neural Networks and Machine Learning – ICANN 2020

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Aspect-based sentiment classification aims to discriminate the polarity of each aspect term for a given sentence. Previous works mainly focus on sequential modeling and aspect representations. However, the syntactical information and relative structural position of aspect in sentence are neglected, resulting in some irrelevant contextual words as clues during the identification process of aspect sentiment. This paper proposes a structural position network (SPNet) based on bidirectional long short-term memory (LSTM) for further integrating syntactical information. Specifically, we first utilize the dependency tree to represent the grammatical structure of the aspect in sentence. Then, a structural weighted-layer is applied after LSTM. In this situation, the syntactically relevant context is formulated. Besides, the sequential position is combined to reduce the impact of noise caused by imperfect grammatical analysis tools. SPNet not only significantly improves the ability of encoding syntactical information and word dependencies, but also provides a tailor-made representation for different aspect in a sentence. On three public ABSC datasets, SPNet produces a competitive performance compared with some existing state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chen, P., Sun, Z., Bing, L., Yang, W.: Recurrent attention network on memory for aspect sentiment analysis. In: Proceeding of EMNLP, pp. 452–461 (2017) Chen, P., Sun, Z., Bing, L., Yang, W.: Recurrent attention network on memory for aspect sentiment analysis. In: Proceeding of EMNLP, pp. 452–461 (2017)
2.
go back to reference Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proc. EMNLP, 1724–1734 (2014) Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proc. EMNLP, 1724–1734 (2014)
3.
go back to reference Dong, L., Wei, F., Tan, C., Tang, D., Zhou, M., Xu, K.: Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceeding of ACL, pp. 49–54 (2014) Dong, L., Wei, F., Tan, C., Tang, D., Zhou, M., Xu, K.: Adaptive recursive neural network for target-dependent twitter sentiment classification. In: Proceeding of ACL, pp. 49–54 (2014)
4.
go back to reference Gu, S., Zhang, L., Hou, Y., Song, Y.: A position-aware bidirectional attention network for aspect-level sentiment analysis. In: Proceeding of COLING, pp. 774–784 (2018) Gu, S., Zhang, L., Hou, Y., Song, Y.: A position-aware bidirectional attention network for aspect-level sentiment analysis. In: Proceeding of COLING, pp. 774–784 (2018)
5.
go back to reference He, R., Lee, W.S., Ng, H.T., Dahlmeier, D.: Effective attention modeling for aspect-level sentiment classification. In: Proceeding of COLING, pp. 1121–1131 (2018) He, R., Lee, W.S., Ng, H.T., Dahlmeier, D.: Effective attention modeling for aspect-level sentiment classification. In: Proceeding of COLING, pp. 1121–1131 (2018)
7.
go back to reference Jiang, L., Yu, M., Zhou, M., Liu, X., Zhao, T.: Target-dependent twitter sentiment classification. In: Proceeding of ACL, pp. 151–160 (2011) Jiang, L., Yu, M., Zhou, M., Liu, X., Zhao, T.: Target-dependent twitter sentiment classification. In: Proceeding of ACL, pp. 151–160 (2011)
8.
go back to reference Kim, Y., Denton, C., Hoang, L., Rush, A.M.: Structured attention networks. Proc. ICLR (2017) Kim, Y., Denton, C., Hoang, L., Rush, A.M.: Structured attention networks. Proc. ICLR (2017)
9.
go back to reference Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceeding of ICLR (2017) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceeding of ICLR (2017)
10.
go back to reference Kiritchenko, S., Zhu, X., Cherry, C., Mohammad, S.: NRC-canada-2014: detecting aspects and sentiment in customer reviews. In: Proceeding of SemEval, pp. 437–442 (2014) Kiritchenko, S., Zhu, X., Cherry, C., Mohammad, S.: NRC-canada-2014: detecting aspects and sentiment in customer reviews. In: Proceeding of SemEval, pp. 437–442 (2014)
11.
go back to reference Li, X., Bing, L., Lam, W., Shi, B.: Transformation networks for target-oriented sentiment classification. Proc. ACL, 946–956 (2018) Li, X., Bing, L., Lam, W., Shi, B.: Transformation networks for target-oriented sentiment classification. Proc. ACL, 946–956 (2018)
12.
go back to reference Li, X., Lam, W.: Deep multi-task learning for aspect term extraction with memory interaction. In: Proceeding of EMNLP, pp. 2886–2892 (2017) Li, X., Lam, W.: Deep multi-task learning for aspect term extraction with memory interaction. In: Proceeding of EMNLP, pp. 2886–2892 (2017)
13.
go back to reference Liu, J., Zhang, Y.: Attention modeling for targeted sentiment. In: Proceeding of EACL, pp. 572–577 (2017) Liu, J., Zhang, Y.: Attention modeling for targeted sentiment. In: Proceeding of EACL, pp. 572–577 (2017)
14.
go back to reference Luong, M.T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation. Proc. EMNLP, 1412–1421 (2015) Luong, M.T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation. Proc. EMNLP, 1412–1421 (2015)
15.
go back to reference Ma, D., Li, S., Zhang, X., Wang, H.: Interactive attention networks for aspect-level sentiment classification. Proc. IJCAI, 4068–4074 (2017) Ma, D., Li, S., Zhang, X., Wang, H.: Interactive attention networks for aspect-level sentiment classification. Proc. IJCAI, 4068–4074 (2017)
16.
go back to reference Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceeding of EMNLP, pp. 1532–1543 (2014) Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceeding of EMNLP, pp. 1532–1543 (2014)
17.
go back to reference Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., Manandhar, S.: SemEval-2014 task 4: aspect based sentiment analysis. In: Proceeding of SemEval, pp. 27–35 (2014) Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., Manandhar, S.: SemEval-2014 task 4: aspect based sentiment analysis. In: Proceeding of SemEval, pp. 27–35 (2014)
18.
go back to reference Shen, Y., Tan, S., Sordoni, A., Courville, A.: Ordered neurons: integrating tree structures into recurrent neural networks. In: Proceeding of ICLR (2019) Shen, Y., Tan, S., Sordoni, A., Courville, A.: Ordered neurons: integrating tree structures into recurrent neural networks. In: Proceeding of ICLR (2019)
19.
go back to reference Tai, K.S., Socher, R., Manning, C.D.: Improved semantic representations from tree-structured long short-term memory networks. Proc. ACL-CoNLL, 1556–1566 (2015) Tai, K.S., Socher, R., Manning, C.D.: Improved semantic representations from tree-structured long short-term memory networks. Proc. ACL-CoNLL, 1556–1566 (2015)
20.
go back to reference Tang, D., Qin, B., Feng, X., Liu, T.: Effective LSTMs for target-dependent sentiment classification. In: Proceeding of COLING, pp. 3298–3307 (2016) Tang, D., Qin, B., Feng, X., Liu, T.: Effective LSTMs for target-dependent sentiment classification. In: Proceeding of COLING, pp. 3298–3307 (2016)
21.
go back to reference Tang, D., Qin, B., Liu, T.: Aspect level sentiment classification with deep memory network. Proc. EMNLP, 214–224 (2016) Tang, D., Qin, B., Liu, T.: Aspect level sentiment classification with deep memory network. Proc. EMNLP, 214–224 (2016)
22.
go back to reference Tang, J., et al.: Progressive self-supervised attention learning for aspect-level sentiment analysis. Proc. ACL, 557–566 (2019) Tang, J., et al.: Progressive self-supervised attention learning for aspect-level sentiment analysis. Proc. ACL, 557–566 (2019)
23.
go back to reference Titov, I., McDonald, R.: Modeling online reviews with multi-grain topic models. In Proceedings of the 17th international conference on World Wide Web, pp. 111–120 (2008) Titov, I., McDonald, R.: Modeling online reviews with multi-grain topic models. In Proceedings of the 17th international conference on World Wide Web, pp. 111–120 (2008)
24.
go back to reference Wang, X., Tu, Z., Wang, L., Shi, S.: Self-attention with structural position representations. Proc. EMNLP-IJCNLP, 1403–1409 (2019) Wang, X., Tu, Z., Wang, L., Shi, S.: Self-attention with structural position representations. Proc. EMNLP-IJCNLP, 1403–1409 (2019)
25.
go back to reference Wang, Y., et al.: Attention-based LSTM for aspect-level sentiment classification. In: Proceeding of EMNLP, pp. 606–615 (2016) Wang, Y., et al.: Attention-based LSTM for aspect-level sentiment classification. In: Proceeding of EMNLP, pp. 606–615 (2016)
26.
go back to reference Zhang, C., Li, Q., Song, D.: Aspect-based sentiment classification with aspect-specific graph convolutional networks. Proc. EMNLP-IJCNLP, 4560–4570 (2019) Zhang, C., Li, Q., Song, D.: Aspect-based sentiment classification with aspect-specific graph convolutional networks. Proc. EMNLP-IJCNLP, 4560–4570 (2019)
27.
go back to reference Zhou, Y., Huang, L., Guo, T., Han, J., Hu, S.: A span-based joint model for opinion target extraction and target sentiment classification. In: Proceeding of IJCAI, pp. 5485–5491 (2019) Zhou, Y., Huang, L., Guo, T., Han, J., Hu, S.: A span-based joint model for opinion target extraction and target sentiment classification. In: Proceeding of IJCAI, pp. 5485–5491 (2019)
Metadata
Title
Structural Position Network for Aspect-Based Sentiment Classification
Authors
Pu Song
Wei Jiang
Fuqing Zhu
Yan Zhou
Jizhong Han
Songlin Hu
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-61616-8_45

Premium Partner