Skip to main content
Top

2019 | OriginalPaper | Chapter

Syntax-Aware Representation for Aspect Term Extraction

Authors : Jingyuan Zhang, Guangluan Xu, Xinyi Wang, Xian Sun, Tinglei Huang

Published in: Advances in Knowledge Discovery and Data Mining

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Aspect Term Extraction (ATE) plays an important role in aspect-based sentiment analysis. Syntax-based neural models that learn rich linguistic knowledge have proven their effectiveness on ATE. However, previous approaches mainly focus on modeling syntactic structure, neglecting rich interactions along dependency arcs. Besides, these methods highly rely on results of dependency parsing and are sensitive to parsing noise. In this work, we introduce a syntax-directed attention network and a contextual gating mechanism to tackle these issues. Specifically, a graphical neural network is utilized to model interactions along dependency arcs. With the help of syntax-directed self-attention, it could directly operate on syntactic graph and obtain structural information. We further introduce a gating mechanism to synthesize syntactic information with structure-free features. This gate is utilized to reduce the effects of parsing noise. Experimental results demonstrate that the proposed method achieves state-of-the-art performance on three widely used benchmark datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chen, K., Wang, R., Utiyama, M., Sumita, E., Zhao1, T.: Syntax-directed attention for neural machine translation. In: AAAI, pp. 4792–4799 (2018) Chen, K., Wang, R., Utiyama, M., Sumita, E., Zhao1, T.: Syntax-directed attention for neural machine translation. In: AAAI, pp. 4792–4799 (2018)
2.
go back to reference Chen, Z., Mukherjee, A., Liu, B.: Aspect extraction with automated prior knowledge learning. In: ACL, pp. 347–358 (2014) Chen, Z., Mukherjee, A., Liu, B.: Aspect extraction with automated prior knowledge learning. In: ACL, pp. 347–358 (2014)
3.
go back to reference Chernyshevich, M.: IHS R&D belarus: cross-domain extraction of product features using CRF. In: SemEval@COLING, pp. 309–313 (2014) Chernyshevich, M.: IHS R&D belarus: cross-domain extraction of product features using CRF. In: SemEval@COLING, pp. 309–313 (2014)
4.
go back to reference Choi, Y., Cardie, C., Riloff, E., Patwardhan, S.: Identifying sources of opinions with conditional random fields and extraction patterns. In: HLT/EMNLP, pp. 355–362 (2005) Choi, Y., Cardie, C., Riloff, E., Patwardhan, S.: Identifying sources of opinions with conditional random fields and extraction patterns. In: HLT/EMNLP, pp. 355–362 (2005)
5.
go back to reference Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)MATH Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)MATH
6.
go back to reference Hu, M., Liu, B.: Mining opinion features in customer reviews. In: AAAI, pp. 775–760 (2004) Hu, M., Liu, B.: Mining opinion features in customer reviews. In: AAAI, pp. 775–760 (2004)
7.
go back to reference Huang, Z., Xu, W., Yu, K.: Bidirectional LSTM-CRF models for sequence tagging. CoRR abs/1508.01991 (2015) Huang, Z., Xu, W., Yu, K.: Bidirectional LSTM-CRF models for sequence tagging. CoRR abs/1508.01991 (2015)
8.
go back to reference Irsoy, O., Cardie, C.: Opinion mining with deep recurrent neural networks. In: EMNLP, pp. 720–728 (2014) Irsoy, O., Cardie, C.: Opinion mining with deep recurrent neural networks. In: EMNLP, pp. 720–728 (2014)
9.
go back to reference Li, F., et al.: Structure-aware review mining and summarization. In: COLING, pp. 653–661 (2010) Li, F., et al.: Structure-aware review mining and summarization. In: COLING, pp. 653–661 (2010)
10.
go back to reference Li, X., Lam, W.: Deep multi-task learning for aspect term extraction with memory interaction. In: EMNLP, pp. 2886–2892 (2017) Li, X., Lam, W.: Deep multi-task learning for aspect term extraction with memory interaction. In: EMNLP, pp. 2886–2892 (2017)
11.
go back to reference Luo, H., Li, T., Liu, B., Wang, B., Unger, H.: Improving aspect term extraction with bidirectional dependency tree representation. CoRR abs/1805.07889 (2018) Luo, H., Li, T., Liu, B., Wang, B., Unger, H.: Improving aspect term extraction with bidirectional dependency tree representation. CoRR abs/1805.07889 (2018)
12.
go back to reference Ma, X., Hovy, E.H.: End-to-end sequence labeling via bi-directional LSTM-CNNS-CRF. CoRR abs/1603.01354 (2016) Ma, X., Hovy, E.H.: End-to-end sequence labeling via bi-directional LSTM-CNNS-CRF. CoRR abs/1603.01354 (2016)
13.
go back to reference Marcheggiani, D., Titov, I.: Encoding sentences with graph convolutional networks for semantic role labeling. In: EMNLP, pp. 1506–1515 (2017) Marcheggiani, D., Titov, I.: Encoding sentences with graph convolutional networks for semantic role labeling. In: EMNLP, pp. 1506–1515 (2017)
14.
go back to reference Toh, Z., Wang, W.: DLIREC: aspect term extraction and term polarity classification system. In: SemEval@COLING, pp. 235–240 (2014) Toh, Z., Wang, W.: DLIREC: aspect term extraction and term polarity classification system. In: SemEval@COLING, pp. 235–240 (2014)
15.
go back to reference Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., Bengio, Y.: Graph attention networks. In: ICLR (2018) Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., Bengio, Y.: Graph attention networks. In: ICLR (2018)
16.
go back to reference Vicente, I.S., Saralegi, X., Agerri, R.: EliXa: a modular and flexible ABSA platform. In: SemEval@NAACL-HLT, pp. 748–752 (2015) Vicente, I.S., Saralegi, X., Agerri, R.: EliXa: a modular and flexible ABSA platform. In: SemEval@NAACL-HLT, pp. 748–752 (2015)
17.
go back to reference Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Recursive neural conditional random fields for aspect-based sentiment analysis. In: EMNLP, pp. 616–626 (2016) Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Recursive neural conditional random fields for aspect-based sentiment analysis. In: EMNLP, pp. 616–626 (2016)
18.
go back to reference Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: AAAI, pp. 3316–3322 (2017) Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: AAAI, pp. 3316–3322 (2017)
20.
go back to reference Yin, Y., Wei, F., Dong, L., Xu, K., Zhang, M., Zhou, M.: Unsupervised word and dependency path embeddings for aspect term extraction. In: IJCAI, pp. 2979–2985 (2016) Yin, Y., Wei, F., Dong, L., Xu, K., Zhang, M., Zhou, M.: Unsupervised word and dependency path embeddings for aspect term extraction. In: IJCAI, pp. 2979–2985 (2016)
21.
go back to reference Zhang, Y., Qi, P., Manning, C.D.: Graph convolution over pruned dependency trees improves relation extraction. CoRR abs/1809.10185 (2018) Zhang, Y., Qi, P., Manning, C.D.: Graph convolution over pruned dependency trees improves relation extraction. CoRR abs/1809.10185 (2018)
22.
go back to reference Zhuang, L., Jing, F., Zhu, X.: Movie review mining and summarization. In: CIKM, pp. 43–50 (2006) Zhuang, L., Jing, F., Zhu, X.: Movie review mining and summarization. In: CIKM, pp. 43–50 (2006)
Metadata
Title
Syntax-Aware Representation for Aspect Term Extraction
Authors
Jingyuan Zhang
Guangluan Xu
Xinyi Wang
Xian Sun
Tinglei Huang
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-16148-4_10

Premium Partner