Skip to main content
Top
Published in:
Cover of the book

2023 | OriginalPaper | Chapter

A Position-Aware Word-Level and Clause-Level Attention Network for Emotion Cause Recognition

Authors : Yufeng Diao, Liang Yang, Xiaochao Fan, Hongfei Lin

Published in: Information Retrieval

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Emotion cause recognition is a vital task in natural language processing (NLP), which aims to identify the reason of emotion expressed in text. Both industry and academia have realized the importance of the relationship between emotion word and context. However, most existing methods usually ignore the fact that the position information is also crucial for detecting the emotion cause. When an emotion word occurs in a clause, its neighboring words and clauses should be given more attractive than others with a long distance. In this paper, we propose a novel framework Position-aware Word-level and Clause-level Attention (PWCA) Network based on bidirectional GRU. PWCA not only concentrates on the position information of emotion word, but also builds the relation between emotion clause and candidate clause by leveraging word-level and clause-level attention mechanism. The experimental results show that our model obviously outperforms other state-of-the-art methods. Through the visualization of attention over words, we validate our observation mentioned above.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Gao, W., Li, S., Yat, S., Lee, M., Zhou, G., Huang, C.R.: Joint learning on sentiment and emotion classification. In: CIKM, pp. 1505–1508 (2013) Gao, W., Li, S., Yat, S., Lee, M., Zhou, G., Huang, C.R.: Joint learning on sentiment and emotion classification. In: CIKM, pp. 1505–1508 (2013)
2.
go back to reference Wang, Y., Sun, A., Han, J., et al.: Sentiment analysis by capsules. In: Proceedings of the 2018 World Wide Web Conference on World Wide Web. International World Wide Web Conferences Steering Committee, pp. 1165–1174 (2018) Wang, Y., Sun, A., Han, J., et al.: Sentiment analysis by capsules. In: Proceedings of the 2018 World Wide Web Conference on World Wide Web. International World Wide Web Conferences Steering Committee, pp. 1165–1174 (2018)
3.
go back to reference Chen, Y., Hou, W., Cheng, X., et al.: Joint learning for emotion classification and emotion cause detection. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 646–651 (2018) Chen, Y., Hou, W., Cheng, X., et al.: Joint learning for emotion classification and emotion cause detection. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 646–651 (2018)
4.
go back to reference Truong, Q.T., Lauw, H.W.: VistaNet: visual aspect attention network for multimodal sentiment analysis. In: AAAI (2019) Truong, Q.T., Lauw, H.W.: VistaNet: visual aspect attention network for multimodal sentiment analysis. In: AAAI (2019)
5.
go back to reference Gui, L., Hu, J., He, Y., et al.: A question answering approach to emotion cause extraction. In: EMNLP (2017) Gui, L., Hu, J., He, Y., et al.: A question answering approach to emotion cause extraction. In: EMNLP (2017)
6.
go back to reference Li, X., Song, K., Feng, S., et al.: A co-attention neural network model for emotion cause analysis with emotional context awareness. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4752–4757 (2018) Li, X., Song, K., Feng, S., et al.: A co-attention neural network model for emotion cause analysis with emotional context awareness. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4752–4757 (2018)
7.
go back to reference Das, D., Bandyopadhyay, S.: Emotions on Bengali blog texts: role of holder and topic. In: International Conference on Advances in Social Networks Analysis and Mining, pp. 587–592 (2011) Das, D., Bandyopadhyay, S.: Emotions on Bengali blog texts: role of holder and topic. In: International Conference on Advances in Social Networks Analysis and Mining, pp. 587–592 (2011)
8.
go back to reference Chang, Y.C., Chen, C.C., Hsieh, Y.L., Hsu, W.L.: Linguistic template extraction for recognizing reader-emotion and emotional resonance writing assistance. In: ACL, pp. 775–780 (2015) Chang, Y.C., Chen, C.C., Hsieh, Y.L., Hsu, W.L.: Linguistic template extraction for recognizing reader-emotion and emotional resonance writing assistance. In: ACL, pp. 775–780 (2015)
9.
go back to reference Cheng, J., Zhao, S., Zhang, J., et al.: Aspect-level sentiment classification with heat (hierarchical attention) network. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 97–106. ACM (2017) Cheng, J., Zhao, S., Zhang, J., et al.: Aspect-level sentiment classification with heat (hierarchical attention) network. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 97–106. ACM (2017)
10.
go back to reference Barbieri, F., Anke, L.E., Camacho-Collados, J., et al.: Interpretable emoji prediction via label-wise attention LSTMs. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4766–4771 (2018) Barbieri, F., Anke, L.E., Camacho-Collados, J., et al.: Interpretable emoji prediction via label-wise attention LSTMs. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 4766–4771 (2018)
11.
go back to reference Gu, S., Zhang, L., Hou, Y., et al.: A position-aware bidirectional attention network for aspect-level sentiment analysis. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 774–784 (2018) Gu, S., Zhang, L., Hou, Y., et al.: A position-aware bidirectional attention network for aspect-level sentiment analysis. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 774–784 (2018)
12.
go back to reference Wang, J., Li, J., Li, S., et al.: Aspect sentiment classification with both word-level and clause-level attention networks. In: IJCAI, pp. 4439–4445 (2018) Wang, J., Li, J., Li, S., et al.: Aspect sentiment classification with both word-level and clause-level attention networks. In: IJCAI, pp. 4439–4445 (2018)
13.
go back to reference Lee, S.Y.M., Chen, Y., Huang, C.R.: A text-driven rule-based system for emotion cause detection. In: Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text. Association for Computational Linguistics, pp. 45–53 (2010) Lee, S.Y.M., Chen, Y., Huang, C.R.: A text-driven rule-based system for emotion cause detection. In: Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text. Association for Computational Linguistics, pp. 45–53 (2010)
14.
go back to reference Russo, I., Caselli, T., Rubino, F., Boldrini, E., Mart´ınez-Barco, P.: Emocause: an easy-adaptable approach to emotion cause contexts. In: Workshop on Computational Approaches to Subjectivity and Sentiment Analysis, pp. 153–160 (2011) Russo, I., Caselli, T., Rubino, F., Boldrini, E., Mart´ınez-Barco, P.: Emocause: an easy-adaptable approach to emotion cause contexts. In: Workshop on Computational Approaches to Subjectivity and Sentiment Analysis, pp. 153–160 (2011)
15.
go back to reference Gui, L., Yuan, L., Xu, R., et al.: Emotion cause detection with linguistic construction in chinese weibo text. In: Natural Language Processing and Chinese Computing, pp. 457–464. Springer, Heidelberg (2014) Gui, L., Yuan, L., Xu, R., et al.: Emotion cause detection with linguistic construction in chinese weibo text. In: Natural Language Processing and Chinese Computing, pp. 457–464. Springer, Heidelberg (2014)
16.
go back to reference Ghazi D, Inkpen D, Szpakowicz S. Detecting emotion stimuli in emotion-bearing sentences. International Conference on Intelligent Text Processing and Computational Linguistics. Springer, Cham, 2015: 152–165 Ghazi D, Inkpen D, Szpakowicz S. Detecting emotion stimuli in emotion-bearing sentences. International Conference on Intelligent Text Processing and Computational Linguistics. Springer, Cham, 2015: 152–165
17.
go back to reference Gui, L., Wu, D., Xu, R., Lu, Q., Zhou, Y.: Event-driven emotion cause extraction with corpus construction. In: EMNLP, pp. 1639–1649 (2016) Gui, L., Wu, D., Xu, R., Lu, Q., Zhou, Y.: Event-driven emotion cause extraction with corpus construction. In: EMNLP, pp. 1639–1649 (2016)
18.
go back to reference Xu, R., Hu, J., Lu, Q., et al.: An ensemble approach for emotion cause detection with event extraction and multi-kernel SVMs. Tsinghua Sci. Technol. 22(6), 646–659 (2017)CrossRef Xu, R., Hu, J., Lu, Q., et al.: An ensemble approach for emotion cause detection with event extraction and multi-kernel SVMs. Tsinghua Sci. Technol. 22(6), 646–659 (2017)CrossRef
19.
go back to reference Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. Comput. Sci. (2014) Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. Comput. Sci. (2014)
20.
go back to reference Mikolov, T., Chen, K., Corrado, G., et al.: Efficient estimation of word representations in vector space. In: ICLR, pp. 1–12 (2013) Mikolov, T., Chen, K., Corrado, G., et al.: Efficient estimation of word representations in vector space. In: ICLR, pp. 1–12 (2013)
21.
go back to reference Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network (2014) Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network (2014)
22.
go back to reference Wang, Y., Huang, M., Zhao, L.: Attention-based lstm for aspect-level sentiment classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (2016) Wang, Y., Huang, M., Zhao, L.: Attention-based lstm for aspect-level sentiment classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (2016)
23.
go back to reference Chung, J., Gulcehre, C., Cho, K.H., et al.: Empirical evaluation of gated recurrent neural networks on sequence modeling (2014). arXiv preprint arXiv:1412.3555 Chung, J., Gulcehre, C., Cho, K.H., et al.: Empirical evaluation of gated recurrent neural networks on sequence modeling (2014). arXiv preprint arXiv:​1412.​3555
24.
go back to reference Manning, C., Surdeanu, M., Bauer, J., et al.: The Stanford CoreNLP natural language processing toolkit. In: Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 55–60 (2014) Manning, C., Surdeanu, M., Bauer, J., et al.: The Stanford CoreNLP natural language processing toolkit. In: Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 55–60 (2014)
25.
go back to reference Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12, 2121–2159 (2011)MATH Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12, 2121–2159 (2011)MATH
26.
go back to reference Chen, Y., Lee, S.Y.M., Li, S., Huang, C.R.: Emotion cause detection with linguistic constructions. In: Coling, pp. 179–187 (2010) Chen, Y., Lee, S.Y.M., Li, S., Huang, C.R.: Emotion cause detection with linguistic constructions. In: Coling, pp. 179–187 (2010)
27.
go back to reference Li, W., Xu, H.: Text-based emotion classification using emotion cause extraction. Expert Syst. Appl. 41(4), 1742–1749 (2014)CrossRef Li, W., Xu, H.: Text-based emotion classification using emotion cause extraction. Expert Syst. Appl. 41(4), 1742–1749 (2014)CrossRef
28.
go back to reference Diao, Y., Lin, H., Yang, L., et al.: Emotion cause detection with enhanced-representation attention convolutional-context network. Soft. Comput. 25(2), 1297–1307 (2021)CrossRef Diao, Y., Lin, H., Yang, L., et al.: Emotion cause detection with enhanced-representation attention convolutional-context network. Soft. Comput. 25(2), 1297–1307 (2021)CrossRef
29.
go back to reference Bostan, L.A.M., Klinger, R.: Token sequence labeling vs. clause classification for english emotion stimulus detection. In: Proceedings of the Ninth Joint Conference on Lexical and Computational Semantics, COLING 2020, Barcelona, Spain, 12–13 December 2020, pp. 58–70. Association for Computational Linguistics (2020) Bostan, L.A.M., Klinger, R.: Token sequence labeling vs. clause classification for english emotion stimulus detection. In: Proceedings of the Ninth Joint Conference on Lexical and Computational Semantics, COLING 2020, Barcelona, Spain, 12–13 December 2020, pp. 58–70. Association for Computational Linguistics (2020)
30.
go back to reference Chen, X., Li, Q., Wang, J.: Conditional causal relationships between emotions and causes in texts. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, 16–20 November 2020, pp. 3111–3121. Association for Computational Linguistics (2020) Chen, X., Li, Q., Wang, J.: Conditional causal relationships between emotions and causes in texts. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, 16–20 November 2020, pp. 3111–3121. Association for Computational Linguistics (2020)
31.
go back to reference Hu, G., Lu, G., Zhao, Y.: FSS-GCN: a graph convolutional networks with fusion of semantic and structure for emotion cause analysis. Knowl.-Based Syst. 212(1), 106584 (2020) Hu, G., Lu, G., Zhao, Y.: FSS-GCN: a graph convolutional networks with fusion of semantic and structure for emotion cause analysis. Knowl.-Based Syst. 212(1), 106584 (2020)
32.
go back to reference Li, X., Gao, W., Feng, S., et al.: Boundary detection with BERT for span-level emotion cause analysis. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (2021) Li, X., Gao, W., Feng, S., et al.: Boundary detection with BERT for span-level emotion cause analysis. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (2021)
Metadata
Title
A Position-Aware Word-Level and Clause-Level Attention Network for Emotion Cause Recognition
Authors
Yufeng Diao
Liang Yang
Xiaochao Fan
Hongfei Lin
Copyright Year
2023
DOI
https://doi.org/10.1007/978-3-031-24755-2_1