skip to main content
research-article

Stance Detection with a Multi-Target Adversarial Attention Network

Authors Info & Claims
Published:27 December 2022Publication History
Skip Abstract Section

Abstract

Stance detection aims to assign a stance label (in favor or against) to a post towards a specific target. In the literature, there are many studies focusing on this topic, and most of them treat stance detection as a supervised learning task. Therefore, a new classifier needs to be built from scratch on a well-prepared set of ground-truth data whenever predictions are needed for an unseen target. However, it is difficult to annotate the stance of a post, since a stance is a subjective attitude towards a target. Hence, it is necessary to learn the information from unlabeled data or other target data to help stance detection with a certain target. In this study, we propose a multi-target stance detection framework to integrate multi-target data together for stance detection. Since topic and sentiment are two important factors to identify the stance of a post in multi-target data, we propose an adversarial attention network to integrate multi-target data by detecting and connecting topic and sentiment information. In particular, the adversarial network is utilized to determine the topic and the sentiment of each post to collect some target-invariant information for stance detection. In addition, the attention mechanism is utilized to connect posts with a similar topic or sentiment to acquire some key information for stance detection. The experimental results not only demonstrate the effectiveness of the proposed model, but also indicate the importance of the topic and the sentiment information for stance detection using multi-target data.

REFERENCES

  1. [1] Anand Pranav, Walker Marilyn A., Abbott Rob, Tree Jean E. Fox, Bowmani Robeson, and Minor Michael. 2011. Cats rule and dogs drool!: Classifying stance in online debate. In Proceedings of the 2nd Workshop on Computational Approaches to Subjectivity and Sentiment Analysis. Association for Computational Linguistics, 19.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. [2] Augenstein Isabelle, Rocktäschel Tim, Vlachos Andreas, and Bontcheva Kalina. 2016. Stance detection with bidirectional conditional encoding. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. The Association for Computational Linguistics, 876885. Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] Chen Luoxin, Ruan Weitong, Liu Xinyue, and Lu Jianhua. 2020. SeqVAT: Virtual adversarial training for semi-supervised sequence labeling. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 88018811.Google ScholarGoogle ScholarCross RefCross Ref
  4. [4] Chen Sihao, Khashabi Daniel, Yin Wenpeng, Callison-Burch Chris, and Roth Dan. 2019. Seeing things from a different angle: Discovering diverse perspectives about claims. In Proceedings of NAACL-HLT 2019. 542557.Google ScholarGoogle Scholar
  5. [5] Chen Weile, Jiang Huiqiang, Wu Qianhui, Karlsson Börje, and Guan Yi. 2021. AdvPicker: Effectively leveraging unlabeled data via adversarial discriminator for cross-lingual NER. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 743753. Google ScholarGoogle ScholarCross RefCross Ref
  6. [6] Chen Wei-Fan and Ku Lun-Wei. 2016. UTCNN: A deep learning model of stance classification on social media text. In Proceedings of the 26th International Conference on Computational Linguistics. The Association for Computer Linguistics, 16351645.Google ScholarGoogle Scholar
  7. [7] Devlin Jacob, Chang Ming-Wei, Lee Kenton, and Toutanova Kristina. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 41714186. Google ScholarGoogle ScholarCross RefCross Ref
  8. [8] Dhanya Sridhar, Lise Getoor, and Marilyn Walker. 2014. Collective stance classification of posts in online debate forums. In Proceedings of the Joint Workshop on Social Dynamics and Personal Attributes in Social Media. 109117.Google ScholarGoogle Scholar
  9. [9] Ebrahimi Javid, Dou Dejing, and Lowd Daniel. 2016. A joint sentiment-target-stance model for stance classification in tweets. In Proceedings of the 26th International Conference on Computational Linguistics. Association for Computational Linguistics, 26562665.Google ScholarGoogle Scholar
  10. [10] Mekki Abdellah El, Mahdaouy Abdelkader El, Berrada Ismail, and Khoumsi Ahmed. 2021. Domain adaptation for arabic cross-domain and cross-dialect sentiment analysis from contextualized word embedding. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 28242837.Google ScholarGoogle ScholarCross RefCross Ref
  11. [11] Fedus William, Goodfellow Ian J., and Dai Andrew M.. 2018. MaskGAN: Better text generation via filling in the ______. CoRR abs/1801.07736 (2018). arXiv:1801.07736 http://arxiv.org/abs/1801.07736.Google ScholarGoogle Scholar
  12. [12] Fu Yujie, Li Xiaoli, Li Yang, Wang Suge, Li Deyu, Liao Jian, and Zheng Jianxing. 2022. Incorporate opinion-towards for stance detection. Knowledge-Based Systems (2022), 108657.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. [13] Ganin Yaroslav, Ustinova Evgeniya, Ajakan Hana, Germain Pascal, Larochelle Hugo, Laviolette François, Marchand Mario, and Lempitsky Victor S.. 2016. Domain-adversarial training of neural networks. Machine Learning Research 17, 59 (2016), 1–35.Google ScholarGoogle Scholar
  14. [14] Glandt Kyle, Khanal Sarthak, Li Yingjie, Caragea Doina, and Caragea Cornelia. 2021. Stance detection in COVID-19 tweets. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 15961611. Google ScholarGoogle ScholarCross RefCross Ref
  15. [15] Goodfellow Ian J., Pouget-Abadie Jean, Mirza Mehdi, Xu Bing, Warde-Farley David, Ozair Sherjil, Courville Aaron C., and Bengio Yoshua. 2014. Generative adversarial nets. In Proceedings of Advances in Neural Information Processing Systems. 26722680.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. [16] Gui Tao, Zhang Qi, Huang Haoran, Peng Minlong, and Huang Xuanjing. 2017. Part-of-speech tagging for Twitter with adversarial neural networks. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 24112420. Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Habernal Ivan and Gurevych Iryna. 2016. Which argument is more convincing? Analyzing and predicting convincingness of Web arguments using bidirectional LSTM. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. The Association for Computer Linguistics, 15891599. Google ScholarGoogle ScholarCross RefCross Ref
  18. [18] Hardalov Momchil, Arora Arnav, Nakov Preslav, and Augenstein Isabelle. 2021. Cross-domain label-adaptive stance detection. CoRR abs/2104.07467 (2021). arXiv:2104.07467 https://arxiv.53yu.com/abs/2104.07467.Google ScholarGoogle Scholar
  19. [19] Hasan Kazi Saidul and Ng Vincent. 2013. Stance classification of ideological debates: Data, models, features, and constraints. In Proceedings of the 6th International Joint Conference on Natural Language Processing. 13481356.Google ScholarGoogle Scholar
  20. [20] Hasan Kazi Saidul and Ng Vincent. 2014. Why are you taking this stance? Identifying and classifying reasons in ideological debates. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 751762. Google ScholarGoogle ScholarCross RefCross Ref
  21. [21] Hochreiter Sepp and Schmidhuber Jürgen. 1997. Long short-term memory. Neural Comput. 9, 8 (1997), 17351780. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. [22] Hosseinia Marjan, Dragut Eduard C., and Mukherjee Arjun. 2020. Stance prediction for contemporary issues: Data and experiments. In Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media, SocialNLP@ACL 2020, Online, July 10, 2020. Association for Computational Linguistics, 3240. Google ScholarGoogle ScholarCross RefCross Ref
  23. [23] Huang Xuancheng, Xu Jingfang, Sun Maosong, and Liu Yang. 2021. Transfer learning for sequence generation: From single-source to multi-source. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 57385750. Google ScholarGoogle ScholarCross RefCross Ref
  24. [24] Jayaram Sahil and Allaway Emily. 2021. Human rationales as attribution priors for explainable stance detection. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 55405554.Google ScholarGoogle ScholarCross RefCross Ref
  25. [25] Jiachen Du, Ruifeng Xu, Yulan He, and Lin Gui. 2017. Stance classification with target-specific neural attention networks. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 39883994.Google ScholarGoogle Scholar
  26. [26] Li Chang, Porco Aldo, and Goldwasser Dan. 2018. Structured representation learning for online debate stance prediction. In Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics, 37283739.Google ScholarGoogle Scholar
  27. [27] Li Yingjie and Caragea Cornelia. 2019. Multi-task stance detection with sentiment and stance lexicons. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, 62986304. Google ScholarGoogle ScholarCross RefCross Ref
  28. [28] Li Yingjie and Caragea Cornelia. 2021. A multi-task learning framework for multi-target stance detection. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. 23202326.Google ScholarGoogle Scholar
  29. [29] Li Yingjie and Caragea Cornelia. 2021. Target-aware data augmentation for stance detection. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 18501860. Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Liu Rui, Lin Zheng, Fu Peng, Liu Yuanxin, and Wang Weiping. 2022. Connecting targets via latent topics and contrastive learning: A unified framework for robust zero-shot and few-shot stance detection. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 78127816.Google ScholarGoogle ScholarCross RefCross Ref
  31. [31] Liu Xiaodong, Gao Jianfeng, He Xiaodong, Deng Li, Duh Kevin, and Wang Ye-Yi. 2015. Representation learning using multi-task deep neural networks for semantic classification and information retrieval. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 912921.Google ScholarGoogle ScholarCross RefCross Ref
  32. [32] Liu Xiaodong, He Pengcheng, Chen Weizhu, and Gao Jianfeng. 2019. Multi-task deep neural networks for natural language understanding. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 44874496.Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Mikolov Tomás, Sutskever Ilya, Chen Kai, Corrado Gregory S., and Dean Jeffrey. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of Advances in Neural Information Processing Systems. 31113119.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. [34] Miyato Takeru, Maeda Shin-Ichi, Koyama Masanori, and Ishii Shin. 2019. Virtual adversarial training: A regularization method for supervised and semi-supervised learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 8 (2019), 19791993. Google ScholarGoogle ScholarCross RefCross Ref
  35. [35] Mohammad Saif, Kiritchenko Svetlana, Sobhani Parinaz, Zhu Xiao-Dan, and Cherry Colin. 2016. SemEval-2016 task 6: Detecting stance in tweets. In Proceedings of the 10th International Workshop on Semantic Evaluation. The Association for Computer Linguistics, 3141. Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Pan Sinno Jialin, Ni Xiaochuan, Sun Jian-Tao, Yang Qiang, and Chen Zheng. 2010. Cross-domain sentiment classification via spectral feature alignment. In Proceedings of the 19th International Conference on World Wide Web. ACM, 751760. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. [37] Pereira Lis, Liu Xiaodong, Cheng Fei, Asahara Masayuki, and Kobayashi Ichiro. 2020. Adversarial training for commonsense inference. In Proceedings of the 5th Workshop on Representation Learning for NLP. 5560.Google ScholarGoogle ScholarCross RefCross Ref
  38. [38] Persing Isaac and Ng Vincent. 2016. Modeling stance in student essays. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. The Association for Computer Linguistics, 21742184. Google ScholarGoogle ScholarCross RefCross Ref
  39. [39] Radford Alec, Metz Luke, and Chintala Soumith. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. CoRR abs/1511.06434 (2015). http://arxiv.org/abs/1511.06434.Google ScholarGoogle Scholar
  40. [40] Schiller Benjamin, Daxenberger Johannes, and Gurevych Iryna. 2021. Stance detection benchmark: How robust is your stance detection? KI-Künstliche Intelligenz 35 (2021), 329341. Google ScholarGoogle ScholarCross RefCross Ref
  41. [41] Sobhani Parinaz, Mohammad Saif, and Kiritchenko Svetlana. 2016. Detecting stance in tweets and analyzing its interaction with sentiment. In Proceedings of the 5th Joint Conference on Lexical and Computational Semantics. 159169. Google ScholarGoogle ScholarCross RefCross Ref
  42. [42] Sridhar Dhanya, Foulds James R., Huang Bert, Getoor Lise, and Walker Marilyn A.. 2015. Joint models of disagreement and stance in online debate. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing. The Association for Computer Linguistics, 116125. Google ScholarGoogle ScholarCross RefCross Ref
  43. [43] Swapna Somasundaran and Janyce Wiebe. 2010. Recognizing stances in ideological on-line debates. In Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text. 116124.Google ScholarGoogle Scholar
  44. [44] Thomas Matt, Pang Bo, and Lee Lillian. 2006. Get out the vote: Determining support or opposition from Congressional floor-debate transcripts. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 327335.Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. [45] Wang Zhongqing, Sun Qingying, Li Shoushan, Zhu Qiaoming, and Zhou Guodong. 2020. Neural stance detection with hierarchical linguistic representations. IEEE ACM Trans. Audio Speech Lang. Process. 28 (2020), 635645. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. [46] Wei Penghui and Mao Wenji. 2019. Modeling transferable topics for cross-target stance detection. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 11731176. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. [47] Wei Wan, Zhang Xiao, Liu Xuqin, Chen Wei, and Wang Tengjiao. 2016. pkudblab at SemEval-2016 task 6 : A specific convolutional neural network system for effective stance detection. In Proceedings of the 10th International Workshop on Semantic Evaluation. The Association for Computer Linguistics, 384388. Google ScholarGoogle ScholarCross RefCross Ref
  48. [48] Xu Chang, Paris Cécile, Nepal Surya, and Sparks Ross. 2018. Cross-target stance classification with self-attention networks. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 778783. Google ScholarGoogle ScholarCross RefCross Ref
  49. [49] Xu Chang, Paris Cécile, Nepal Surya, and Sparks Ross. 2019. Recognising agreement and disagreement between stances with reason comparing networks. In Proceedings of the 57th Conference of the Association for Computational Linguistics. Association for Computational Linguistics, 46654671. Google ScholarGoogle ScholarCross RefCross Ref
  50. [50] Zarrella Guido and Marsh Amy. 2016. MITRE at SemEval-2016 task 6: Transfer learning for stance detection. In Proceedings of the 10th International Workshop on Semantic Evaluation. The Association for Computer Linguistics, 458463. Google ScholarGoogle ScholarCross RefCross Ref
  51. [51] Zhang Bowen, Yang Min, Li Xutao, Ye Yunming, Xu Xiaofei, and Dai Kuai. 2020. Enhancing cross-target stance detection with transferable semantic-emotion knowledge. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 31883197. Google ScholarGoogle ScholarCross RefCross Ref
  52. [52] Zhang Xin, Xu Guangwei, Sun Yueheng, Zhang Meishan, and Xie Pengjun. 2021. Crowdsourcing learning as domain adaptation: A case study on named entity recognition. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, 55585570.Google ScholarGoogle ScholarCross RefCross Ref
  53. [53] Ziser Yftah and Reichart Roi. 2017. Neural structural correspondence learning for domain adaptation. In Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL’17). Association for Computational Linguistics, 400410. Google ScholarGoogle ScholarCross RefCross Ref
  54. [54] Zou Bowei, Xu Zengzhuang, Hong Yu, and Zhou Guodong. 2018. Adversarial feature adaptation for cross-lingual relation classification. In Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics, 437448.Google ScholarGoogle Scholar

Index Terms

  1. Stance Detection with a Multi-Target Adversarial Attention Network

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Asian and Low-Resource Language Information Processing
      ACM Transactions on Asian and Low-Resource Language Information Processing  Volume 22, Issue 2
      February 2023
      624 pages
      ISSN:2375-4699
      EISSN:2375-4702
      DOI:10.1145/3572719
      Issue’s Table of Contents

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 December 2022
      • Online AM: 16 June 2022
      • Accepted: 6 June 2022
      • Revised: 15 May 2022
      • Received: 10 September 2021
      Published in tallip Volume 22, Issue 2

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    View Full Text

    HTML Format

    View this article in HTML Format .

    View HTML Format