skip to main content
10.1145/3366423.3380273acmconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article

Don’t Let Me Be Misunderstood:Comparing Intentions and Perceptions in Online Discussions

Published:20 April 2020Publication History

ABSTRACT

Discourse involves two perspectives: a person’s intention in making an utterance and others’ perception of that utterance. The misalignment between these perspectives can lead to undesirable outcomes, such as misunderstandings, low productivity and even overt strife. In this work, we present a computational framework for exploring and comparing both perspectives in online public discussions.

We combine logged data about public comments on Facebook with a survey of over 16,000 people about their intentions in writing these comments or about their perceptions of comments that others had written. Unlike previous studies of online discussions that have largely relied on third-party labels to quantify properties such as sentiment and subjectivity, our approach also directly captures what the speakers actually intended when writing their comments. In particular, our analysis focuses on judgments of whether a comment is stating a fact or an opinion, since these concepts were shown to be often confused.

We show that intentions and perceptions diverge in consequential ways. People are more likely to perceive opinions than to intend them, and linguistic cues that signal how an utterance is intended can differ from those that signal how it will be perceived. Further, this misalignment between intentions and perceptions can be linked to the future health of a conversation: when a comment whose author intended to share a fact is misperceived as sharing an opinion, the subsequent conversation is more likely to derail into uncivil behavior than when the comment is perceived as intended. Altogether, these findings may inform the design of discussion platforms that better promote positive interactions.

References

  1. Tim Althoff, Kevin Clark, and Jure Leskovec. 2016. Large-Scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health. Transactions of the Association for Computational Linguistics (Dec. 2016).Google ScholarGoogle ScholarCross RefCross Ref
  2. Pablo Aragón, Vicenç Gómez, David García, and Andreas Kaltenbrunner. 2017. Generative Models of Online Discussion Threads: State of the Art and Research Challenges. Journal of Internet Services and Applications 8, 15 (Dec. 2017).Google ScholarGoogle ScholarCross RefCross Ref
  3. Yoav Artzi, Patrick Pantel, and Michael Gamon. 2012. Predicting Responses to Microblog Posts. In Proceedings of NAACL.Google ScholarGoogle Scholar
  4. Azin Ashkan, Charles L. A. Clarke, Eugene Agichtein, and Qi Guo. 2009. Classifying and Characterizing Query Intent. In Advances in Information Retrieval, Mohand Boughanem, Catherine Berrut, Josiane Mothe, and Chantal Soule-Dupuy (Eds.). Springer Berlin Heidelberg.Google ScholarGoogle Scholar
  5. Lars Backstrom, Jon Kleinberg, Lillian Lee, and Cristian Danescu-Niculescu-Mizil. 2013. Characterizing and Curating Conversation Threads: Expansion, Focus, Volume, Re-Entry. In Proceedings of WSDM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. David Bamman and Noah A. Smith. 2015. Contextualized Sarcasm Detection on Twitter. In Proceedings of ICWSM.Google ScholarGoogle Scholar
  7. David J. Brenes, Daniel Gayo-Avello, and Kilian Pérez-González. 2009. Survey and Evaluation of Query Intent Detection Methods. In Proceedings of the 2009 Workshop on Web Search Click Data.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Andrei Broder. 2002. A Taxonomy of Web Search. ACM SIGIR Forum 36, 2 (Jan. 2002).Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Mark Brown, Nigel Pope, and Kevin Voges. 2003. Buying or Browsing? An Exploration of Shopping Orientations and Online Purchase Intention. European Journal of Marketing 37, 11/12 (Dec. 2003).Google ScholarGoogle ScholarCross RefCross Ref
  10. Penelope Brown and Stephen C Levinson. 1987. Politeness: Some Universals in Language Usage. Cambridge University Press.Google ScholarGoogle ScholarCross RefCross Ref
  11. Anais Cadilhac, Nicholas Asher, Farah Benamara, and Alex Lascarides. 2013. Grounding Strategic Conversation: Using Negotiation Dialogues to Predict Trades in a Win-Lose Game. In Proceedings of EMNLP.Google ScholarGoogle Scholar
  12. Vitor R. Carvalho. 2011. Modeling Intention in Email - Speech Acts, Information Leaks and Recommendation Models. In Studies in Computational Intelligence.Google ScholarGoogle Scholar
  13. Jonathan P. Chang and Cristian Danescu-Niculescu-Mizil. 2019. Trajectories of Blocked Community Members: Redemption, Recidivism and Departure. In Proceedings of WWW.Google ScholarGoogle Scholar
  14. Herbert H Clark. 1996. Using Language (seconded.). Cambridge University Press.Google ScholarGoogle Scholar
  15. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research 12, Aug (2011).Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Victor Corral-Verdugo. 1993. The Effect of Examples and Gender on Third Graders’ Ability to Distinguish Environmental Facts from Opinions. The Journal of Environmental Education 24, 4 (July 1993).Google ScholarGoogle ScholarCross RefCross Ref
  17. Naomi Craker and Evita March. 2016. The Dark Side of Facebook®: The Dark Tetrad, Negative Social Potency, and Trolling Behaviours. Personality and Individual Differences 102 (Nov. 2016).Google ScholarGoogle Scholar
  18. Jared R. Curhan and Alex Pentland. 2007. Thin Slices of Negotiation: Predicting Outcomes From Conversational Dynamics Within the First 5 Minutes.Journal of Applied Psychology 92 (May 2007).Google ScholarGoogle Scholar
  19. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL.Google ScholarGoogle Scholar
  20. Raffaele Filieri. 2016. What Makes an Online Consumer Review Trustworthy?Annals of Tourism Research 58 (May 2016).Google ScholarGoogle Scholar
  21. Lei Gao and Ruihong Huang. 2017. Detecting Online Hate Speech Using Context Aware Models. In Proceedings of RANLP.Google ScholarGoogle ScholarCross RefCross Ref
  22. Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2017. Quantifying Controversy in Social Media. ACM Transactions on Social Computing 1, 1 (2017).Google ScholarGoogle Scholar
  23. Debanjan Ghosh, Alexander Richard Fabbri, and Smaranda Muresan. 2017. The Role of Conversation Context for Sarcasm Detection in Online Interactions. In Proceedings of SIGDIAL.Google ScholarGoogle ScholarCross RefCross Ref
  24. Leonard M. Giambra, Cameron J. Camp, and Alicia Grodsky. 1992. Curiosity and Stimulation Seeking across the Adult Life Span: Cross-Sectional and 6- to 8-Year Longitudinal Findings. Psychology and Aging 7, 1 (1992).Google ScholarGoogle Scholar
  25. Roberto González-Ibáñez, Smaranda Muresan, and Nina Wacholder. 2011. Identifying Sarcasm in Twitter: A Closer Look. In Proceedings of ACL.Google ScholarGoogle Scholar
  26. Barbara J. Grosz and Candace L. Sidner. 1986. Attention, Intentions, and the Structure of Discourse. Computational Linguistics 12, 3 (July 1986).Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Andrew Guess, Jonathan Nagler, and Joshua Tucker. 2019. Less than You Think: Prevalence and Predictors of Fake News Dissemination on Facebook. Science Advances 5, 1 (Jan. 2019).Google ScholarGoogle ScholarCross RefCross Ref
  28. Ido Guy, Victor Makarenkov, Niva Hazon, Lior Rokach, and Bracha Shapira. 2018. Identifying Informational vs. Conversational Questions on Community Question Answering Archives. In Proceedings of WSDM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Alan Hanjalic, Christoph Kofler, and Martha Larson. 2012. Intent and Its Discontents: The User at the Wheel of the Online Video Search Engine. In Proceedings of MM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. F. Maxwell Harper, Daniel Moy, and Joseph A. Konstan. 2009. Facts or Friends?: Distinguishing Informational and Conversational Questions in Social Q&A Sites. In Proceedings of CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Homa B Hashemi, Amir Asiaee, and Reiner Kraft. 2016. Query Intent Detection Using Convolutional Neural Networks. In Proceedings of QRUMS.Google ScholarGoogle Scholar
  32. Jack Hessel and Lillian Lee. 2019. Something’s Brewing! Early Prediction of Controversy-Causing Posts from Discussion Features. In Proceedings of NAACL.Google ScholarGoogle Scholar
  33. Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019. “Did You Suspect the Post Would Be Removed?”: Understanding User Reactions to Content Removals on Reddit. In Proceedings of CSCW, Vol. 1.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Seunga Venus Jin and Cassie Martin. 2015. “A Match Made...Online?” The Effects of User-Generated Online Dater Profile Types (Free-Spirited Versus Uptight) on Other Users’ Perception of Trustworthiness, Interpersonal Attraction, and Personality. Cyberpsychology, Behavior, and Social Networking 18, 6 (June 2015).Google ScholarGoogle Scholar
  35. Andrew Kehler and Hannah Rohde. 2017. Evaluating an Expectation-Driven Question-Under-Discussion Model of Discourse Interpretation. Discourse Processes 54, 3 (April 2017).Google ScholarGoogle ScholarCross RefCross Ref
  36. Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In Proceedings of EMNLP.Google ScholarGoogle ScholarCross RefCross Ref
  37. Ravi Kumar, Mohammad Mahdian, and Mary McGlohon. 2010. Dynamics of Conversations. In Proceedings of KDD.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Elisabeth Lex, Andreas Juffinger, and Michael Granitzer. 2010. Objectivity Classification in Online Media. In Proceedings of HT.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Elisabeth Lex, Michael Voelske, Marcelo Errecalde, Edgardo Ferretti, Leticia Cagnina, Christopher Horn, Benno Stein, and Michael Granitzer. 2012. Measuring the Quality of Web Content Using Factual Information. In Proceedings of WebQuality.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Chenghua Lin, Yulan He, and Richard Everson. 2011. Sentence Subjectivity Detection with Weakly-Supervised Learning. In Proceedings of IJCNLP.Google ScholarGoogle Scholar
  41. Chu-Cheng Lin, Dongyeop Kang, Michael Gamon, and Patrick Pantel. 2018. Actionable Email Intent Modeling With Reparametrized RNNs. In Proceedings of AAAI.Google ScholarGoogle Scholar
  42. Kwek Choon Ling, Lau Teck Chai, and Tan Hoi Piew. 2010. The Effects of Shopping Orientations, Online Trust and Prior Online Purchase Experience toward Customers’ Online Purchase Intention. International Business Research 3, 3 (June 2010).Google ScholarGoogle ScholarCross RefCross Ref
  43. Bing Liu. 2010. Sentiment Analysis and Subjectivity. In Handbook of Natural Language Processing (2nd ed.).Google ScholarGoogle Scholar
  44. Ping Liu, Joshua Guberman, Libby Hemphill, and Aron Culotta. 2018. Forecasting the Presence and Intensity of Hostility on Instagram Using Linguistic and Social Features. In Proceedings of ICWSM.Google ScholarGoogle ScholarCross RefCross Ref
  45. Zhe Liu and Bernard J. Jansen. 2015. A Taxonomy for Classifying Questions Asked in Social Question and Answering. In Proceedings of CHI Extended Abstracts.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Heidi McKee. 2002. “YOUR VIEWS SHOWED TRUE IGNORANCE!!!”: (Mis)Communication in an Online Interracial Discussion Forum. Computers and Composition 19, 4 (Dec. 2002).Google ScholarGoogle ScholarCross RefCross Ref
  47. Amy Mitchell, Jeffrey Gottfried, Michael Barthel, and Nami Sumida. 2018. Distinguishing Between Factual and Opinion Statements in the News. https://www.journalism.org/2018/06/18/distinguishing-between-factual-and-opinion-statements-in-the-news/.Google ScholarGoogle Scholar
  48. Peter J. Moor, Ard Heuvelman, and Ria Verleur. 2010. Flaming on YouTube. Computers in Human Behavior 26, 6 (Nov. 2010).Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Meredith Ringel Morris, Jaime Teevan, and Katrina Panovich. 2010. What Do People Ask Their Social Networks, and Why?: A Survey Study of Status Message Q&a Behavior. In Proceedings of CHI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Gabriel Murray and Giuseppe Carenini. 2011. Subjectivity Detection in Spoken and Written Conversations. Natural Language Engineering 17, 3 (July 2011).Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Silvia Quarteroni, Alexei V. Ivanov, and Giuseppe Riccardi. 2011. Simultaneous Dialog Act Segmentation and Classification from Human-Human Spoken Conversations. In Proceedings of ICASSP.Google ScholarGoogle ScholarCross RefCross Ref
  52. Randolph Quirk, Sidney Greenbaum, Geoffrey Leech, and Jan Svartvik. 1985. A Comprehensive Grammar of the English Language. Longman, New York.Google ScholarGoogle Scholar
  53. Mitchell Rabinowitz, Maria Acevedo, Sara Casen, Myriah Rosengarten, Martha Kowalczyk, and Lindsay Blau Portnoy. 2013. Distinguishing Facts from Beliefs: Fuzzy Categories. Psychology of Language and Communication 17, 3 (Dec. 2013).Google ScholarGoogle Scholar
  54. Santosh Regmi and Bal Krishna Bal. 2015. What Make Facts Stand Out from Opinions? Distinguishing Facts from Opinions in News Media. Creativity in Intelligent Technologies and Data Science 535 (2015).Google ScholarGoogle Scholar
  55. Antonio Reyes, Paolo Rosso, and Davide Buscaldi. 2012. From Humor Recognition to Irony Detection: The Figurative Language of Social Media. Data & Knowledge Engineering 74 (April 2012).Google ScholarGoogle Scholar
  56. Ellen Riloff, Janyce Wiebe, and William Phillips. 2005. Exploiting Subjectivity Classification to Improve Information Extraction. In Proceedings of AAAI.Google ScholarGoogle Scholar
  57. S. Shyam Sundar. 1998. Effect of Source Attribution on Perception of Online News Stories. Journalism & Mass Communication Quarterly 75, 1 (March 1998).Google ScholarGoogle ScholarCross RefCross Ref
  58. Deborah Tannen. 2000. Indirectness at Work. In Language in Action: New Studies of Language in Society, Festschrift for Roger Shuy.Google ScholarGoogle Scholar
  59. Deborah Tannen. 2005. Conversational Style : Analyzing Talk among Friends. Oxford University Press, New York.Google ScholarGoogle Scholar
  60. Richard Valliant. 1993. Poststratification and Conditional Variance Estimation. J. Amer. Statist. Assoc. 88, 421 (March 1993).Google ScholarGoogle Scholar
  61. Hans van der Heijden, Tibert Verhagen, and Marcel Creemers. 2001. Predicting Online Purchase Behavior: Replications and Tests of Competing Models. In Proceedings of HICSS.Google ScholarGoogle ScholarCross RefCross Ref
  62. Wei Wang, Saghar Hosseini, Ahmed Hassan Awadallah, Paul N. Bennett, and Chris Quirk. 2019. Context-Aware Intent Identification in Email Conversations. In Proceedings of SIGIR.Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Janyce Wiebe, Eric Breck, Chris Buckley, Claire Cardie, Paul Davis, Bruce Fraser, Diane Litman, David Pierce, Ellen Riloff, Theresa Wilson, David Day, and Mark Maybury. 2003. Recognizing and Organizing Opinions Expressed in the World Press. In AAAI Symposium on New Directions in Question Answering.Google ScholarGoogle Scholar
  64. Janyce Wiebe, Theresa Wilson, Rebecca Bruce, Matthew Bell, and Melanie Martin. 2004. Learning Subjective Language. Computational Linguistics 30, 3 (Sept. 2004).Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Janyce Wiebe, Theresa Wilson, and Claire Cardie. 2005. Annotating Expressions of Opinions and Emotions in Language. Language Resources and Evaluation 39, 2 (May 2005).Google ScholarGoogle ScholarCross RefCross Ref
  66. Janyce M. Wiebe, Rebecca F. Bruce, and Thomas P. O’Hara. 1999. Development and Use of a Gold-Standard Data Set for Subjectivity Classifications. In Proceedings of ACL.Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Ainur Yessenalina, Yisong Yue, and Claire Cardie. 2010. Multi-Level Structured Models for Document-Level Sentiment Classification. In Proceedings of EMNLP. Cambridge, Massachusetts.Google ScholarGoogle Scholar
  68. Hong Yu and Vasileios Hatzivassiloglou. 2003. Towards Answering Opinion Questions: Separating Facts from Opinions and Identifying the Polarity of Opinion Sentences. In Proceedings of EMNLP.Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Justine Zhang, Jonathan P. Chang, Cristian Danescu-Niculescu-Mizil, Lucas Dixon, Nithum Thain, Yiqing Hua, and Dario Taraborelli. 2018. Conversations Gone Awry: Detecting Early Signs of Conversational Failure. In Proceedings of ACL.Google ScholarGoogle ScholarCross RefCross Ref
  70. Justine Zhang, Arthur Spirling, and Cristian Danescu-Niculescu-Mizil. 2017. Asking Too Much? The Rhetorical Role of Questions in Political Discourse. In Proceedings of EMNLP.Google ScholarGoogle ScholarCross RefCross Ref
  71. Xiang Zhang and Yann LeCun. 2015. Text Understanding from Scratch. Technical Report.Google ScholarGoogle Scholar

Index Terms

  1. Don’t Let Me Be Misunderstood:Comparing Intentions and Perceptions in Online Discussions
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        WWW '20: Proceedings of The Web Conference 2020
        April 2020
        3143 pages
        ISBN:9781450370233
        DOI:10.1145/3366423

        Copyright © 2020 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 20 April 2020

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate1,899of8,196submissions,23%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format