ABSTRACT
Discourse involves two perspectives: a person’s intention in making an utterance and others’ perception of that utterance. The misalignment between these perspectives can lead to undesirable outcomes, such as misunderstandings, low productivity and even overt strife. In this work, we present a computational framework for exploring and comparing both perspectives in online public discussions.
We combine logged data about public comments on Facebook with a survey of over 16,000 people about their intentions in writing these comments or about their perceptions of comments that others had written. Unlike previous studies of online discussions that have largely relied on third-party labels to quantify properties such as sentiment and subjectivity, our approach also directly captures what the speakers actually intended when writing their comments. In particular, our analysis focuses on judgments of whether a comment is stating a fact or an opinion, since these concepts were shown to be often confused.
We show that intentions and perceptions diverge in consequential ways. People are more likely to perceive opinions than to intend them, and linguistic cues that signal how an utterance is intended can differ from those that signal how it will be perceived. Further, this misalignment between intentions and perceptions can be linked to the future health of a conversation: when a comment whose author intended to share a fact is misperceived as sharing an opinion, the subsequent conversation is more likely to derail into uncivil behavior than when the comment is perceived as intended. Altogether, these findings may inform the design of discussion platforms that better promote positive interactions.
- Tim Althoff, Kevin Clark, and Jure Leskovec. 2016. Large-Scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health. Transactions of the Association for Computational Linguistics (Dec. 2016).Google ScholarCross Ref
- Pablo Aragón, Vicenç Gómez, David García, and Andreas Kaltenbrunner. 2017. Generative Models of Online Discussion Threads: State of the Art and Research Challenges. Journal of Internet Services and Applications 8, 15 (Dec. 2017).Google ScholarCross Ref
- Yoav Artzi, Patrick Pantel, and Michael Gamon. 2012. Predicting Responses to Microblog Posts. In Proceedings of NAACL.Google Scholar
- Azin Ashkan, Charles L. A. Clarke, Eugene Agichtein, and Qi Guo. 2009. Classifying and Characterizing Query Intent. In Advances in Information Retrieval, Mohand Boughanem, Catherine Berrut, Josiane Mothe, and Chantal Soule-Dupuy (Eds.). Springer Berlin Heidelberg.Google Scholar
- Lars Backstrom, Jon Kleinberg, Lillian Lee, and Cristian Danescu-Niculescu-Mizil. 2013. Characterizing and Curating Conversation Threads: Expansion, Focus, Volume, Re-Entry. In Proceedings of WSDM.Google ScholarDigital Library
- David Bamman and Noah A. Smith. 2015. Contextualized Sarcasm Detection on Twitter. In Proceedings of ICWSM.Google Scholar
- David J. Brenes, Daniel Gayo-Avello, and Kilian Pérez-González. 2009. Survey and Evaluation of Query Intent Detection Methods. In Proceedings of the 2009 Workshop on Web Search Click Data.Google ScholarDigital Library
- Andrei Broder. 2002. A Taxonomy of Web Search. ACM SIGIR Forum 36, 2 (Jan. 2002).Google ScholarDigital Library
- Mark Brown, Nigel Pope, and Kevin Voges. 2003. Buying or Browsing? An Exploration of Shopping Orientations and Online Purchase Intention. European Journal of Marketing 37, 11/12 (Dec. 2003).Google ScholarCross Ref
- Penelope Brown and Stephen C Levinson. 1987. Politeness: Some Universals in Language Usage. Cambridge University Press.Google ScholarCross Ref
- Anais Cadilhac, Nicholas Asher, Farah Benamara, and Alex Lascarides. 2013. Grounding Strategic Conversation: Using Negotiation Dialogues to Predict Trades in a Win-Lose Game. In Proceedings of EMNLP.Google Scholar
- Vitor R. Carvalho. 2011. Modeling Intention in Email - Speech Acts, Information Leaks and Recommendation Models. In Studies in Computational Intelligence.Google Scholar
- Jonathan P. Chang and Cristian Danescu-Niculescu-Mizil. 2019. Trajectories of Blocked Community Members: Redemption, Recidivism and Departure. In Proceedings of WWW.Google Scholar
- Herbert H Clark. 1996. Using Language (seconded.). Cambridge University Press.Google Scholar
- Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research 12, Aug (2011).Google ScholarDigital Library
- Victor Corral-Verdugo. 1993. The Effect of Examples and Gender on Third Graders’ Ability to Distinguish Environmental Facts from Opinions. The Journal of Environmental Education 24, 4 (July 1993).Google ScholarCross Ref
- Naomi Craker and Evita March. 2016. The Dark Side of Facebook®: The Dark Tetrad, Negative Social Potency, and Trolling Behaviours. Personality and Individual Differences 102 (Nov. 2016).Google Scholar
- Jared R. Curhan and Alex Pentland. 2007. Thin Slices of Negotiation: Predicting Outcomes From Conversational Dynamics Within the First 5 Minutes.Journal of Applied Psychology 92 (May 2007).Google Scholar
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL.Google Scholar
- Raffaele Filieri. 2016. What Makes an Online Consumer Review Trustworthy?Annals of Tourism Research 58 (May 2016).Google Scholar
- Lei Gao and Ruihong Huang. 2017. Detecting Online Hate Speech Using Context Aware Models. In Proceedings of RANLP.Google ScholarCross Ref
- Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2017. Quantifying Controversy in Social Media. ACM Transactions on Social Computing 1, 1 (2017).Google Scholar
- Debanjan Ghosh, Alexander Richard Fabbri, and Smaranda Muresan. 2017. The Role of Conversation Context for Sarcasm Detection in Online Interactions. In Proceedings of SIGDIAL.Google ScholarCross Ref
- Leonard M. Giambra, Cameron J. Camp, and Alicia Grodsky. 1992. Curiosity and Stimulation Seeking across the Adult Life Span: Cross-Sectional and 6- to 8-Year Longitudinal Findings. Psychology and Aging 7, 1 (1992).Google Scholar
- Roberto González-Ibáñez, Smaranda Muresan, and Nina Wacholder. 2011. Identifying Sarcasm in Twitter: A Closer Look. In Proceedings of ACL.Google Scholar
- Barbara J. Grosz and Candace L. Sidner. 1986. Attention, Intentions, and the Structure of Discourse. Computational Linguistics 12, 3 (July 1986).Google ScholarDigital Library
- Andrew Guess, Jonathan Nagler, and Joshua Tucker. 2019. Less than You Think: Prevalence and Predictors of Fake News Dissemination on Facebook. Science Advances 5, 1 (Jan. 2019).Google ScholarCross Ref
- Ido Guy, Victor Makarenkov, Niva Hazon, Lior Rokach, and Bracha Shapira. 2018. Identifying Informational vs. Conversational Questions on Community Question Answering Archives. In Proceedings of WSDM.Google ScholarDigital Library
- Alan Hanjalic, Christoph Kofler, and Martha Larson. 2012. Intent and Its Discontents: The User at the Wheel of the Online Video Search Engine. In Proceedings of MM.Google ScholarDigital Library
- F. Maxwell Harper, Daniel Moy, and Joseph A. Konstan. 2009. Facts or Friends?: Distinguishing Informational and Conversational Questions in Social Q&A Sites. In Proceedings of CHI.Google ScholarDigital Library
- Homa B Hashemi, Amir Asiaee, and Reiner Kraft. 2016. Query Intent Detection Using Convolutional Neural Networks. In Proceedings of QRUMS.Google Scholar
- Jack Hessel and Lillian Lee. 2019. Something’s Brewing! Early Prediction of Controversy-Causing Posts from Discussion Features. In Proceedings of NAACL.Google Scholar
- Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019. “Did You Suspect the Post Would Be Removed?”: Understanding User Reactions to Content Removals on Reddit. In Proceedings of CSCW, Vol. 1.Google ScholarDigital Library
- Seunga Venus Jin and Cassie Martin. 2015. “A Match Made...Online?” The Effects of User-Generated Online Dater Profile Types (Free-Spirited Versus Uptight) on Other Users’ Perception of Trustworthiness, Interpersonal Attraction, and Personality. Cyberpsychology, Behavior, and Social Networking 18, 6 (June 2015).Google Scholar
- Andrew Kehler and Hannah Rohde. 2017. Evaluating an Expectation-Driven Question-Under-Discussion Model of Discourse Interpretation. Discourse Processes 54, 3 (April 2017).Google ScholarCross Ref
- Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In Proceedings of EMNLP.Google ScholarCross Ref
- Ravi Kumar, Mohammad Mahdian, and Mary McGlohon. 2010. Dynamics of Conversations. In Proceedings of KDD.Google ScholarDigital Library
- Elisabeth Lex, Andreas Juffinger, and Michael Granitzer. 2010. Objectivity Classification in Online Media. In Proceedings of HT.Google ScholarDigital Library
- Elisabeth Lex, Michael Voelske, Marcelo Errecalde, Edgardo Ferretti, Leticia Cagnina, Christopher Horn, Benno Stein, and Michael Granitzer. 2012. Measuring the Quality of Web Content Using Factual Information. In Proceedings of WebQuality.Google ScholarDigital Library
- Chenghua Lin, Yulan He, and Richard Everson. 2011. Sentence Subjectivity Detection with Weakly-Supervised Learning. In Proceedings of IJCNLP.Google Scholar
- Chu-Cheng Lin, Dongyeop Kang, Michael Gamon, and Patrick Pantel. 2018. Actionable Email Intent Modeling With Reparametrized RNNs. In Proceedings of AAAI.Google Scholar
- Kwek Choon Ling, Lau Teck Chai, and Tan Hoi Piew. 2010. The Effects of Shopping Orientations, Online Trust and Prior Online Purchase Experience toward Customers’ Online Purchase Intention. International Business Research 3, 3 (June 2010).Google ScholarCross Ref
- Bing Liu. 2010. Sentiment Analysis and Subjectivity. In Handbook of Natural Language Processing (2nd ed.).Google Scholar
- Ping Liu, Joshua Guberman, Libby Hemphill, and Aron Culotta. 2018. Forecasting the Presence and Intensity of Hostility on Instagram Using Linguistic and Social Features. In Proceedings of ICWSM.Google ScholarCross Ref
- Zhe Liu and Bernard J. Jansen. 2015. A Taxonomy for Classifying Questions Asked in Social Question and Answering. In Proceedings of CHI Extended Abstracts.Google ScholarDigital Library
- Heidi McKee. 2002. “YOUR VIEWS SHOWED TRUE IGNORANCE!!!”: (Mis)Communication in an Online Interracial Discussion Forum. Computers and Composition 19, 4 (Dec. 2002).Google ScholarCross Ref
- Amy Mitchell, Jeffrey Gottfried, Michael Barthel, and Nami Sumida. 2018. Distinguishing Between Factual and Opinion Statements in the News. https://www.journalism.org/2018/06/18/distinguishing-between-factual-and-opinion-statements-in-the-news/.Google Scholar
- Peter J. Moor, Ard Heuvelman, and Ria Verleur. 2010. Flaming on YouTube. Computers in Human Behavior 26, 6 (Nov. 2010).Google ScholarDigital Library
- Meredith Ringel Morris, Jaime Teevan, and Katrina Panovich. 2010. What Do People Ask Their Social Networks, and Why?: A Survey Study of Status Message Q&a Behavior. In Proceedings of CHI.Google ScholarDigital Library
- Gabriel Murray and Giuseppe Carenini. 2011. Subjectivity Detection in Spoken and Written Conversations. Natural Language Engineering 17, 3 (July 2011).Google ScholarDigital Library
- Silvia Quarteroni, Alexei V. Ivanov, and Giuseppe Riccardi. 2011. Simultaneous Dialog Act Segmentation and Classification from Human-Human Spoken Conversations. In Proceedings of ICASSP.Google ScholarCross Ref
- Randolph Quirk, Sidney Greenbaum, Geoffrey Leech, and Jan Svartvik. 1985. A Comprehensive Grammar of the English Language. Longman, New York.Google Scholar
- Mitchell Rabinowitz, Maria Acevedo, Sara Casen, Myriah Rosengarten, Martha Kowalczyk, and Lindsay Blau Portnoy. 2013. Distinguishing Facts from Beliefs: Fuzzy Categories. Psychology of Language and Communication 17, 3 (Dec. 2013).Google Scholar
- Santosh Regmi and Bal Krishna Bal. 2015. What Make Facts Stand Out from Opinions? Distinguishing Facts from Opinions in News Media. Creativity in Intelligent Technologies and Data Science 535 (2015).Google Scholar
- Antonio Reyes, Paolo Rosso, and Davide Buscaldi. 2012. From Humor Recognition to Irony Detection: The Figurative Language of Social Media. Data & Knowledge Engineering 74 (April 2012).Google Scholar
- Ellen Riloff, Janyce Wiebe, and William Phillips. 2005. Exploiting Subjectivity Classification to Improve Information Extraction. In Proceedings of AAAI.Google Scholar
- S. Shyam Sundar. 1998. Effect of Source Attribution on Perception of Online News Stories. Journalism & Mass Communication Quarterly 75, 1 (March 1998).Google ScholarCross Ref
- Deborah Tannen. 2000. Indirectness at Work. In Language in Action: New Studies of Language in Society, Festschrift for Roger Shuy.Google Scholar
- Deborah Tannen. 2005. Conversational Style : Analyzing Talk among Friends. Oxford University Press, New York.Google Scholar
- Richard Valliant. 1993. Poststratification and Conditional Variance Estimation. J. Amer. Statist. Assoc. 88, 421 (March 1993).Google Scholar
- Hans van der Heijden, Tibert Verhagen, and Marcel Creemers. 2001. Predicting Online Purchase Behavior: Replications and Tests of Competing Models. In Proceedings of HICSS.Google ScholarCross Ref
- Wei Wang, Saghar Hosseini, Ahmed Hassan Awadallah, Paul N. Bennett, and Chris Quirk. 2019. Context-Aware Intent Identification in Email Conversations. In Proceedings of SIGIR.Google ScholarDigital Library
- Janyce Wiebe, Eric Breck, Chris Buckley, Claire Cardie, Paul Davis, Bruce Fraser, Diane Litman, David Pierce, Ellen Riloff, Theresa Wilson, David Day, and Mark Maybury. 2003. Recognizing and Organizing Opinions Expressed in the World Press. In AAAI Symposium on New Directions in Question Answering.Google Scholar
- Janyce Wiebe, Theresa Wilson, Rebecca Bruce, Matthew Bell, and Melanie Martin. 2004. Learning Subjective Language. Computational Linguistics 30, 3 (Sept. 2004).Google ScholarDigital Library
- Janyce Wiebe, Theresa Wilson, and Claire Cardie. 2005. Annotating Expressions of Opinions and Emotions in Language. Language Resources and Evaluation 39, 2 (May 2005).Google ScholarCross Ref
- Janyce M. Wiebe, Rebecca F. Bruce, and Thomas P. O’Hara. 1999. Development and Use of a Gold-Standard Data Set for Subjectivity Classifications. In Proceedings of ACL.Google ScholarDigital Library
- Ainur Yessenalina, Yisong Yue, and Claire Cardie. 2010. Multi-Level Structured Models for Document-Level Sentiment Classification. In Proceedings of EMNLP. Cambridge, Massachusetts.Google Scholar
- Hong Yu and Vasileios Hatzivassiloglou. 2003. Towards Answering Opinion Questions: Separating Facts from Opinions and Identifying the Polarity of Opinion Sentences. In Proceedings of EMNLP.Google ScholarDigital Library
- Justine Zhang, Jonathan P. Chang, Cristian Danescu-Niculescu-Mizil, Lucas Dixon, Nithum Thain, Yiqing Hua, and Dario Taraborelli. 2018. Conversations Gone Awry: Detecting Early Signs of Conversational Failure. In Proceedings of ACL.Google ScholarCross Ref
- Justine Zhang, Arthur Spirling, and Cristian Danescu-Niculescu-Mizil. 2017. Asking Too Much? The Rhetorical Role of Questions in Political Discourse. In Proceedings of EMNLP.Google ScholarCross Ref
- Xiang Zhang and Yann LeCun. 2015. Text Understanding from Scratch. Technical Report.Google Scholar
Index Terms
- Don’t Let Me Be Misunderstood:Comparing Intentions and Perceptions in Online Discussions
Recommendations
Understanding Egyptian Consumers' Intentions in Online Shopping
The purpose of this article is to investigate the factors that impact on Egyptian consumers' attitudes and intentions to use online shopping by integrating the technology acceptance models of Davis, and Fishbein and Ajzen's theory of reasoned action. In ...
Understanding online purchase intentions: contributions from technology and trust perspectives
This paper explores factors that influence consumer's intentions to purchase online at an electronic commerce website. Specifically, we investigate online purchase intention using two different perspectives: a technology-oriented perspective and a trust-...
Identifying evaluative sentences in online discussions
AAAI'11: Proceedings of the Twenty-Fifth AAAI Conference on Artificial IntelligenceMuch of opinion mining research focuses on product reviews because reviews are opinion-rich and contain little irrelevant information. However, this cannot be said about online discussions and comments. In such postings, the discussions can get highly ...
Comments