ABSTRACT
Misinformation has become a common part of our digital media environments and it is compromising the ability of our societies to form informed opinions. It generates misperceptions, which have affected the decision making processes in many domains, including economy, health, environment, and elections, among others. Misinformation and its generation, propagation, impact, and management is being studied through a variety of lenses (computer science, social science, journalism, psychology, etc.) since it widely affects multiple aspects of society. In this paper we analyse the phenomenon of misinformation from a technological point of view. We study the current socio-technical advancements towards addressing the problem, identify some of the key limitations of current technologies, and propose some ideas to target such limitations. The goal of this position paper is to reflect on the current state of the art and to stimulate discussions on the future design and development of algorithms, methodologies, and applications.
- Michelle A Amazeen. 2013. A Critical Assessment of Fact-checking in 2012. (2013).Google Scholar
- Sotirios Antoniadis, Iouliana Litou, and Vana Kalogeraki. 2015. A model for identifying misinformation in online social networks. In OTM Confederated International Conferences" On the Move to Meaningful Internet Systems". Springer, 473--482. Google ScholarDigital Library
- Eytan Bakshy, Solomon Messing, and Lada A Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130--1132.Google Scholar
- Larry M Bartels. 2002. Beyond the running tally: Partisan bias in political perceptions. Political Behavior 24, 2 (2002), 117--150.Google ScholarCross Ref
- Alessandro Bessi, Fabio Petroni, Michela Del Vicario, Fabiana Zollo, Aris Anagnostopoulos, Antonio Scala, Guido Caldarelli, and Walter Quattrociocchi. 2015. Viral misinformation: The role of homophily and polarization. In Proceedings of the 24th International Conference on World Wide Web. ACM, 355--356. Google ScholarDigital Library
- Leticia Bode and Emily K Vraga. 2015. In related news, that was wrong: The correction of misinformation through related stories functionality in social media. Journal of Communication 65, 4 (2015), 619--638.Google ScholarCross Ref
- Christina Boididou, Symeon Papadopoulos, Yiannis Kompatsiaris, Steve Schifferes, and Nic Newman. 2014. Challenges of computational verification in social multimedia. In Proceedings of the 23rd International Conference on World Wide Web. ACM, 743--748. Google ScholarDigital Library
- Yazan Boshmaf, Ildar Muslukhov, Konstantin Beznosov, and Matei Ripeanu. 2011. The socialbot network: when bots socialize for fame and money. In Proceedings of the 27th annual computer security applications conference. ACM, 93--102. Google ScholarDigital Library
- Ceren Budak, Divyakant Agrawal, and Amr El Abbadi. 2011. Limiting the spread of misinformation in social networks. In Proceedings of the 20th international conference on World wide web. ACM, 665--674. Google ScholarDigital Library
- Carlos Carvalho, Nicholas Klagge, and Emanuel Moench. 2011. The persistent effects of a false news shock. Journal of Empirical Finance 18, 4 (2011), 597--615.Google ScholarCross Ref
- Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information credibility on twitter. In Proceedings of the 20th international conference on World wide web. ACM, 675--684. Google ScholarDigital Library
- Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2013. Predicting information credibility in time-sensitive social media. Internet Research 23, 5 (2013), 560--588.Google ScholarCross Ref
- Xinran Chen and Sei-Ching Joanna Sin. 2013. --Misinformation What of it--Motivations and individual differences in misinformation sharing on social media. Proceedings of the Association for Information Science and Technology 50, 1 (2013), 1--4. Google ScholarDigital Library
- Giovanni Luca Ciampaglia, Alessandro Flammini, and Filippo Menczer. 2015. The production of information in the attention economy. Scientific reports 5 (2015).Google Scholar
- Giovanni Luca Ciampaglia, Prashant Shiralkar, Luis M Rocha, Johan Bollen, Filippo Menczer, and Alessandro Flammini. 2015. Computational fact checking from knowledge networks. PloS one 10, 6 (2015), e0128193.Google ScholarCross Ref
- Michael D Cobb, Brendan Nyhan, and Jason Reifler. 2013. Beliefs dont always persevere: How political figures are punished when positive information about them is discredited. Political Psychology 34, 3 (2013), 307--326.Google ScholarCross Ref
- Michael Conover, Jacob Ratkiewicz, Matthew R Francisco, Bruno Gonçalves, Filippo Menczer, and Alessandro Flammini. 2011. Political polarization on twitter. ICWSM 133 (2011), 89--96.Google Scholar
- Michela Del Vicario, Alessandro Bessi, Fabiana Zollo, Fabio Petroni, Antonio Scala, Guido Caldarelli, H Eugene Stanley, and Walter Quattrociocchi. 2016. The spreading of misinformation online. Proceedings of the National Academy of Sciences 113, 3 (2016), 554--559.Google ScholarCross Ref
- Manuel Egele, Gianluca Stringhini, Christopher Kruegel, and Giovanni Vigna. 2013. Compa: Detecting compromised accounts on social networks. In NDSS.Google Scholar
- Rob Ennals, Beth Trushkowsky, and John Mark Agosta. 2010. Highlighting disputed claims on the web. In Proceedings of the 19th international conference on World wide web. ACM, 341--350. Google ScholarDigital Library
- Emilio Ferrara, Onur Varol, Clayton Davis, Filippo Menczer, and Alessandro Flammini. 2016. The rise of social bots. Commun. ACM 59, 7 (2016), 96--104. Google ScholarDigital Library
- Andrew J Flanagin and Miriam J Metzger. 2000. Perceptions of Internet information credibility. Journalism & Mass Communication Quarterly 77, 3 (2000), 515--540.Google ScholarCross Ref
- DJ Flynn, Brendan Nyhan, and Jason Reifler. 2017. The nature and origins of misperceptions: Understanding false and unsupported beliefs about politics. Political Psychology 38, S1 (2017), 127--150.Google ScholarCross Ref
- Gary L Freed, Sarah J Clark, Amy T Butchart, Dianne C Singer, and Matthew M Davis. 2010. Parental vaccine safety concerns in 2009. Pediatrics 125, 4 (2010), 654--659.Google ScholarCross Ref
- Carlos Freitas, Fabricio Benevenuto, Saptarshi Ghosh, and Adriano Veloso. 2015. Reverse engineering socialbot infiltration strategies in twitter. In Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2015. ACM, 25--32. Google ScholarDigital Library
- Adrien Friggeri, Lada A Adamic, Dean Eckles, and Justin Cheng. 2014. Rumor Cascades. In Proceedings of the 2014 International Conference on Web and Social Media. ICWSM 2014.Google Scholar
- R Kelly Garrett, Erik C Nisbet, and Emily K Lynch. 2013. Undermining the corrective effects of media-based political fact checking The role of contextual cues and naïve theory. Journal of Communication 63, 4 (2013), 617--637.Google ScholarCross Ref
- R Kelly Garrett and Brian E Weeks. 2013. The promise and peril of real-time corrections to political misperceptions. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 1047--1058. Google ScholarDigital Library
- Tarleton Gillespie. 2014. The relevance of algorithms. Media technologies: Essays on communication, materiality, and society 167 (2014).Google ScholarCross Ref
- LUCAS Graves and FEDERICA Cherubini. 2016. The rise of fact-checking sites in Europe. (2016).Google Scholar
- Aditi Gupta, Ponnurangam Kumaraguru, Carlos Castillo, and Patrick Meier. 2014. Tweetcred: A real-time Web-based system for assessing credibility of content on Twitter. In Proc. 6th International Conference on Social Informatics (SocInfo). Barcelona, Spain.Google Scholar
- Naeemul Hassan, Fatma Arslan, Chengkai Li, and Mark Tremayne. 2017. Toward automated fact-checking: Detecting check-worthy factual claims by ClaimBuster. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1803--1812. Google ScholarDigital Library
- Naeemul Hassan, Afroza Sultana, You Wu, Gensheng Zhang, Chengkai Li, Jun Yang, and Cong Yu. 2014. Data in, fact out: automated monitoring of facts by FactWatcher. Proceedings of the VLDB Endowment 7, 13 (2014), 1557--1560. Google ScholarDigital Library
- Marianne E Jaeger, Susan Anthony, and Ralph L Rosnow. 1980. Who hears what from whom and with what effect: A study of rumor. Personality and Social Psychology Bulletin 6, 3 (1980), 473--478.Google ScholarCross Ref
- Anna Kata. 2010. A postmodern Pandora's box: anti-vaccination misinformation on the Internet. Vaccine 28, 7 (2010), 1709--1716.Google ScholarCross Ref
- Per Kristensson, Jonas Matthing, and Niklas Johansson. 2008. Key strategies for the successful involvement of customers in the co-creation of new technologybased services. International journal of service industry management 19, 4 (2008), 474--491.Google Scholar
- Steven Kull, Clay Ramsay, and Evan Lewis. 2003. Misperceptions, the media, and the Iraq war. Political Science Quarterly 118, 4 (2003), 569--598.Google ScholarCross Ref
- Ziva Kunda. 1990. The case for motivated reasoning. Psychological bulletin 108, 3 (1990), 480.Google Scholar
- Tom Lauricella, Christopher S. Stewart, and Shira Ovide. 2013. Twitter hoax sparks swift stock swoon. The Wall Street Journal 23 (2013).Google Scholar
- Kyumin Lee, Prithivi Tamilarasan, and James Caverlee. 2013. Crowdturfers, Campaigns, and Social Media: Tracking and Revealing Crowdsourced Manipulation of Social Media. In ICWSM.Google Scholar
- Sangho Lee and Jong Kim. 2014. Early filtering of ephemeral malicious accounts on Twitter. Computer Communications 54 (2014), 48--57. Google ScholarDigital Library
- Thomas C Leonard. 2008. Richard H. Thaler, Cass R. Sunstein, Nudge: Improving decisions about health, wealth, and happiness. Constitutional Political Economy 19, 4 (2008), 356--360.Google ScholarCross Ref
- Stephan Lewandowsky, Ullrich KH Ecker, Colleen M Seifert, Norbert Schwarz, and John Cook. 2012. Misinformation and its correction: Continued influence and successful debiasing. Psychological Science in the Public Interest 13, 3 (2012), 106--131.Google ScholarCross Ref
- Aaron M McCright and Riley E Dunlap. 2011. The politicization of climate change and polarization in the American public's views of global warming, 2001--2010. The Sociological Quarterly 52, 2 (2011), 155--194.Google ScholarCross Ref
- Miller McPherson, Lynn Smith-Lovin, and James M Cook. 2001. Birds of a feather: Homophily in social networks. Annual review of sociology 27, 1 (2001), 415--444.Google Scholar
- Panagiotis Takas Metaxas, Samantha Finn, and Eni Mustafaraj. 2015. Using twittertrails. com to investigate rumor propagation. In Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing. ACM, 69--72. Google ScholarDigital Library
- Dung T Nguyen, Nam P Nguyen, and My T Thai. 2012. Sources of misinformation in online social networks: Who to suspect. In Military Communications Conference, 2012-MILCOM 2012. IEEE, 1--6.Google ScholarCross Ref
- Nam P Nguyen, Guanhua Yan, My T Thai, and Stephan Eidenbenz. 2012. Containment of misinformation spread in online social networks. In Proceedings of the 4th Annual ACM Web Science Conference. ACM, 213--222. Google ScholarDigital Library
- Dimitar Nikolov, Diego FM Oliveira, Alessandro Flammini, and Filippo Menczer. 2015. Measuring online social bubbles. PeerJ Computer Science 1 (2015), e38.Google ScholarCross Ref
- Brendan Nyhan. 2010. Why the" Death Panel" Myth Wouldnt Die: Misinformation in the Health Care Reform Debate. In The Forum, Vol. 8.Google Scholar
- Brendan Nyhan and Jason Reifler. 2013. Which Corrections Work Research results and practice recommendations. New America Foundation Media Policy Initiative Research Paper (2013).Google Scholar
- Brendan Nyhan and Jason Reifler. 2015. Displacing misinformation about events: An experimental test of causal corrections. Journal of Experimental Political Science 2, 1 (2015), 81--93.Google ScholarCross Ref
- Eli Pariser. 2011. The filter bubble: What the Internet is hiding from you. Penguin UK. Google ScholarDigital Library
- Gordon Pennycook, T Cannon, and D Rand. 2017. Implausibility and Illusory Truth: Prior Exposure Increases Perceived Accuracy of Fake News but Has No Effect on Entirely Implausible Statements. Unpublished Paper Manuscript, December 11 (2017), 2017.Google Scholar
- Vahed Qazvinian, Emily Rosengren, Dragomir R Radev, and Qiaozhu Mei. 2011. Rumor has it: Identifying misinformation in microblogs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1589--1599. Google ScholarDigital Library
- Xiaoyan Qiu, Diego FM Oliveira, Alireza Sahami Shirazi, Alessandro Flammini, and Filippo Menczer. 2017. Limited individual attention and online virality of low-quality information. Nature Human Behaviour 1, 7 (2017), 0132.Google ScholarCross Ref
- Jacob Ratkiewicz, Michael Conover, Mark Meiss, Bruno Gonçalves, Snehal Patil, Alessandro Flammini, and Filippo Menczer. 2011. Truthy: mapping the spread of astroturf in microblog streams. In Proceedings of the 20th international conference companion on World wide web. ACM, 249--252. Google ScholarDigital Library
- Paul Resnick, Samuel Carton, Souneil Park, Yuncheng Shen, and Nicole Zeffer. 2014. Rumorlens: A system for analyzing the impact of rumors and corrections in social media. In Proc. Computational Journalism Conference.Google Scholar
- Eunsoo Seo, Prasant Mohapatra, and Tarek Abdelzaher. 2012. Identifying rumors and their sources in social networks. SPIE defense, security, and sensing (2012), 83891I--83891I.Google Scholar
- Chengcheng Shao, Giovanni Luca Ciampaglia, Alessandro Flammini, and Filippo Menczer. 2016. Hoaxy: A platform for tracking online misinformation. In Proceedings of the 25th International Conference Companion on World Wide Web. International World Wide Web Conferences Steering Committee, 745--750. Google ScholarDigital Library
- Baoxu Shi and Tim Weninger. 2015. Fact checking in large knowledge graphs: A discriminative predict path mining approach. arXiv preprint arXiv:1510.05911 (2015).Google Scholar
- Jieun Shin, Lian Jian, Kevin Driscoll, and François Bar. 2017. Political rumoring on Twitter during the 2012 US presidential election: Rumor diffusion and correction. new media & society 19, 8 (2017), 1214--1235.Google Scholar
- Marcella Tambuscio, Diego FM Oliveira, Giovanni Luca Ciampaglia, and Giancarlo Ruffo. 2016. Network segregation in a model of misinformation and fact checking. arXiv preprint arXiv:1610.04170 (2016).Google Scholar
- Emily Thorson. 2016. Belief echoes: The persistent effects of corrected misinformation. Political Communication 33, 3 (2016), 460--480.Google ScholarCross Ref
- Sander van der Linden, Anthony Leiserowitz, Seth Rosenthal, and Edward Maibach. 2017. Inoculating the public against misinformation about climate change. Global Challenges 1, 2 (2017).Google Scholar
- William H Voorberg, Viktor JJM Bekkers, and Lars G Tummers. 2015. A systematic review of co-creation and co-production: Embarking on the social innovation journey. Public Management Review 17, 9 (2015), 1333--1357.Google ScholarCross Ref
- Claudia Wagner, Silvia Mitter, Christian Körner, and Markus Strohmaier. 2012. When social bots attack: Modeling susceptibility of users in online social networks. Making Sense of Microposts (# MSM2012) 2, 4 (2012), 1951--1959.Google Scholar
- Gang Wang, Christo Wilson, Xiaohan Zhao, Yibo Zhu, Manish Mohanlal, Haitao Zheng, and Ben Y Zhao. 2012. Serf and turf: crowdturfing for fun and profit. In Proceedings of the 21st international conference on World Wide Web. ACM, 679--688. Google ScholarDigital Library
- Steve Webb, James Caverlee, and Calton Pu. 2008. Social Honeypots: Making Friends With A Spammer Near You. In CEAS.Google Scholar
- Huiyuan Zhang, Huiling Zhang, Xiang Li, and My T Thai. 2015. Limiting the spread of misinformation while effectively raising awareness in social networks. In International Conference on Computational Social Networks. Springer, 35--47.Google ScholarCross Ref
- Bi Zhu, Chuansheng Chen, Elizabeth F Loftus, Chongde Lin, Qinghua He, Chunhui Chen, He Li, Robert K Moyzis, Jared Lessard, and Qi Dong. 2010. Individual differences in false memory from misinformation: Personality characteristics and their interactions with cognitive abilities. Personality and Individual Differences 48, 8 (2010), 889--894.Google ScholarCross Ref
- Melissa Zimdars. 2016. False, misleading, clickbait-y, and satirical news sources. https://docs.google.com/document/d/ 10eA5-mCZLSS4MQY5QGb5ewC3VAL6pLkT53V_81ZyitM/preview. (2016).Google Scholar
- Arkaitz Zubiaga, Maria Liakata, Rob Procter, Kalina Bontcheva, and Peter Tolmie. 2015. Crowdsourcing the annotation of rumourous conversations in social media. In Proceedings of the 24th International Conference on World Wide Web. ACM, 347--353. Google ScholarDigital Library
- Arkaitz Zubiaga, Maria Liakata, Rob Procter, Geraldine Wong Sak Hoi, and Peter Tolmie. 2016. Analysing how people orient to and spread rumours in social media by looking at conversational threads. PloS one 11, 3 (2016), e0150989.Google ScholarCross Ref
Index Terms
- Online Misinformation: Challenges and Future Directions
Recommendations
Online Misinformation Spread: A Systematic Literature Map
ICISDM '19: Proceedings of the 2019 3rd International Conference on Information System and Data MiningMisinformation is widely and rapidly spreading on social media platforms. This could result in severe negative effects on users and the quality of online generated content. Luckily, there is a growing interest among researchers to combat this spread of ...
Are Mutated Misinformation More Contagious? A Case Study of COVID-19 Misinformation on Twitter
WebSci '22: Proceedings of the 14th ACM Web Science Conference 2022The spread of online misinformation has become a major global risk. Understanding how misinformation propagates on social media is vital. While prior studies suggest that the content factors, such as emotion and topic in texts, are closely related to the ...
Linguistic Signals under Misinformation and Fact-Checking: Evidence from User Comments on Social Media
Misinformation and fact-checking are opposite forces in the news environment: the former creates inaccuracies to mislead people, while the latter provides evidence to rebut the former. These news articles are often posted on social media and attract user ...
Comments