skip to main content
10.1145/3184558.3188730acmotherconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article
Free Access

Online Misinformation: Challenges and Future Directions

Published:23 April 2018Publication History

ABSTRACT

Misinformation has become a common part of our digital media environments and it is compromising the ability of our societies to form informed opinions. It generates misperceptions, which have affected the decision making processes in many domains, including economy, health, environment, and elections, among others. Misinformation and its generation, propagation, impact, and management is being studied through a variety of lenses (computer science, social science, journalism, psychology, etc.) since it widely affects multiple aspects of society. In this paper we analyse the phenomenon of misinformation from a technological point of view. We study the current socio-technical advancements towards addressing the problem, identify some of the key limitations of current technologies, and propose some ideas to target such limitations. The goal of this position paper is to reflect on the current state of the art and to stimulate discussions on the future design and development of algorithms, methodologies, and applications.

References

  1. Michelle A Amazeen. 2013. A Critical Assessment of Fact-checking in 2012. (2013).Google ScholarGoogle Scholar
  2. Sotirios Antoniadis, Iouliana Litou, and Vana Kalogeraki. 2015. A model for identifying misinformation in online social networks. In OTM Confederated International Conferences" On the Move to Meaningful Internet Systems". Springer, 473--482. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Eytan Bakshy, Solomon Messing, and Lada A Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130--1132.Google ScholarGoogle Scholar
  4. Larry M Bartels. 2002. Beyond the running tally: Partisan bias in political perceptions. Political Behavior 24, 2 (2002), 117--150.Google ScholarGoogle ScholarCross RefCross Ref
  5. Alessandro Bessi, Fabio Petroni, Michela Del Vicario, Fabiana Zollo, Aris Anagnostopoulos, Antonio Scala, Guido Caldarelli, and Walter Quattrociocchi. 2015. Viral misinformation: The role of homophily and polarization. In Proceedings of the 24th International Conference on World Wide Web. ACM, 355--356. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Leticia Bode and Emily K Vraga. 2015. In related news, that was wrong: The correction of misinformation through related stories functionality in social media. Journal of Communication 65, 4 (2015), 619--638.Google ScholarGoogle ScholarCross RefCross Ref
  7. Christina Boididou, Symeon Papadopoulos, Yiannis Kompatsiaris, Steve Schifferes, and Nic Newman. 2014. Challenges of computational verification in social multimedia. In Proceedings of the 23rd International Conference on World Wide Web. ACM, 743--748. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Yazan Boshmaf, Ildar Muslukhov, Konstantin Beznosov, and Matei Ripeanu. 2011. The socialbot network: when bots socialize for fame and money. In Proceedings of the 27th annual computer security applications conference. ACM, 93--102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Ceren Budak, Divyakant Agrawal, and Amr El Abbadi. 2011. Limiting the spread of misinformation in social networks. In Proceedings of the 20th international conference on World wide web. ACM, 665--674. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Carlos Carvalho, Nicholas Klagge, and Emanuel Moench. 2011. The persistent effects of a false news shock. Journal of Empirical Finance 18, 4 (2011), 597--615.Google ScholarGoogle ScholarCross RefCross Ref
  11. Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information credibility on twitter. In Proceedings of the 20th international conference on World wide web. ACM, 675--684. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2013. Predicting information credibility in time-sensitive social media. Internet Research 23, 5 (2013), 560--588.Google ScholarGoogle ScholarCross RefCross Ref
  13. Xinran Chen and Sei-Ching Joanna Sin. 2013. --Misinformation What of it--Motivations and individual differences in misinformation sharing on social media. Proceedings of the Association for Information Science and Technology 50, 1 (2013), 1--4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Giovanni Luca Ciampaglia, Alessandro Flammini, and Filippo Menczer. 2015. The production of information in the attention economy. Scientific reports 5 (2015).Google ScholarGoogle Scholar
  15. Giovanni Luca Ciampaglia, Prashant Shiralkar, Luis M Rocha, Johan Bollen, Filippo Menczer, and Alessandro Flammini. 2015. Computational fact checking from knowledge networks. PloS one 10, 6 (2015), e0128193.Google ScholarGoogle ScholarCross RefCross Ref
  16. Michael D Cobb, Brendan Nyhan, and Jason Reifler. 2013. Beliefs dont always persevere: How political figures are punished when positive information about them is discredited. Political Psychology 34, 3 (2013), 307--326.Google ScholarGoogle ScholarCross RefCross Ref
  17. Michael Conover, Jacob Ratkiewicz, Matthew R Francisco, Bruno Gonçalves, Filippo Menczer, and Alessandro Flammini. 2011. Political polarization on twitter. ICWSM 133 (2011), 89--96.Google ScholarGoogle Scholar
  18. Michela Del Vicario, Alessandro Bessi, Fabiana Zollo, Fabio Petroni, Antonio Scala, Guido Caldarelli, H Eugene Stanley, and Walter Quattrociocchi. 2016. The spreading of misinformation online. Proceedings of the National Academy of Sciences 113, 3 (2016), 554--559.Google ScholarGoogle ScholarCross RefCross Ref
  19. Manuel Egele, Gianluca Stringhini, Christopher Kruegel, and Giovanni Vigna. 2013. Compa: Detecting compromised accounts on social networks. In NDSS.Google ScholarGoogle Scholar
  20. Rob Ennals, Beth Trushkowsky, and John Mark Agosta. 2010. Highlighting disputed claims on the web. In Proceedings of the 19th international conference on World wide web. ACM, 341--350. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Emilio Ferrara, Onur Varol, Clayton Davis, Filippo Menczer, and Alessandro Flammini. 2016. The rise of social bots. Commun. ACM 59, 7 (2016), 96--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Andrew J Flanagin and Miriam J Metzger. 2000. Perceptions of Internet information credibility. Journalism & Mass Communication Quarterly 77, 3 (2000), 515--540.Google ScholarGoogle ScholarCross RefCross Ref
  23. DJ Flynn, Brendan Nyhan, and Jason Reifler. 2017. The nature and origins of misperceptions: Understanding false and unsupported beliefs about politics. Political Psychology 38, S1 (2017), 127--150.Google ScholarGoogle ScholarCross RefCross Ref
  24. Gary L Freed, Sarah J Clark, Amy T Butchart, Dianne C Singer, and Matthew M Davis. 2010. Parental vaccine safety concerns in 2009. Pediatrics 125, 4 (2010), 654--659.Google ScholarGoogle ScholarCross RefCross Ref
  25. Carlos Freitas, Fabricio Benevenuto, Saptarshi Ghosh, and Adriano Veloso. 2015. Reverse engineering socialbot infiltration strategies in twitter. In Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2015. ACM, 25--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Adrien Friggeri, Lada A Adamic, Dean Eckles, and Justin Cheng. 2014. Rumor Cascades. In Proceedings of the 2014 International Conference on Web and Social Media. ICWSM 2014.Google ScholarGoogle Scholar
  27. R Kelly Garrett, Erik C Nisbet, and Emily K Lynch. 2013. Undermining the corrective effects of media-based political fact checking The role of contextual cues and naïve theory. Journal of Communication 63, 4 (2013), 617--637.Google ScholarGoogle ScholarCross RefCross Ref
  28. R Kelly Garrett and Brian E Weeks. 2013. The promise and peril of real-time corrections to political misperceptions. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 1047--1058. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Tarleton Gillespie. 2014. The relevance of algorithms. Media technologies: Essays on communication, materiality, and society 167 (2014).Google ScholarGoogle ScholarCross RefCross Ref
  30. LUCAS Graves and FEDERICA Cherubini. 2016. The rise of fact-checking sites in Europe. (2016).Google ScholarGoogle Scholar
  31. Aditi Gupta, Ponnurangam Kumaraguru, Carlos Castillo, and Patrick Meier. 2014. Tweetcred: A real-time Web-based system for assessing credibility of content on Twitter. In Proc. 6th International Conference on Social Informatics (SocInfo). Barcelona, Spain.Google ScholarGoogle Scholar
  32. Naeemul Hassan, Fatma Arslan, Chengkai Li, and Mark Tremayne. 2017. Toward automated fact-checking: Detecting check-worthy factual claims by ClaimBuster. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1803--1812. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Naeemul Hassan, Afroza Sultana, You Wu, Gensheng Zhang, Chengkai Li, Jun Yang, and Cong Yu. 2014. Data in, fact out: automated monitoring of facts by FactWatcher. Proceedings of the VLDB Endowment 7, 13 (2014), 1557--1560. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Marianne E Jaeger, Susan Anthony, and Ralph L Rosnow. 1980. Who hears what from whom and with what effect: A study of rumor. Personality and Social Psychology Bulletin 6, 3 (1980), 473--478.Google ScholarGoogle ScholarCross RefCross Ref
  35. Anna Kata. 2010. A postmodern Pandora's box: anti-vaccination misinformation on the Internet. Vaccine 28, 7 (2010), 1709--1716.Google ScholarGoogle ScholarCross RefCross Ref
  36. Per Kristensson, Jonas Matthing, and Niklas Johansson. 2008. Key strategies for the successful involvement of customers in the co-creation of new technologybased services. International journal of service industry management 19, 4 (2008), 474--491.Google ScholarGoogle Scholar
  37. Steven Kull, Clay Ramsay, and Evan Lewis. 2003. Misperceptions, the media, and the Iraq war. Political Science Quarterly 118, 4 (2003), 569--598.Google ScholarGoogle ScholarCross RefCross Ref
  38. Ziva Kunda. 1990. The case for motivated reasoning. Psychological bulletin 108, 3 (1990), 480.Google ScholarGoogle Scholar
  39. Tom Lauricella, Christopher S. Stewart, and Shira Ovide. 2013. Twitter hoax sparks swift stock swoon. The Wall Street Journal 23 (2013).Google ScholarGoogle Scholar
  40. Kyumin Lee, Prithivi Tamilarasan, and James Caverlee. 2013. Crowdturfers, Campaigns, and Social Media: Tracking and Revealing Crowdsourced Manipulation of Social Media. In ICWSM.Google ScholarGoogle Scholar
  41. Sangho Lee and Jong Kim. 2014. Early filtering of ephemeral malicious accounts on Twitter. Computer Communications 54 (2014), 48--57. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Thomas C Leonard. 2008. Richard H. Thaler, Cass R. Sunstein, Nudge: Improving decisions about health, wealth, and happiness. Constitutional Political Economy 19, 4 (2008), 356--360.Google ScholarGoogle ScholarCross RefCross Ref
  43. Stephan Lewandowsky, Ullrich KH Ecker, Colleen M Seifert, Norbert Schwarz, and John Cook. 2012. Misinformation and its correction: Continued influence and successful debiasing. Psychological Science in the Public Interest 13, 3 (2012), 106--131.Google ScholarGoogle ScholarCross RefCross Ref
  44. Aaron M McCright and Riley E Dunlap. 2011. The politicization of climate change and polarization in the American public's views of global warming, 2001--2010. The Sociological Quarterly 52, 2 (2011), 155--194.Google ScholarGoogle ScholarCross RefCross Ref
  45. Miller McPherson, Lynn Smith-Lovin, and James M Cook. 2001. Birds of a feather: Homophily in social networks. Annual review of sociology 27, 1 (2001), 415--444.Google ScholarGoogle Scholar
  46. Panagiotis Takas Metaxas, Samantha Finn, and Eni Mustafaraj. 2015. Using twittertrails. com to investigate rumor propagation. In Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing. ACM, 69--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Dung T Nguyen, Nam P Nguyen, and My T Thai. 2012. Sources of misinformation in online social networks: Who to suspect. In Military Communications Conference, 2012-MILCOM 2012. IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  48. Nam P Nguyen, Guanhua Yan, My T Thai, and Stephan Eidenbenz. 2012. Containment of misinformation spread in online social networks. In Proceedings of the 4th Annual ACM Web Science Conference. ACM, 213--222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Dimitar Nikolov, Diego FM Oliveira, Alessandro Flammini, and Filippo Menczer. 2015. Measuring online social bubbles. PeerJ Computer Science 1 (2015), e38.Google ScholarGoogle ScholarCross RefCross Ref
  50. Brendan Nyhan. 2010. Why the" Death Panel" Myth Wouldnt Die: Misinformation in the Health Care Reform Debate. In The Forum, Vol. 8.Google ScholarGoogle Scholar
  51. Brendan Nyhan and Jason Reifler. 2013. Which Corrections Work Research results and practice recommendations. New America Foundation Media Policy Initiative Research Paper (2013).Google ScholarGoogle Scholar
  52. Brendan Nyhan and Jason Reifler. 2015. Displacing misinformation about events: An experimental test of causal corrections. Journal of Experimental Political Science 2, 1 (2015), 81--93.Google ScholarGoogle ScholarCross RefCross Ref
  53. Eli Pariser. 2011. The filter bubble: What the Internet is hiding from you. Penguin UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Gordon Pennycook, T Cannon, and D Rand. 2017. Implausibility and Illusory Truth: Prior Exposure Increases Perceived Accuracy of Fake News but Has No Effect on Entirely Implausible Statements. Unpublished Paper Manuscript, December 11 (2017), 2017.Google ScholarGoogle Scholar
  55. Vahed Qazvinian, Emily Rosengren, Dragomir R Radev, and Qiaozhu Mei. 2011. Rumor has it: Identifying misinformation in microblogs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1589--1599. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Xiaoyan Qiu, Diego FM Oliveira, Alireza Sahami Shirazi, Alessandro Flammini, and Filippo Menczer. 2017. Limited individual attention and online virality of low-quality information. Nature Human Behaviour 1, 7 (2017), 0132.Google ScholarGoogle ScholarCross RefCross Ref
  57. Jacob Ratkiewicz, Michael Conover, Mark Meiss, Bruno Gonçalves, Snehal Patil, Alessandro Flammini, and Filippo Menczer. 2011. Truthy: mapping the spread of astroturf in microblog streams. In Proceedings of the 20th international conference companion on World wide web. ACM, 249--252. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Paul Resnick, Samuel Carton, Souneil Park, Yuncheng Shen, and Nicole Zeffer. 2014. Rumorlens: A system for analyzing the impact of rumors and corrections in social media. In Proc. Computational Journalism Conference.Google ScholarGoogle Scholar
  59. Eunsoo Seo, Prasant Mohapatra, and Tarek Abdelzaher. 2012. Identifying rumors and their sources in social networks. SPIE defense, security, and sensing (2012), 83891I--83891I.Google ScholarGoogle Scholar
  60. Chengcheng Shao, Giovanni Luca Ciampaglia, Alessandro Flammini, and Filippo Menczer. 2016. Hoaxy: A platform for tracking online misinformation. In Proceedings of the 25th International Conference Companion on World Wide Web. International World Wide Web Conferences Steering Committee, 745--750. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Baoxu Shi and Tim Weninger. 2015. Fact checking in large knowledge graphs: A discriminative predict path mining approach. arXiv preprint arXiv:1510.05911 (2015).Google ScholarGoogle Scholar
  62. Jieun Shin, Lian Jian, Kevin Driscoll, and François Bar. 2017. Political rumoring on Twitter during the 2012 US presidential election: Rumor diffusion and correction. new media & society 19, 8 (2017), 1214--1235.Google ScholarGoogle Scholar
  63. Marcella Tambuscio, Diego FM Oliveira, Giovanni Luca Ciampaglia, and Giancarlo Ruffo. 2016. Network segregation in a model of misinformation and fact checking. arXiv preprint arXiv:1610.04170 (2016).Google ScholarGoogle Scholar
  64. Emily Thorson. 2016. Belief echoes: The persistent effects of corrected misinformation. Political Communication 33, 3 (2016), 460--480.Google ScholarGoogle ScholarCross RefCross Ref
  65. Sander van der Linden, Anthony Leiserowitz, Seth Rosenthal, and Edward Maibach. 2017. Inoculating the public against misinformation about climate change. Global Challenges 1, 2 (2017).Google ScholarGoogle Scholar
  66. William H Voorberg, Viktor JJM Bekkers, and Lars G Tummers. 2015. A systematic review of co-creation and co-production: Embarking on the social innovation journey. Public Management Review 17, 9 (2015), 1333--1357.Google ScholarGoogle ScholarCross RefCross Ref
  67. Claudia Wagner, Silvia Mitter, Christian Körner, and Markus Strohmaier. 2012. When social bots attack: Modeling susceptibility of users in online social networks. Making Sense of Microposts (# MSM2012) 2, 4 (2012), 1951--1959.Google ScholarGoogle Scholar
  68. Gang Wang, Christo Wilson, Xiaohan Zhao, Yibo Zhu, Manish Mohanlal, Haitao Zheng, and Ben Y Zhao. 2012. Serf and turf: crowdturfing for fun and profit. In Proceedings of the 21st international conference on World Wide Web. ACM, 679--688. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Steve Webb, James Caverlee, and Calton Pu. 2008. Social Honeypots: Making Friends With A Spammer Near You. In CEAS.Google ScholarGoogle Scholar
  70. Huiyuan Zhang, Huiling Zhang, Xiang Li, and My T Thai. 2015. Limiting the spread of misinformation while effectively raising awareness in social networks. In International Conference on Computational Social Networks. Springer, 35--47.Google ScholarGoogle ScholarCross RefCross Ref
  71. Bi Zhu, Chuansheng Chen, Elizabeth F Loftus, Chongde Lin, Qinghua He, Chunhui Chen, He Li, Robert K Moyzis, Jared Lessard, and Qi Dong. 2010. Individual differences in false memory from misinformation: Personality characteristics and their interactions with cognitive abilities. Personality and Individual Differences 48, 8 (2010), 889--894.Google ScholarGoogle ScholarCross RefCross Ref
  72. Melissa Zimdars. 2016. False, misleading, clickbait-y, and satirical news sources. https://docs.google.com/document/d/ 10eA5-mCZLSS4MQY5QGb5ewC3VAL6pLkT53V_81ZyitM/preview. (2016).Google ScholarGoogle Scholar
  73. Arkaitz Zubiaga, Maria Liakata, Rob Procter, Kalina Bontcheva, and Peter Tolmie. 2015. Crowdsourcing the annotation of rumourous conversations in social media. In Proceedings of the 24th International Conference on World Wide Web. ACM, 347--353. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Arkaitz Zubiaga, Maria Liakata, Rob Procter, Geraldine Wong Sak Hoi, and Peter Tolmie. 2016. Analysing how people orient to and spread rumours in social media by looking at conversational threads. PloS one 11, 3 (2016), e0150989.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Online Misinformation: Challenges and Future Directions

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Other conferences
              WWW '18: Companion Proceedings of the The Web Conference 2018
              April 2018
              2023 pages
              ISBN:9781450356404

              Copyright © 2018 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              International World Wide Web Conferences Steering Committee

              Republic and Canton of Geneva, Switzerland

              Publication History

              • Published: 23 April 2018

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

              Acceptance Rates

              Overall Acceptance Rate1,899of8,196submissions,23%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader

            HTML Format

            View this article in HTML Format .

            View HTML Format