Abstract
In the contemporary political environment of polarized claims about disputed realities, the online fact-check industry was born. These enterprises have received awards and praise but also accusations of bias and error, bringing their methods and conclusions into question. This paper examines the comparative epistemology of the three major fact-check sites: do they examine the same questions and reach the same conclusions? A content analysis of the published fact-checks addressing three disputed realties – the existence of climate change, the influence of racism, and the consequences of the national debt – suggests substantial differences in the questions asked and the answers offered, limiting the usefulness of fact-checking for citizens trying to decide which version of disputed realities to believe.
About the authors
Morgan Marietta is Assistant Professor of Political Science at the University of Massachusetts Lowell and author of The Politics of Sacred Rhetoric: Absolutist Appeals and Political Persuasion and A Citizen’s Guide to American Ideology: Conservatism and Liberalism in Contemporary Politics.
David C. Barker is Professor of Political Science and Director of the Institute for Social Research at California State University Sacramento and author of Rushed to Judgment: Talk Radio, Persuasion, and American Political Behavior and Representing Red and Blue: How the Culture Wars Change the Way Citizens Speak and Politicians Listen.
Todd Bowser is a graduate of the University of Massachusetts Lowell.
Acknowledgments
We would like to thank Michelle Amazeen, Danielle Brouder, Tyler Cote, Tyler Farley, Paul Murphy, Jordan Marietta, Joe Uscinski, Makayle Washington, and the members of the UML Political Communication Working Group, including John Cluverius, Joshua Dyck, Mona Kleinberg, and Jenifer Whitten-Woodring for helpful comments on earlier drafts.
References
Adair, Bill. 2013. “Principles of PolitiFact and the Truth-O-Meter.” PolitiFact.com, 1 November.Search in Google Scholar
Amazeen, Michelle. 2014. “Checking the Fact-Checkers in 2008: Predicting Political Ad Scrutiny and Assessing Consistency.” Journal of Political Marketing.10.1080/15377857.2014.959691Search in Google Scholar
Amazeen, Michelle. 2015. “Revisiting the Epistemology of Fact-Checking.” Critical Review 27 (1): 1–22.10.1080/08913811.2014.993890Search in Google Scholar
Bartels, Larry. 2002. “Beyond the Running Rally: Partisan Bias in Political Perceptions.” Political Behavior 24 (2): 117–150.10.1023/A:1021226224601Search in Google Scholar
Dobbs, Michael. 2012. “The Rise of Political Fact-Checking.” New America Foundation Research Paper.Search in Google Scholar
Fridkin, Kim, Patrick Kenney, and Amanda Wintersieck. 2015. “Liar, Liar, Pants on Fire: How Fact-checking Influences Reactions to Negative Advertising.” Political Communication 32 (1): 127–151.10.1080/10584609.2014.914613Search in Google Scholar
Gaines, Brian, James Kuklinski, Paul Quirk, Buddy Peyton, and Jay Verkuilen. 2007. “Same Facts, Different Interpretations: Partisan Motivation and Opinion on Iraq.” Journal of Politics 69: 957–974.10.1111/j.1468-2508.2007.00601.xSearch in Google Scholar
Gerber, Alan, and Gregory Huber. 2010. “Partisanship, Political Control, and Economic Assessments.” American Journal of Political Science 54 (1): 153–173.10.1111/j.1540-5907.2009.00424.xSearch in Google Scholar
Gottfried, Jeffrey, Bruce Hardy, Kenneth Winneg, and Kathleen Hall Jamieson. 2013. “Did Fact Checking Matter in the 2012 Presidential Campaign?” American Behavioral Scientist 57 (11): 1558–1567.10.1177/0002764213489012Search in Google Scholar
Graves, Lucas. 2013a. “Deciding What’s True: Fact-Checking Journalism and the New Ecology of News.” Ph.D. dissertation, Columbia University Graduate School of Journalism.Search in Google Scholar
Graves, Lucas. 2013b. “What We Can Learn From the Factcheckers’ Ratings.” Columbia Journalism Review 4 June.Search in Google Scholar
Graves, Lucas. 2013c. “In Defense of Factchecking.” Columbia Journalism Review 9 August.Search in Google Scholar
Hochschild, Jennifer, and Katherine Einstein. 2015. Do Facts Matter? Information and Misinformation in American Politics. Norman: University of Oklahoma Press.10.1002/polq.12398Search in Google Scholar
Jerit, Jennifer, and Jason Barabas. 2012. “Partisan Perceptual Bias and the Information Environment.” Journal of Politics 74 (3): 672–684.10.1017/S0022381612000187Search in Google Scholar
Joslyn, Mark, and Donald Haider-Markel. 2014. “Who Knows Best? Education, Partisanship, and Contested Facts.” Politics & Policy 42 (6): 919–947.10.1111/polp.12098Search in Google Scholar
Kahan, Dan. 2013. “Ideology, Motivated Reasoning, and Cognitive Reflection.” Judgment & Decision-Making 4: 407.Search in Google Scholar
Kahan, Dan, and Donald Braman. 2006. “Cultural Cognition and Public Policy.” Yale Law & Policy Review 24: 147–170.Search in Google Scholar
Kahan, Dan, Donald Braman, John Gastil, and Paul Slovic. 2007. “Culture and Identity-Protective Cognition: Explaining the White-Male Effect in Risk Perception.” Journal of Empirical Legal Studies 4: 465–505.10.1111/j.1740-1461.2007.00097.xSearch in Google Scholar
Khanna, Kabir, and Markus Prior. 2014. “Different Realities for Different Parties? Measuring Partisan Bias in Perceptions of the National Economy.” Midwest Political Science Association Meetings.Search in Google Scholar
Kuklinski, James, Paul Quirk, Jennifer Jerit, David Schweider, and Robert Rich. 2000. “Misinformation and the Currency of Democratic Citizenship.” Journal of Politics 62: 790–815.10.1111/0022-3816.00033Search in Google Scholar
Marietta, Morgan, and David Barker. 2014. Your Facts or Mine? The Role of Values, Knowledge, and Certainty in Perceptions of Disputed Reality. Washington, DC: American Political Science Association Meetings.Search in Google Scholar
Nyhan, Brendan, and Jason Reifler. 2010. “When Corrections Fail: The Persistence of Political Misperceptions.” Political Behavior 32 (2): 303–330.10.1007/s11109-010-9112-2Search in Google Scholar
Nyhan, Brendan, and Jason Reifler. 2012. “Misinformation and Fact-Checking: Research Findings From Social Science.” New America Foundation.Search in Google Scholar
Nyhan, Brendan, and Jason Reifler. 2014. “The Effects of Fact-checking on Elites: A Field Experiment on U.S. State Legislatures.” American Journal of Political Science 59 (3): 628–640.10.1111/ajps.12162Search in Google Scholar
Ostermeier, Eric. 2011. “Selection Bias? PolitiFact Rates Republican Statements as False at Three Times the Rate of Democrats.” Smart Politics 10 February.Search in Google Scholar
Popper, Karl. 1935. The Logic of Scientific Discovery. Vienna: Springer Verlag.Search in Google Scholar
Shapiro, Robert, and Yaeli Bloch-Elchon. 2008. “Do the Facts Speak for Themselves? Partisan Disagreement as a Challenge to Democratic Competence.” Critical Review 20 (1): 115–139.10.1080/08913810802316373Search in Google Scholar
Spivak, Cary. 2011. “The Fact-Checking Explosion.” American Journalism Review January.Search in Google Scholar
Uscinski, Joseph. 2015. “The Epistemology of Fact Checking (Is Still Naïve): Rejoinder to Amazeen.” Critical Review 27 (2): 243–252.10.1080/08913811.2015.1055892Search in Google Scholar
Uscinski, Joseph, and Ryden Butler. 2013. “The Epistemology of Fact Checking.” Critical Review 25 (2): 162–180.10.1080/08913811.2013.843872Search in Google Scholar
Wintersieck, Amanda, and Kim Fridkin. 2015. “The Rise of Fact Checking in American Political Campaigns.” In The Praeger Handbook of Political Campaigning in the United States, New York: Praeger.Search in Google Scholar
©2015 by De Gruyter