Julia Schwarz
Meredith Morris
ABSTRACT
The presence (and, sometimes, prominence) of incorrect and misleading content on the Web can have serious consequences for people who increasingly rely on the internet as their information source for topics such as health, politics, and financial advice. In this paper, we identify and collect several page features (such as popularity among specialized user groups) that are currently difficult or impossible for end users to assess, yet provide valuable signals regarding credibility. We then present visualizations designed to augment search results and Web pages with the most promising of these features. Our lab evaluation finds that our augmented search results are particularly effective at increasing the accuracy of users'" credibility assessments, highlighting the potential of data aggregation and simple interventions to help people make more informed decisions as they search for information online.
Supplemental Material
Available for Download
Slides from the presentation
- Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., and Etzioni, O. Open information extraction from the Web. IJCAI 2007, 2670--2676. Google Scholar
Digital Library
- Bhavnani, S. Domain-Specific Search Strategies for the Effective Retrieval of Healthcare and Shopping Infor-mation. CHI 2002 Extended Abstracts, 610--611. Google ScholarDigital Library
- Brin, S. and Page, L. The anatomy of a large-scale hy-pertextual Web search engine. ISDN 1998, 107--117. Google ScholarDigital Library
- Cavarlee, J. and Liu, L. Countering Web spam with credibility-based link analysis. PODC 2007, 157--166. Google ScholarDigital Library
- Chi, E., Pirolli, P., Chen, K., and Pitkow, J. Using in-formation scent to model user information needs and ac-tions and the Web. CHI 2001, 490--497. Google ScholarDigital Library
- Cutrell, E. and Guan,Z. What are you looking for? An eye-tracking study of information usage in Web search. CHI 2007, 407--416. Google ScholarDigital Library
- Dignan, L. Gartner Puts Phishing Tab at $3.2 Billion. ZDNet. December 17, 2007.Google Scholar
- Ennals, R. Byler, D., Agosta, J.M. and Rosario, B. What is Disputed on the Web? WICOW 2010, 67--74. Google ScholarDigital Library
- Fallows, D. Search Engine Users. Pew Internet and American Life Project, 2005.Google Scholar
- Ferebee, S. An examination of the influence of in-volvement level of Web site users on the perceived cred-ibility of Web sites. PERSUASIVE 2007, 176--186. Google ScholarDigital Library
- Fogg, B.J. Marshall, Laraki, O., Osipovich, A., Varma, C. Fang, N., Paul, J., Rangekar, A., Shon, J., Swani, P., and Treinen, M. What makes Web sites credible?: A re-port on a large quantitative study. CHI 2001, 61--68. Google ScholarDigital Library
- Fogg, B.J. Persuasive Technology: Using Computers to Change What We Think and Do. Morgan Kaufmann, 2002. Google ScholarDigital Library
- Fogg, B. J. Prominence-interpretation theory: explaining how people assess credibility online. CHI 2003 Extend-ed Abstracts, 722--723. Google ScholarDigital Library
- Fogg, B.J., Soohoo, C., Danielson, D.R., Marable, L., Stanford, J., and Tauber, E.R. How do users evaluate the credibility of Web sites?: A study with over 2,500 par-ticipants. DUX 2003, 1--15. Google ScholarDigital Library
- Gamon, M., Basu, S., Belenko, D., Fisher, D., Hurst, M., and Konig, A.C. BLEWS: Using Blogs to Provide Context for News Articles. ICWSM 2008.Google Scholar
- Gyongyi, Z., Molina, H.G., and Pederson, J. Combating Web spam with TrustRank. VLDB 2004, 576--587. Google ScholarDigital Library
- Hargittai, E., Fullerton, F., Menchen-Trevino, E. and Thomas, D. Trust online: young adults' evaluation of Web content. International Journal of Communications, 2010.Google Scholar
- Hilligoss, B. and Rieh, S.Y., Developing a unifying framework of credibility assessment: construct, heuristics, and interaction in context. Information Processing and Management, 44(4), 2008, 1467--1484. Google ScholarDigital Library
- Ivory, M. and Hearst, M. Statistical profiles of highly-rated Web sites. CHI 2002, 367--374. Google ScholarDigital Library
- Joachims, T., Granka, L., Pan, B., Hembrooke, H., and Gay, G. Accurately interpreting clickthrough data as implicit feedback. SIGIR 2005, 154--161. Google ScholarDigital Library
- Jenkins, H. Confronting the Challenges of Participatory Culture: Media Education for the 21st Century. 2006.Google Scholar
- Kapoun, J. Teaching Undergrads WEB Evaluation: A Guide for Library Instruction. C&RL News, July/August 1998, 522--523.Google Scholar
- Kittur, A., Suh, B. and Chi, E. Can you ever trust a wiki?: Impacting perceived trustworthiness in Wikipe-dia. CSCW 2008, 477--480. Google ScholarDigital Library
- Lazar, J., Meiselwitz, G., and Feng, J. Understanding Web Credibility: A Synthesis of the Research Literature. Foundations and Trends in HCI, 1(2), 2007. Google ScholarDigital Library
- Leu, D.J. and Zawilinski, L. The New Literacies of Online Reading Comprehension. New England Reading Association Journal, 43(1), 2007, 1--7.Google Scholar
- Lohr, S. This Boring Headline is Written for Google. The New York Times, April 9, 2006.Google Scholar
- McKnight, D. and Kacmar, C. Factors and effects of information credibility. ICEC 2007, 423--432. Google ScholarDigital Library
- Metzger, M. J. Making sense of credibility on the Web: Models for evaluating online information and recom-mendations for future research. Journal of the American Society for Information Science and Technology, 58(13), 2007, 2078--2091. Google ScholarDigital Library
- Pew Research. Growing Number of Americans Say Obama is a Muslim. August 18, 2010.Google Scholar
- Schneiderman, B. Designing trust into online experienc-es. CACM, 43(12), 2000, 57--59. Google ScholarDigital Library
- White, R., Dumais, S., and Teevan, J. Characterizing the influence of domain expertise on Web search behavior. WSDM 2009, 132--141. Google ScholarDigital Library
- White, R. and Morris, D. Investigating the querying and browsing behavior of advanced search engine users. SIGIR 2007, 255--262. Google ScholarDigital Library
- Wu, M., Miller, R., and Garfinkel, S. Do security toolbars actually prevent phishing attacks? CHI 2006. Google ScholarDigital Library
Index Terms
- Augmenting web pages and search results to support credibility assessment
Recommendations
Enhancing credibility judgment of web search results
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn this paper, we propose a system for helping users to judge the credibility of Web search results and to search for credible Web pages. Conventional Web search engines present only titles, snippets, and URLs for users, which give few clues to judge ...
What makes Web sites credible?: a report on a large quantitative study
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe credibility of web sites is becoming an increasingly important area to understand. To expand knowledge in this domain, we conducted an online study that investigated how different elements of Web sites affect people's perception of credibility. Over ...
How do credibility and utility play in the user experience of health informatics services?
While the use of health informatics is increasing in health care, how it is improving health care and how users accept the services has been little studied, and due to increasing uncertainty, credibility has become a key determinant of health ...
Comments