Ryen W. White
Susan T. Dumais
Jaime Teevan
ABSTRACT
Domain experts search differently than people with little or no domain knowledge. Previous research suggests that domain experts employ different search strategies and are more successful in finding what they are looking for than non-experts. In this paper we present a large-scale, longitudinal, log-based analysis of the effect of domain expertise on web search behavior in four different domains (medicine, finance, law, and computer science). We characterize the nature of the queries, search sessions, web sites visited, and search success for users identified as experts and non-experts within these domains. Large-scale analysis of real-world interactions allows us to understand how expertise relates to vocabulary, resource use, and search task under more realistic search conditions than has been possible in previous small-scale studies. Building upon our analysis we develop a model to predict expertise based on search behavior, and describe how knowledge about domain expertise can be used to present better results and query suggestions to users and to help non-experts gain expertise.
- Agichtein, E., Brill, E., Dumais, S. & Ragno, R. (2006). Learning user interaction models for predicting web search result preferences. Proc. SIGIR, 3--10. Google Scholar
Digital Library
- Allen, B. L. (1991). Topic knowledge and online catalog search formulation. Lib. Quart., 61(2), 188--213.Google ScholarCross Ref
- Bhavnani, S. K. (2001). Important cognitive components of domain-specific search knowledge. Proc. TREC, 571--578.Google Scholar
- Bhavnani, S. K. (2002). Domain-specific search strategies for the effective retrieval of healthcare and shopping information. Proc. SIGCHI, 610--611. Google ScholarDigital Library
- Bhavnani, S. K. et al. (2005). Strategy Hubs: Domain portals to help find comprehensive information. JASIST, 57(1), 4--24. Google ScholarDigital Library
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Earlbaum.Google Scholar
- Collins, M. (2002). Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. Proc. EMNLP, 1--8. Google ScholarDigital Library
- Downey, D., Dumais, S. & Horvitz, E. (2007). Models of searching and browsing: Languages, studies and application. Proc. IJCAI, 2740--2747. Google ScholarDigital Library
- Duggan, G. B. & Payne, S. J. (2008). Knowledge in the head and on the web: Using topic expertise to aid search. Proc. SIGCHI, 39--48. Google ScholarDigital Library
- Freund, L. & Toms, E. G. (2006). Enterprise search behaviour of software engineers. Proc. SIGIR, 645--646. Google ScholarDigital Library
- Hembrooke, H. A., Gay, G. K. & Granka, L. A. (2005). The effects of expertise and feedback on search term selection and subsequent learning. JASIST, 56(8), 861--871. Google ScholarDigital Library
- Hölscher, C. & Strube, G. (2000). Web search behavior of internet experts and newbies. Comp. Net., 33(1), 337--346. Google ScholarDigital Library
- Hsieh-Yee, I. (1993). Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. JASIST, 44(3), 161--174.Google ScholarCross Ref
- Kelly, D. & Cool, C. (2002). The effects of topic familiarity on information search behavior. Proc. JCDL, 74--75. Google ScholarDigital Library
- Marchionini, G., Lin, X. & Dwiggins, S. (1990). Effects of search and subject expertise on information seeking in a hypertext environment. Proc. ASIS, 129--142.Google Scholar
- Shen, X., Dumais, S. & Horvitz, E. (2005). Analysis of topic dynamics in web search. Proc. WWW, 1102--1103. Google ScholarDigital Library
- Spink, A. & Jensen, B. (2004). Web search: Public searching of the web. Kluwer Academic Publishers. Google ScholarDigital Library
- Teevan, J., Dumais, S. T. & Liebling, D. J. (2008). To personalize or not to personalize: Modeling queries with variation in user intent. Proc. SIGIR, 163--170. Google ScholarDigital Library
- Vakkari, P., Pennanen, M. & Serola, S. (2003). Changes in search terms and tactics while writing a research proposal: A longitudinal case study. IP&M, 39(3), 445--463. Google ScholarDigital Library
- White, R. W. & Drucker, S. M. (2007). Investigating behavioral variability in web search. Proc. WWW, 21--30. Google ScholarDigital Library
- White, R. W., Dumais, S. & Teevan, J. (2008). How medical expertise influences web search interaction. Proc. SIGIR 791--792. Google ScholarDigital Library
- White, R. W. & Morris, D. (2007). Investigating the querying and browsing behavior of advanced search engine users. Proc. SIGIR, 255--262. Google ScholarDigital Library
- Wildemuth, B. M. (2004). The effects of domain knowledge on search tactic formulation. JASIST, 55(3), 246--258. Google ScholarDigital Library
- Zhang, X., Anghelescu, H. G. B. & Yuan, X. (2005). Domain knowledge, search behavior, and search effectiveness of engineering and science students. Inf. Res., 10(2), 217.Google Scholar
Index Terms
- Characterizing the influence of domain expertise on web search behavior
Recommendations
How Does Domain Expertise Affect Users’ Search Interaction and Outcome in Exploratory Search?
People often conduct exploratory search to explore unfamiliar information space and learn new knowledge. While supporting the highly dynamic and interactive exploratory search is still challenging for the search system, we want to investigate which ...
How medical expertise influences web search interaction
SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrievalDomain expertise can have an important influence on how people search. In this poster we present findings from a log-based study into how medical domain experts search the Web for information related to their expertise, as compared with non-experts. We ...
Problem solving, domain expertise and learning: ground-truth performance results for math data corpus
ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interactionProblem solving, domain expertise, and learning are analyzed for the Math Data Corpus, which involves multimodal data on collaborating student groups as they solve math problems together across sessions. Compared with non-expert students, domain experts ...
Comments