Jane Li
ABSTRACT
Query abandonment by search engine users is generally considered to be a negative signal. In this paper, we explore the concept of good abandonment. We define a good abandonment as an abandoned query for which the user's information need was successfully addressed by the search results page, with no need to click on a result or refine the query. We present an analysis of abandoned internet search queries across two modalities (PC and mobile) in three locales. The goal is to approximate the prevalence of good abandonment, and to identify types of information needs that may lead to good abandonment, across different locales and modalities. Our study has three key findings: First, queries potentially indicating good abandonment make up a significant portion of all abandoned queries. Second, the good abandonment rate from mobile search is significantly higher than that from PC search, across all locales tested. Third, classified by type of information need, the major classes of good abandonment vary dramatically by both locale and modality. Our findings imply that it is a mistake to uniformly consider query abandonment as a negative signal. Further, there is a potential opportunity for search engines to drive additional good abandonment, especially for mobile search users, by improving search features and result snippets.
- Google search features: http://www.google.com/intl/en/help/features.html.Google Scholar
- Yahoo! shortcuts services: http://help.yahoo.com/l/us/yahoo/search/basics/basics--05.html.Google Scholar
- E. Agichtein, E. Brill, and E. Dumais. Improving web search ranking by incorporating user behavior information. In Proceedings of the 29th annual international ACM SIGIR, pages 19 -- 26. ACM, 2006. Google ScholarDigital Library
- R. Baeza-Yates, G. Dupret, and J. Velasco. A study of mobile search queries in japan. In Proceedings of the International World Wide Web Conference, 2007.Google Scholar
- B. Carterette and R. Jones. Evaluating web search engines using clickthrough data. Submitted to SIGIR, 2007. {6} K. Church, B. Smyth, P. Cotter, and K. Bradley. Mobile information access: A study of emerging search behavior on the mobile internet. ACM Transactions on the Web, 1(1), 2007. Google ScholarDigital Library
- E. Cutrell and Z. Guan. What are you looking for?: an eye-tracking study of information usage in web search. In proceedings of the SIGCHI conference on Human factors in computing systems, pages 407 -- 416, 2007. Google ScholarDigital Library
- T. Joachims. Evaluating retrieval performance using clickthrough data. In Proceedings of the SIGIR Workshop on Mathematical/Formal Methods in Information Retrieval, 2002.Google Scholar
- T. Joachims, L. A. Granka, B. Pan, H. Hembrooke, and G. Gay. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 154 -- 161. ACM, 2005. Google ScholarDigital Library
- T. Joachims and F. Radlinski. Search engines that learn from implicit feedback. Computer, 40: 34 -- 40, 2007. Google ScholarDigital Library
- M. Kamvar and S. Baluja. A large scale study of wireless search behavior: Google mobile search. In Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 701 -- 709, 2006. Google ScholarDigital Library
- M. Kamvar, M. Kellar, P. R., and Y. Xu. Computers and iphones and mobile phones, oh my! a logs--based comparison of search users on different devices. WWW, 2008. Google ScholarDigital Library
- F. Radlinski and T. Joachims. Query chains: learning to rank from implicit feedback. In Proceeding of the 11th ACM SIGKDD international conference on Knowledge discovery in data mining, pages 239 -- 248. ACM, 2005. Google ScholarDigital Library
- F. Radlinski and T. Joachims. Active exploration for learning rankings from clickthrough data. In Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 570 -- 579. ACM, 2007. Google ScholarDigital Library
- A. Sarma, S. Gollapudi, and S. Ieong. Bypass rates: Reducing query abandonment using negative inferences. In Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 177 -- 185, 2008. Google ScholarDigital Library
- T. Sohn, K. Li, W. Griswold, and J. Hollan. A diary study of mobile information needs. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, pages 433 -- 443. ACM, 2008. Google ScholarDigital Library
- A. Turpin, Y. Tsegay, D. Hawking, and H. E. Williams. Fast generation of result snippets in web search. In Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 127 -- 134. ACM, 2007. Google ScholarDigital Library
- G. R. Xue, H. J. Zeng, Z. Chen, Y. Yu, W. Y. Ma, W. S. Xi, and W. G. Fan. Optimizing web search using web click--through data. In Proceedings of the thirteenth ACM international conference on Information and knowledge management, pages 118 -- 126. ACM, 2004. Google ScholarDigital Library
- X. Xue, Z. Zhou, and Z. Zhang. Improve web search using image snippets. In Proceedings of the National Conference on Artificial. ACM, 2006. Google ScholarDigital Library
- K. Yamauchi, C. W., and W. D. A study on japanese mobile phone market and its applications. In Computer and Information Technology, The Fourth International Conference, pages 875 -- 878, 2004. Google ScholarDigital Library
Index Terms
- Good abandonment in mobile and PC internet search
Recommendations
Learning to Account for Good Abandonment in Search Success Metrics
CIKM '16: Proceedings of the 25th ACM International on Conference on Information and Knowledge ManagementAbandonment in web search has been widely used as a proxy to measure user satisfaction. Initially it was considered a signal of dissatisfaction, however with search engines moving towards providing answer-like results, a new category of abandonment was ...
Detecting Good Abandonment in Mobile Search
WWW '16: Proceedings of the 25th International Conference on World Wide WebWeb search queries for which there are no clicks are referred to as abandoned queries and are usually considered as leading to user dissatisfaction. However, there are many cases where a user may not click on any search result page (SERP) but still be ...
Context-aware web search abandonment prediction
SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrievalWeb search queries without hyperlink clicks are often referred to as abandoned queries. Understanding the reasons for abandonment is crucial for search engines in evaluating their performance. Abandonment can be categorized as good or bad depending on ...
Comments