ABSTRACT
Web search queries without hyperlink clicks are often referred to as abandoned queries. Understanding the reasons for abandonment is crucial for search engines in evaluating their performance. Abandonment can be categorized as good or bad depending on whether user information needs are satisfied by result page content. Previous research has sought to understand abandonment rationales via user surveys, or has developed models to predict those rationales using behavioral patterns. However, these models ignore important contextual factors such as the relationship between the abandoned query and prior abandonment instances. We propose more advanced methods for modeling and predicting abandonment rationales using contextual information from user search sessions by analyzing search engine logs, and discover dependencies between abandoned queries and user behaviors. We leverage these dependency signals to build a sequential classifier using a structured learning framework designed to handle such signals. Our experimental results show that our approach is 22% more accurate than the state-of-the-art abandonment-rationale classifier. Going beyond prediction, we leverage the prediction results to significantly improve relevance using instances of predicted good and bad abandonment.
- M. Ageev, Q. Guo, D. Lagun, and E. Agichtein. Find it if you can: a game for modeling different types of web search success using interaction data. In SIGIR '11, pages 345--354, 2011. Google ScholarDigital Library
- Y. Altun, I. Tsochantaridis, and T. Hofmann. Hidden markov support vector machines. In ICML '03, pages 104--111, 2003.Google Scholar
- M. S. Bernstein, J. Teevan, S. Dumais, D. Liebling, and E. Horvitz. Direct answers for search queries in the long tail. In CHI '12, pages 237--246, 2012. Google ScholarDigital Library
- G. Buscher, R. W. White, S. Dumais, and J. Huang. Large-scale analysis of individual and task differences in search result page examination strategies. In WSDM '12, pages 373--382, 2012. Google ScholarDigital Library
- C. Castillo, A. Gionis, R. Lempel, and Y. Maarek. When no clicks are good news. In SIGIR 2010 Industry Track, 2010.Google Scholar
- M.-W. Chang and W. tau Yih. Dual coordinate descent algorithms for efficient large margin structured prediction. TACL, 1:207--218, 2013.Google ScholarCross Ref
- L. B. Chilton and J. Teevan. Addressing people's information needs directly in a web search result page. In WWW '11, pages 27--36, 2011. Google ScholarDigital Library
- A. Chuklin and P. Serdyukov. Good abandonments in factoid queries. In WWW '12 Companion, pages 483--484, 2012. Google ScholarDigital Library
- A. Chuklin and P. Serdyukov. How query extensions reflect search result abandonments. In SIGIR '12, pages 1087--1088, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- A. Chuklin and P. Serdyukov. Potential good abandonment prediction. In WWW '12 Companion, pages 485--486, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- A. Diriye, R. White, G. Buscher, and S. Dumais. Leaving so soon?: understanding and predicting web search abandonment rationales. In CIKM '12, pages 1025--1034, 2012. Google ScholarDigital Library
- J. Friedman, T. Hastie, and R. Tibshirani. Additive logistic regression: a statistical view of boosting. Annals of Statistics, 28:2000, 1998.Google Scholar
- A. Hassan, R. Jones, and K. L. Klinkner. Beyond dcg: user behavior as a predictor of a successful search. In WSDM '10, pages 221--230, 2010. Google ScholarDigital Library
- A. Hassan, Y. Song, and L.-w. He. A task level metric for measuring web search satisfaction and its application on improving relevance estimation. In CIKM '11, pages 125--134, 2011. Google ScholarDigital Library
- J. Huang, R. W. White, and S. Dumais. No clicks, no problem: using cursor movements to understand and improve search. In CHI '11, pages 1225--1234, 2011. Google ScholarDigital Library
- T. Joachims. Optimizing search engines using clickthrough data. In KDD '02, pages 133--142, 2002. Google ScholarDigital Library
- T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Accurately interpreting clickthrough data as implicit feedback. In SIGIR '05, pages 154--161, 2005. Google ScholarDigital Library
- A. Koumpouri and V. Simaki. Queries without clicks: Evaluating retrieval effectiveness based on user feedback. In SIGIR '12, pages 1133--1134, New York, NY, USA, 2012. Google ScholarDigital Library
- J. Li, S. Huffman, and A. Tokuda. Good abandonment in mobile and pc internet search. In SIGIR '09, pages 43--50, 2009. Google ScholarDigital Library
- Z. Liao, Y. Song, L.-w. He, and Y. Huang. Evaluating the effectiveness of search task trails. In WWW '12, pages 489--498, 2012. Google ScholarDigital Library
- T. Sakai, M. P. Kato, and Y.-I. Song. Click the search button and be happy: evaluating direct and immediate information access. In CIKM '11, pages 621--630, 2011. Google ScholarDigital Library
- S. Stamou and E. N. Efthimiadis. Queries without clicks: Successful or failed searches. In SIGIR 2009 Workshop on the Future of IR Evaluation, pages 13--14, 2009.Google Scholar
- S. Stamou and E. N. Efthimiadis. Interpreting user inactivity on search results. In ECIR'2010, pages 100--113, Berlin, Heidelberg, 2010. Springer-Verlag. Google ScholarDigital Library
- E. Thuma, S. Rogers, and I. Ounis. Evaluating bad query abandonment in an iterative sms-based faq retrieval system. In OAIR '13, pages 117--120, Paris, France, France, 2013. Google ScholarDigital Library
- I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. Support vector machine learning for interdependent and structured output spaces. In ICML '04, 2004. Google ScholarDigital Library
- M. wei Chang, V. Srikumar, D. Goldwasser, and D. Roth. Structured output learning with indirect supervision. In ICML '10, 2010.Google Scholar
- Q. Wu, C. J. Burges, K. M. Svore, and J. Gao. Adapting boosting for information retrieval measures. Inf. Retr., 13(3):254--270, June 2010. Google ScholarDigital Library
- T. Yao, M. Zhang, Y. Liu, S. Ma, Y. Zhang, and L. Ru. Investigating characteristics of non-click behavior using query logs. In AAIRS, volume 6458 of Lecture Notes in Computer Science, pages 85--96. Springer, 2010.Google Scholar
Index Terms
- Context-aware web search abandonment prediction
Recommendations
Leaving so soon?: understanding and predicting web search abandonment rationales
CIKM '12: Proceedings of the 21st ACM international conference on Information and knowledge managementUsers of search engines often abandon their searches. Despite the high frequency of Web search abandonment and its importance to Web search engines, little is known about why searchers abandon beyond that it can be for good or bad reasons. In this paper,...
Context-aware ranking in web search
SIGIR '10: Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrievalThe context of a search query often provides a search engine meaningful hints for answering the current query better. Previous studies on context-aware search were either focused on the development of context models or limited to a relatively small ...
Study on the Click Context of Web Search Users for Reliability Analysis
AIRS '09: Proceedings of the 5th Asia Information Retrieval Symposium on Information Retrieval TechnologyUser behavior information analysis has been shown important for optimization and evaluation of Web search and has become one of the major areas in both information retrieval and knowledge management researches. This paper focuses on users' searching ...
Comments