Denis Savenkov
ABSTRACT
Sometimes, during a search task users may switch from one search engine to another for several reasons, e.g., dissatisfaction with the current search results or desire for broader topic coverage. Detecting the fact of switching is difficult but important for understanding users' satisfaction with the search engine and the complexity of their search tasks, leading to economic significance for search providers. Previous research on switching detection mainly focused on studying different signals useful for the task and particular reasons for switching. Although it is known that switching is a personal choice of a user and different users have different search behavior, little has been done to understand how these differences could be used for switching detection. In this paper we study the effectiveness of learning personal behavior patterns for switching detection and present a personalized approach which uses user's session history containing sessions with and without switches. Experiments show that users' personal habits and behavior patterns are indeed among the most informative signals. Our findings can be used by a search log analyzer for engine switching detection and potentially other log mining problems, thus providing valuable signals for search providers to improve user experience.
- M. Ageev, Q. Guo, D. Lagun, and E. Agichtein. Find It If You Can: A Game for Modeling Different Types of Web Search Success Using Interaction Data. In Proc. of SIGIR'11, pages 345-354, New York, New York, USA, July 2011. ACM Press. Google Scholar
Digital Library
- E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. In Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR '06, pages 19-26, New York, NY, USA, 2006. ACM. Google ScholarDigital Library
- A. Aula, R. M. Khan, and Z. Guan. How does search behavior change as search becomes more difficult? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10, pages 35-44, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- P. N. Bennett, R. W. White, W. Chu, S. T. Dumais, P. Bailey, F. Borisyuk, and X. Cui. Modeling the impact of short- and long-term behavior on search personalization. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval, SIGIR '12, pages 185-194, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- G. Buscher, R. W. White, S. Dumais, and J. Huang. Large-scale analysis of individual and task differences in search result page examination strategies. In Proceedings of the fifth ACM international conference on Web search and data mining, WSDM '12, pages 373-382, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- H. Cao, D. Jiang, J. Pei, Q. He, Z. Liao, E. Chen, and H. Li. Context-aware query suggestion by mining click-through and session data. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '08, pages 875-883, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- G. Dupret and C. Liao. A model to estimate intrinsic document relevance from the clickthrough logs of a web search engine. In Proceedings of the third ACM international conference on Web search and data mining, WSDM '10, pages 181-190, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- H. A. Feild, J. Allan, and R. Jones. Predicting searcher frustration. In Proc. of SIGIR'10, pages 34-41, New York, New York, USA, July 2010. ACM Press. Google ScholarDigital Library
- Q. Guo, R. White, Y. Zhang, B. Anderson, and S. Dumais. Why searchers switch: understanding and predicting engine switching rationales. In Proc. of SIGIR'11, pages 335-344, 2011. Google ScholarDigital Library
- A. Hassan. A semi-supervised approach to modeling web search satisfaction. In Proc. of SIGIR'12, pages 275-284, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- A. Hassan, R. Jones, and K. L. Klinkner. Beyond DCG: User Behavior as a Predictor of a Successful Search. In Proc. of WSDM'10, pages 221-230, New York, New York, USA, Feb. 2010. ACM Press. Google ScholarDigital Library
- A. Hassan, Y. Song, and L.-w. He. A task level metric for measuring web search satisfaction and its application on improving relevance estimation. In Proc. of CIKM'11, pages 125-134, New York, New York, USA, Oct. 2011. ACM Press. Google ScholarDigital Library
- A. Heath and R. White. Defection detection: Predicting search engine switching. In Proc. of WWW'08, pages 1173-1174, 2008. Google ScholarDigital Library
- S. Laxman, V. Tankasali, and R. W. White. Stream prediction using a generative model based on frequent episodes in event sequences. In Proc. of SIGKDD'08, pages 453-461, New York, New York, USA, Aug. 2008. ACM Press. Google ScholarDigital Library
- C. Ling, J. Huang, and H. Zhang. Auc: a statistically consistent and more discriminating measure than accuracy. In International Joint Conference on Artificial Intelligence, volume 18, pages 519-526, 2003. Google ScholarDigital Library
- F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Machine Learning in Python . Journal of Machine Learning Research, 12:2825-2830, 2011. Google ScholarDigital Library
- S. Shen, B. Hu, W. Chen, and Q. Yang. Personalized click model through collaborative filtering. In Proceedings of the fifth ACM international conference on Web search and data mining, WSDM '12, pages 323-332, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- D. Sontag, K. Collins-Thompson, P. N. Bennett, R. W. White, S. Dumais, and B. Billerbeck. Probabilistic models for personalizing web search. In Proceedings of the fifth ACM international conference on Web search and data mining, WSDM '12, pages 433-442, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- S. Tyree, K. Weinberger, K. Agrawal, and J. Paykin. Parallel boosted regression trees for web search ranking. In Proc. of WWW'11, pages 387-396. ACM. Google ScholarDigital Library
- R. White and S. Dumais. Characterizing and predicting search engine switching behavior. In Proc. of CIKM'09, pages 87-96. ACM, 2009. Google ScholarDigital Library
- R. White, A. Kapoor, and S. Dumais. Modeling long-term search engine usage. User Modeling, Adaptation, and Personalization, pages 28-39, 2010. Google ScholarDigital Library
- R. W. White and S. M. Drucker. Investigating behavioral variability in web search. In Proceedings of the 16th international conference on World Wide Web, WWW '07, pages 21-30, New York, NY, USA, 2007. ACM. Google ScholarDigital Library
Index Terms
- Search engine switching detection based on user personal preferences and behavior patterns
Recommendations
Characterizing and predicting search engine switching behavior
CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge managementSearch engine switching describes the voluntarily transition from one Web search engine to another. In this paper we present a study of search engine switching behavior that combines large-scale log-based analysis and survey data. We characterize ...
Search Engine Evaluation based on Search Engine Switching Prediction
SIGIR '15: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information RetrievalIn this paper we present a novel application of the search engine switching prediction model for online evaluation. We propose a new metric pSwitch for A/B-testing, which allows us to evaluate the quality of search engines in different aspects such as ...
Enhancing web search by promoting multiple search engine use
SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrievalAny given Web search engine may provide higher quality results than others for certain queries. Therefore, it is in users' best interest to utilize multiple search engines. In this paper, we propose and evaluate a framework that maximizes users' search ...
Comments