skip to main content
10.1145/2600428.2609604acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Context-aware web search abandonment prediction

Published:03 July 2014Publication History

ABSTRACT

Web search queries without hyperlink clicks are often referred to as abandoned queries. Understanding the reasons for abandonment is crucial for search engines in evaluating their performance. Abandonment can be categorized as good or bad depending on whether user information needs are satisfied by result page content. Previous research has sought to understand abandonment rationales via user surveys, or has developed models to predict those rationales using behavioral patterns. However, these models ignore important contextual factors such as the relationship between the abandoned query and prior abandonment instances. We propose more advanced methods for modeling and predicting abandonment rationales using contextual information from user search sessions by analyzing search engine logs, and discover dependencies between abandoned queries and user behaviors. We leverage these dependency signals to build a sequential classifier using a structured learning framework designed to handle such signals. Our experimental results show that our approach is 22% more accurate than the state-of-the-art abandonment-rationale classifier. Going beyond prediction, we leverage the prediction results to significantly improve relevance using instances of predicted good and bad abandonment.

References

  1. M. Ageev, Q. Guo, D. Lagun, and E. Agichtein. Find it if you can: a game for modeling different types of web search success using interaction data. In SIGIR '11, pages 345--354, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Y. Altun, I. Tsochantaridis, and T. Hofmann. Hidden markov support vector machines. In ICML '03, pages 104--111, 2003.Google ScholarGoogle Scholar
  3. M. S. Bernstein, J. Teevan, S. Dumais, D. Liebling, and E. Horvitz. Direct answers for search queries in the long tail. In CHI '12, pages 237--246, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. G. Buscher, R. W. White, S. Dumais, and J. Huang. Large-scale analysis of individual and task differences in search result page examination strategies. In WSDM '12, pages 373--382, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. C. Castillo, A. Gionis, R. Lempel, and Y. Maarek. When no clicks are good news. In SIGIR 2010 Industry Track, 2010.Google ScholarGoogle Scholar
  6. M.-W. Chang and W. tau Yih. Dual coordinate descent algorithms for efficient large margin structured prediction. TACL, 1:207--218, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  7. L. B. Chilton and J. Teevan. Addressing people's information needs directly in a web search result page. In WWW '11, pages 27--36, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. A. Chuklin and P. Serdyukov. Good abandonments in factoid queries. In WWW '12 Companion, pages 483--484, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. A. Chuklin and P. Serdyukov. How query extensions reflect search result abandonments. In SIGIR '12, pages 1087--1088, New York, NY, USA, 2012. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Chuklin and P. Serdyukov. Potential good abandonment prediction. In WWW '12 Companion, pages 485--486, New York, NY, USA, 2012. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. A. Diriye, R. White, G. Buscher, and S. Dumais. Leaving so soon?: understanding and predicting web search abandonment rationales. In CIKM '12, pages 1025--1034, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Friedman, T. Hastie, and R. Tibshirani. Additive logistic regression: a statistical view of boosting. Annals of Statistics, 28:2000, 1998.Google ScholarGoogle Scholar
  13. A. Hassan, R. Jones, and K. L. Klinkner. Beyond dcg: user behavior as a predictor of a successful search. In WSDM '10, pages 221--230, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. A. Hassan, Y. Song, and L.-w. He. A task level metric for measuring web search satisfaction and its application on improving relevance estimation. In CIKM '11, pages 125--134, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. J. Huang, R. W. White, and S. Dumais. No clicks, no problem: using cursor movements to understand and improve search. In CHI '11, pages 1225--1234, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. T. Joachims. Optimizing search engines using clickthrough data. In KDD '02, pages 133--142, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Accurately interpreting clickthrough data as implicit feedback. In SIGIR '05, pages 154--161, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. A. Koumpouri and V. Simaki. Queries without clicks: Evaluating retrieval effectiveness based on user feedback. In SIGIR '12, pages 1133--1134, New York, NY, USA, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. J. Li, S. Huffman, and A. Tokuda. Good abandonment in mobile and pc internet search. In SIGIR '09, pages 43--50, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Z. Liao, Y. Song, L.-w. He, and Y. Huang. Evaluating the effectiveness of search task trails. In WWW '12, pages 489--498, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. T. Sakai, M. P. Kato, and Y.-I. Song. Click the search button and be happy: evaluating direct and immediate information access. In CIKM '11, pages 621--630, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. S. Stamou and E. N. Efthimiadis. Queries without clicks: Successful or failed searches. In SIGIR 2009 Workshop on the Future of IR Evaluation, pages 13--14, 2009.Google ScholarGoogle Scholar
  23. S. Stamou and E. N. Efthimiadis. Interpreting user inactivity on search results. In ECIR'2010, pages 100--113, Berlin, Heidelberg, 2010. Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. E. Thuma, S. Rogers, and I. Ounis. Evaluating bad query abandonment in an iterative sms-based faq retrieval system. In OAIR '13, pages 117--120, Paris, France, France, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. Support vector machine learning for interdependent and structured output spaces. In ICML '04, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. M. wei Chang, V. Srikumar, D. Goldwasser, and D. Roth. Structured output learning with indirect supervision. In ICML '10, 2010.Google ScholarGoogle Scholar
  27. Q. Wu, C. J. Burges, K. M. Svore, and J. Gao. Adapting boosting for information retrieval measures. Inf. Retr., 13(3):254--270, June 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. T. Yao, M. Zhang, Y. Liu, S. Ma, Y. Zhang, and L. Ru. Investigating characteristics of non-click behavior using query logs. In AAIRS, volume 6458 of Lecture Notes in Computer Science, pages 85--96. Springer, 2010.Google ScholarGoogle Scholar

Index Terms

  1. Context-aware web search abandonment prediction

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval
      July 2014
      1330 pages
      ISBN:9781450322577
      DOI:10.1145/2600428

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 3 July 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader