skip to main content
10.1145/3477314.3507214acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
poster

v-TCM: vertical-aware transformer click model for web search

Published:06 May 2022Publication History

ABSTRACT

Understanding 1 and predicting user click behavior on a web search engine results page is critical for online advertising and recommendation engines. The click prediction results can be further used to estimate the relevance of the search engine results. Sequence-to-sequence models are effective for predicting user click behavior since they consider contextual information in the input sequence, and transformers are the recent state of the art in sequence learning. A novel transformer model is proposed in this paper for click prediction and relevance estimation that learns additionally from the vertical information, apart from the query and search engine results that are the inputs for the traditional click models. Vertical information is the representation style of a document in the search engine results page. The proposed vertical-aware transformer click model (v-TCM) takes into account both the position bias and the vertical bias of the search engine results. From our experiments, it is proved that v-TCM outperforms the existing click models for the click prediction and relevance estimation tasks.

References

  1. Chapelle, O. and Zhang, Y., 2009, April. A dynamic bayesian network click model for web search ranking. In Proceedings of the 18th international conference on World wide web (pp. 1--10).Google ScholarGoogle Scholar
  2. Dupret, G.E. and Piwowarski, B., 2008, July. A user browsing model to predict search engine click data from past observations. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval (pp. 331--338).Google ScholarGoogle Scholar
  3. Guo, F., Liu, C. and Wang, Y.M., 2009, February. Efficient multiple-click models in web search. In Proceedings of the second acm international conference on web search and data mining (pp. 124--131).Google ScholarGoogle Scholar
  4. Borisov, A., Markov, I., De Rijke, M. and Serdyukov, P., 2016, April. A neural click model for web search. In Proceedings of the 25th International Conference on World Wide Web (pp. 531--541).Google ScholarGoogle Scholar
  5. Borisov, A., Wardenaar, M., Markov, I. and de Rijke, M., 2018, June. A click sequence model for web search. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 45--54).Google ScholarGoogle Scholar
  6. Bisht, K. and Susan, S., 2021, May. Weighted Ensemble of Neural and Probabilistic Graphical Models for Click Prediction. In 2021 the 5th International Conference on Information System and Data Mining (pp. 145--150).Google ScholarGoogle Scholar
  7. Li, X., Liu, Y., Cai, R. and Ma, S., 2017, February. Investigation of user search behavior while facing heterogeneous search services. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining (pp. 161--170).Google ScholarGoogle Scholar
  8. Wang, C., Liu, Y., Zhang, M., Ma, S., Zheng, M., Qian, J. and Zhang, K., 2013, July. Incorporating vertical results into search click models. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (pp. 503--512).Google ScholarGoogle Scholar
  9. Chen, D., Chen, W., Wang, H., Chen, Z. and Yang, Q., 2012, February. Beyond ten blue links: enabling user click modeling in federated web search. In Proceedings of the fifth ACM international conference on Web search and data mining (pp. 463--472).Google ScholarGoogle Scholar
  10. Chuklin, A., Zhou, K., Schuth, A., Sietsma, F. and De Rijke, M., 2014, July. Evaluating intuitiveness of vertical-aware click models. In Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval (pp. 1075--1078).Google ScholarGoogle Scholar
  11. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł. and Polosukhin, I., 2017. Attention is all you need. In Advances in neural information processing systems (pp. 5998--6008).Google ScholarGoogle Scholar
  12. Bahdanau, D., Cho, K. and Bengio, Y., 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.Google ScholarGoogle Scholar
  13. Li, Z., Cheng, W., Chen, Y., Chen, H. and Wang, W., 2020, January. Interpretable click-through rate prediction through hierarchical attention. In Proceedings of the 13th International Conference on Web Search and Data Mining (pp. 313--321).Google ScholarGoogle Scholar
  14. Mallick, R., Susan, S., Agrawal, V., Garg, R. and Rawal, P., 2021, March. Context-and sequence-aware convolutional recurrent encoder for neural machine translation. In Proceedings of the 36th Annual ACM Symposium on Applied Computing (pp. 853--856).Google ScholarGoogle Scholar
  15. Goel, R., Vashisht, S., Dhanda, A. and Susan, S., 2021, January. An Empathetic Conversational Agent with Attentional Mechanism. In 2021 International Conference on Computer Communication and Informatics (ICCCI) (pp. 1--4). IEEE.Google ScholarGoogle Scholar
  16. Chen, J., Mao, J., Liu, Y., Zhang, M. and Ma, S., 2020, January. A context-aware click model for web search. In Proceedings of the 13th International Conference on Web Search and Data Mining (pp. 88--96).Google ScholarGoogle Scholar
  17. Chen, Q., Zhao, H., Li, W., Huang, P. and Ou, W., 2019, August. Behavior sequence transformer for e-commerce recommendation in alibaba. In Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data (pp. 1--4).Google ScholarGoogle Scholar
  18. Chen, J., Mao, J., Liu, Y., Zhang, M. and Ma, S., 2019, November. TianGong-ST: A new dataset with large-scale refined real-world web search sessions. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (pp. 2485--2488).Google ScholarGoogle Scholar

Index Terms

  1. v-TCM: vertical-aware transformer click model for web search

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SAC '22: Proceedings of the 37th ACM/SIGAPP Symposium on Applied Computing
        April 2022
        2099 pages
        ISBN:9781450387132
        DOI:10.1145/3477314

        Copyright © 2022 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 6 May 2022

        Check for updates

        Qualifiers

        • poster

        Acceptance Rates

        Overall Acceptance Rate1,650of6,669submissions,25%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader