ABSTRACT
Understanding 1 and predicting user click behavior on a web search engine results page is critical for online advertising and recommendation engines. The click prediction results can be further used to estimate the relevance of the search engine results. Sequence-to-sequence models are effective for predicting user click behavior since they consider contextual information in the input sequence, and transformers are the recent state of the art in sequence learning. A novel transformer model is proposed in this paper for click prediction and relevance estimation that learns additionally from the vertical information, apart from the query and search engine results that are the inputs for the traditional click models. Vertical information is the representation style of a document in the search engine results page. The proposed vertical-aware transformer click model (v-TCM) takes into account both the position bias and the vertical bias of the search engine results. From our experiments, it is proved that v-TCM outperforms the existing click models for the click prediction and relevance estimation tasks.
- Chapelle, O. and Zhang, Y., 2009, April. A dynamic bayesian network click model for web search ranking. In Proceedings of the 18th international conference on World wide web (pp. 1--10).Google Scholar
- Dupret, G.E. and Piwowarski, B., 2008, July. A user browsing model to predict search engine click data from past observations. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval (pp. 331--338).Google Scholar
- Guo, F., Liu, C. and Wang, Y.M., 2009, February. Efficient multiple-click models in web search. In Proceedings of the second acm international conference on web search and data mining (pp. 124--131).Google Scholar
- Borisov, A., Markov, I., De Rijke, M. and Serdyukov, P., 2016, April. A neural click model for web search. In Proceedings of the 25th International Conference on World Wide Web (pp. 531--541).Google Scholar
- Borisov, A., Wardenaar, M., Markov, I. and de Rijke, M., 2018, June. A click sequence model for web search. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 45--54).Google Scholar
- Bisht, K. and Susan, S., 2021, May. Weighted Ensemble of Neural and Probabilistic Graphical Models for Click Prediction. In 2021 the 5th International Conference on Information System and Data Mining (pp. 145--150).Google Scholar
- Li, X., Liu, Y., Cai, R. and Ma, S., 2017, February. Investigation of user search behavior while facing heterogeneous search services. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining (pp. 161--170).Google Scholar
- Wang, C., Liu, Y., Zhang, M., Ma, S., Zheng, M., Qian, J. and Zhang, K., 2013, July. Incorporating vertical results into search click models. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (pp. 503--512).Google Scholar
- Chen, D., Chen, W., Wang, H., Chen, Z. and Yang, Q., 2012, February. Beyond ten blue links: enabling user click modeling in federated web search. In Proceedings of the fifth ACM international conference on Web search and data mining (pp. 463--472).Google Scholar
- Chuklin, A., Zhou, K., Schuth, A., Sietsma, F. and De Rijke, M., 2014, July. Evaluating intuitiveness of vertical-aware click models. In Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval (pp. 1075--1078).Google Scholar
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł. and Polosukhin, I., 2017. Attention is all you need. In Advances in neural information processing systems (pp. 5998--6008).Google Scholar
- Bahdanau, D., Cho, K. and Bengio, Y., 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.Google Scholar
- Li, Z., Cheng, W., Chen, Y., Chen, H. and Wang, W., 2020, January. Interpretable click-through rate prediction through hierarchical attention. In Proceedings of the 13th International Conference on Web Search and Data Mining (pp. 313--321).Google Scholar
- Mallick, R., Susan, S., Agrawal, V., Garg, R. and Rawal, P., 2021, March. Context-and sequence-aware convolutional recurrent encoder for neural machine translation. In Proceedings of the 36th Annual ACM Symposium on Applied Computing (pp. 853--856).Google Scholar
- Goel, R., Vashisht, S., Dhanda, A. and Susan, S., 2021, January. An Empathetic Conversational Agent with Attentional Mechanism. In 2021 International Conference on Computer Communication and Informatics (ICCCI) (pp. 1--4). IEEE.Google Scholar
- Chen, J., Mao, J., Liu, Y., Zhang, M. and Ma, S., 2020, January. A context-aware click model for web search. In Proceedings of the 13th International Conference on Web Search and Data Mining (pp. 88--96).Google Scholar
- Chen, Q., Zhao, H., Li, W., Huang, P. and Ou, W., 2019, August. Behavior sequence transformer for e-commerce recommendation in alibaba. In Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data (pp. 1--4).Google Scholar
- Chen, J., Mao, J., Liu, Y., Zhang, M. and Ma, S., 2019, November. TianGong-ST: A new dataset with large-scale refined real-world web search sessions. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (pp. 2485--2488).Google Scholar
Index Terms
- v-TCM: vertical-aware transformer click model for web search
Recommendations
A Context-Aware Click Model for Web Search
WSDM '20: Proceedings of the 13th International Conference on Web Search and Data MiningTo better exploit the search logs, various click models have been proposed to extract implicit relevance feedback from user clicks. Most traditional click models are based on probability graphical models (PGMs) with manually designed dependencies. ...
New features for query dependent sponsored search click prediction
WWW '13 Companion: Proceedings of the 22nd International Conference on World Wide WebClick prediction for sponsored search is an important problem for commercial search engines. Good click prediction algorithm greatly affects on the revenue of the search engine, user experience and brings more clicks to landing pages of advertisers. ...
Improving Ranking Consistency for Web Search by Leveraging a Knowledge Base and Search Logs
CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge ManagementIn this paper, we propose a new idea called ranking consistency in web search. Relevance ranking is one of the biggest problems in creating an effective web search system. Given some queries with similar search intents, conventional approaches typically ...
Comments