Skip to main content
Top

2023 | OriginalPaper | Chapter

Bi-directional Contrastive Distillation for Multi-behavior Recommendation

Authors : Yabo Chu, Enneng Yang, Qiang Liu, Yuting Liu, Linying Jiang, Guibing Guo

Published in: Machine Learning and Knowledge Discovery in Databases

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-behavior recommendation leverages auxiliary behaviors (e.g., view, add-to-cart) to improve the prediction for target behaviors (e.g., buy). Most existing works are built upon the assumption that all the auxiliary behaviors are positively correlated with target behaviors. However, we empirically find that such an assumption may not hold in real-world datasets. In fact, some auxiliary feedback is too noisy to be helpful, and it is necessary to restrict its influence for better performance. To this end, in this paper we propose a Bi-directional Contrastive Distillation (BCD) model for multi-behavior recommendation, aiming to distill valuable knowledge (about user preference) from the interplay of multiple user behaviors. Specifically, we design a forward distillation to distill the knowledge from auxiliary behaviors to help model target behaviors, and then a backward distillation to distill the knowledge from target behaviors to enhance the modelling of auxiliary behaviors. Through this circular learning, we can better extract the common knowledge from multiple user behaviors, where noisy auxiliary behaviors will not be involved. The experimental results on two real-world datasets show that our approach outperforms other counterparts in accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chen, C., et al.: Graph heterogeneous multi-relational recommendation. In: Proceedings of AAAI (2021) Chen, C., et al.: Graph heterogeneous multi-relational recommendation. In: Proceedings of AAAI (2021)
2.
go back to reference Chen, C., et al.: An efficient adaptive transfer neural network for social-aware recommendation. In: Proceedings of SIGIR (2019) Chen, C., et al.: An efficient adaptive transfer neural network for social-aware recommendation. In: Proceedings of SIGIR (2019)
3.
go back to reference Chen, C., Zhang, M., Zhang, Y., Ma, W., Liu, Y., Ma, S.: Efficient heterogeneous collaborative filtering without negative sampling for recommendation. In: Proceedings of AAAI (2020) Chen, C., Zhang, M., Zhang, Y., Ma, W., Liu, Y., Ma, S.: Efficient heterogeneous collaborative filtering without negative sampling for recommendation. In: Proceedings of AAAI (2020)
4.
go back to reference Chen, T., Kornblith, S., Norouzi, M., Hinton, G.: A simple framework for contrastive learning of visual representations. In: Proceedings of ICML (2020) Chen, T., Kornblith, S., Norouzi, M., Hinton, G.: A simple framework for contrastive learning of visual representations. In: Proceedings of ICML (2020)
5.
6.
go back to reference Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018) Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:​1810.​04805 (2018)
7.
go back to reference Devooght, R., Kourtellis, N., Mantrach, A.: Dynamic matrix factorization with priors on unknown values. In: Proceedings of KDD (2015) Devooght, R., Kourtellis, N., Mantrach, A.: Dynamic matrix factorization with priors on unknown values. In: Proceedings of KDD (2015)
8.
go back to reference Gao, C., et al.: Neural multi-task recommendation from multi-behavior data. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE) (2019) Gao, C., et al.: Neural multi-task recommendation from multi-behavior data. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE) (2019)
9.
go back to reference Hamilton, W., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. In: Proceedings of NeurIPS (2017) Hamilton, W., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. In: Proceedings of NeurIPS (2017)
10.
go back to reference He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., Wang, M.: LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of SIGIR (2020) He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., Wang, M.: LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of SIGIR (2020)
11.
go back to reference Jansen, B.J., Schuster, S.: Bidding on the buying funnel for sponsored search and keyword advertising. J. Electron. Commerce Res. (2011) Jansen, B.J., Schuster, S.: Bidding on the buying funnel for sponsored search and keyword advertising. J. Electron. Commerce Res. (2011)
12.
go back to reference Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst. (TOIS) (2002) Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst. (TOIS) (2002)
13.
go back to reference Jin, B., Gao, C., He, X., Jin, D., Li, Y.: Multi-behavior recommendation with graph convolutional networks. In: Proceedings of SIGIR (2020) Jin, B., Gao, C., He, X., Jin, D., Li, Y.: Multi-behavior recommendation with graph convolutional networks. In: Proceedings of SIGIR (2020)
14.
go back to reference Jing, L., Vincent, P., LeCun, Y., Tian, Y.: Understanding dimensional collapse in contrastive self-supervised learning. arXiv preprint arXiv:2110.09348 (2021) Jing, L., Vincent, P., LeCun, Y., Tian, Y.: Understanding dimensional collapse in contrastive self-supervised learning. arXiv preprint arXiv:​2110.​09348 (2021)
15.
go back to reference Kang, S., Hwang, J., Kweon, W., Yu, H.: De-RRD: a knowledge distillation framework for recommender system. In: Proceedings of CIKM (2020) Kang, S., Hwang, J., Kweon, W., Yu, H.: De-RRD: a knowledge distillation framework for recommender system. In: Proceedings of CIKM (2020)
16.
go back to reference Liang, D., Charlin, L., McInerney, J., Blei, D.M.: Modeling user exposure in recommendation. In: Proceedings of WWW (2016) Liang, D., Charlin, L., McInerney, J., Blei, D.M.: Modeling user exposure in recommendation. In: Proceedings of WWW (2016)
17.
go back to reference Liu, Q., Wu, S., Wang, L.: Multi-behavioral sequential prediction with recurrent log-bilinear model. IEEE Trans. Knowl. Data Eng. (2017) Liu, Q., Wu, S., Wang, L.: Multi-behavioral sequential prediction with recurrent log-bilinear model. IEEE Trans. Knowl. Data Eng. (2017)
18.
go back to reference Maas, A.L., Hannun, A.Y., Ng, A.Y.: Rectifier nonlinearities improve neural network acoustic models. In: Proceedings of ICML (2013) Maas, A.L., Hannun, A.Y., Ng, A.Y.: Rectifier nonlinearities improve neural network acoustic models. In: Proceedings of ICML (2013)
19.
go back to reference Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Sig. Process. (1997) Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Sig. Process. (1997)
20.
go back to reference Tang, L., Long, B., Chen, B.C., Agarwal, D.: An empirical study on recommendation with multiple types of feedback. In: Proceedings of KDD (2016) Tang, L., Long, B., Chen, B.C., Agarwal, D.: An empirical study on recommendation with multiple types of feedback. In: Proceedings of KDD (2016)
22.
go back to reference Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., Bengio, Y.: Graph attention networks. In: Proceedings of ICLR (2018) Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., Bengio, Y.: Graph attention networks. In: Proceedings of ICLR (2018)
23.
go back to reference Voorhees, E.M., et al.: The trec-8 question answering track report. In: TREC (1999) Voorhees, E.M., et al.: The trec-8 question answering track report. In: TREC (1999)
24.
go back to reference Wan, M., McAuley, J.: Item recommendation on monotonic behavior chains. In: Proceedings of the 12th ACM Conference on Recommender Systems (2018) Wan, M., McAuley, J.: Item recommendation on monotonic behavior chains. In: Proceedings of the 12th ACM Conference on Recommender Systems (2018)
25.
go back to reference Wang, W., et al.: Beyond clicks: modeling multi-relational item graph for session-based target behavior prediction. In: Proceedings of WWW (2020) Wang, W., et al.: Beyond clicks: modeling multi-relational item graph for session-based target behavior prediction. In: Proceedings of WWW (2020)
26.
go back to reference Wang, Y., Wang, L., Li, Y., He, D., Liu, T.Y.: A theoretical analysis of NDCG type ranking measures. In: Conference on Learning Theory (2013) Wang, Y., Wang, L., Li, Y., He, D., Liu, T.Y.: A theoretical analysis of NDCG type ranking measures. In: Conference on Learning Theory (2013)
27.
go back to reference Wei, W., Huang, C., Xia, L., Xu, Y., Zhao, J., Yin, D.: Contrastive meta learning with behavior multiplicity for recommendation. In: Proceedings of WSDM (2022) Wei, W., Huang, C., Xia, L., Xu, Y., Zhao, J., Yin, D.: Contrastive meta learning with behavior multiplicity for recommendation. In: Proceedings of WSDM (2022)
28.
go back to reference Wei, Y., et al.: Contrastive learning for cold-start recommendation. In: Proceedings of ACM MM (2021) Wei, Y., et al.: Contrastive learning for cold-start recommendation. In: Proceedings of ACM MM (2021)
29.
go back to reference Xia, L., Xu, Y., Huang, C., Dai, P., Bo, L.: Graph meta network for multi-behavior recommendation. In: Proceedings of SIGIR (2021) Xia, L., Xu, Y., Huang, C., Dai, P., Bo, L.: Graph meta network for multi-behavior recommendation. In: Proceedings of SIGIR (2021)
31.
go back to reference Zhang, J., Zhu, Y., Liu, Q., Zhang, M., Wu, S., Wang, L.: Latent structures mining with contrastive modality fusion for multimedia recommendation. arXiv preprint arXiv:2111.00678 (2021) Zhang, J., Zhu, Y., Liu, Q., Zhang, M., Wu, S., Wang, L.: Latent structures mining with contrastive modality fusion for multimedia recommendation. arXiv preprint arXiv:​2111.​00678 (2021)
32.
go back to reference Zhang, J., Xu, X., Shen, F., Lu, H., Liu, X., Shen, H.T.: Enhancing audio-visual association with self-supervised curriculum learning. In: Proceedings of AAAI (2021) Zhang, J., Xu, X., Shen, F., Lu, H., Liu, X., Shen, H.T.: Enhancing audio-visual association with self-supervised curriculum learning. In: Proceedings of AAAI (2021)
Metadata
Title
Bi-directional Contrastive Distillation for Multi-behavior Recommendation
Authors
Yabo Chu
Enneng Yang
Qiang Liu
Yuting Liu
Linying Jiang
Guibing Guo
Copyright Year
2023
DOI
https://doi.org/10.1007/978-3-031-26387-3_30

Premium Partner