Skip to main content
Top
Published in: International Journal of Data Science and Analytics 2/2023

12-03-2023 | Regular Paper

Privacy preserving cold-start recommendation for out-of-matrix users via content baskets

Authors: Michael Sun, Andrew Wang

Published in: International Journal of Data Science and Analytics | Issue 2/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Guest users, single-time clients who use an online service anonymously without prior registration, are common in real-world recommendation applications, requiring industrial recommendation systems to handle the “cold-start” problem in which no existing interactions between new users and recommendable items can be drawn from to make predictions.Prior work addresses this problem by learning profiling user representations to bootstrap recommendations for new users. However, this process can often be invasive, requiring new users to submit personal data, or shallow, yielding unexpressive representations for accurate recommendations. In this work, we propose new representations for guest users based on their “content basket.” A set of seed items is submitted by the user to use the service, allowing each user to be represented as a function of a collection of items. Simultaneously, we design a graph representation space in which items (nodes) are connected by edges that signify joint, written recommendations between items. We propose a graph neural network architecture that inductively learns item and inter-item (edge) representations as a combination of deep language encodings of textual content descriptions and graph embeddings learned via message passing on the edges. This scheme enables effective generalization to items unseen during training. To demonstrate the effectiveness of our model on a real-world setting in which guest users are prevalent, we present a new dataset for anime recommendations, AnimeULike, containing anonymized interactions between  13k users and 10k animes, with an accompanying recommendation engine which can exclusively serve guest users. Our empirical results on AnimeULike and a standard recommender systems benchmark dataset demonstrate significant performance improvements over previous cold-start solutions that do not learn to dynamically represent new users.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
The name “DropoutNet” is slightly misleading if the substitutions made are \(V_v \leftarrow \) 0 and \(U_u \leftarrow 0\). We keep more flexibility in the choice of the mask function.
 
2
It may be the case on AnimeULike, \(U_u\) was basically noise already, so DN couldn’t overfit to U, which caused the user transform approximation to help to an extent.
 
3
This is akin to DNN (removed GNN), except the language encoder is differentiable.
 
6
visualized using Cytoscape.js.
 
Literature
1.
go back to reference Ahmadian, S., Afsharchi, M., Meghdadi, M.: A novel approach based on multi-view reliability measures to alleviate data sparsity in recommender systems. Multimedia Tools Appl. 78(13), 17763–17798 (2019)CrossRef Ahmadian, S., Afsharchi, M., Meghdadi, M.: A novel approach based on multi-view reliability measures to alleviate data sparsity in recommender systems. Multimedia Tools Appl. 78(13), 17763–17798 (2019)CrossRef
2.
go back to reference Bernardi, L., Kamps, J., Kiseleva, J., Müller, M.: The continuous cold-start problem in e-commerce recommender systems. CBRecSys@RecSys (2015) Bernardi, L., Kamps, J., Kiseleva, J., Müller, M.: The continuous cold-start problem in e-commerce recommender systems. CBRecSys@RecSys (2015)
4.
go back to reference Bogers, T., Van den Bosch, A.: Recommending scientific articles using citeulike. In: Proceedings of the 2008 ACM conference on Recommender systems, pp. 287–290 (2008) Bogers, T., Van den Bosch, A.: Recommending scientific articles using citeulike. In: Proceedings of the 2008 ACM conference on Recommender systems, pp. 287–290 (2008)
5.
go back to reference Chee, S.H.S., Han, J., Wang, K.: Rectree: an efficient collaborative filtering method. In: International Conference on Data Warehousing and Knowledge Discovery. Springer, pp. 141–151 (2001) Chee, S.H.S., Han, J., Wang, K.: Rectree: an efficient collaborative filtering method. In: International Conference on Data Warehousing and Knowledge Discovery. Springer, pp. 141–151 (2001)
6.
go back to reference Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018) Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:​1810.​04805 (2018)
7.
go back to reference Eksombatchai, C., Jindal, P., Liu, J.Z., Liu, Yuchen, S., Rahul, Sugnet, C., Ulrich, M., Leskovec, J.: Pixie: a system for recommending 3+ billion items to 200+ million users in real-time. In: Proceedings of the 2018 world wide web conference, pp. 1775–1784 (2018) Eksombatchai, C., Jindal, P., Liu, J.Z., Liu, Yuchen, S., Rahul, Sugnet, C., Ulrich, M., Leskovec, J.: Pixie: a system for recommending 3+ billion items to 200+ million users in real-time. In: Proceedings of the 2018 world wide web conference, pp. 1775–1784 (2018)
8.
go back to reference Gopalan, P., Hofman, J., Blei, D.: Scalable recommendation with hierarchical poisson factorization. In: Proceedings of the thirty-first conference on uncertainty in artificial intelligence, pp. 326–335 (2015) Gopalan, P., Hofman, J., Blei, D.: Scalable recommendation with hierarchical poisson factorization. In: Proceedings of the thirty-first conference on uncertainty in artificial intelligence, pp. 326–335 (2015)
9.
go back to reference Hamilton, W.L., Ying, R., Leskovec, J.: Inductive representation learning on large graphs. In: NIPS (2017) Hamilton, W.L., Ying, R., Leskovec, J.: Inductive representation learning on large graphs. In: NIPS (2017)
10.
go back to reference Hao, B., Zhang, J., Yin, H., Li, C., Chen, H.: Pre-training graph neural networks for cold-start users and items representation. In: Proceedings Of The 14th ACM International Conference On Web Search And Data Mining, pp. 265–273 (2021) Hao, B., Zhang, J., Yin, H., Li, C., Chen, H.: Pre-training graph neural networks for cold-start users and items representation. In: Proceedings Of The 14th ACM International Conference On Web Search And Data Mining, pp. 265–273 (2021)
11.
go back to reference He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., Wang, M.: LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp. 639–648 (2020). https://doi.org/10.1145/3397271.3401063 He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., Wang, M.: LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp. 639–648 (2020). https://​doi.​org/​10.​1145/​3397271.​3401063
12.
go back to reference Hofmann, T.: Latent semantic models for collaborative filtering. ACM Trans. Inf. Syst. (TOIS) 22(1), 89–115 (2004)CrossRef Hofmann, T.: Latent semantic models for collaborative filtering. ACM Trans. Inf. Syst. (TOIS) 22(1), 89–115 (2004)CrossRef
13.
go back to reference Hu, W., Liu, B, Gomes, J., Zitnik, M., Liang, P., Pande, V., Leskovec, J: Strategies for pre-training graph neural networks. In: International Conference on Learning Representations (2020) Hu, W., Liu, B, Gomes, J., Zitnik, M., Liang, P., Pande, V., Leskovec, J: Strategies for pre-training graph neural networks. In: International Conference on Learning Representations (2020)
14.
go back to reference Hu, Y., Koren, Yehuda, Volinsky, Chris: Collaborative filtering for implicit feedback datasets. In: 2008 Eighth IEEE International Conference on Data Mining. IEEE, pp. 263–272 (2008) Hu, Y., Koren, Yehuda, Volinsky, Chris: Collaborative filtering for implicit feedback datasets. In: 2008 Eighth IEEE International Conference on Data Mining. IEEE, pp. 263–272 (2008)
16.
go back to reference Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (ICLR) (2017) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (ICLR) (2017)
17.
go back to reference Nikolakopoulos, A.N., Karypis, G.: RecWalk: Nearly uncoupled random walks for top-N recommendation. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining (WSDM ’19). Association for Computing Machinery, New York, NY, USA, pp. 150–158 (2019) Nikolakopoulos, A.N., Karypis, G.: RecWalk: Nearly uncoupled random walks for top-N recommendation. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining (WSDM ’19). Association for Computing Machinery, New York, NY, USA, pp. 150–158 (2019)
18.
go back to reference Kouki, P., Schaffer, J., Pujara, J., O’Donovan, J., Getoor, L.: Generating and understanding personalized explanations in hybrid recommender systems. ACM Trans. Interact. Intell. Syst.. 10 (2020,11), https://doi.org/10.1145/3365843 Kouki, P., Schaffer, J., Pujara, J., O’Donovan, J., Getoor, L.: Generating and understanding personalized explanations in hybrid recommender systems. ACM Trans. Interact. Intell. Syst.. 10 (2020,11), https://​doi.​org/​10.​1145/​3365843
20.
go back to reference Pi, Q., Bian, W., Zhou, G., Zhu, X., Gai, K.: Practice on long sequential user behavior modeling for click-through rate prediction. In: Proceedings Of The 25th ACM SIGKDD International Conference On Knowledge Discovery & Data Mining (2019) Pi, Q., Bian, W., Zhou, G., Zhu, X., Gai, K.: Practice on long sequential user behavior modeling for click-through rate prediction. In: Proceedings Of The 25th ACM SIGKDD International Conference On Knowledge Discovery & Data Mining (2019)
21.
go back to reference Singh, M.: Scalability and sparsity issues in recommender datasets: a survey. Knowl. Inf. Syst. 62(1), 1–43 (2020)CrossRef Singh, M.: Scalability and sparsity issues in recommender datasets: a survey. Knowl. Inf. Syst. 62(1), 1–43 (2020)CrossRef
22.
go back to reference Su, X., Khoshgoftaar, T.M: Collaborative filtering for multi-class data using belief nets algorithms. In: 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI’06). IEEE, pp. 497–504 (2006) Su, X., Khoshgoftaar, T.M: Collaborative filtering for multi-class data using belief nets algorithms. In: 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI’06). IEEE, pp. 497–504 (2006)
23.
go back to reference Van Den Oord, A., Dieleman, S., Schrauwen, B.: Deep content-based music recommendation. In: Neural Information Processing Systems Conference (NIPS 2013), Vol. 26. Neural Information Processing Systems Foundation (NIPS) (2013) Van Den Oord, A., Dieleman, S., Schrauwen, B.: Deep content-based music recommendation. In: Neural Information Processing Systems Conference (NIPS 2013), Vol. 26. Neural Information Processing Systems Foundation (NIPS) (2013)
24.
go back to reference Volkovs, M., Yu, G.W., Poutanen, T.: DropoutNet: Addressing Cold Start in Recommender Systems.. In: NIPS, pp. 4957–4966 (2017) Volkovs, M., Yu, G.W., Poutanen, T.: DropoutNet: Addressing Cold Start in Recommender Systems.. In: NIPS, pp. 4957–4966 (2017)
25.
go back to reference Wang, C., Blei, D.M: Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 448–456 (2011) Wang, C., Blei, D.M: Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 448–456 (2011)
26.
go back to reference Wang, S., Hu, L., Wang, Y., He, X., Sheng, Q., Orgun, M., Cao, L., Ricci, F., Yu, P.: Graph learning based recommender systems: a review. In: Proceedings of The Thirtieth International Joint Conference On Artificial Intelligence, IJCAI-21. pp. 4644–4652 (2021). https://doi.org/10.24963/ijcai.2021/630, Survey Track Wang, S., Hu, L., Wang, Y., He, X., Sheng, Q., Orgun, M., Cao, L., Ricci, F., Yu, P.: Graph learning based recommender systems: a review. In: Proceedings of The Thirtieth International Joint Conference On Artificial Intelligence, IJCAI-21. pp. 4644–4652 (2021). https://​doi.​org/​10.​24963/​ijcai.​2021/​630, Survey Track
28.
go back to reference Wang, H., Wang, N., Yeung, D.-Y.: Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1235–1244 (2015) Wang, H., Wang, N., Yeung, D.-Y.: Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1235–1244 (2015)
29.
go back to reference Wang, H., Zhang, F., Zhang, M., Leskovec, J., Zhao, M., Li, W., Wang, Z.: Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’19). Association for Computing Machinery, New York, NY, USA, pp. 968–977 (2019) Wang, H., Zhang, F., Zhang, M., Leskovec, J., Zhao, M., Li, W., Wang, Z.: Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’19). Association for Computing Machinery, New York, NY, USA, pp. 968–977 (2019)
30.
go back to reference Wang, S., Hu, L., Cao, L.: Perceiving the next choice with comprehensive transaction embeddings for online recommendation. ECML/PKDD (2017) Wang, S., Hu, L., Cao, L.: Perceiving the next choice with comprehensive transaction embeddings for online recommendation. ECML/PKDD (2017)
31.
go back to reference Wang, S., Hu, L., Cao, L., Huang, X., Lian, D., Liu, W.: Attention-based transactional context embedding for next-item recommendation. In: AAAI Conference On Artificial Intelligence (2018) Wang, S., Hu, L., Cao, L., Huang, X., Lian, D., Liu, W.: Attention-based transactional context embedding for next-item recommendation. In: AAAI Conference On Artificial Intelligence (2018)
32.
go back to reference Wang, X., He, X., Cao, Y., Liu, M., Chua, T.: KGAT: knowledge graph attention network for recommendation. In: Proceedings of the 25th ACM SIGKDD International Conference On Knowledge Discovery and Data Mining, pp. 950–958 (2019) Wang, X., He, X., Cao, Y., Liu, M., Chua, T.: KGAT: knowledge graph attention network for recommendation. In: Proceedings of the 25th ACM SIGKDD International Conference On Knowledge Discovery and Data Mining, pp. 950–958 (2019)
33.
34.
go back to reference Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T. Louf, R., Funtowicz, M., et al.: HuggingFace’s transformers: state-of-the-art natural language processing. arXiv preprint arXiv:1910.03771 (2019) Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T. Louf, R., Funtowicz, M., et al.: HuggingFace’s transformers: state-of-the-art natural language processing. arXiv preprint arXiv:​1910.​03771 (2019)
35.
go back to reference Wu, C.-Y., Ahmed, A., Beutel, A., Smola, A.J., Jing, H.: Recurrent recommender networks. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 495–503 (2017) Wu, C.-Y., Ahmed, A., Beutel, A., Smola, A.J., Jing, H.: Recurrent recommender networks. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 495–503 (2017)
36.
go back to reference Xue, H.-J., Dai, X., Zhang, J., Huang, S., Chen, J.: Deep matrix factorization models for recommender systems. In: IJCAI, vol. 17, pp. 3203–3209. Melbourne, Australia (2017) Xue, H.-J., Dai, X., Zhang, J., Huang, S., Chen, J.: Deep matrix factorization models for recommender systems. In: IJCAI, vol. 17, pp. 3203–3209. Melbourne, Australia (2017)
37.
go back to reference Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W.L., Leskovec, J.: Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 974–983 (2018) Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W.L., Leskovec, J.: Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 974–983 (2018)
38.
go back to reference Zhang, J., Shi, X., Zhao, S., King, I.: STAR-GCN: stacked and reconstructed graph convolutional networks for recommender systems. In: International Joint Conference On Artificial Intelligence (2019) Zhang, J., Shi, X., Zhao, S., King, I.: STAR-GCN: stacked and reconstructed graph convolutional networks for recommender systems. In: International Joint Conference On Artificial Intelligence (2019)
39.
go back to reference Huang, Z., Zeng, D.: Why does collaborative filtering work? Recommendation model validation and selection by analyzing bipartite random graphs. INFORMS J. Comput. 23, 138–152 (2011)CrossRefMATH Huang, Z., Zeng, D.: Why does collaborative filtering work? Recommendation model validation and selection by analyzing bipartite random graphs. INFORMS J. Comput. 23, 138–152 (2011)CrossRefMATH
40.
go back to reference Zhang, Z.-K., Liu, C., Zhang, Y.-C., Zhou, T.: Solving the cold-start problem in recommender systems with social tags. EPL (Europhys. Lett.) 92, 28002 (2010)CrossRef Zhang, Z.-K., Liu, C., Zhang, Y.-C., Zhou, T.: Solving the cold-start problem in recommender systems with social tags. EPL (Europhys. Lett.) 92, 28002 (2010)CrossRef
41.
go back to reference Zhang, M., Chen, Y.: Inductive matrix completion based on graph neural networks. In: International Conference on Learning Representations (2020) Zhang, M., Chen, Y.: Inductive matrix completion based on graph neural networks. In: International Conference on Learning Representations (2020)
42.
go back to reference Zhu, Z., Sefati, S., Saadatpanah, P., Caverlee, J.: Recommendation for new users and new items via randomized training and mixture-of-experts transformation. In: Proceedings Of The 43rd International ACM SIGIR Conference On Research And Development In Information Retrieval (2020) Zhu, Z., Sefati, S., Saadatpanah, P., Caverlee, J.: Recommendation for new users and new items via randomized training and mixture-of-experts transformation. In: Proceedings Of The 43rd International ACM SIGIR Conference On Research And Development In Information Retrieval (2020)
Metadata
Title
Privacy preserving cold-start recommendation for out-of-matrix users via content baskets
Authors
Michael Sun
Andrew Wang
Publication date
12-03-2023
Publisher
Springer International Publishing
Published in
International Journal of Data Science and Analytics / Issue 2/2023
Print ISSN: 2364-415X
Electronic ISSN: 2364-4168
DOI
https://doi.org/10.1007/s41060-023-00388-7

Other articles of this Issue 2/2023

International Journal of Data Science and Analytics 2/2023 Go to the issue

Premium Partner