Skip to main content

2021 | OriginalPaper | Buchkapitel

Learning Disentangled User Representation Based on Controllable VAE for Recommendation

verfasst von : Yunyi Li, Pengpeng Zhao, Deqing Wang, Xuefeng Xian, Yanchi Liu, Victor S. Sheng

Erschienen in: Database Systems for Advanced Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

User behaviour on purchasing is always driven by complex latent factors, which are highly disentangled in the real world. Learning latent factorized representation of users can uncover user intentions behind the observed data (i.e. user-item interaction) and improve the robustness and interpretability of the recommender system. However, existing collaborative filtering methods learning disentangled representation face problems of balancing the trade-off between reconstruction quality and disentanglement. In this paper, we propose a controllable variational autoencoder framework for collaborative filtering. Specifically, we adopt a modified Proportional-Integral-Derivative (PID) control to the \(\beta \)-VAE objective to automatically tune the hyperparameter \(\beta \) using the output of Kullback-Leibler divergence as feedback. We further introduce item embeddings to guide the system to learn representation related to the real-world concepts using a factorized Gaussian distribution. Experimental results show that our model can get a crucial improvement over state-of-the-art baselines. We further evaluate our model’s effectiveness to control the trade-off between reconstruction error and disentanglement quality in the recommendation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Chen, T.Q., Li, X., Grosse, R.B., Duvenaud, D.K.: Isolating sources of disentanglement in variational autoencoders. In: NeurIPS, pp. 2610–2620 (2018) Chen, T.Q., Li, X., Grosse, R.B., Duvenaud, D.K.: Isolating sources of disentanglement in variational autoencoders. In: NeurIPS, pp. 2610–2620 (2018)
4.
Zurück zum Zitat Dawen, L., Rahul, G.K., Matthew, D.H., Tony, J.: Variational autoencoders for collaborative filtering. In: WWW, pp. 689–698 (2018) Dawen, L., Rahul, G.K., Matthew, D.H., Tony, J.: Variational autoencoders for collaborative filtering. In: WWW, pp. 689–698 (2018)
5.
Zurück zum Zitat Francesco, L., Stefan, B., Mario, L., Sylvain, G., Bernhard, S., Olivier, B.: Challenging common assumptions in the unsupervised learning of disentangled representations. In: PMLR, pp. 4114–4124 (2019) Francesco, L., Stefan, B., Mario, L., Sylvain, G., Bernhard, S., Olivier, B.: Challenging common assumptions in the unsupervised learning of disentangled representations. In: PMLR, pp. 4114–4124 (2019)
6.
Zurück zum Zitat Graham, C.G., Stefan, F.G., Mario, E.S.: Classical PID control. Control System Design, Prentice Hall PTR (2005) Graham, C.G., Stefan, F.G., Mario, E.S.: Classical PID control. Control System Design, Prentice Hall PTR (2005)
7.
Zurück zum Zitat Irina, H.: Beta-VAE: learning basic visual concepts with a constrained variational framework. In: ICLR (2017) Irina, H.: Beta-VAE: learning basic visual concepts with a constrained variational framework. In: ICLR (2017)
8.
Zurück zum Zitat Jianxin, M., Chang, Z., Peng, C., Hongxia, Y., Wenwu, Z.: Learning disentangled representations for recommendation. In: NeurIPS, pp. 5712–5723 (2019) Jianxin, M., Chang, Z., Peng, C., Hongxia, Y., Wenwu, Z.: Learning disentangled representations for recommendation. In: NeurIPS, pp. 5712–5723 (2019)
9.
Zurück zum Zitat Jianmo, N., Jiacheng, L.: Justifying recommendations using distantly-labeled reviews and fined-grained aspects. In: EMNLP, pp. 188–197 (2019) Jianmo, N., Jiacheng, L.: Justifying recommendations using distantly-labeled reviews and fined-grained aspects. In: EMNLP, pp. 188–197 (2019)
10.
Zurück zum Zitat Julian, M., Christopher, T., Qinfeng, S., Anton, V.D.H.: Image-based recommendations on styles and substitutes. In: SIGIR, pp. 43–52 (2015) Julian, M., Christopher, T., Qinfeng, S., Anton, V.D.H.: Image-based recommendations on styles and substitutes. In: SIGIR, pp. 43–52 (2015)
11.
Zurück zum Zitat Kim, H., Mnih, A.: Disentangling by factorising. In: ICML, pp. 2654–2663 (2018) Kim, H., Mnih, A.: Disentangling by factorising. In: ICML, pp. 2654–2663 (2018)
12.
Zurück zum Zitat Kumar, A., Sattigeri, P., Balakrishnan, A.: Variational inference of disentangled latent concepts from unlabeled observations. In: ICLR (2018) Kumar, A., Sattigeri, P., Balakrishnan, A.: Variational inference of disentangled latent concepts from unlabeled observations. In: ICLR (2018)
13.
Zurück zum Zitat Luo, A., Zhao, P., Liu, Y.: Collaborative self-attention network for session-based recommendation. In: IJCAI, pp. 2591–2597 (2020) Luo, A., Zhao, P., Liu, Y.: Collaborative self-attention network for session-based recommendation. In: IJCAI, pp. 2591–2597 (2020)
14.
Zurück zum Zitat Petar, V.: Graph attention networks. In: ICLR (2018) Petar, V.: Graph attention networks. In: ICLR (2018)
15.
Zurück zum Zitat Ruslan, S., Andriy, M., Geoffrey, E.H.: Restricted Boltzmann machines for collaborative filtering. In: ICML, pp. 791–798 (2007) Ruslan, S., Andriy, M., Geoffrey, E.H.: Restricted Boltzmann machines for collaborative filtering. In: ICML, pp. 791–798 (2007)
16.
Zurück zum Zitat Santosh, K., Xia, N., George, K.: FISM: factored item similarity models for top-N recommender systems. In: KDD, pp. 659–667. ACM (2013) Santosh, K., Xia, N., George, K.: FISM: factored item similarity models for top-N recommender systems. In: KDD, pp. 659–667. ACM (2013)
17.
Zurück zum Zitat Shao, H., Yao, S., Sun, D., Zhang, A.: ControlVAE: controllable variational autoencoder. In: ICML, pp. 8655–8664 (2020) Shao, H., Yao, S., Sun, D., Zhang, A.: ControlVAE: controllable variational autoencoder. In: ICML, pp. 8655–8664 (2020)
18.
Zurück zum Zitat Suvash, S., Aditya, K.M., Scott, S., Lexing, X.: AutoRec: autoencoders meet collaborative filtering. In: WWW, pp. 111–112 (2015) Suvash, S., Aditya, K.M., Scott, S., Lexing, X.: AutoRec: autoencoders meet collaborative filtering. In: WWW, pp. 111–112 (2015)
19.
Zurück zum Zitat Xi, C., Yan, D., Rein, H., John, S., Ilya, S., Pieter, A.: InfoGAN: interpretable representation learning by information maximizing generative adversarial nets. In: NeurIPS, pp. 2172–2180 (2016) Xi, C., Yan, D., Rein, H., John, S., Ilya, S., Pieter, A.: InfoGAN: interpretable representation learning by information maximizing generative adversarial nets. In: NeurIPS, pp. 2172–2180 (2016)
20.
Zurück zum Zitat Xiaopeng, L., James, S.: Collaborative variational autoencoder for recommender systems. In: SIGKDD, pp. 305–314 (2017) Xiaopeng, L., James, S.: Collaborative variational autoencoder for recommender systems. In: SIGKDD, pp. 305–314 (2017)
21.
Zurück zum Zitat Xiang, W., Hongye, J., An, Z., Xiangnan, H., Tat, S.C.: Disentangled graph collaborative filtering. In: SIGIR, pp. 1001–1010 (2020) Xiang, W., Hongye, J., An, Z., Xiangnan, H., Tat, S.C.: Disentangled graph collaborative filtering. In: SIGIR, pp. 1001–1010 (2020)
22.
Zurück zum Zitat Xiangnan, H., Lizi, L., Hanwang, Z., Liqiang, N., Xia, H., Tat, S.C.: Neural collaborative filtering. In: WWW, pp. 173–182 (2017) Xiangnan, H., Lizi, L., Hanwang, Z., Liqiang, N., Xia, H., Tat, S.C.: Neural collaborative filtering. In: WWW, pp. 173–182 (2017)
23.
Zurück zum Zitat Yao, W., Christopher, D., Alice, X.Z., Martin, E.: Collaborative denoising auto-encoders for top-N recommender systems. In: WSDM, pp. 153–162. ACM (2016) Yao, W., Christopher, D., Alice, X.Z., Martin, E.: Collaborative denoising auto-encoders for top-N recommender systems. In: WSDM, pp. 153–162. ACM (2016)
24.
Zurück zum Zitat Yehuda, K.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: KDD, pp. 426–434. ACM (2018) Yehuda, K.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: KDD, pp. 426–434. ACM (2018)
25.
Zurück zum Zitat Yehuda, K., Robert, M.B., Chris, V.: Matrix factorization techniques for recommender systems. In: IEEE Computer, pp. 30–37 (2009) Yehuda, K., Robert, M.B., Chris, V.: Matrix factorization techniques for recommender systems. In: IEEE Computer, pp. 30–37 (2009)
26.
Zurück zum Zitat Zhang, Y., Zhu, Z., He, Y.: Content-collaborative disentanglement representation learning for enhanced recommendation. In: RecSys, pp. 43–52. ACM (2020) Zhang, Y., Zhu, Z., He, Y.: Content-collaborative disentanglement representation learning for enhanced recommendation. In: RecSys, pp. 43–52. ACM (2020)
Metadaten
Titel
Learning Disentangled User Representation Based on Controllable VAE for Recommendation
verfasst von
Yunyi Li
Pengpeng Zhao
Deqing Wang
Xuefeng Xian
Yanchi Liu
Victor S. Sheng
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-73200-4_12