ABSTRACT
Recently, many researchers in recommender systems have realized that encoding user-item interactions based on deep neural networks (DNNs) promotes collaborative-filtering (CF)'s performance. Nonetheless, those DNN-based models' performance is still limited when observed user-item interactions are very less because the training samples distilled from these interactions are critical for deep learning models. To address this problem, we resort to plenty features distilled from knowledge graphs (KGs), to profile users and items precisely and sufficiently rather than observed user-item interactions. In this paper, we propose a knowledge embedding based recommendation framework to alleviate the problem of sparse user-item interactions in recommendation. In our framework, each user and each item are both represented by the combination of an item embedding and a tag embedding at first. Specifically, item embeddings are learned by Metapath2Vec which is a graph embedding model qualified to embedding heterogeneous information networks. Tag embeddings are learned by a Skip-gram model similar to word embedding. We regarded these embeddings as knowledge embeddings because they both indicate knowledge about the latent relationships of movie-movie and user-movie. At last, a target user's representation and a candidate movie's representation are both fed into a multi-layer perceptron to output the probability that the user likes the item. The probability can be further used to achieve top-n recommendation. The extensive experiments on a movie recommendation dataset demonstrate our framework's superiority over some state-of-the-art recommendation models, especially in the scenario of sparse user-movie interactions.
- T. Hofmann, "Collaborative filtering via gaussian probabilistic latent semantic analysis," in Proc. of SIGIR, 2003.Google Scholar
- T. HoFann, "Latent semantic models for collaborative filtering," ACM Transactions on Information Systems, vol. 2, pp. 89 -- 115, 2004.Google ScholarDigital Library
- I. Cantador, A. Bellogin, and D. Vallet, "Content-based recommendation in social tagging systems," in Proc. of Recommender System, 2010.Google Scholar
- S. Aciar, D. Zhang, S. Simoff, and J. Debenham, "Recommender system based on consumer product reviews," in Proc. of WI, 2006.Google Scholar
- A. Elkahky, Y. Song, and X. He, "A multi-view deep learning approach for cross domain user modeling in recommendation systems," in Proc. of WWW, 2015.Google Scholar
- X. He and T. S. Chua, "Neural factorization machines for sparse predictive analytics," in Proc. of SIGIR, 2017.Google Scholar
- X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T. S. Chua, "Neural collaborative filtering," in Proc. of WWW, 2017.Google Scholar
- N. T. D, M. R, O. V. C, R. D, and Z. M, "Linked open data to support content-based recommender systems," in Proc. of ICSS, 2012.Google Scholar
- X. Yu, X. Ren, Y. Sun, Q. Gu, B. Sturt, U. Khandelwal, B. Norick, and J. Han, "Personalized entity recommendation: A heterogeneous information network approach," in Proc. of WSDM, 2014.Google Scholar
- A. Swami, A. Swami, and A. Swami, "metapath2vec: Scalable representation learning for heterogeneous networks," in Proc. of KDD, 2017.Google Scholar
- B. Xu, Y. Xu, J. Liang, C. Xie, B. Liang, W. Cui, and Y. Xiao., "Cn-dbpedia: A never-ending chinese knowledge extraction system," in Proc. of ICIEA, 2017.Google Scholar
- T. Mikolov, K. Chen, G. Corrado, and J. Dean, "Efficient estimation of word representations in vector space," in arXiv:1301.3781, 2013.Google Scholar
- X. Glorot, A. Bordes, and Y. Bengio, "Deep sparse rectifier neural networks," AISTATS, pp. 315 -- 323, 2011.Google Scholar
- J. Kingma and J. Ba, "Adam: A method for stochastic optimization," in Proc. of ICLR, 2015.Google Scholar
- J. H. Friedman, "Stochastic gradient boosting," Computational Statistics & Data Analysis, vol. 38, no. 4, pp. 367 -- 378, 2002.Google ScholarDigital Library
- X. He, Z. He, J. Song, Z. Liu, Y.-G. Jiang, and T.-S. Chua, "Nais: Neural attentive item similarity model for recommendation," IEEE TKDE, 2018.Google Scholar
- D. Yang, L. Chen, J. Liang, Y. Xiao, and W. Wang, "Social tag embedding for the recommendation with sparse user-item interactions," in Proc. of ASONAM, 2018.Google Scholar
- S. Rendle, "Factorization machines," in Proc. of ICDM, 2010.Google Scholar
- F. Zhang, N. J. Yuan, D. Lian, X. Xie, and W. Y. Ma, "Collaborative knowledge base embedding for recommender systems," in Proc. of KDD, 2016.Google Scholar
- E. Palumbo, G. Rizzo, and R. Troncy, "entity2rec: Learning user-item relatedness from knowledge graphs for top-n item recommendation," in Proc. of RecSys., 2017.Google Scholar
- A. Grover and J. Leskovec, "node2vec: Scalable feature learning for networks," in Proc. of KDD, 2016.Google Scholar
- H. Wang, F. Zhang, X. Xie, and M. Guo, "Dkn: Deep knowledge-aware network for news recommendation," 2018.Google Scholar
- R. Salakhutdinov, A. Mnih, and G. Hinton, "Restricted boltzmann machines for collaborative filtering," in Proc. of ICML, 2007.Google Scholar
- X. Dong, L. Yu, Zhonghuo Wu, Y. Sun, L. Yuan, and F. Zhang, "A hybrid collaborative filtering model with deep structure for recommender systems," in Proc. of AAAI, 2017.Google Scholar
- P. Vincent, H. Larochelle, Y. B. I. Lajoie, and P.-A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion," JMLR, vol. 11, pp. 3371 -- 3408, 2010.Google ScholarDigital Library
- A. V. den Oord, S. Dieleman, and B. Schrauwen, "Deep content-based music recommendation," in Proc. of NIPS, 2013.Google Scholar
- S. Sedhain, A. K. Menon, S. Sanner, and L. Xie, "Autorec: Autoencoders meet collaborative filtering," in Proc. of WWW, 2015.Google Scholar
- H. J. Xue, X. Y. Dai, J. Zhang, S. Huang, and J. Chen, "Deep matrix factorization models for recommender systems," in Proc. of IJCAI, 2017.Google Scholar
- W. L. Hamilton, R. Ying, and J. Leskovec, "Representation learning on graphs: Methods and applications," arXiv:1709.05584v2[cs.SI], Sep. 2017.Google Scholar
- S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, and S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction," TPAMI, vol. 29, no. 1, 2007.Google Scholar
- T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, "Distributed representations of words and phrases and their compositionality," in Proc. of NIPS, 2013.Google Scholar
- T. Y. Fu, W. C. Lee, and Z. Lei, "Hin2vec: Explore meta-paths in heterogeneous information networks for representation learning," in Proc. of CIKM, 2017.Google Scholar
- Knowledge embedding towards the recommendation with sparse user-item interactions
Recommendations
Social tag embedding for the recommendation with sparse user-item interactions
ASONAM '18: Proceedings of the 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and MiningMost of traditional recommender systems perform well only when sufficient user-item interactions, such as purchase records or ratings, have been obtained in advance, while suffering from poor performance in the scenario of sparse interactions. ...
Knowledge-enhanced recommendation using item embedding and path attention
AbstractRecommender systems have attracted widespread attention in various online applications. To effectively recommend the needed items of users, knowledge graphs have been introduced to provide rich and complementary information to infer ...
KEP-Rec: A Knowledge Enhanced User-Item Relation Prediction Model for Personalized Recommendation
Web and Big DataAbstractFor more accurate, diversified and interpretable personalized recommendation, the joint consideration of user-item interaction information and side information in knowledge graph has become a research hotspot. Traditional models based on ...
Comments