Ze Wang
ABSTRACT
Since it can effectively address the problem of sparsity and cold start of collaborative filtering, knowledge graph (KG) is widely studied and employed as side information in the field of recommender systems. However, most of existing KG-based recommendation methods mainly focus on how to effectively encode the knowledge associations in KG, without highlighting the crucial collaborative signals which are latent in user-item interactions. As such, the learned embeddings underutilize the two kinds of pivotal information and are insufficient to effectively represent the latent semantics of users and items in vector space.
In this paper, we propose a novel method named Collaborative Knowledge-aware Attentive Network (CKAN) which explicitly encodes the collaborative signals by collaboration propagation and proposes a natural way of combining collaborative signals with knowledge associations together. Specifically, CKAN employs a heterogeneous propagation strategy to explicitly encode both kinds of information, and applies a knowledge-aware attention mechanism to discriminate the contribution of different knowledge-based neighbors. Compared with other KG-based methods, CKAN provides a brand-new idea of combining collaborative information with knowledge information together. We apply the proposed model on four real-world datasets, and the empirical results demonstrate that CKAN significantly outperforms several compelling state-of-the-art baselines.
Supplemental Material
- Yixin Cao, Xiang Wang, Xiangnan He, Zikun Hu, and Tat-Seng Chua. 2019. Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences. In the 28th International Conference on World Wide Web. ACM, 151--161.Google Scholar
Digital Library
- Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In the 13th International Conference on Artificial Intelligence and Statistics. 249--256.Google Scholar
- Richard HR Hahnloser, Rahul Sarpeshkar, Misha A Mahowald, Rodney J Douglas, and H Sebastian Seung. 2000. Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. Nature, Vol. 405, 6789 (2000), 947.Google Scholar
- Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In the 31st Conference on Advances in Neural Information Processing Systems. 1024--1034.Google Scholar
- Jun Han and Claudio Moraga. 1995. The influence of the sigmoid function parameters on the speed of backpropagation learning. In International Workshop on Artificial Neural Networks. Springer, 195--201.Google ScholarDigital Library
- Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In the 26th International Conference on World Wide Web. ACM, 173--182.Google ScholarDigital Library
- Binbin Hu, Chuan Shi, Wayne Xin Zhao, and Philip S. Yu. 2018. Leveraging Meta-path Based Context for Top- N Recommendation with A Neural Co-Attention Model. In the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 1531--1540.Google Scholar
- Guoliang Ji, Shizhu He, Liheng Xu, Kang Liu, and Jun Zhao. 2015. Knowledge graph embedding via dynamic mapping matrix. In the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing. 687--696.Google ScholarCross Ref
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).Google Scholar
- Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 8 (2009), 30--37.Google ScholarDigital Library
- Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning entity and relation embeddings for knowledge graph completion. In the 29th AAAI Conference on Artificial Intelligence.Google ScholarCross Ref
- Roland Memisevic, Christopher Zach, Marc Pollefeys, and Geoffrey E Hinton. 2010. Gated softmax classification. In the 24th Conference on Advances in Neural Information Processing Systems. 1603--1611.Google Scholar
- Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In the 25th Conference on Uncertainty in Artificial Intelligence. AUAI Press, 452--461.Google Scholar
- Xiao Sha, Zhu Sun, and Jie Zhang. 2019. Attentive Knowledge Graph Embedding for Personalized Recommendation. arXiv preprint arXiv:1910.08288 (2019).Google Scholar
- Chuan Shi, Binbin Hu, Wayne Xin Zhao, and S Yu Philip. 2018. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering, Vol. 31, 2 (2018), 357--370.Google ScholarDigital Library
- Zhu Sun, Jie Yang, Jie Zhang, Alessandro Bozzon, Long-Kai Huang, and Chi Xu. 2018. Recurrent knowledge graph embedding for effective recommendation. In the 12th ACM Conference on Recommender Systems. ACM, 297--305.Google ScholarDigital Library
- Xiaoli Tang, Tengyun Wang, Haizhi Yang, and Hengjie Song. 2019. AKUPM: Attention-enhanced knowledge-aware user preference model for recommendation. In the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 1891--1899.Google ScholarDigital Library
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In the 31st Conference on Advances in Neural Information Processing Systems. 5998--6008.Google Scholar
- V Vijayakumar, Subramaniyaswamy Vairavasundaram, R Logesh, and A Sivapathi. 2019. Effective knowledge based recommender system for tailored multiple point of interest recommendation. International Journal of Web Portals, Vol. 11, 1 (2019), 1--18.Google ScholarCross Ref
- Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2018a. Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In the 27th ACM SIGKDD International Conference on Information and Knowledge Management. ACM, 417--426.Google ScholarDigital Library
- Hongwei Wang, Fuzheng Zhang, Xing Xie, and Minyi Guo. 2018b. DKN: Deep knowledge-aware network for news recommendation. In the 27th International Conference on World Wide Web. ACM, 1835--1844.Google ScholarDigital Library
- Hongwei Wang, Fuzheng Zhang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2019 d. Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation. In the 28th International Conference on World Wide Web. ACM, 2000--2010.Google Scholar
- Hongwei Wang, Fuzheng Zhang Zhang, Mengdi Zhang, Leskovec Jure, Miao Zhao, Wenjie Li, and Zhongyuan Wang. 2019 c. Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In the 25th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. ACM, 968--977.Google ScholarDigital Library
- Hongwei Wang, Miao Zhao, Xing Xie, Wenjie Li, and Minyi Guo. 2019 e. Knowledge graph convolutional networks for recommender systems. In the 28th International Conference on World Wide Web. ACM, 3307--3313.Google ScholarDigital Library
- Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. 2017. Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Knowledge and Data Engineering, Vol. 29, 12 (2017), 2724--2743.Google ScholarCross Ref
- Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019 a. KGAT: Knowledge Graph Attention Network for Recommendation. In the 25th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. ACM, 950--958.Google Scholar
- Xiang Wang, Dingxian Wang, Canran Xu, Xiangnan He, Yixin Cao, and Tat-Seng Chua. 2019 b. Explainable reasoning over knowledge graphs for recommendation. In the AAAI Conference on Artificial Intelligence, Vol. 33. 5329--5336.Google ScholarDigital Library
- Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge Graph Embedding by Translating on Hyperplanes.Google Scholar
- Markus Weimer, Alexandros Karatzoglou, and Alex Smola. 2008. Adaptive Collaborative Filtering. In the 2nd ACM Conference on Recommender Systems. ACM, 275--282.Google Scholar
- Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L Hamilton, and Jure Leskovec. 2018. Graph convolutional neural networks for web-scale recommender systems. In the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 974--983.Google ScholarDigital Library
- Xiao Yu, Xiang Ren, Quanquan Gu, Yizhou Sun, and Jiawei Han. 2013. Collaborative filtering with entity similarity regularization in heterogeneous information networks. In the 2nd International Joint Conference on Artificial Intelligence Workshop on Heterogeneous Information Network Analysis. Citeseer.Google Scholar
- Xiao Yu, Xiang Ren, Yizhou Sun, Quanquan Gu, Bradley Sturt, Urvashi Khandelwal, Brandon Norick, and Jiawei Han. 2014. Personalized entity recommendation: A heterogeneous information network approach. In the 7th ACM International Conference on Web Search and Data Mining. ACM, 283--292.Google ScholarDigital Library
- Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. 2016b. Collaborative knowledge base embedding for recommender systems. In the 22nd ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 353--362.Google ScholarDigital Library
- Hanwang Zhang, Fumin Shen, Wei Liu, Xiangnan He, Huanbo Luan, and Tat-Seng Chua. 2016a. Discrete collaborative filtering. In the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 325--334.Google ScholarDigital Library
- Ming Zhu, De-sheng Zhen, Ran Tao, You-qun Shi, Xiang-yang Feng, and Qian Wang. 2019. Top-N Collaborative Filtering Recommendation Algorithm Based on Knowledge Graph Embedding. In the 14th International Conference on Knowledge Management in Organizations. Springer, 122--134.Google Scholar
Index Terms
- CKAN: Collaborative Knowledge-aware Attentive Network for Recommender Systems
Recommendations
Exploring High-Order User Preference on the Knowledge Graph for Recommender Systems
To address the sparsity and cold-start problem of collaborative filtering, researchers usually make use of side information, such as social networks or item attributes, to improve the performance of recommendation. In this article, we consider the ...
MindReader: Recommendation over Knowledge Graph Entities with Explicit User Ratings
CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge ManagementKnowledge Graphs (KGs) have been integrated in several models of recommendation to augment the informational value of an item by means of its related entities in the graph. Yet, existing datasets only provide explicit ratings on items and no information ...
CKEN: Collaborative Knowledge-Aware Enhanced Network for Recommender Systems
Artificial Neural Networks and Machine Learning – ICANN 2022AbstractKnowledge graph are widely used as a kind of side information to alleviate the data sparsity in collaborative filtering. However, a majority of existing recommendation methods incorporating knowledge graph emphasize how to encode knowledge ...
Comments