Binbin Hu
ABSTRACT
Heterogeneous information network (HIN) has been widely adopted in recommender systems due to its excellence in modeling complex context information. Although existing HIN based recommendation methods have achieved performance improvement to some extent, they have two major shortcomings. First, these models seldom learn an explicit representation for path or meta-path in the recommendation task. Second, they do not consider the mutual effect between the meta-path and the involved user-item pair in an interaction. To address these issues, we develop a novel deep neural network with the co-attention mechanism for leveraging rich meta-path based context for top-N recommendation. We elaborately design a three-way neural interaction model by explicitly incorporating meta-path based context. To construct the meta-path based context, we propose to use a priority based sampling technique to select high-quality path instances. Our model is able to learn effective representations for users, items and meta-path based context for implementing a powerful interaction function. The co-attention mechanism improves the representations for meta-path based con- text, users and items in a mutual enhancement way. Extensive experiments on three real-world datasets have demonstrated the effectiveness of the proposed model. In particular, the proposed model performs well in the cold-start scenario and has potentially good interpretability for the recommendation results.
Supplemental Material
- Gediminas Adomavicius and Alexander Tuzhilin . 2015. Context-aware recommender systems. In Recommender systems handbook. 191--226.Google Scholar
- Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua . 2017. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. 335--344. Google ScholarDigital Library
- Tianqi Chen, Weinan Zhang, Qiuxia Lu, Kailong Chen, Zhao Zheng, and Yong Yu . 2012. SVDFeature: a toolkit for feature-based collaborative filtering. Journal of Machine Learning Research Vol. 13 (2012), 3619--3622. Google ScholarDigital Library
- Yuxiao Dong, Nitesh V Chawla, and Ananthram Swami . 2017. metapath2vec: Scalable representation learning for heterogeneous networks Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 135--144. Google ScholarDigital Library
- Wei Feng and Jianyong Wang . 2012. Incorporating heterogeneous information for personalized tag recommendation in social tagging systems. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining. 1276--1284. Google ScholarDigital Library
- Tao Yang Fu, Wang Chien Lee, and Zhen Lei . 2017. HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1797--1806. Google ScholarDigital Library
- Aditya Grover and Jure Leskovec . 2016. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining. 855--864. Google ScholarDigital Library
- Yanchao Hao, Yuanzhe Zhang, Kang Liu, Shizhu He, Zhanyi Liu, Hua Wu, and Jun Zhao . 2017. An end-to-end model for question answering over knowledge base with cross-attention combining global knowledge. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. 221--231.Google ScholarCross Ref
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun . 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.Google ScholarCross Ref
- Xiangnan He and Tat-Seng Chua . 2017. Neural factorization machines for sparse predictive analytics Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. 355--364. Google ScholarDigital Library
- Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua . 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173--182. Google ScholarDigital Library
- Geoffrey E Hinton and Ruslan R Salakhutdinov . 2012. A better way to pretrain deep boltzmann machines. In Advances in Neural Information Processing Systems. 2447--2455. Google ScholarDigital Library
- Yifan Hu, Yehuda Koren, and Chris Volinsky . 2008. Collaborative filtering for implicit feedback datasets IEEE International Conference on Data Mining. 263--272. Google ScholarDigital Library
- Diederik P Kingma and Jimmy Ba . 2015. Adam: A method for stochastic optimization. Third International Conference on Learning Representations (2015).Google Scholar
- Yehuda Koren and Robert Bell . 2015. Advances in collaborative filtering. In Recommender systems handbook. 77--118.Google Scholar
- Yehuda Koren, Robert Bell, and Chris Volinsky . 2009. Matrix factorization techniques for recommender systems. Computer Vol. 42 (2009). Google ScholarDigital Library
- Aaron Q. Li, Amr Ahmed, Sujith Ravi, and Alexander J. Smola . 2014. Reducing the sampling complexity of topic models. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 891--900. Google ScholarDigital Library
- Jian Liu, Chuan Shi, Binbin Hu, Shenghua Liu, and S Yu Philip . 2017. Personalized ranking recommendation via integrating multiple feedbacks Pacific-Asia Conference on Knowledge Discovery and Data Mining. 131--143.Google Scholar
- Bryan Perozzi, Rami Al-Rfou, and Steven Skiena . 2014. Deepwalk: Online learning of social representations Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 701--710. Google ScholarDigital Library
- Tuan-Anh Nguyen Pham, Xutao Li, Gao Cong, and Zhenjie Zhang . 2016. A general recommendation model for heterogeneous networks. IEEE Transactions on Knowledge and Data Engineering Vol. 28 (2016), 3140--3153. Google ScholarDigital Library
- Minh C Phan, Aixin Sun, Yi Tay, Jialong Han, and Chenliang Li . 2017. NeuPL: Attention-based Semantic Matching and Pair-Linking for Entity Disambiguation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1667--1676. Google ScholarDigital Library
- Steffen Rendle . 2010. Factorization machines. In IEEE 10th International Conference on Data Mining. 995--1000. Google ScholarDigital Library
- Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme . 2009. BPR: Bayesian personalized ranking from implicit feedback Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence. Google ScholarDigital Library
- Royi Ronen, Elad Yom-Tov, and Gal Lavee . 2016. Recommendations meet web browsing: enhancing collaborative filtering using internet browsing logs. In IEEE 32nd International Conference on Data Engineering. 1230--1238.Google Scholar
- Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl . 2001. Item-based collaborative filtering recommendation algorithms Proceedings of the 10th international conference on World Wide Web. 285--295. Google ScholarDigital Library
- Chuan Shi, Binbin Hu, Wayne Xin Zhao, and Philip S Yu . 2018. Heterogeneous Information Network Embedding for Recommendation. IEEE Transactions on Knowledge and Data Engineering (2018).Google Scholar
- Chuan Shi, Xiangnan Kong, Yue Huang, S Yu Philip, and Bin Wu . 2014. Hetesim: A general framework for relevance measure in heterogeneous networks. IEEE Transactions on Knowledge and Data Engineering Vol. 26 (2014), 2479--2492.Google ScholarCross Ref
- Chuan Shi, Yitong Li, Jiawei Zhang, Yizhou Sun, and S Yu Philip . 2017. A survey of heterogeneous information network analysis. IEEE Transactions on Knowledge and Data Engineering Vol. 29 (2017), 17--37. Google ScholarDigital Library
- Chuan Shi, Zhiqiang Zhang, Ping Luo, Philip S Yu, Yading Yue, and Bin Wu . 2015. Semantic path based personalized recommendation on weighted heterogeneous information networks. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 453--462. Google ScholarDigital Library
- Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S Yu, and Tianyi Wu . 2011. Pathsim: Meta path-based top-k similarity search in heterogeneous information networks. Very Large Data Base Endowment Vol. 4 (2011), 992--1003.Google ScholarDigital Library
- Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei . 2015. Line: Large-scale information network embedding. In Proceedings of the 24th International Conference on World Wide Web. 1067--1077. Google ScholarDigital Library
- Yi Tay, Luu Anh Tuan, and Siu Cheung Hui . 2018. Latent Relational Metric Learning via Memory-based A ention for Collaborative Ranking Proceedings of the 27th International Conference on World Wide Web. Google ScholarDigital Library
- Xin Wang, Wei Lu, Martin Ester, Can Wang, and Chun Chen . 2016. Social recommendation with strong and weak ties. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. 5--14. Google ScholarDigital Library
- Xuejian Wang, Lantao Yu, Kan Ren, Guanyu Tao, Weinan Zhang, Yong Yu, and Jun Wang . 2017. Dynamic attention deep model for article recommendation by learning human editors' demonstration. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2051--2059. Google ScholarDigital Library
- Jun Xiao, Hao Ye, Xiangnan He, Hanwang Zhang, Fei Wu, and Tat-Seng Chua . 2017. Attentional factorization machines: Learning the weight of feature interactions via attention networks. arXiv preprint arXiv:1708.04617 (2017).Google Scholar
- Caiming Xiong, Victor Zhong, and Richard Socher . 2017. Dynamic coattention networks for question answering. Fifth International Conference on Learning Representations (2017).Google Scholar
- Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio . 2015. Show, attend and tell: Neural image caption generation with visual attention International Conference on Machine Learning. 2048--2057. Google ScholarDigital Library
- Linchuan Xu, Xiaokai Wei, Jiannong Cao, and Philip S Yu . 2017. Embedding of embedding (eoe): Joint embedding for coupled heterogeneous networks Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. 741--749. Google ScholarDigital Library
- Hongzhi Yin, Yizhou Sun, Bin Cui, Zhiting Hu, and Ling Chen . 2013. LCARS: a location-content-aware recommender system Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. 221--229. Google ScholarDigital Library
- Xiao Yu, Xiang Ren, Yizhou Sun, Quanquan Gu, Bradley Sturt, Urvashi Khandelwal, Brandon Norick, and Jiawei Han . 2014. Personalized entity recommendation: A heterogeneous information network approach Proceedings of the 7th ACM international conference on Web search and data mining. 283--292. Google ScholarDigital Library
- Huan Zhao, Quanming Yao, Jianda Li, Yangqiu Song, and Dik Lun Lee . 2017. Meta-graph based recommendation fusion over heterogeneous information networks Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 635--644. Google ScholarDigital Library
- Wayne Xin Zhao, Sui Li, Yulan He, Edward Y Chang, Ji-Rong Wen, and Xiaoming Li . 2016. Connecting social media to e-commerce: Cold-start product recommendation using microblogging information. IEEE Transactions on Knowledge and Data Engineering Vol. 28, 5 (2016), 1147--1159. Google ScholarDigital Library
- Xin Wayne Zhao, Yanwei Guo, Yulan He, Han Jiang, Yuexin Wu, and Xiaoming Li . 2014. We know what you want to buy: a demographic-based system for product recommendation on microblogs. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 1935--1944. Google ScholarDigital Library
Index Terms
- Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model
Recommendations
Attention-aware metapath-based network embedding for HIN based recommendation
Highlights- Heterogenous information network based recommendation is investigated.
- An attention-aware metapath-based network embedding approach is proposed.
- Each metapath is modeled as a weighted homogenous information network.
- A self-...
AbstractHeterogeneous information network (HIN) attracts increasing attention from the communities of recommender systems. HIN based recommendation methods can help overcome the difficulties of data sparsity and cold start. The majority of the existing ...
Local and Global Information Fusion for Top-N Recommendation in Heterogeneous Information Network
CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge ManagementSince heterogeneous information network (HIN) is able to integrate complex information and contain rich semantics, there is a surge of HIN based recommendation in recent years. Although existing methods have achieved performance improvement to some ...
MOOCRec: An Attention Meta-path Based Model for Top-K Recommendation in MOOC
Knowledge Science, Engineering and ManagementAbstractWith the surge of the courses and users on Massive Open Online Courses (MOOC), MOOC has accumulated rich educational data. However, the utilization of MOOC resources is not high enough to satisfy the dynamic and diverse demands of different ...
Comments