Skip to main content
Erschienen in: Neural Processing Letters 7/2023

04.05.2023

Multi-Head Attention and Knowledge Graph Based Dual Target Graph Collaborative Filtering Network

verfasst von: Xu Yu, Qinglong Peng, Feng Jiang, Junwei Du, Hongtao Liang, Jinhuan Liu

Erschienen in: Neural Processing Letters | Ausgabe 7/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recently, cross-domain collaborative filtering (CDCF) has been widely used to solve the data sparsity problem in recommendation systems. Therein, dual-target cross-domain recommendation becomes a research hotspot, which aims to improve the recommendation performance of both target and source domains. Most existing approaches tend to use fixed weights or self-attention in a single representation space for the bi-directional inter-domain transfer of the user representation. However, a single representation space leads to limited representation capability, which makes the transfer of the user representation inaccurate. Also, the existing approaches ignore the representation enhancement of items. In this paper, Multi-head Attention and Knowledge Graph Based Dual Target Graph Collaborative Filtering Network (MAKG-DTGCF) is proposed. Based on the graph collaborative filtering model, it uses the multi-head attention based bi-directional transfer module to realize adaptive transfer and fusion of user features in multiple representation subspaces, which can make the transfer of user representation more accurate. Meanwhile, we also enhance the item representation by aligning the item embedding in the user-item heterogeneous graph with the knowledge embedding of the item in the knowledge graph. Experimental results on three real datasets show that the proposed MAKG-DTGCF model significantly outperforms the state-of-the-art models in terms of HR and NDCG.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat He X, Deng K, Wang X, et al (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648 He X, Deng K, Wang X, et al (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648
2.
Zurück zum Zitat Zhu F, Wang Y, Chen C, et al (2020) A graphical and attentional framework for dual-target cross-domain recommendation. In: the 29th international joint conference on artificial intelligence and the 17th Pacific rim international conference on artificial intelligence, pp 3001–3008 Zhu F, Wang Y, Chen C, et al (2020) A graphical and attentional framework for dual-target cross-domain recommendation. In: the 29th international joint conference on artificial intelligence and the 17th Pacific rim international conference on artificial intelligence, pp 3001–3008
3.
Zurück zum Zitat Yu X, Peng Q, Xu L et al (2021) A selective ensemble learning based two-sided cross-domain collaborative filtering algorithm. Inf Process Manag 58(6):102691CrossRef Yu X, Peng Q, Xu L et al (2021) A selective ensemble learning based two-sided cross-domain collaborative filtering algorithm. Inf Process Manag 58(6):102691CrossRef
4.
Zurück zum Zitat Fu M, Qu H, Yi Z et al (2018) A novel deep learning-based collaborative filtering model for recommendation system. IEEE Trans Cybern 49(3):1084–1096CrossRef Fu M, Qu H, Yi Z et al (2018) A novel deep learning-based collaborative filtering model for recommendation system. IEEE Trans Cybern 49(3):1084–1096CrossRef
5.
Zurück zum Zitat He X, Liao L, Zhang H, et al (2017) Neural collaborative filtering. In: the 26th international conference on World Wide Web, pp 173–182 He X, Liao L, Zhang H, et al (2017) Neural collaborative filtering. In: the 26th international conference on World Wide Web, pp 173–182
6.
Zurück zum Zitat Berkovsky S, Kuflik T, Ricci F (2007) Cross-domain mediation in collaborative filtering. In: The international conference on user modeling, pp 355–359 Berkovsky S, Kuflik T, Ricci F (2007) Cross-domain mediation in collaborative filtering. In: The international conference on user modeling, pp 355–359
7.
Zurück zum Zitat Singh AP, Gordon GJ (2008) Relational learning via collective matrix factorization. In: the 14th ACM SIGKDD international conference on knowledge discovery and data mining, pp 650–658 Singh AP, Gordon GJ (2008) Relational learning via collective matrix factorization. In: the 14th ACM SIGKDD international conference on knowledge discovery and data mining, pp 650–658
8.
Zurück zum Zitat Hu G, Zhang Y, Yang Q (2018) Conet: collaborative cross networks for cross-domain recommendation. In: The 27th ACM international conference on information and knowledge management, pp 667–676 Hu G, Zhang Y, Yang Q (2018) Conet: collaborative cross networks for cross-domain recommendation. In: The 27th ACM international conference on information and knowledge management, pp 667–676
9.
Zurück zum Zitat Zhao C, Li C, Fu C (2019) Cross-domain recommendation via preference propagation graphnet. In: The 28th ACM international conference on information and knowledge management, pp 2165–2168 Zhao C, Li C, Fu C (2019) Cross-domain recommendation via preference propagation graphnet. In: The 28th ACM international conference on information and knowledge management, pp 2165–2168
10.
Zurück zum Zitat Liu M, Li J, Li G, et al (2020) Cross domain recommendation via bi-directional transfer graph collaborative filtering networks. In: The 29th ACM international conference on information and knowledge management, pp 885–894 Liu M, Li J, Li G, et al (2020) Cross domain recommendation via bi-directional transfer graph collaborative filtering networks. In: The 29th ACM international conference on information and knowledge management, pp 885–894
11.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N, et al (2017) Attention is all you need. In: The 31st international conference on neural information processing systems, pp 6000–6010 Vaswani A, Shazeer N, Parmar N, et al (2017) Attention is all you need. In: The 31st international conference on neural information processing systems, pp 6000–6010
12.
Zurück zum Zitat Wang H, Zhang F, Wang J, et al (2018) Ripplenet: propagating user preferences on the knowledge graph for recommender systems. In: The 27th ACM international conference on information and knowledge management, pp 417–426 Wang H, Zhang F, Wang J, et al (2018) Ripplenet: propagating user preferences on the knowledge graph for recommender systems. In: The 27th ACM international conference on information and knowledge management, pp 417–426
13.
Zurück zum Zitat Wang X, He X, Cao Y, et al (2019) Kgat: knowledge graph attention network for recommendation. In: The 25th ACM SIGKDD international conference on knowledge discovery and data mining, pp 950–958 Wang X, He X, Cao Y, et al (2019) Kgat: knowledge graph attention network for recommendation. In: The 25th ACM SIGKDD international conference on knowledge discovery and data mining, pp 950–958
14.
Zurück zum Zitat Yu X, Zhan D, Liu L et al (2022) A privacy-preserving cross-domain healthcare wearables recommendation algorithm based on domain-dependent and domain-independent feature fusion. IEEE J Biomed Health Inform 26(5):1928–1936CrossRef Yu X, Zhan D, Liu L et al (2022) A privacy-preserving cross-domain healthcare wearables recommendation algorithm based on domain-dependent and domain-independent feature fusion. IEEE J Biomed Health Inform 26(5):1928–1936CrossRef
15.
Zurück zum Zitat Zhu F, Chen C, Wang Y, et al (2019) Dtcdr: a framework for dual-target cross-domain recommendation. In: The 28th ACM international conference on information and knowledge management, pp 1533–1542 Zhu F, Chen C, Wang Y, et al (2019) Dtcdr: a framework for dual-target cross-domain recommendation. In: The 28th ACM international conference on information and knowledge management, pp 1533–1542
16.
Zurück zum Zitat Gori M, Pucci A (2007) Itemrank: a random-walk based scoring algorithm for recommender engines. In: The 20th international joint conference on artificial intelligence, pp 2766–2771 Gori M, Pucci A (2007) Itemrank: a random-walk based scoring algorithm for recommender engines. In: The 20th international joint conference on artificial intelligence, pp 2766–2771
17.
Zurück zum Zitat Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. In: The 5th international conference on learning representations. arXiv:1609.02907 Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. In: The 5th international conference on learning representations. arXiv:​1609.​02907
18.
Zurück zum Zitat Berg Rvd, Kipf TN, Welling M (2018) Graph convolutional matrix completion. In: The KDD workshop on deep learning day. arXiv:1706.02263 Berg Rvd, Kipf TN, Welling M (2018) Graph convolutional matrix completion. In: The KDD workshop on deep learning day. arXiv:​1706.​02263
19.
Zurück zum Zitat Ying R, He R, Chen K, et al (2018) Graph convolutional neural networks for web-scale recommender systems. In: The 24th ACM SIGKDD international conference on knowledge discovery and data mining, pp 974–983 Ying R, He R, Chen K, et al (2018) Graph convolutional neural networks for web-scale recommender systems. In: The 24th ACM SIGKDD international conference on knowledge discovery and data mining, pp 974–983
20.
Zurück zum Zitat Wang X, He X, Wang M, et al (2019) Neural graph collaborative filtering. In: The 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174 Wang X, He X, Wang M, et al (2019) Neural graph collaborative filtering. In: The 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174
21.
Zurück zum Zitat Bordes A, Usunier N, Garcia-Durán A, et al (2013) Translating embeddings for modeling multi-relational data. In: The 26th international conference on neural information processing systems, pp 2787–2795 Bordes A, Usunier N, Garcia-Durán A, et al (2013) Translating embeddings for modeling multi-relational data. In: The 26th international conference on neural information processing systems, pp 2787–2795
22.
Zurück zum Zitat Wang Z, Zhang J, Feng J, et al (2014) Knowledge graph embedding by translating on hyperplanes. In: The 28th AAAI conference on artificial intelligence, pp 1112–1119 Wang Z, Zhang J, Feng J, et al (2014) Knowledge graph embedding by translating on hyperplanes. In: The 28th AAAI conference on artificial intelligence, pp 1112–1119
23.
Zurück zum Zitat Lin Y, Liu Z, Sun M, et al (2015) Learning entity and relation embeddings for knowledge graph completion. In: The 20th AAAI conference on artificial intelligence, pp 2181–2187 Lin Y, Liu Z, Sun M, et al (2015) Learning entity and relation embeddings for knowledge graph completion. In: The 20th AAAI conference on artificial intelligence, pp 2181–2187
24.
Zurück zum Zitat Ji G, He S, Xu L, et al (2015) Knowledge graph embedding via dynamic mapping matrix. In: The 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, pp 687–696 Ji G, He S, Xu L, et al (2015) Knowledge graph embedding via dynamic mapping matrix. In: The 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, pp 687–696
25.
Zurück zum Zitat Bordes A, Weston J, Collobert R, et al (2011) Learning structured embeddings of knowledge bases. In: The AAAI conference on artificial intelligence, pp 301–306 Bordes A, Weston J, Collobert R, et al (2011) Learning structured embeddings of knowledge bases. In: The AAAI conference on artificial intelligence, pp 301–306
26.
Zurück zum Zitat Socher R, Chen D, Manning CD, et al (2013) Reasoning with neural tensor networks for knowledge base completion. In: The 26th international conference on neural information processing systems, pp 926–934 Socher R, Chen D, Manning CD, et al (2013) Reasoning with neural tensor networks for knowledge base completion. In: The 26th international conference on neural information processing systems, pp 926–934
27.
Zurück zum Zitat Sun Z, Deng ZH, Nie JY, et al (2019) Rotate: knowledge graph embedding by relational rotation in complex space. In: The 7th international conference on learning representations. arXiv:1902.10197 Sun Z, Deng ZH, Nie JY, et al (2019) Rotate: knowledge graph embedding by relational rotation in complex space. In: The 7th international conference on learning representations. arXiv:​1902.​10197
28.
Zurück zum Zitat Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. In: The 3rd international conference on learning representations. arXiv:1409.0473 Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. In: The 3rd international conference on learning representations. arXiv:​1409.​0473
29.
Zurück zum Zitat Fan W, Ma Y, Li Q et al (2022) A graph neural network framework for social recommendations. IEEE Trans Knowl Data Eng 34(5):2033–2047CrossRef Fan W, Ma Y, Li Q et al (2022) A graph neural network framework for social recommendations. IEEE Trans Knowl Data Eng 34(5):2033–2047CrossRef
30.
Zurück zum Zitat Zhou G, Zhu X, Song C, et al (2018) Deep interest network for click-through rate prediction. In: The 24th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1059–1068 Zhou G, Zhu X, Song C, et al (2018) Deep interest network for click-through rate prediction. In: The 24th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1059–1068
31.
Zurück zum Zitat Milne D, Witten IH (2008) Learning to link with Wikipedia. In: The 17th ACM conference on information and knowledge management, pp 509–518 Milne D, Witten IH (2008) Learning to link with Wikipedia. In: The 17th ACM conference on information and knowledge management, pp 509–518
32.
Zurück zum Zitat Sil A, Yates A (2013) Re-ranking for joint named-entity recognition and linking. In: The 22nd ACM international conference on information and knowledge management, pp 2369–2374 Sil A, Yates A (2013) Re-ranking for joint named-entity recognition and linking. In: The 22nd ACM international conference on information and knowledge management, pp 2369–2374
33.
Zurück zum Zitat Yuan F, Yao L, Benatallah B (2019) Darec: deep domain adaptation for cross-domain recommendation via transferring rating patterns. In: The 28th international joint conference on artificial intelligence, pp 4227–4233 Yuan F, Yao L, Benatallah B (2019) Darec: deep domain adaptation for cross-domain recommendation via transferring rating patterns. In: The 28th international joint conference on artificial intelligence, pp 4227–4233
34.
Zurück zum Zitat Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: The 3rd international conference on learning representations Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: The 3rd international conference on learning representations
35.
Zurück zum Zitat He X, Chen T, Kan MY, et al (2015) Trirank: review-aware explainable recommendation by modeling aspects. In: The 24th ACM international on conference on information and knowledge management, pp 1661–1670 He X, Chen T, Kan MY, et al (2015) Trirank: review-aware explainable recommendation by modeling aspects. In: The 24th ACM international on conference on information and knowledge management, pp 1661–1670
36.
Zurück zum Zitat Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: The 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 855–864 Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: The 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 855–864
37.
Zurück zum Zitat Maddalena L, Giordano M, Manzo M, et al (2022) Whole-graph embedding and adversarial attacks for life sciences. In: Trends in biomathematics: stability and oscillations in environmental, social, and biological models: selected works from the BIOMAT consortium lectures pp 1–21 Maddalena L, Giordano M, Manzo M, et al (2022) Whole-graph embedding and adversarial attacks for life sciences. In: Trends in biomathematics: stability and oscillations in environmental, social, and biological models: selected works from the BIOMAT consortium lectures pp 1–21
Metadaten
Titel
Multi-Head Attention and Knowledge Graph Based Dual Target Graph Collaborative Filtering Network
verfasst von
Xu Yu
Qinglong Peng
Feng Jiang
Junwei Du
Hongtao Liang
Jinhuan Liu
Publikationsdatum
04.05.2023
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 7/2023
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-023-11197-1

Weitere Artikel der Ausgabe 7/2023

Neural Processing Letters 7/2023 Zur Ausgabe

Neuer Inhalt