Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 5/2023

25.11.2022 | Original Article

Fusing collaborative transformation with temporally aware target interaction networks for sequential recommendation

verfasst von: Kaiyang Ma, Zhenyu Yang, Yu Wang, Laiping Cui, Wenfeng Jiang

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 5/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Sequential recommendation aims to simulate the changes in users’ interests according to their historical behavior data to predict which items they may interact with next. However, most existing sequential recommendation methods (such as attention and recurrent network-based models) utilize only the user’s own behavior sequence for user modeling, ignoring the dynamic transitions between items in the temporal pattern and between users’ complex transition structures arising from multilevel interdependencies. Additionally, traditional methods fuse a sequence representation into a fixed vector, but user interests are diverse, and a single vector does not reflect the diversity of user interests, and a fixed vector representation will limit the representation capability of the model.To address the above problems, this paper proposes a novel sequential recommendation method that fuses collaborative transformations and temporally aware target interaction networks. It can automatically learn the item transformation relationships within and between sequences. We first design a global feature extraction layer. This layer explicitly captures item transitions in different sequences in the form of higher-order connectivity by performing embedding propagation using global graph contexts. The global static representation extracted after collaborative transformation is used as the initial embedding of the sequential pattern, and the user-item interaction information is integrated into the embedded representation to enhance the sequential pattern. Then, different forms of temporal embeddings are fused to capture the dynamic interest changes of users over time. Finally, the candidate target items are used to activate users’ specific interests, and some items in the interaction sequence are enhanced by measuring the correlation between historical items and candidate items, so as to realize diverse user interest modeling and greatly improve the expression ability of the model. Extensive experiments on three real datasets show that our model can effectively improve the recommendation performance compared with existing methods. Code and data are open-sourced at https://​github.​com/​carolmky/​FCTT4Rec.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM). IEEE, pp 197–206 Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM). IEEE, pp 197–206
2.
Zurück zum Zitat He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648 He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648
3.
Zurück zum Zitat Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37CrossRef Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37CrossRef
4.
Zurück zum Zitat Goldberg D, Nichols D, Oki BM, Terry D (1992) Using collaborative filtering to weave an information tapestry. Commun ACM 35(12):61–70CrossRef Goldberg D, Nichols D, Oki BM, Terry D (1992) Using collaborative filtering to weave an information tapestry. Commun ACM 35(12):61–70CrossRef
5.
Zurück zum Zitat Wang X, He X, Wang M, Feng F, Chua, T-S (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174 Wang X, He X, Wang M, Feng F, Chua, T-S (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174
6.
Zurück zum Zitat He R, McAuley J (2016) Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mining (ICDM). IEEE, pp 191–200 He R, McAuley J (2016) Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mining (ICDM). IEEE, pp 191–200
7.
Zurück zum Zitat Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv:1511.06939 Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv:​1511.​06939
8.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser, Ł., Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser, Ł., Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30
9.
Zurück zum Zitat Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web, pp 811–820 Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web, pp 811–820
10.
Zurück zum Zitat Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 843–852 Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 843–852
11.
Zurück zum Zitat Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the eleventh ACM conference on recommender systems, pp 130–137 Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the eleventh ACM conference on recommender systems, pp 130–137
12.
Zurück zum Zitat Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 565–573 Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 565–573
13.
Zurück zum Zitat You J, Wang Y, Pal A, Eksombatchai P, Rosenburg C, Leskovec J (2019) Hierarchical temporal convolutional networks for dynamic recommender systems. In: The world wide web conference, pp 2236–2246 You J, Wang Y, Pal A, Eksombatchai P, Rosenburg C, Leskovec J (2019) Hierarchical temporal convolutional networks for dynamic recommender systems. In: The world wide web conference, pp 2236–2246
14.
Zurück zum Zitat Yuan F, Karatzoglou A, Arapakis I, Jose JM, He X (2019) A simple convolutional generative network for next item recommendation. In: Proceedings of the twelfth ACM international conference on web search and data mining, pp 582–590 Yuan F, Karatzoglou A, Arapakis I, Jose JM, He X (2019) A simple convolutional generative network for next item recommendation. In: Proceedings of the twelfth ACM international conference on web search and data mining, pp 582–590
15.
Zurück zum Zitat Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T (2019) Session-based recommendation with graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 346–353 Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T (2019) Session-based recommendation with graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 346–353
16.
Zurück zum Zitat Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) Stamp: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1831–1839 Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) Stamp: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1831–1839
17.
Zurück zum Zitat Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450 Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450
18.
Zurück zum Zitat Fan Z, Liu Z,y Wang Y, Wang A, Nazari Z, Zheng L, Peng H, Yu PS (2022) Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM web conference 2022, pp 2036–2047 Fan Z, Liu Z,y Wang Y, Wang A, Nazari Z, Zheng L, Peng H, Yu PS (2022) Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM web conference 2022, pp 2036–2047
19.
Zurück zum Zitat Koren Y (2009) Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining, pp 447–456 Koren Y (2009) Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining, pp 447–456
20.
Zurück zum Zitat Xiang L, Yuan Q, Zhao S, Chen L, Zhang X, Yang Q, Sun J (2010) Temporal recommendation on graphs via long-and short-term preference fusion. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, pp 723–732 Xiang L, Yuan Q, Zhao S, Chen L, Zhang X, Yang Q, Sun J (2010) Temporal recommendation on graphs via long-and short-term preference fusion. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, pp 723–732
21.
Zurück zum Zitat Kumar S, Zhang X, Leskovec J (2019) Predicting dynamic embedding trajectory in temporal interaction networks. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1269–1278 Kumar S, Zhang X, Leskovec J (2019) Predicting dynamic embedding trajectory in temporal interaction networks. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1269–1278
22.
Zurück zum Zitat Ye W, Wang S, Chen X, Wang X, Qin Z, Yin D (2020) Time matters: sequential recommendation with complex temporal information. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 1459–1468 Ye W, Wang S, Chen X, Wang X, Qin Z, Yin D (2020) Time matters: sequential recommendation with complex temporal information. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 1459–1468
23.
Zurück zum Zitat Zhu Y, Li H, Liao Y, Wang B, Guan Z, Liu H, Cai D (2017) What to do next: modeling user behaviors by time-lstm. In: IJCAI, vol 17, pp 3602–3608 Zhu Y, Li H, Liao Y, Wang B, Guan Z, Liu H, Cai D (2017) What to do next: modeling user behaviors by time-lstm. In: IJCAI, vol 17, pp 3602–3608
24.
Zurück zum Zitat Wu J, Cai R, Wang H, Déjà vu (2020) A contextualized temporal attention mechanism for sequential recommendation. In: Proceedings of the web conference 2020, pp 2199–2209 Wu J, Cai R, Wang H, Déjà vu (2020) A contextualized temporal attention mechanism for sequential recommendation. In: Proceedings of the web conference 2020, pp 2199–2209
25.
Zurück zum Zitat Li J, Wang Y, McAuley J (2020) Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining, pp 322–330 Li J, Wang Y, McAuley J (2020) Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining, pp 322–330
26.
Zurück zum Zitat Chen Z, Zhang W, Yan J, Wang G, Wang J (2021) Learning dual dynamic representations on time-sliced user-item interaction graphs for sequential recommendation. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 231–240 Chen Z, Zhang W, Yan J, Wang G, Wang J (2021) Learning dual dynamic representations on time-sliced user-item interaction graphs for sequential recommendation. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 231–240
27.
Zurück zum Zitat Fan Z, Liu Z, Zhang J, Xiong Y, Zheng L, Yu PS (2021) Continuous-time sequential recommendation with temporal graph collaborative transformer. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 433–442 Fan Z, Liu Z, Zhang J, Xiong Y, Zheng L, Yu PS (2021) Continuous-time sequential recommendation with temporal graph collaborative transformer. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 433–442
28.
Zurück zum Zitat Yang J-H, Chen C-M, Wang C-J, Tsai M-F (2018) Hop-rec: high-order proximity for implicit recommendation. In: Proceedings of the 12th ACM conference on recommender systems, pp 140–144 Yang J-H, Chen C-M, Wang C-J, Tsai M-F (2018) Hop-rec: high-order proximity for implicit recommendation. In: Proceedings of the 12th ACM conference on recommender systems, pp 140–144
29.
Zurück zum Zitat Liu Z, Yang L, Fan Z, Peng H, Yu PS (2021) Federated social recommendation with graph neural network. ACM Trans Intell Syst Technol Liu Z, Yang L, Fan Z, Peng H, Yu PS (2021) Federated social recommendation with graph neural network. ACM Trans Intell Syst Technol
30.
Zurück zum Zitat Huang C, Chen J, Xia L, Xu Y, Dai P, Chen Y, Bo L, Zhao J, Huang JX (2021) Graph-enhanced multi-task learning of multi-level transition dynamics for session-based recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 4123–4130 Huang C, Chen J, Xia L, Xu Y, Dai P, Chen Y, Bo L, Zhao J, Huang JX (2021) Graph-enhanced multi-task learning of multi-level transition dynamics for session-based recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 4123–4130
31.
Zurück zum Zitat Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi, Ki, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. In: International conference on machine learning. PMLR, pp 5453–5462 Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi, Ki, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. In: International conference on machine learning. PMLR, pp 5453–5462
33.
Zurück zum Zitat Dai Z, Yang Z, Yang Y, Carbonell J, Le QV, Salakhutdinov R (2019) Transformer-xl: attentive language models beyond a fixed-length context. arXiv:1901.02860 Dai Z, Yang Z, Yang Y, Carbonell J, Le QV, Salakhutdinov R (2019) Transformer-xl: attentive language models beyond a fixed-length context. arXiv:​1901.​02860
34.
Zurück zum Zitat Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov RR, Le QV (2019) Xlnet: generalized autoregressive pretraining for language understanding. Adv Neural Inf Process Syst 32 Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov RR, Le QV (2019) Xlnet: generalized autoregressive pretraining for language understanding. Adv Neural Inf Process Syst 32
35.
Zurück zum Zitat Harper FM, Konstan JA (2015) The movielens datasets: history and context. ACM Trans Interact Intell Syst 5(4):1–19CrossRef Harper FM, Konstan JA (2015) The movielens datasets: history and context. ACM Trans Interact Intell Syst 5(4):1–19CrossRef
36.
Zurück zum Zitat McAuley J, Targett C, Shi Q, Van Den Hengel A (2015) Image-based recommendations on styles and substitutes. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, pp 43–52 McAuley J, Targett C, Shi Q, Van Den Hengel A (2015) Image-based recommendations on styles and substitutes. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, pp 43–52
37.
Zurück zum Zitat Cho SM, Park E, Yoo S (2020) Meantime: mixture of attention mechanisms with multi-temporal embeddings for sequential recommendation. In: Fourteenth ACM conference on recommender systems, pp 515–520 Cho SM, Park E, Yoo S (2020) Meantime: mixture of attention mechanisms with multi-temporal embeddings for sequential recommendation. In: Fourteenth ACM conference on recommender systems, pp 515–520
38.
Zurück zum Zitat Yu L, Zhang C, Liang S, Zhang X (2019) Multi-order attentive ranking model for sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 5709–5716 Yu L, Zhang C, Liang S, Zhang X (2019) Multi-order attentive ranking model for sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 5709–5716
Metadaten
Titel
Fusing collaborative transformation with temporally aware target interaction networks for sequential recommendation
verfasst von
Kaiyang Ma
Zhenyu Yang
Yu Wang
Laiping Cui
Wenfeng Jiang
Publikationsdatum
25.11.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 5/2023
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-022-01717-1

Weitere Artikel der Ausgabe 5/2023

International Journal of Machine Learning and Cybernetics 5/2023 Zur Ausgabe