Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 5/2023

25-11-2022 | Original Article

Fusing collaborative transformation with temporally aware target interaction networks for sequential recommendation

Authors: Kaiyang Ma, Zhenyu Yang, Yu Wang, Laiping Cui, Wenfeng Jiang

Published in: International Journal of Machine Learning and Cybernetics | Issue 5/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Sequential recommendation aims to simulate the changes in users’ interests according to their historical behavior data to predict which items they may interact with next. However, most existing sequential recommendation methods (such as attention and recurrent network-based models) utilize only the user’s own behavior sequence for user modeling, ignoring the dynamic transitions between items in the temporal pattern and between users’ complex transition structures arising from multilevel interdependencies. Additionally, traditional methods fuse a sequence representation into a fixed vector, but user interests are diverse, and a single vector does not reflect the diversity of user interests, and a fixed vector representation will limit the representation capability of the model.To address the above problems, this paper proposes a novel sequential recommendation method that fuses collaborative transformations and temporally aware target interaction networks. It can automatically learn the item transformation relationships within and between sequences. We first design a global feature extraction layer. This layer explicitly captures item transitions in different sequences in the form of higher-order connectivity by performing embedding propagation using global graph contexts. The global static representation extracted after collaborative transformation is used as the initial embedding of the sequential pattern, and the user-item interaction information is integrated into the embedded representation to enhance the sequential pattern. Then, different forms of temporal embeddings are fused to capture the dynamic interest changes of users over time. Finally, the candidate target items are used to activate users’ specific interests, and some items in the interaction sequence are enhanced by measuring the correlation between historical items and candidate items, so as to realize diverse user interest modeling and greatly improve the expression ability of the model. Extensive experiments on three real datasets show that our model can effectively improve the recommendation performance compared with existing methods. Code and data are open-sourced at https://​github.​com/​carolmky/​FCTT4Rec.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM). IEEE, pp 197–206 Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM). IEEE, pp 197–206
2.
go back to reference He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648 He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020) Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 639–648
3.
go back to reference Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37CrossRef Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37CrossRef
4.
go back to reference Goldberg D, Nichols D, Oki BM, Terry D (1992) Using collaborative filtering to weave an information tapestry. Commun ACM 35(12):61–70CrossRef Goldberg D, Nichols D, Oki BM, Terry D (1992) Using collaborative filtering to weave an information tapestry. Commun ACM 35(12):61–70CrossRef
5.
go back to reference Wang X, He X, Wang M, Feng F, Chua, T-S (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174 Wang X, He X, Wang M, Feng F, Chua, T-S (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174
6.
go back to reference He R, McAuley J (2016) Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mining (ICDM). IEEE, pp 191–200 He R, McAuley J (2016) Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mining (ICDM). IEEE, pp 191–200
7.
8.
go back to reference Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser, Ł., Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser, Ł., Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30
9.
go back to reference Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web, pp 811–820 Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web, pp 811–820
10.
go back to reference Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 843–852 Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM international conference on information and knowledge management, pp 843–852
11.
go back to reference Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the eleventh ACM conference on recommender systems, pp 130–137 Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the eleventh ACM conference on recommender systems, pp 130–137
12.
go back to reference Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 565–573 Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 565–573
13.
go back to reference You J, Wang Y, Pal A, Eksombatchai P, Rosenburg C, Leskovec J (2019) Hierarchical temporal convolutional networks for dynamic recommender systems. In: The world wide web conference, pp 2236–2246 You J, Wang Y, Pal A, Eksombatchai P, Rosenburg C, Leskovec J (2019) Hierarchical temporal convolutional networks for dynamic recommender systems. In: The world wide web conference, pp 2236–2246
14.
go back to reference Yuan F, Karatzoglou A, Arapakis I, Jose JM, He X (2019) A simple convolutional generative network for next item recommendation. In: Proceedings of the twelfth ACM international conference on web search and data mining, pp 582–590 Yuan F, Karatzoglou A, Arapakis I, Jose JM, He X (2019) A simple convolutional generative network for next item recommendation. In: Proceedings of the twelfth ACM international conference on web search and data mining, pp 582–590
15.
go back to reference Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T (2019) Session-based recommendation with graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 346–353 Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T (2019) Session-based recommendation with graph neural networks. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 346–353
16.
go back to reference Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) Stamp: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1831–1839 Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) Stamp: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1831–1839
17.
go back to reference Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450 Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450
18.
go back to reference Fan Z, Liu Z,y Wang Y, Wang A, Nazari Z, Zheng L, Peng H, Yu PS (2022) Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM web conference 2022, pp 2036–2047 Fan Z, Liu Z,y Wang Y, Wang A, Nazari Z, Zheng L, Peng H, Yu PS (2022) Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM web conference 2022, pp 2036–2047
19.
go back to reference Koren Y (2009) Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining, pp 447–456 Koren Y (2009) Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining, pp 447–456
20.
go back to reference Xiang L, Yuan Q, Zhao S, Chen L, Zhang X, Yang Q, Sun J (2010) Temporal recommendation on graphs via long-and short-term preference fusion. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, pp 723–732 Xiang L, Yuan Q, Zhao S, Chen L, Zhang X, Yang Q, Sun J (2010) Temporal recommendation on graphs via long-and short-term preference fusion. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, pp 723–732
21.
go back to reference Kumar S, Zhang X, Leskovec J (2019) Predicting dynamic embedding trajectory in temporal interaction networks. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1269–1278 Kumar S, Zhang X, Leskovec J (2019) Predicting dynamic embedding trajectory in temporal interaction networks. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1269–1278
22.
go back to reference Ye W, Wang S, Chen X, Wang X, Qin Z, Yin D (2020) Time matters: sequential recommendation with complex temporal information. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 1459–1468 Ye W, Wang S, Chen X, Wang X, Qin Z, Yin D (2020) Time matters: sequential recommendation with complex temporal information. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp 1459–1468
23.
go back to reference Zhu Y, Li H, Liao Y, Wang B, Guan Z, Liu H, Cai D (2017) What to do next: modeling user behaviors by time-lstm. In: IJCAI, vol 17, pp 3602–3608 Zhu Y, Li H, Liao Y, Wang B, Guan Z, Liu H, Cai D (2017) What to do next: modeling user behaviors by time-lstm. In: IJCAI, vol 17, pp 3602–3608
24.
go back to reference Wu J, Cai R, Wang H, Déjà vu (2020) A contextualized temporal attention mechanism for sequential recommendation. In: Proceedings of the web conference 2020, pp 2199–2209 Wu J, Cai R, Wang H, Déjà vu (2020) A contextualized temporal attention mechanism for sequential recommendation. In: Proceedings of the web conference 2020, pp 2199–2209
25.
go back to reference Li J, Wang Y, McAuley J (2020) Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining, pp 322–330 Li J, Wang Y, McAuley J (2020) Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining, pp 322–330
26.
go back to reference Chen Z, Zhang W, Yan J, Wang G, Wang J (2021) Learning dual dynamic representations on time-sliced user-item interaction graphs for sequential recommendation. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 231–240 Chen Z, Zhang W, Yan J, Wang G, Wang J (2021) Learning dual dynamic representations on time-sliced user-item interaction graphs for sequential recommendation. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 231–240
27.
go back to reference Fan Z, Liu Z, Zhang J, Xiong Y, Zheng L, Yu PS (2021) Continuous-time sequential recommendation with temporal graph collaborative transformer. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 433–442 Fan Z, Liu Z, Zhang J, Xiong Y, Zheng L, Yu PS (2021) Continuous-time sequential recommendation with temporal graph collaborative transformer. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 433–442
28.
go back to reference Yang J-H, Chen C-M, Wang C-J, Tsai M-F (2018) Hop-rec: high-order proximity for implicit recommendation. In: Proceedings of the 12th ACM conference on recommender systems, pp 140–144 Yang J-H, Chen C-M, Wang C-J, Tsai M-F (2018) Hop-rec: high-order proximity for implicit recommendation. In: Proceedings of the 12th ACM conference on recommender systems, pp 140–144
29.
go back to reference Liu Z, Yang L, Fan Z, Peng H, Yu PS (2021) Federated social recommendation with graph neural network. ACM Trans Intell Syst Technol Liu Z, Yang L, Fan Z, Peng H, Yu PS (2021) Federated social recommendation with graph neural network. ACM Trans Intell Syst Technol
30.
go back to reference Huang C, Chen J, Xia L, Xu Y, Dai P, Chen Y, Bo L, Zhao J, Huang JX (2021) Graph-enhanced multi-task learning of multi-level transition dynamics for session-based recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 4123–4130 Huang C, Chen J, Xia L, Xu Y, Dai P, Chen Y, Bo L, Zhao J, Huang JX (2021) Graph-enhanced multi-task learning of multi-level transition dynamics for session-based recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 4123–4130
31.
go back to reference Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi, Ki, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. In: International conference on machine learning. PMLR, pp 5453–5462 Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi, Ki, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. In: International conference on machine learning. PMLR, pp 5453–5462
33.
go back to reference Dai Z, Yang Z, Yang Y, Carbonell J, Le QV, Salakhutdinov R (2019) Transformer-xl: attentive language models beyond a fixed-length context. arXiv:1901.02860 Dai Z, Yang Z, Yang Y, Carbonell J, Le QV, Salakhutdinov R (2019) Transformer-xl: attentive language models beyond a fixed-length context. arXiv:​1901.​02860
34.
go back to reference Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov RR, Le QV (2019) Xlnet: generalized autoregressive pretraining for language understanding. Adv Neural Inf Process Syst 32 Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov RR, Le QV (2019) Xlnet: generalized autoregressive pretraining for language understanding. Adv Neural Inf Process Syst 32
35.
go back to reference Harper FM, Konstan JA (2015) The movielens datasets: history and context. ACM Trans Interact Intell Syst 5(4):1–19CrossRef Harper FM, Konstan JA (2015) The movielens datasets: history and context. ACM Trans Interact Intell Syst 5(4):1–19CrossRef
36.
go back to reference McAuley J, Targett C, Shi Q, Van Den Hengel A (2015) Image-based recommendations on styles and substitutes. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, pp 43–52 McAuley J, Targett C, Shi Q, Van Den Hengel A (2015) Image-based recommendations on styles and substitutes. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, pp 43–52
37.
go back to reference Cho SM, Park E, Yoo S (2020) Meantime: mixture of attention mechanisms with multi-temporal embeddings for sequential recommendation. In: Fourteenth ACM conference on recommender systems, pp 515–520 Cho SM, Park E, Yoo S (2020) Meantime: mixture of attention mechanisms with multi-temporal embeddings for sequential recommendation. In: Fourteenth ACM conference on recommender systems, pp 515–520
38.
go back to reference Yu L, Zhang C, Liang S, Zhang X (2019) Multi-order attentive ranking model for sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 5709–5716 Yu L, Zhang C, Liang S, Zhang X (2019) Multi-order attentive ranking model for sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 5709–5716
Metadata
Title
Fusing collaborative transformation with temporally aware target interaction networks for sequential recommendation
Authors
Kaiyang Ma
Zhenyu Yang
Yu Wang
Laiping Cui
Wenfeng Jiang
Publication date
25-11-2022
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 5/2023
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-022-01717-1

Other articles of this Issue 5/2023

International Journal of Machine Learning and Cybernetics 5/2023 Go to the issue