Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 9/2021

29.05.2021 | Original Article

Sequence and graph structure co-awareness via gating mechanism and self-attention for session-based recommendation

verfasst von: Jingjing Qiao, Li Wang, Liguo Duan

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 9/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Session-based recommendation (SR) is important in online applications for its ability to predict user’s next interactions solely based on ongoing sessions. To recommend proper items at proper time are two key aspects in SR. The sequence of items in a session implies user’s preferences shift, which may give us clues about when the user interacted. The graph constructed based on a session can give latent structural dependencies between items, which may give us clues about which items users interacted with. They complement each other and collaborate to boost the performance of recommendation. Based on the motivation, we propose a novel sequence and graph structure co-awareness session-based recommendation model, namely SeqGo for short. In this model, a gated recurrent unit is employed to obtain sequence information and a gated graph neural network to get graph structure information. A two-stage fusion strategy is built to combine these two types of information to generate the representation of the general interest of users. The gating mechanism is used to calculate the relative importance of sequence and graph structure information. Then, multi-head masked self-attention is applied to assign different weights to different items and ignore irrelevant items. The user's general interest and the last item representing the user's current interest are combined to get the session representation to predict the probability of clicking on the next items. Experiment results on two real-world datasets show that SeqGo outperforms the state-of-the-art baselines.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
3.
Zurück zum Zitat Yu R, Liu Q, Ye Y et al (2020) Collaborative list-and-pairwise filtering from implicit feedback. IEEE Trans Knowl Data Eng 99:1–1 Yu R, Liu Q, Ye Y et al (2020) Collaborative list-and-pairwise filtering from implicit feedback. IEEE Trans Knowl Data Eng 99:1–1
12.
Zurück zum Zitat Jannach D, Ludewig M (2017) When recurrent neural networks meet the neighborhood for session-based recommendation. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 306–310. https://doi.org/https://doi.org/10.1145/3109859.3109872 Jannach D, Ludewig M (2017) When recurrent neural networks meet the neighborhood for session-based recommendation. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 306–310. https://​doi.​org/​https://​doi.​org/​10.​1145/​3109859.​3109872
13.
15.
Zurück zum Zitat Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) STAMP: short-term attention/memory priority model for session-based recommendation. In: KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1831–1839. https://doi.org/10.1145/3219819.3219950 Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) STAMP: short-term attention/memory priority model for session-based recommendation. In: KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1831–1839. https://​doi.​org/​10.​1145/​3219819.​3219950
16.
Zurück zum Zitat Hidasi B, Quadrana M, Karatzoglou A, Tikk D (2016) Parallel recurrent neural network architectures for feature-rich session-based recommendations. In: RecSys '16: Proceedings of the 10th ACM conference on Recommender systems 241–248. https://doi.org/10.1145/2959100.2959167 Hidasi B, Quadrana M, Karatzoglou A, Tikk D (2016) Parallel recurrent neural network architectures for feature-rich session-based recommendations. In: RecSys '16: Proceedings of the 10th ACM conference on Recommender systems 241–248. https://​doi.​org/​10.​1145/​2959100.​2959167
17.
Zurück zum Zitat Bogina V, Kuflik T (2017) incorporating dwell time in session-based recommendations with recurrent neural networks. In: RecSys '17: Proceedings of the Poster Track of the 11th ACM Conference on Recommender Systems 1922:57–59. http://ceur-ws.org/Vol-1922/paper11.pdf Bogina V, Kuflik T (2017) incorporating dwell time in session-based recommendations with recurrent neural networks. In: RecSys '17: Proceedings of the Poster Track of the 11th ACM Conference on Recommender Systems 1922:57–59. http://​ceur-ws.​org/​Vol-1922/​paper11.​pdf
18.
Zurück zum Zitat Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 130–137. https://doi.org/10.1145/3109859.3109896 Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 130–137. https://​doi.​org/​10.​1145/​3109859.​3109896
19.
Zurück zum Zitat Li Z, Zhao H, Liu Q, et al. (2018) Learning from history and present: next-item recommendation via discriminatively exploiting user behaviors. In: KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1734–1743. https://doi.org/10.1145/3219819.3220014 Li Z, Zhao H, Liu Q, et al. (2018) Learning from history and present: next-item recommendation via discriminatively exploiting user behaviors. In: KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1734–1743. https://​doi.​org/​10.​1145/​3219819.​3220014
22.
Zurück zum Zitat Li Y, Tarlow D, Brockschmidt M, Zemel R (2016) Gated graph sequence neural networks. In: ICLR '16: Proceedings of the 4th International Conference on Learning Representations. Li Y, Tarlow D, Brockschmidt M, Zemel R (2016) Gated graph sequence neural networks. In: ICLR '16: Proceedings of the 4th International Conference on Learning Representations.
24.
Zurück zum Zitat Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: bayesian personalized ranking from implicit feedback. In: UAI '09: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence 452–461. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: bayesian personalized ranking from implicit feedback. In: UAI '09: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence 452–461.
29.
31.
Zurück zum Zitat Wang S, Cao L, Wang Y, et al. (2019) Modeling multi-purpose sessions for next-item recommendations via mixture-channel purpose routing networks. In: IJCAI '19: Proceedings of the 28th International Joint Conference on Artificial Intelligence. https://www.ijcai.org/Proceedings/2019/523 Wang S, Cao L, Wang Y, et al. (2019) Modeling multi-purpose sessions for next-item recommendations via mixture-channel purpose routing networks. In: IJCAI '19: Proceedings of the 28th International Joint Conference on Artificial Intelligence. https://​www.​ijcai.​org/​Proceedings/​2019/​523
36.
Zurück zum Zitat Wang M, Ren P, Mei L, et al. (2019) A collaborative session-based recommendation approach with parallel memory modules. In: SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval 345–354. https://doi.org/10.1145/3331184.3331210 Wang M, Ren P, Mei L, et al. (2019) A collaborative session-based recommendation approach with parallel memory modules. In: SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval 345–354. https://​doi.​org/​10.​1145/​3331184.​3331210
37.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N, et al. (2017) Attention is all you need. In: NIPS '17: Proceedings of the 31st Annual Conference on Neural Information Processing Systems 5999–6009. Vaswani A, Shazeer N, Parmar N, et al. (2017) Attention is all you need. In: NIPS '17: Proceedings of the 31st Annual Conference on Neural Information Processing Systems 5999–6009.
40.
Zurück zum Zitat Sun F, Liu J, Wu J, et al. (2019) BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer. In: CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management 1441–1450. https://doi.org/10.1145/3357384.3357895 Sun F, Liu J, Wu J, et al. (2019) BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer. In: CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management 1441–1450. https://​doi.​org/​10.​1145/​3357384.​3357895
42.
Zurück zum Zitat Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958MathSciNetMATH Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958MathSciNetMATH
Metadaten
Titel
Sequence and graph structure co-awareness via gating mechanism and self-attention for session-based recommendation
verfasst von
Jingjing Qiao
Li Wang
Liguo Duan
Publikationsdatum
29.05.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 9/2021
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-021-01343-3

Weitere Artikel der Ausgabe 9/2021

International Journal of Machine Learning and Cybernetics 9/2021 Zur Ausgabe