Skip to main content
Erschienen in: Neural Computing and Applications 17/2021

04.01.2021 | Original Article

Attentive Hybrid Recurrent Neural Networks for sequential recommendation

verfasst von: Lixiang Zhang, Peisen Wang, Jingchen Li, Zhiwei Xiao, Haobin Shi

Erschienen in: Neural Computing and Applications | Ausgabe 17/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recently, the sequential recommendation has become a hot spot. Previous works combined user long-term and short-term behavior to achieve the next item recommendation, but the previous works typically processed the user long-term sequential behavior in left-to-right order and some useful information may be overlooked in such a particular way. Moreover, these methods ignored that every user has his/her own attention on the different items. In this paper, we propose a novel hybrid model called Attentive Hybrid Recurrent Neural Networks to resolve these problems. The first module is the bidirectional long- and short-term memory network (Bi-LSTM), and the second is the GRU module, both of which are equipped with user-based attention mechanism. The hybrid model aims to grasp the user general preference as well as to capture the user latest intent. Experiment results on two public datasets suggest that our hybrid model has better performance on the next item recommendation task compared with previously reported baseline algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bagher RC, Hassanpour H, Mashayekhi H (2017) User trends modeling for a content-based recommender system. Expert Syst Appl 87:209–219CrossRef Bagher RC, Hassanpour H, Mashayekhi H (2017) User trends modeling for a content-based recommender system. Expert Syst Appl 87:209–219CrossRef
2.
Zurück zum Zitat Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Knowledge-based systems. Recommender Syst Surv 46:109–132 Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Knowledge-based systems. Recommender Syst Surv 46:109–132
3.
Zurück zum Zitat Chen L, Zhang G, Zhou E (2018) Fast greedy map inference for determinantal point process to improve recommendation diversity. In: Advances in Neural Information Processing Systems, pp. 5622–5633 Chen L, Zhang G, Zhou E (2018) Fast greedy map inference for determinantal point process to improve recommendation diversity. In: Advances in Neural Information Processing Systems, pp. 5622–5633
4.
Zurück zum Zitat Chen S, Xu J, Joachims T (2013) Multi-space probabilistic sequence modeling. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 865–873 Chen S, Xu J, Joachims T (2013) Multi-space probabilistic sequence modeling. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 865–873
5.
Zurück zum Zitat Cho K, van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder–decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1724–1734 Cho K, van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder–decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1724–1734
6.
Zurück zum Zitat Choi S, Ha H, Hwang U, Kim C, Ha JW, Yoon S (2018) Reinforcement learning based recommender system using biclustering technique. arXiv preprint arXiv:1801.05532 Choi S, Ha H, Hwang U, Kim C, Ha JW, Yoon S (2018) Reinforcement learning based recommender system using biclustering technique. arXiv preprint arXiv:​1801.​05532
8.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778
9.
Zurück zum Zitat He R, Kang WC, McAuley J (2017) Translation-based recommendation. In: Proceedings of the eleventh ACM conference on recommender systems, pp. 161–169 He R, Kang WC, McAuley J (2017) Translation-based recommendation. In: Proceedings of the eleventh ACM conference on recommender systems, pp. 161–169
10.
Zurück zum Zitat He X, Chua TS (2017) Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval, pp. 355–364 He X, Chua TS (2017) Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval, pp. 355–364
11.
Zurück zum Zitat Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2016) Session-based recommendations with recurrent neural networks. In: 4th International Conference on Learning Representations, ICLR 2016 Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2016) Session-based recommendations with recurrent neural networks. In: 4th International Conference on Learning Representations, ICLR 2016
12.
Zurück zum Zitat Hu Y, Koren Y, Volinsky C (2008) Collaborative filtering for implicit feedback datasets. In: 2008 Eighth IEEE International Conference on Data Mining, pp. 263–272. Ieee Hu Y, Koren Y, Volinsky C (2008) Collaborative filtering for implicit feedback datasets. In: 2008 Eighth IEEE International Conference on Data Mining, pp. 263–272. Ieee
13.
Zurück zum Zitat Huang R, McIntyre S, Song M, Ou Z et al (2018) An attention-based recommender system to predict contextual intent based on choice histories across and within sessions. Appl Sci 8(12):2426CrossRef Huang R, McIntyre S, Song M, Ou Z et al (2018) An attention-based recommender system to predict contextual intent based on choice histories across and within sessions. Appl Sci 8(12):2426CrossRef
14.
Zurück zum Zitat Kabbur S, Ning X, Karypis G (2013) Fism: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 659–667 Kabbur S, Ning X, Karypis G (2013) Fism: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 659–667
15.
Zurück zum Zitat Kang WC, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 197–206. IEEE Kang WC, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 197–206. IEEE
17.
Zurück zum Zitat Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 426–434 Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 426–434
18.
Zurück zum Zitat Koren Y, Bell R (2015) Advances in collaborative filtering. In: Recommender systems handbook. Springer, Berlin, pp 77–118CrossRef Koren Y, Bell R (2015) Advances in collaborative filtering. In: Recommender systems handbook. Springer, Berlin, pp 77–118CrossRef
19.
Zurück zum Zitat Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37CrossRef Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37CrossRef
20.
Zurück zum Zitat Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J (2017) Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 1419–1428 Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J (2017) Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 1419–1428
21.
Zurück zum Zitat Linden, G., Smith, B., York, J.: Amazon. com recommendations: Item-to-item collaborative filtering. IEEE Internet computing 7(1), 76–80 (2003) Linden, G., Smith, B., York, J.: Amazon. com recommendations: Item-to-item collaborative filtering. IEEE Internet computing 7(1), 76–80 (2003)
22.
Zurück zum Zitat Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In: Proceedings of the 8th ACM Conference on Recommender systems, pp. 105–112 Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In: Proceedings of the 8th ACM Conference on Recommender systems, pp. 105–112
23.
Zurück zum Zitat Lu J, Wu D, Mao M, Wang W, Zhang G (2015) Recommender system application developments: a survey. Decis Support Syst 74:12–32CrossRef Lu J, Wu D, Mao M, Wang W, Zhang G (2015) Recommender system application developments: a survey. Decis Support Syst 74:12–32CrossRef
24.
Zurück zum Zitat McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on Recommender systems, pp. 165–172 McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on Recommender systems, pp. 165–172
25.
Zurück zum Zitat Van den Oord A, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: Advances in neural information processing systems, pp. 2643–2651 Van den Oord A, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: Advances in neural information processing systems, pp. 2643–2651
26.
Zurück zum Zitat Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2012) Bpr: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618 Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2012) Bpr: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:​1205.​2618
27.
Zurück zum Zitat Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on World wide web, pp. 811–820 Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on World wide web, pp. 811–820
28.
Zurück zum Zitat Ruocco M, Skrede OSL, Langseth H (2017) Inter-session modeling for session-based recommendation. In: Proceedings of the 2nd Workshop on Deep Learning for Recommender Systems, pp. 24–31 Ruocco M, Skrede OSL, Langseth H (2017) Inter-session modeling for session-based recommendation. In: Proceedings of the 2nd Workshop on Deep Learning for Recommender Systems, pp. 24–31
29.
Zurück zum Zitat Salakhutdinov R, Mnih A (2008) Bayesian probabilistic matrix factorization using markov chain monte carlo. In: Proceedings of the 25th international conference on Machine learning, pp. 880–887 Salakhutdinov R, Mnih A (2008) Bayesian probabilistic matrix factorization using markov chain monte carlo. In: Proceedings of the 25th international conference on Machine learning, pp. 880–887
30.
Zurück zum Zitat Salakhutdinov R, Mnih A, Hinton G (2007) Restricted boltzmann machines for collaborative filtering. In: Proceedings of the 24th international conference on Machine learning, pp. 791–798 Salakhutdinov R, Mnih A, Hinton G (2007) Restricted boltzmann machines for collaborative filtering. In: Proceedings of the 24th international conference on Machine learning, pp. 791–798
31.
Zurück zum Zitat Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, pp. 285–295 Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, pp. 285–295
32.
Zurück zum Zitat Singhal A, Sinha P, Pant R (2017) Use of deep learning in modern recommendation system: a summary of recent works. Int J Comp Appl 975:8875–8887 Singhal A, Sinha P, Pant R (2017) Use of deep learning in modern recommendation system: a summary of recent works. Int J Comp Appl 975:8875–8887
33.
Zurück zum Zitat Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 1441–1450 Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 1441–1450
34.
Zurück zum Zitat Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 565–573 Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 565–573
35.
Zurück zum Zitat Terzi M, Rowe M, Ferrario MA, Whittle J(2014) Text-based user-knn: Measuring user similarity based on text reviews. In: International Conference on User Modeling, Adaptation, and Personalization, pp. 195–206. Springer Terzi M, Rowe M, Ferrario MA, Whittle J(2014) Text-based user-knn: Measuring user similarity based on text reviews. In: International Conference on User Modeling, Adaptation, and Personalization, pp. 195–206. Springer
36.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp. 5998–6008 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp. 5998–6008
38.
Zurück zum Zitat Wang X, Wang Y (2014) Improving content-based and hybrid music recommendation using deep learning. In: Proceedings of the 22nd ACM international conference on Multimedia, pp. 627–636 Wang X, Wang Y (2014) Improving content-based and hybrid music recommendation using deep learning. In: Proceedings of the 22nd ACM international conference on Multimedia, pp. 627–636
39.
Zurück zum Zitat Xiao J, Ye H, He X, Zhang H, Wu F, Chua TS (2017) Attentional factorization machines: learning the weight of feature interactions via attention networks. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp. 3119–3125 Xiao J, Ye H, He X, Zhang H, Wu F, Chua TS (2017) Attentional factorization machines: learning the weight of feature interactions via attention networks. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp. 3119–3125
40.
Zurück zum Zitat Yao L, Sheng QZ, Ngu AH, Ashman H, Li X (2014) Exploring recommendations in internet of things. In: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval, pp. 855–858 Yao L, Sheng QZ, Ngu AH, Ashman H, Li X (2014) Exploring recommendations in internet of things. In: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval, pp. 855–858
41.
Zurück zum Zitat Yera R, Martinez L (2017) Fuzzy tools in recommender systems: a survey. Int J Comput Intell Syst 10(1):776–803CrossRef Yera R, Martinez L (2017) Fuzzy tools in recommender systems: a survey. Int J Comput Intell Syst 10(1):776–803CrossRef
42.
Zurück zum Zitat Yu F, Liu Q, Wu S, Wang L, Tan T (2016) A dynamic recurrent model for next basket recommendation. In: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, pp. 729–732 Yu F, Liu Q, Wu S, Wang L, Tan T (2016) A dynamic recurrent model for next basket recommendation. In: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, pp. 729–732
43.
Zurück zum Zitat Zhao X, Zhang L, Ding Z, Xia L, Tang J, Yin D (2018) Recommendations with negative feedback via pairwise deep reinforcement learning. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1040–1048 Zhao X, Zhang L, Ding Z, Xia L, Tang J, Yin D (2018) Recommendations with negative feedback via pairwise deep reinforcement learning. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1040–1048
44.
Zurück zum Zitat Zhao Z, Hong L, Wei L, Chen J, Nath A, Andrews S, Kumthekar A, Sathiamoorthy M, Yi X, Chi E (2019) Recommending what video to watch next: a multitask ranking system. In: Proceedings of the 13th ACM Conference on Recommender Systems, pp. 43–51 Zhao Z, Hong L, Wei L, Chen J, Nath A, Andrews S, Kumthekar A, Sathiamoorthy M, Yi X, Chi E (2019) Recommending what video to watch next: a multitask ranking system. In: Proceedings of the 13th ACM Conference on Recommender Systems, pp. 43–51
45.
Zurück zum Zitat Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 425–434 Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 425–434
Metadaten
Titel
Attentive Hybrid Recurrent Neural Networks for sequential recommendation
verfasst von
Lixiang Zhang
Peisen Wang
Jingchen Li
Zhiwei Xiao
Haobin Shi
Publikationsdatum
04.01.2021
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 17/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05643-7

Weitere Artikel der Ausgabe 17/2021

Neural Computing and Applications 17/2021 Zur Ausgabe

S. I : Hybridization of Neural Computing with Nature-Inspired Algorithms

Lung nodules detection using semantic segmentation and classification with optimal features

S. I : Hybridization of Neural Computing with Nature Inspired Algorithms

VNE strategy based on chaos hybrid flower pollination algorithm considering multi-criteria decision making

Premium Partner