Skip to main content
Erschienen in: Discover Computing 3/2022

18.07.2022

Exploring latent connections in graph neural networks for session-based recommendation

verfasst von: Fei Cai, Zhiqiang Pan, Chengyu Song, Xin Zhang

Erschienen in: Discover Computing | Ausgabe 3/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Session-based recommendation, without the access to a user’s historical user-item interactions, is a challenging task, where the available information in an ongoing session is very limited. Previous work on session-based recommendation has considered sequences of items that users have interacted with sequentially. Such item sequences may not fully capture the complex transition relationship between items that go beyond the inspection order. This issue is partially addressed by the graph neural network (GNN) based models. However, GNNs can only propagate information from adjacent items while neglecting items without a direct connection, which makes the latent connections unavailable in propagation of GNNs. Importantly, GNN-based approaches often face a serious overfitting problem. Thus, we propose Star Graph Neural Networks with Highway Net- works (SGNN-HN) for session-based recommendation. The proposed SGNN-HN model applies a star graph neural network (SGNN) to model the complex transition relationship between items in an ongoing session. To avoid overfitting, we employ the highway networks (HN) to adaptively select embeddings from item representations before and after multi-layer SGNNs. Finally, we aggregate the item embeddings generated by SGNN in an ongoing session to represent a user’s final preference for item prediction. Experiments are conducted on two public benchmark datasets, i.e., Yoochoose and Diginetica. The results show that SGNN-HN can outperform the state-of-the-art models in terms of Recall and MRR for session-based recommendation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Abdollahpouri, H., Burke, R., & Mobasher, B. (2017). Controlling popularity bias in learning-to-rank recommendation. In RecSys’17 (pp. 42–46). Abdollahpouri, H., Burke, R., & Mobasher, B. (2017). Controlling popularity bias in learning-to-rank recommendation. In RecSys’17 (pp. 42–46).
Zurück zum Zitat Adomavicius, G., & Tuzhilin, A. (2005). Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6), 734–749.CrossRef Adomavicius, G., & Tuzhilin, A. (2005). Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6), 734–749.CrossRef
Zurück zum Zitat Chen, W., Cai, F., Chen, H., & de Rijke, M. (2019). Joint neural collaborative filtering for recommender systems. ACM Transactions on Information Systems, 37(4), 39–13930.CrossRef Chen, W., Cai, F., Chen, H., & de Rijke, M. (2019). Joint neural collaborative filtering for recommender systems. ACM Transactions on Information Systems, 37(4), 39–13930.CrossRef
Zurück zum Zitat Chen, W., Cai, F., Chen, H., & de Rijke, M. (2019). A dynamic co-attention network for session-based recommendation. In CIKM’19 (pp. 1461–1470). Chen, W., Cai, F., Chen, H., & de Rijke, M. (2019). A dynamic co-attention network for session-based recommendation. In CIKM’19 (pp. 1461–1470).
Zurück zum Zitat Gu, Y., Ding, Z., Wang, S., & Yin, D. (2020). Hierarchical user profiling for e-commerce recommender systems. In WSDM’20 (pp. 223–231). Gu, Y., Ding, Z., Wang, S., & Yin, D. (2020). Hierarchical user profiling for e-commerce recommender systems. In WSDM’20 (pp. 223–231).
Zurück zum Zitat Guo, J., Zhu, X., Lan, Y., & Cheng, X. (2017). Modeling users’ search sessions for high utility query recommendation. Information Retrieval Journal, 20(1), 4–24.CrossRef Guo, J., Zhu, X., Lan, Y., & Cheng, X. (2017). Modeling users’ search sessions for high utility query recommendation. Information Retrieval Journal, 20(1), 4–24.CrossRef
Zurück zum Zitat Guo, Q., Qiu, X., Liu, P., Shao, Y., Xue, X., & Zhang, Z. (2019). Star-transformer. In NAACL’19 (pp. 1315–1325). Guo, Q., Qiu, X., Liu, P., Shao, Y., Xue, X., & Zhang, Z. (2019). Star-transformer. In NAACL’19 (pp. 1315–1325).
Zurück zum Zitat Gupta, P., Garg, D., Malhotra, P., Vig, L., & Shroff, G. M. (2019). NISER: Normalized item and session representations with graph neural networks. arXiv preprint arXiv:1909.04276. Gupta, P., Garg, D., Malhotra, P., Vig, L., & Shroff, G. M. (2019). NISER: Normalized item and session representations with graph neural networks. arXiv preprint arXiv:​1909.​04276.
Zurück zum Zitat He, X., Liao, L., Zhang, H., Nie, L., Hu, X., & Chua, T. (2017). Neural collaborative filtering. In WWW’17 (pp. 173–182). He, X., Liao, L., Zhang, H., Nie, L., Hu, X., & Chua, T. (2017). Neural collaborative filtering. In WWW’17 (pp. 173–182).
Zurück zum Zitat Hidasi, B., Karatzoglou, A., Baltrunas, L., & Tikk, D. (2016). Session-based recommendations with recurrent neural networks. In ICLR’16. Hidasi, B., Karatzoglou, A., Baltrunas, L., & Tikk, D. (2016). Session-based recommendations with recurrent neural networks. In ICLR’16.
Zurück zum Zitat Hidasi, B., & Karatzoglou, A. (2018). Recurrent neural networks with top-k gains for session-based recommendations. In CIKM’18 (pp. 843–852). Hidasi, B., & Karatzoglou, A. (2018). Recurrent neural networks with top-k gains for session-based recommendations. In CIKM’18 (pp. 843–852).
Zurück zum Zitat Hu, D., Wei, L., Zhou, W., Huai, X., Fang, Z., & Hu, S. (2021). Pen4rec: Preference evolution networks for session-based recommendation. In KSEM’21, vol. 12815 (pp. 504–516). Hu, D., Wei, L., Zhou, W., Huai, X., Fang, Z., & Hu, S. (2021). Pen4rec: Preference evolution networks for session-based recommendation. In KSEM’21, vol. 12815 (pp. 504–516).
Zurück zum Zitat Jannach, D., & Ludewig, M. (2017). When recurrent neural networks meet the neighborhood for session-based recommendation. In RecSys’17 (pp. 306–310). Jannach, D., & Ludewig, M. (2017). When recurrent neural networks meet the neighborhood for session-based recommendation. In RecSys’17 (pp. 306–310).
Zurück zum Zitat Jin, R., Chai, J. Y., & Si, L. (2004). An automatic weighting scheme for collaborative filtering. In SIGIR’04 (pp. 337–344). Jin, R., Chai, J. Y., & Si, L. (2004). An automatic weighting scheme for collaborative filtering. In SIGIR’04 (pp. 337–344).
Zurück zum Zitat Jin, B., Gao, C., He, X., Jin, D., & Li, Y. (2020). Multi-behavior recommendation with graph convolutional networks. In SIGIR’20 (pp. 659–668). Jin, B., Gao, C., He, X., Jin, D., & Li, Y. (2020). Multi-behavior recommendation with graph convolutional networks. In SIGIR’20 (pp. 659–668).
Zurück zum Zitat Kang, W., & McAuley, J. J. (2018). Self-attentive sequential recommendation. In ICDM’18 (pp. 197–206). Kang, W., & McAuley, J. J. (2018). Self-attentive sequential recommendation. In ICDM’18 (pp. 197–206).
Zurück zum Zitat Kipf, T. N., & Welling, M. (2017). Semi-supervised classification with graph convolutional networks. In ICLR’17. Kipf, T. N., & Welling, M. (2017). Semi-supervised classification with graph convolutional networks. In ICLR’17.
Zurück zum Zitat Koren, Y. (2008). Factorization meets the neighborhood: A multifaceted collaborative filtering model. In KDD’08 (pp. 426–434). Koren, Y. (2008). Factorization meets the neighborhood: A multifaceted collaborative filtering model. In KDD’08 (pp. 426–434).
Zurück zum Zitat Lei, W., He, X., Miao, Y., Wu, Q., Hong, R., Kan, M., & Chua, T. (2020). Estimation-action-reflection: Towards deep interaction between conversational and recommender systems. In WSDM’20 (pp. 304–312). Lei, W., He, X., Miao, Y., Wu, Q., Hong, R., Kan, M., & Chua, T. (2020). Estimation-action-reflection: Towards deep interaction between conversational and recommender systems. In WSDM’20 (pp. 304–312).
Zurück zum Zitat Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T., & Ma, J. (2017). Neural attentive session-based recommendation. In CIKM’17 (pp. 1419–1428). Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T., & Ma, J. (2017). Neural attentive session-based recommendation. In CIKM’17 (pp. 1419–1428).
Zurück zum Zitat Li, Y., Tarlow, D., Brockschmidt, M., & Zemel, R. S. (2016). Gated graph sequence neural networks. In ICLR’16. Li, Y., Tarlow, D., Brockschmidt, M., & Zemel, R. S. (2016). Gated graph sequence neural networks. In ICLR’16.
Zurück zum Zitat Liu, Q., Zeng, Y., Mokhosi, R., & Zhang, H. (2018). STAMP: Short-term attention/memory priority model for session-based recommendation. In KDD’18 (pp. 1831–1839). Liu, Q., Zeng, Y., Mokhosi, R., & Zhang, H. (2018). STAMP: Short-term attention/memory priority model for session-based recommendation. In KDD’18 (pp. 1831–1839).
Zurück zum Zitat Pan, Z., Cai, F., Chen, W., Chen, H., & de Rijke, M. (2020). Star graph neural networks for session-based recommendation. In CIKM’20 (pp. 1195–1204). Pan, Z., Cai, F., Chen, W., Chen, H., & de Rijke, M. (2020). Star graph neural networks for session-based recommendation. In CIKM’20 (pp. 1195–1204).
Zurück zum Zitat Pan, Z., Cai, F., Ling, Y., & de Rijke, M. (2020). Rethinking item importance in session-based recommendation. In SIGIR’20 (pp. 1837–1840). Pan, Z., Cai, F., Ling, Y., & de Rijke, M. (2020). Rethinking item importance in session-based recommendation. In SIGIR’20 (pp. 1837–1840).
Zurück zum Zitat Qiu, R., Huang, Z., Li, J., & Yin, H. (2020). Exploiting cross-session information for session-based recommendation with graph neural networks. ACM Transactions on Information Systems, 38(3), 22–12223.CrossRef Qiu, R., Huang, Z., Li, J., & Yin, H. (2020). Exploiting cross-session information for session-based recommendation with graph neural networks. ACM Transactions on Information Systems, 38(3), 22–12223.CrossRef
Zurück zum Zitat Qiu, R., Li, J., Huang, Z., & Yin, H. (2019). Rethinking the item order in session-based recommendation with graph neural networks. In CIKM’19 (pp. 579–588). Qiu, R., Li, J., Huang, Z., & Yin, H. (2019). Rethinking the item order in session-based recommendation with graph neural networks. In CIKM’19 (pp. 579–588).
Zurück zum Zitat Ren, P., Chen, Z., Li, J., Ren, Z., Ma, J., & de Rijke, M. (2019). Repeatnet: A repeat aware neural recommendation machine for session-based recommendation. In AAAI’19 (pp. 4806–4813). Ren, P., Chen, Z., Li, J., Ren, Z., Ma, J., & de Rijke, M. (2019). Repeatnet: A repeat aware neural recommendation machine for session-based recommendation. In AAAI’19 (pp. 4806–4813).
Zurück zum Zitat Rendle, S., Freudenthaler, C., & Schmidt-Thieme, L. (2010). Factorizing personalized markov chains for next-basket recommendation. In WWW’10 (pp. 811–820). Rendle, S., Freudenthaler, C., & Schmidt-Thieme, L. (2010). Factorizing personalized markov chains for next-basket recommendation. In WWW’10 (pp. 811–820).
Zurück zum Zitat Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323(6088), 533–536.CrossRef Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323(6088), 533–536.CrossRef
Zurück zum Zitat Sarwar, B. M., Karypis, G., Konstan, J. A., & Riedl, J. (2001). Item-based collaborative filtering recommendation algorithms. In WWW’01 (pp. 285–295). Sarwar, B. M., Karypis, G., Konstan, J. A., & Riedl, J. (2001). Item-based collaborative filtering recommendation algorithms. In WWW’01 (pp. 285–295).
Zurück zum Zitat Song, W., Xiao, Z., Wang, Y., Charlin, L., Zhang, M., & Tang, J. (2019). Session-based social recommendation via dynamic graph attention networks. In WSDM’19 (pp. 555–563). Song, W., Xiao, Z., Wang, Y., Charlin, L., Zhang, M., & Tang, J. (2019). Session-based social recommendation via dynamic graph attention networks. In WSDM’19 (pp. 555–563).
Zurück zum Zitat Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015). End-to-end memory networks. In NeurIPS’15 (pp. 2440–2448). Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015). End-to-end memory networks. In NeurIPS’15 (pp. 2440–2448).
Zurück zum Zitat Sun, K., Qian, T., Yin, H., Chen, T., Chen, Y., & Chen, L. (2019). What can history tell us?. In CIKM’19 (pp. 1593–1602). Sun, K., Qian, T., Yin, H., Chen, T., Chen, Y., & Chen, L. (2019). What can history tell us?. In CIKM’19 (pp. 1593–1602).
Zurück zum Zitat Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. In NeurIPS’17 (pp. 5998–6008). Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. In NeurIPS’17 (pp. 5998–6008).
Zurück zum Zitat Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2018). Graph attention networks. In ICLR’18. Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2018). Graph attention networks. In ICLR’18.
Zurück zum Zitat Vinyals, O., Bengio, S., & Kudlur, M. (2016). Order matters: Sequence to sequence for sets. In ICLR’16. Vinyals, O., Bengio, S., & Kudlur, M. (2016). Order matters: Sequence to sequence for sets. In ICLR’16.
Zurück zum Zitat Wang, M., Ren, P., Mei, L., Chen, Z., Ma, J., & de Rijke, M. (2019). A collaborative session-based recommendation approach with parallel memory modules. In SIGIR’19 (pp. 345–354). Wang, M., Ren, P., Mei, L., Chen, Z., Ma, J., & de Rijke, M. (2019). A collaborative session-based recommendation approach with parallel memory modules. In SIGIR’19 (pp. 345–354).
Zurück zum Zitat Wang, Z., Wei, W., Cong, G., Li, X., Mao, X., & Qiu, M. (2020). Global context enhanced graph neural networks for session-based recommendation. In SIGIR’20 (pp. 169–178). Wang, Z., Wei, W., Cong, G., Li, X., Mao, X., & Qiu, M. (2020). Global context enhanced graph neural networks for session-based recommendation. In SIGIR’20 (pp. 169–178).
Zurück zum Zitat Wang, F., Xiang, X., Cheng, J., & Yuille, A. L. (2017). Normface: L\({}_{\text{2}}\) hypersphere embedding for face verification. In MM’17 (pp. 1041–1049). Wang, F., Xiang, X., Cheng, J., & Yuille, A. L. (2017). Normface: L\({}_{\text{2}}\) hypersphere embedding for face verification. In MM’17 (pp. 1041–1049).
Zurück zum Zitat Wang, X., He, X., Wang, M., Feng, F., & Chua, T. (2019). Neural graph collaborative filtering. In SIGIR’19 (pp. 165–174). Wang, X., He, X., Wang, M., Feng, F., & Chua, T. (2019). Neural graph collaborative filtering. In SIGIR’19 (pp. 165–174).
Zurück zum Zitat Weston, J., Chopra, S., & Bordes, A. (2015). Memory networks. In ICLR’15. Weston, J., Chopra, S., & Bordes, A. (2015). Memory networks. In ICLR’15.
Zurück zum Zitat Wu, S., Tang, Y., Zhu, Y., Wang, L., Xie, X., & Tan, T. (2019). Session-based recommendation with graph neural networks. In AAAI’19 (pp. 346–353). Wu, S., Tang, Y., Zhu, Y., Wang, L., Xie, X., & Tan, T. (2019). Session-based recommendation with graph neural networks. In AAAI’19 (pp. 346–353).
Zurück zum Zitat Xu, C., Zhao, P., Liu, Y., Sheng, V. S., Xu, J., Zhuang, F., Fang, J., & Zhou, X. (2019). Graph contextualized self-attention network for session-based recommendation. In IJCAI’19 (pp. 3940–3946). Xu, C., Zhao, P., Liu, Y., Sheng, V. S., Xu, J., Zhuang, F., Fang, J., & Zhou, X. (2019). Graph contextualized self-attention network for session-based recommendation. In IJCAI’19 (pp. 3940–3946).
Zurück zum Zitat Xu, K., Li, C., Tian, Y., Sonobe, T., Kawarabayashi, K., & Jegelka, S. (2018). Representation learning on graphs with jumping knowledge networks. In ICML’18 (pp. 5449–5458). Xu, K., Li, C., Tian, Y., Sonobe, T., Kawarabayashi, K., & Jegelka, S. (2018). Representation learning on graphs with jumping knowledge networks. In ICML’18 (pp. 5449–5458).
Zurück zum Zitat Ying, H., Zhuang, F., Zhang, F., Liu, Y., Xu, G., Xie, X., Xiong, H., & Wu, J. (2018). Sequential recommender system based on hierarchical attention networks. In IJCAI’18 (pp. 3926–3932). Ying, H., Zhuang, F., Zhang, F., Liu, Y., Xu, G., Xie, X., Xiong, H., & Wu, J. (2018). Sequential recommender system based on hierarchical attention networks. In IJCAI’18 (pp. 3926–3932).
Zurück zum Zitat Yu, F., Liu, Q., Wu, S., Wang, L., & Tan, T. (2016). A dynamic recurrent model for next basket recommendation. In SIGIR’16 (pp. 729–732). Yu, F., Liu, Q., Wu, S., Wang, L., & Tan, T. (2016). A dynamic recurrent model for next basket recommendation. In SIGIR’16 (pp. 729–732).
Zurück zum Zitat Zhang, Z., Zhang, Y., & Ren, Y. (2020). Employing neighborhood reduction for alleviating sparsity and cold start problems in user-based collaborative filtering. Information Retrieval Journal, 23(4), 449–472.CrossRef Zhang, Z., Zhang, Y., & Ren, Y. (2020). Employing neighborhood reduction for alleviating sparsity and cold start problems in user-based collaborative filtering. Information Retrieval Journal, 23(4), 449–472.CrossRef
Zurück zum Zitat Zhang, H., Lan, Y., Pang, L., Guo, J., & Cheng, X. (2019). Recosa: Detecting the relevant contexts with self-attention for multi-turn dialogue generation. In ACL’19 (pp. 3721–3730). Zhang, H., Lan, Y., Pang, L., Guo, J., & Cheng, X. (2019). Recosa: Detecting the relevant contexts with self-attention for multi-turn dialogue generation. In ACL’19 (pp. 3721–3730).
Metadaten
Titel
Exploring latent connections in graph neural networks for session-based recommendation
verfasst von
Fei Cai
Zhiqiang Pan
Chengyu Song
Xin Zhang
Publikationsdatum
18.07.2022
Verlag
Springer Netherlands
Erschienen in
Discover Computing / Ausgabe 3/2022
Print ISSN: 2948-2984
Elektronische ISSN: 2948-2992
DOI
https://doi.org/10.1007/s10791-022-09412-z

Premium Partner