Skip to main content
Erschienen in: Pattern Analysis and Applications 4/2019

05.04.2019 | Industrial and commercial application

RACMF: robust attention convolutional matrix factorization for rating prediction

verfasst von: Biqing Zeng, Qi Shang, Xuli Han, Feng Zeng, Min Zhang

Erschienen in: Pattern Analysis and Applications | Ausgabe 4/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Matrix factorization is widely used in collaborative filtering, especially when the data are extremely large and sparse. To deal with the scale and sparsity problem of data, several recommender models adopt users and items’ side information to improve the recommendation results. However, some existing works do not perform well enough for they are not effectively use the side information. For example, using bag-of-words model, topic model to gain the latent representation of words or merely utilizing items or users’ side information, leads to the result that the performance deteriorates, especially when rating dataset is extremely large and sparse. To overcome the data sparsity problem, we present a hybrid model named robust attention convolutional matrix factorization (RACMF) model, which is composed of attention convolutional neural network (ACNN) and additional stacked denoising autoencoder (aSDAE); ACNN and aSDAE are used to extract the items’ and users’ latent factors, respectively. The experimental results show that our RACMF model has good prediction ability, even when the rating data are sparse or the scale of rating data is large. What’s more, compared with the state-of-the-art model PHD, the present model RACMF increased the accuracy rate on ML-100k, ML-1m, ML-10m and AIV-6 datasets by 4.80%, 0.57%, 1.98% and 3.67%, respectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mnih A, Salakhutdinov RR (2008) Probabilistic matrix factorization. In: Advances in neural information processing systems, pp 1257–1264 Mnih A, Salakhutdinov RR (2008) Probabilistic matrix factorization. In: Advances in neural information processing systems, pp 1257–1264
2.
Zurück zum Zitat Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749CrossRef Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749CrossRef
3.
Zurück zum Zitat Wang C, Blei DM (2011) Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 448–456 Wang C, Blei DM (2011) Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 448–456
4.
Zurück zum Zitat Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1235–1244 Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1235–1244
5.
Zurück zum Zitat McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on Recommender systems. ACM, pp 165–172 McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on Recommender systems. ACM, pp 165–172
6.
Zurück zum Zitat Li S, Kawale J, Fu Y (2015) Deep collaborative filtering via marginalized denoising auto-encoder. In: Proceedings of the 24th ACM international on conference on information and knowledge management. ACM, pp 811–820 Li S, Kawale J, Fu Y (2015) Deep collaborative filtering via marginalized denoising auto-encoder. In: Proceedings of the 24th ACM international on conference on information and knowledge management. ACM, pp 811–820
7.
Zurück zum Zitat Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In: Proceedings of the 8th ACM conference on recommender systems. ACM, pp 105–112 Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In: Proceedings of the 8th ACM conference on recommender systems. ACM, pp 105–112
8.
Zurück zum Zitat Dong X, Yu L, Wu Z, et al (2017) A hybrid collaborative filtering model with deep structure for recommender systems. In: AAAI, pp 1309–1315 Dong X, Yu L, Wu Z, et al (2017) A hybrid collaborative filtering model with deep structure for recommender systems. In: AAAI, pp 1309–1315
9.
Zurück zum Zitat Liu J, Wang D, Ding Y (2017) PHD: a probabilistic model of hybrid deep collaborative filtering for recommender systems. In: Asian Conference on machine learning, pp 224–239 Liu J, Wang D, Ding Y (2017) PHD: a probabilistic model of hybrid deep collaborative filtering for recommender systems. In: Asian Conference on machine learning, pp 224–239
10.
Zurück zum Zitat Vincent P, Larochelle H, Lajoie I et al (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11(Dec):3371–3408MathSciNetMATH Vincent P, Larochelle H, Lajoie I et al (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11(Dec):3371–3408MathSciNetMATH
11.
Zurück zum Zitat Seo S, Huang J, Yang H, et al (2017) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the eleventh ACM conference on recommender systems. ACM, pp 297–305 Seo S, Huang J, Yang H, et al (2017) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the eleventh ACM conference on recommender systems. ACM, pp 297–305
12.
Zurück zum Zitat Seo S, Huang J, Yang H, et al (2017) Representation learning of users and items for review rating prediction using attention-based convolutional neural network. In: 3rd international workshop on machine learning methods for recommender systems (MLRec) (SDM’17) Seo S, Huang J, Yang H, et al (2017) Representation learning of users and items for review rating prediction using attention-based convolutional neural network. In: 3rd international workshop on machine learning methods for recommender systems (MLRec) (SDM’17)
13.
Zurück zum Zitat Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on Web search and data mining. ACM, pp 425–434 Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on Web search and data mining. ACM, pp 425–434
14.
Zurück zum Zitat Chen C, Zhang M, Liu Y, et al (2018) Neural attentional rating regression with review-level explanations. In: Proceedings of the 2018 World Wide Web conference on World Wide Web. International World Wide Web conferences Steering Committee, pp 1583–1592 Chen C, Zhang M, Liu Y, et al (2018) Neural attentional rating regression with review-level explanations. In: Proceedings of the 2018 World Wide Web conference on World Wide Web. International World Wide Web conferences Steering Committee, pp 1583–1592
15.
Zurück zum Zitat Kim D, Park C, Oh J, et al (2016) Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM conference on recommender systems. ACM, pp 233–240 Kim D, Park C, Oh J, et al (2016) Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM conference on recommender systems. ACM, pp 233–240
16.
Zurück zum Zitat Kim D, Park C, Oh J et al (2017) Deep hybrid recommender systems via exploiting document context and statistics of items. Inf Sci 417:72–87CrossRef Kim D, Park C, Oh J et al (2017) Deep hybrid recommender systems via exploiting document context and statistics of items. Inf Sci 417:72–87CrossRef
17.
Zurück zum Zitat Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 8:30–37CrossRef Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 8:30–37CrossRef
18.
Zurück zum Zitat Xu K, Ba J, Kiros R, et al (2015) Show, attend and tell: Neural image caption generation with visual attention. In: International conference on machine learning, pp 2048–2057 Xu K, Ba J, Kiros R, et al (2015) Show, attend and tell: Neural image caption generation with visual attention. In: International conference on machine learning, pp 2048–2057
19.
Zurück zum Zitat Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:​1409.​0473
20.
Zurück zum Zitat Luong MT, Pham H, Manning CD (2015) Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025 Luong MT, Pham H, Manning CD (2015) Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:​1508.​04025
21.
Zurück zum Zitat Yin W, Schütze H, Xiang B et al (2016) ABCNN: attention-based convolutional neural network for modeling sentence Pairs. Trans Assoc Comput Linguist 4:259–272CrossRef Yin W, Schütze H, Xiang B et al (2016) ABCNN: attention-based convolutional neural network for modeling sentence Pairs. Trans Assoc Comput Linguist 4:259–272CrossRef
22.
Zurück zum Zitat Wang Y, Huang M, Zhao L (2016) Attention-based lstm for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in Natural Language Processing, pp 606–615 Wang Y, Huang M, Zhao L (2016) Attention-based lstm for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in Natural Language Processing, pp 606–615
23.
Zurück zum Zitat LeCun Y, Bottou L, Bengio Y et al (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef LeCun Y, Bottou L, Bengio Y et al (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
24.
Zurück zum Zitat Van den Oord A, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: Advances in neural information processing systems, pp 2643–2651 Van den Oord A, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: Advances in neural information processing systems, pp 2643–2651
25.
Zurück zum Zitat Zhang F, Yuan NJ, Lian D, et al (2016) Collaborative knowledge base embedding for recommender systems. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 353–362 Zhang F, Yuan NJ, Lian D, et al (2016) Collaborative knowledge base embedding for recommender systems. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 353–362
26.
Zurück zum Zitat Xue H, Dai X, Zhang J, et al (2017) Deep matrix factorization models for recommender systems. In: International joint conference on artificial intelligence, pp 3203–3209 Xue H, Dai X, Zhang J, et al (2017) Deep matrix factorization models for recommender systems. In: International joint conference on artificial intelligence, pp 3203–3209
27.
Zurück zum Zitat Zhang S, Wang W, Ford J, et al (2006) Learning from incomplete ratings using non-negative matrix factorization. In: Proceedings of the 2006 SIAM international conference on data mining. Society for Industrial and Applied Mathematics, pp 549–553 Zhang S, Wang W, Ford J, et al (2006) Learning from incomplete ratings using non-negative matrix factorization. In: Proceedings of the 2006 SIAM international conference on data mining. Society for Industrial and Applied Mathematics, pp 549–553
28.
Zurück zum Zitat Sarwar B, Karypis G, Konstan J, et al (2000) Application of dimensionality reduction in recommender system-a case study. Minnesota Univ Minneapolis Dept of Computer Science Sarwar B, Karypis G, Konstan J, et al (2000) Application of dimensionality reduction in recommender system-a case study. Minnesota Univ Minneapolis Dept of Computer Science
29.
Zurück zum Zitat Goodfellow I, Pouget-Abadie J, Mirza M, et al (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680 Goodfellow I, Pouget-Abadie J, Mirza M, et al (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680
Metadaten
Titel
RACMF: robust attention convolutional matrix factorization for rating prediction
verfasst von
Biqing Zeng
Qi Shang
Xuli Han
Feng Zeng
Min Zhang
Publikationsdatum
05.04.2019
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 4/2019
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-019-00814-2

Weitere Artikel der Ausgabe 4/2019

Pattern Analysis and Applications 4/2019 Zur Ausgabe