Skip to main content
Top
Published in: International Journal of Multimedia Information Retrieval 1/2023

01-06-2023 | Regular Paper

Multiple feedback based adversarial collaborative filtering with aesthetics

Authors: Zhefu Wu, Yuhang Ma, Junzhuo Cao, Agyemang Paul, Xiang Li

Published in: International Journal of Multimedia Information Retrieval | Issue 1/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Visual-aware personalized recommendation systems can estimate the potential demand by evaluating consumer personalized preferences. In general, consumer feedback data is deduced from either explicit feedback or implicit feedback. However, explicit and implicit feedback raises the chance of malicious operation or misoperation, which can lead to deviations in recommended outcomes. Adversarial learning, a regularization approach that can resist disturbances, could be a promising choice for enhancing model resilience. We propose a novel adversarial collaborative filtering with aesthetics (ACFA) for the visual recommendation that utilizes adversarial learning to improve resilience and performance in the case of perturbation. The ACFA algorithm applies three types of input to the visual Bayesian personalized ranking: negative, unobserved, and positive feedback. Through feedbacks at various levels, it uses a probabilistic approach to obtain consumer personalized preferences. Since in visual recommendation, the aesthetic data in determining consumer preferences on product is critical, we construct the consumer personalized preferences model with aesthetic elements, and then use them to enhance the sampling quality when training the algorithm. To mitigate the negative effects of feedback noise, We use minimax adversarial learning to learn the ACFA objective function. Experiments using two datasets demonstrate that the ACFA model outperforms state-of-the-art algorithms on two metrics.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hu L, Cao J, Xu G et al (2013) Personalized recommendation via cross domain triadic factorization. In: Proceedings of international conference on world wide web, pp 595–606 Hu L, Cao J, Xu G et al (2013) Personalized recommendation via cross domain triadic factorization. In: Proceedings of international conference on world wide web, pp 595–606
2.
go back to reference Deshpande M, Karypis G (2004) Item-based top-N recommendation algorithms. ACM Trans Inf Syst 22(1):143–177CrossRef Deshpande M, Karypis G (2004) Item-based top-N recommendation algorithms. ACM Trans Inf Syst 22(1):143–177CrossRef
3.
go back to reference Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of ACM SIGKDD international conference on knowledge discovery and data mining, pp 426–434 Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of ACM SIGKDD international conference on knowledge discovery and data mining, pp 426–434
4.
go back to reference Rendle S, Freudenthaler C, Gantner Z et al (2009) BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of uncertainty in artificial intelligence, pp 452–461 Rendle S, Freudenthaler C, Gantner Z et al (2009) BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of uncertainty in artificial intelligence, pp 452–461
5.
go back to reference Pan R, Zhou Y, Cao B et al (2008) One-class collaborative filtering. In: Proceedings of IEEE international conference on data mining, pp 502–511 Pan R, Zhou Y, Cao B et al (2008) One-class collaborative filtering. In: Proceedings of IEEE international conference on data mining, pp 502–511
6.
go back to reference Cao Z (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of machine learning, pp 129–136 Cao Z (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of machine learning, pp 129–136
7.
go back to reference He R, McAuley J (2016) VBPR: visual bayesian personalized ranking from implicit feedback. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, pp 144–150 He R, McAuley J (2016) VBPR: visual bayesian personalized ranking from implicit feedback. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, pp 144–150
8.
go back to reference Yu W, Zhang H, He X et al (2018) Aesthetic-based clothing recommendation. In: Proceedings of the 2018 world wide web conference on world wide web, pp 649–658 Yu W, Zhang H, He X et al (2018) Aesthetic-based clothing recommendation. In: Proceedings of the 2018 world wide web conference on world wide web, pp 649–658
9.
go back to reference Tang J, Du X, He X, Yuan F, Tian Q, Chua TS (2020) Adversarial training towards robust multimedia recommender system. IEEE Trans Knowl Data Eng 32(5):855–867CrossRef Tang J, Du X, He X, Yuan F, Tian Q, Chua TS (2020) Adversarial training towards robust multimedia recommender system. IEEE Trans Knowl Data Eng 32(5):855–867CrossRef
10.
go back to reference Yu DJ, Chen C, Wu JH et al (2018) Personalized game recommendation based on implicit feedback. Chin J Electron 27(4):2626–2632 Yu DJ, Chen C, Wu JH et al (2018) Personalized game recommendation based on implicit feedback. Chin J Electron 27(4):2626–2632
11.
go back to reference Liu TY (2009) Learning to rank for information retrieval. Found Trends Inf Ret 3(3):225–331CrossRef Liu TY (2009) Learning to rank for information retrieval. Found Trends Inf Ret 3(3):225–331CrossRef
12.
go back to reference Zhao T, McAuley J, King I (2014) Leveraging social connections to improve personalized ranking for collaborative filtering. In: Proceedings of ACM international conference on information and knowledge management, pp 261–270 Zhao T, McAuley J, King I (2014) Leveraging social connections to improve personalized ranking for collaborative filtering. In: Proceedings of ACM international conference on information and knowledge management, pp 261–270
13.
go back to reference Peugh JL, Enders CK (2004) Missing data in educational research: a review of reporting practices and suggestions for improvement. Rev Educ Res 74(4):525–556CrossRef Peugh JL, Enders CK (2004) Missing data in educational research: a review of reporting practices and suggestions for improvement. Rev Educ Res 74(4):525–556CrossRef
14.
go back to reference He X, Zhang H, Kan M Y et al (2016) Fast matrix factorization for online recommendation with implicit feedback. In: Proceedings of the 39th international ACM SIGIR conference on research and development in information retrieval, pp 549–558 He X, Zhang H, Kan M Y et al (2016) Fast matrix factorization for online recommendation with implicit feedback. In: Proceedings of the 39th international ACM SIGIR conference on research and development in information retrieval, pp 549–558
15.
go back to reference Runlong Y, Yunzhou Z, Yuyang Y et al (2018) Multiple pairwise ranking with implicit feedback. In: Proceedings of ACM international conference on information and knowledge management, pp 1727–1730 Runlong Y, Yunzhou Z, Yuyang Y et al (2018) Multiple pairwise ranking with implicit feedback. In: Proceedings of ACM international conference on information and knowledge management, pp 1727–1730
16.
go back to reference Loftin R, Peng B, MacGlashan J et al (2016) Learning behaviors via human-delivered discrete feedback: modeling implicit feedback strategies to speed up learning. Auton Agent Multi-Ag 30(1):30–59CrossRef Loftin R, Peng B, MacGlashan J et al (2016) Learning behaviors via human-delivered discrete feedback: modeling implicit feedback strategies to speed up learning. Auton Agent Multi-Ag 30(1):30–59CrossRef
17.
go back to reference Chen X, Wang P F, Qin Z et al (2016) Hlbpr: a hybrid local Bayesian personal ranking method. In: Proceedings of international conference on world wide web, pp 21–22 Chen X, Wang P F, Qin Z et al (2016) Hlbpr: a hybrid local Bayesian personal ranking method. In: Proceedings of international conference on world wide web, pp 21–22
18.
go back to reference Babak L, Roberto P, Martha L et al (2016) Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM conference on recommender systems, pp 361–364 Babak L, Roberto P, Martha L et al (2016) Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM conference on recommender systems, pp 361–364
19.
go back to reference He R, Lin C, Wang J, Mcauley J (2016) Sherlock: sparse hierarchical embeddings for visually-aware one-class collaborative filtering. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 3740–3746 He R, Lin C, Wang J, Mcauley J (2016) Sherlock: sparse hierarchical embeddings for visually-aware one-class collaborative filtering. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 3740–3746
20.
go back to reference He R, McAuley J (2016) Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In: Proceedings of the 25th international conference on world wide web, pp 507–517 He R, McAuley J (2016) Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In: Proceedings of the 25th international conference on world wide web, pp 507–517
21.
go back to reference Wu Z, Agyemang P, Chan M et al. (2017) Improved one-class collaborative filtering for online recommendation. In: International workshop on complex systems and networks (IWCSN), pp 205–209 Wu Z, Agyemang P, Chan M et al. (2017) Improved one-class collaborative filtering for online recommendation. In: International workshop on complex systems and networks (IWCSN), pp 205–209
22.
go back to reference Niu W, Caverlee J, Lu H (2018) Neural personalized ranking for image recommendation. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 423–431 Niu W, Caverlee J, Lu H (2018) Neural personalized ranking for image recommendation. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 423–431
23.
go back to reference Kang W C, Fang C, Wang Z, McAuley JJ (2017) Visually-aware fashion recommendation and design with generative image models. In: IEEE international conference on data mining, pp 207–216 Kang W C, Fang C, Wang Z, McAuley JJ (2017) Visually-aware fashion recommendation and design with generative image models. In: IEEE international conference on data mining, pp 207–216
24.
go back to reference Liu Q, Wu S, Wang L (2017) DeepStyle: learning user preferences for visual recommendation. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 841–844 Liu Q, Wu S, Wang L (2017) DeepStyle: learning user preferences for visual recommendation. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 841–844
25.
go back to reference Meng L, Feng F, He X et al. (2020) Heterogeneous fusion of semantic and collaborative information for visually-aware food recommendation. In: ACM multimedia, pp 3460–3468 Meng L, Feng F, He X et al. (2020) Heterogeneous fusion of semantic and collaborative information for visually-aware food recommendation. In: ACM multimedia, pp 3460–3468
26.
go back to reference Chen J, Zhang H, He X et al (2017) Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In : Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 335-344 Chen J, Zhang H, He X et al (2017) Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In : Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 335-344
27.
go back to reference Yin R, Li K, Lu J, Zhang G (2019) Enhancing fashion recommendation with visual compatibility relationship. In: The world wide web conference, pp 3434–3440 Yin R, Li K, Lu J, Zhang G (2019) Enhancing fashion recommendation with visual compatibility relationship. In: The world wide web conference, pp 3434–3440
29.
go back to reference Anelli VW, Deldjoo Y, Noia TD et al. (2021) A study of defensive methods to protect visual recommendation against adversarial manipulation of images. In: SIGIR, pp 1094–1103 Anelli VW, Deldjoo Y, Noia TD et al. (2021) A study of defensive methods to protect visual recommendation against adversarial manipulation of images. In: SIGIR, pp 1094–1103
30.
go back to reference Noia TD, Malitesta D, Merra FA (2020) TAaMR: targeted adversarial attack against multimedia recommender systems. In: 50th annual IEEE/IFIP international conference on dependable systems and networks workshops, pp 1–8 Noia TD, Malitesta D, Merra FA (2020) TAaMR: targeted adversarial attack against multimedia recommender systems. In: 50th annual IEEE/IFIP international conference on dependable systems and networks workshops, pp 1–8
31.
go back to reference Cohen R, Shalom OS, Jannach D, Amir A (2021) A black-box attack model for visually-aware recommender systems. In: The fourteenth ACM international conference on web search and data mining, pp 94–102 Cohen R, Shalom OS, Jannach D, Amir A (2021) A black-box attack model for visually-aware recommender systems. In: The fourteenth ACM international conference on web search and data mining, pp 94–102
32.
go back to reference Liu Z, Larson M (2021) Adversarial item promotion: vulnerabilities at the core of top-N recommenders that use images to address cold start. In: WWW.ACM/IW3C2, pp 3590–3602 Liu Z, Larson M (2021) Adversarial item promotion: vulnerabilities at the core of top-N recommenders that use images to address cold start. In: WWW.​ACM/​IW3C2, pp 3590–3602
Metadata
Title
Multiple feedback based adversarial collaborative filtering with aesthetics
Authors
Zhefu Wu
Yuhang Ma
Junzhuo Cao
Agyemang Paul
Xiang Li
Publication date
01-06-2023
Publisher
Springer London
Published in
International Journal of Multimedia Information Retrieval / Issue 1/2023
Print ISSN: 2192-6611
Electronic ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-023-00273-w

Other articles of this Issue 1/2023

International Journal of Multimedia Information Retrieval 1/2023 Go to the issue

Premium Partner