Skip to main content
Erschienen in: Knowledge and Information Systems 3/2017

08.07.2016 | Regular Paper

A GPU-oriented online recommendation algorithm for efficient processing of time-varying continuous data streams

verfasst von: Chandima HewaNadungodage, Yuni Xia, John Jaehwan Lee

Erschienen in: Knowledge and Information Systems | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Research on recommendation systems has gained a considerable amount of attention over the past decade as the number of online users and online contents continue to grow at an exponential rate. With the evolution of the social web, people generate and consume data in real time using online services such as Twitter, Facebook, and web news portals. With the rapidly growing online community, web-based retail systems and social media sites have to process several millions of user requests per day. Generating quality recommendations using this vast amount of data is itself a very challenging task. Nevertheless, opposed to the web-based retailers such as Amazon and Netflix, the above-mentioned social networking sites have to face an additional challenge when generating recommendations as their contents are very rapidly changing. Therefore, providing fresh information in the least amount of time is a major objective of such recommender systems. Although collaborative filtering is a widely used technique in recommendation systems, generating the recommendation model using this approach is a costly task, and often done offline. Hence, it is difficult to use collaborative filtering in the presence of dynamically changing contents, as such systems require frequent updates to the recommendation model to maintain the accuracy and the freshness of the recommendations. Parallel processing power of graphic processing units (GPUs) can be used to process large volumes of data with dynamically changing contents in real time, and accelerate the recommendation process for social media data streams. In this paper, we address the issue of rapidly changing contents, and propose a parallel on-the-fly collaborative filtering algorithm using GPUs to facilitate frequent updates to the recommendations model. We use a hybrid similarity calculation method by combining the item–item collaborative filtering with item category information and temporal information. The experimental results on real-world datasets show that the proposed algorithm outperformed several existing online CF algorithms in terms of accuracy, memory consumption, and runtime. It was also observed that the proposed algorithm scaled well with the data rate and the data volume, and generated recommendations in a timely manner.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intell 2009:4CrossRef Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intell 2009:4CrossRef
2.
Zurück zum Zitat Deshpande M, Karypis G (2004) Item based top-N recommendation algorithms. ACM Trans Inf Syst 22(1):143–177CrossRef Deshpande M, Karypis G (2004) Item based top-N recommendation algorithms. ACM Trans Inf Syst 22(1):143–177CrossRef
3.
Zurück zum Zitat Bobadilla J, Fernando O, Hernando A et al (2013) Recommender systems survey. Knowl Based Syst 46:109–132CrossRef Bobadilla J, Fernando O, Hernando A et al (2013) Recommender systems survey. Knowl Based Syst 46:109–132CrossRef
4.
Zurück zum Zitat Pan R, Zhou Y, Cao B et al (2008) One-class collaborative filtering. In: Proceedings of the IEEE international conference on data mining, pp 502–511 Pan R, Zhou Y, Cao B et al (2008) One-class collaborative filtering. In: Proceedings of the IEEE international conference on data mining, pp 502–511
5.
Zurück zum Zitat Kitts B, Freed D, Vrieze M (2000) Cross-sell: a fast promotion-tunable customer-item recommendation method based on conditional independent probabilities. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 437–441 Kitts B, Freed D, Vrieze M (2000) Cross-sell: a fast promotion-tunable customer-item recommendation method based on conditional independent probabilities. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 437–441
6.
Zurück zum Zitat Linden G, Smith B, York J (2003) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput 7(1):76–80CrossRef Linden G, Smith B, York J (2003) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput 7(1):76–80CrossRef
7.
Zurück zum Zitat Sarwar B, Karypis G, Konstan J et al (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the ACM international conference on world wide web, pp 285–295 Sarwar B, Karypis G, Konstan J et al (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the ACM international conference on world wide web, pp 285–295
8.
Zurück zum Zitat Das AS, Datar M, Garg A et al (2007) Google news personalization: scalable online collaborative filtering. In: Proceedings of the 16th international conference on world wide web, pp 271–280 Das AS, Datar M, Garg A et al (2007) Google news personalization: scalable online collaborative filtering. In: Proceedings of the 16th international conference on world wide web, pp 271–280
9.
Zurück zum Zitat Davidson J, Liebald B, Liu J et al (2010) The YouTube video recommendation system. In: Proceedings of the ACM RecSys, pp 293–296 Davidson J, Liebald B, Liu J et al (2010) The YouTube video recommendation system. In: Proceedings of the ACM RecSys, pp 293–296
10.
Zurück zum Zitat Hofmann T (2004) Latent semantic models for collaborative filtering. ACM Trans Inf Syst 22(1):89–115CrossRef Hofmann T (2004) Latent semantic models for collaborative filtering. ACM Trans Inf Syst 22(1):89–115CrossRef
11.
Zurück zum Zitat Gemulla R, Nijkamp E, Haas PJ et al (2011) Large-scale matrix factorization with distributed stochastic gradient descent. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 69–77 Gemulla R, Nijkamp E, Haas PJ et al (2011) Large-scale matrix factorization with distributed stochastic gradient descent. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 69–77
12.
Zurück zum Zitat Han S, Yang Y, Liu W (2011) Incremental learning for dynamic collaborative filtering. J Softw 6(6):969–976CrossRef Han S, Yang Y, Liu W (2011) Incremental learning for dynamic collaborative filtering. J Softw 6(6):969–976CrossRef
13.
Zurück zum Zitat Narang A, Srivastava A, Katta NPK (2011) Distributed scalable collaborative filtering algorithm. In: Proceedings of Euro-Par conference, pp 353–365 Narang A, Srivastava A, Katta NPK (2011) Distributed scalable collaborative filtering algorithm. In: Proceedings of Euro-Par conference, pp 353–365
14.
Zurück zum Zitat Shang Y, Li Z, Qu W et al (2014) Scalable collaborative filtering recommendation algorithm with MapReduce. In: Proceedings of the IEEE international conference on dependable, autonomic and secure computing, pp 103–108 Shang Y, Li Z, Qu W et al (2014) Scalable collaborative filtering recommendation algorithm with MapReduce. In: Proceedings of the IEEE international conference on dependable, autonomic and secure computing, pp 103–108
15.
16.
Zurück zum Zitat Abernethy J, Canini K, Langford J et al (2007) Online collaborative filtering. Technical Report, University of California at Berkeley Abernethy J, Canini K, Langford J et al (2007) Online collaborative filtering. Technical Report, University of California at Berkeley
17.
Zurück zum Zitat Agarwal D, Chen BC, Elango P (2010) Fast online learning through offline initialization for time-sensitive recommendation. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 703–712 Agarwal D, Chen BC, Elango P (2010) Fast online learning through offline initialization for time-sensitive recommendation. In: Proceedings of the ACM SIGKDD conference on knowledge discovery and data mining, pp 703–712
18.
Zurück zum Zitat Khoshneshin M, Street WN (2010) Incremental collaborative filtering via evolutionary co-clustering. In: Proceedings of the 4th ACM RecSys, pp 325–328 Khoshneshin M, Street WN (2010) Incremental collaborative filtering via evolutionary co-clustering. In: Proceedings of the 4th ACM RecSys, pp 325–328
19.
Zurück zum Zitat Li X, Barajas JM, Ding Y (2007) Collaborative filtering on streaming data with interest-drifting. Intell Data Anal 11(1):75–87 Li X, Barajas JM, Ding Y (2007) Collaborative filtering on streaming data with interest-drifting. Intell Data Anal 11(1):75–87
20.
Zurück zum Zitat Ling G, Yang H, King I et al (2012) Online learning for collaborative filtering. In: Proceedings of the international joint conference on neural networks, pp 1–8 Ling G, Yang H, King I et al (2012) Online learning for collaborative filtering. In: Proceedings of the international joint conference on neural networks, pp 1–8
21.
Zurück zum Zitat Luo X, Xia Y, Zhu Q (2012) Incremental collaborative filtering recommender based on regularized matrix factorization. Knowl Based Syst 27:271–280CrossRef Luo X, Xia Y, Zhu Q (2012) Incremental collaborative filtering recommender based on regularized matrix factorization. Knowl Based Syst 27:271–280CrossRef
22.
Zurück zum Zitat Luo X, Xia Y, Zhu Q et al (2013) Boosting the k-nearest-neighborhood based incremental collaborative filtering. Knowl Based Syst 53:90–99CrossRef Luo X, Xia Y, Zhu Q et al (2013) Boosting the k-nearest-neighborhood based incremental collaborative filtering. Knowl Based Syst 53:90–99CrossRef
23.
Zurück zum Zitat Miranda C, Jorge AM (2008) Incremental collaborative filtering for binary ratings. In: Proceedings of the IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology, pp 389–392 Miranda C, Jorge AM (2008) Incremental collaborative filtering for binary ratings. In: Proceedings of the IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology, pp 389–392
24.
Zurück zum Zitat Miranda C, Jorge AM (2009) Item-based and user-based incremental collaborative filtering for web recommendations. In: Proceedings of the portuguese conference on artificial intelligence, pp 673–684 Miranda C, Jorge AM (2009) Item-based and user-based incremental collaborative filtering for web recommendations. In: Proceedings of the portuguese conference on artificial intelligence, pp 673–684
25.
Zurück zum Zitat Nilashi M, Jannach D, Ibrahim O et al (2015) Clustering-and regression-based multi-criteria collaborative filtering with incremental updates. Inf Sci 293:235–250CrossRef Nilashi M, Jannach D, Ibrahim O et al (2015) Clustering-and regression-based multi-criteria collaborative filtering with incremental updates. Inf Sci 293:235–250CrossRef
26.
Zurück zum Zitat Papagelis M, Rousidis I, Plexousakis D et al (2005) Incremental collaborative filtering for highly-scalable recommendation algorithms. In: Proceedings of the international conference on foundations of intelligent systems, pp 553–561 Papagelis M, Rousidis I, Plexousakis D et al (2005) Incremental collaborative filtering for highly-scalable recommendation algorithms. In: Proceedings of the international conference on foundations of intelligent systems, pp 553–561
27.
Zurück zum Zitat Takács G, Pilászy I, Németh B et al (2009) Scalable collaborative filtering approaches for large recommender systems. J Mach Learn Res 10:623–656 Takács G, Pilászy I, Németh B et al (2009) Scalable collaborative filtering approaches for large recommender systems. J Mach Learn Res 10:623–656
28.
Zurück zum Zitat Vinagre J, Jorge AM, Gama J (2014) Fast incremental matrix factorization for recommendation with positive-only feedback. In: Proceedings of the international conference on user modeling, adaptation, and personalization, pp 459–470 Vinagre J, Jorge AM, Gama J (2014) Fast incremental matrix factorization for recommendation with positive-only feedback. In: Proceedings of the international conference on user modeling, adaptation, and personalization, pp 459–470
29.
Zurück zum Zitat Wang X, Zhang J (2014) Using incremental clustering technique in collaborative filtering data update. In: Proceedings of the IEEE international conference on information reuse and integration, pp 420–427 Wang X, Zhang J (2014) Using incremental clustering technique in collaborative filtering data update. In: Proceedings of the IEEE international conference on information reuse and integration, pp 420–427
30.
Zurück zum Zitat Ali M, Johnson CC, Tang AK (2011) Parallel collaborative filtering for streaming data. Technical Report, University of Texas Austin Ali M, Johnson CC, Tang AK (2011) Parallel collaborative filtering for streaming data. Technical Report, University of Texas Austin
31.
Zurück zum Zitat Chandramouli B, Levandoski JJ, Eldawy A et al (2011) StreamRec: a real-time recommender system. In: Proceedings of the ACM SIGMOD, pp 1243–1246 Chandramouli B, Levandoski JJ, Eldawy A et al (2011) StreamRec: a real-time recommender system. In: Proceedings of the ACM SIGMOD, pp 1243–1246
32.
Zurück zum Zitat Diaz-Aviles E, Drumond L, Schmidt-Thieme I et al (2012) Real-time top-N recommendation in social streams. In: Proceedings of the ACM RecSys, pp 59–66 Diaz-Aviles E, Drumond L, Schmidt-Thieme I et al (2012) Real-time top-N recommendation in social streams. In: Proceedings of the ACM RecSys, pp 59–66
33.
Zurück zum Zitat Jamali M, Ester M (2010) A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of the ACM RecSys, pp 135–142 Jamali M, Ester M (2010) A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of the ACM RecSys, pp 135–142
34.
Zurück zum Zitat Matuszyk P, Spiliopoulou M (2014) Selective forgetting for incremental matrix factorization in recommender systems. In: Proceedings of the international conference on discovery science, pp 204–215 Matuszyk P, Spiliopoulou M (2014) Selective forgetting for incremental matrix factorization in recommender systems. In: Proceedings of the international conference on discovery science, pp 204–215
35.
Zurück zum Zitat Matuszyk P, Vinagre J, Spiliopoulou M et al (2015) Forgetting methods for incremental matrix factorization in recommender systems. In: Proceedings of the ACM/ SIGAPP symposium on applied computing, pp 947–953 Matuszyk P, Vinagre J, Spiliopoulou M et al (2015) Forgetting methods for incremental matrix factorization in recommender systems. In: Proceedings of the ACM/ SIGAPP symposium on applied computing, pp 947–953
36.
Zurück zum Zitat Nasraoui O, Cerwinske J, Rojas C et al (2007) Performance of recommendation systems in dynamic streaming environments. In: Proceedings of the SIAM international conference on data mining, pp 569–574 Nasraoui O, Cerwinske J, Rojas C et al (2007) Performance of recommendation systems in dynamic streaming environments. In: Proceedings of the SIAM international conference on data mining, pp 569–574
37.
Zurück zum Zitat Vinagre J, Jorge AM (2012) Forgetting mechanisms for scalable collaborative filtering. J Braz Comput Socy 18(4):271–282CrossRef Vinagre J, Jorge AM (2012) Forgetting mechanisms for scalable collaborative filtering. J Braz Comput Socy 18(4):271–282CrossRef
38.
Zurück zum Zitat Yu K, Xu X, Tao J et al (2002) Instance selection techniques for memory-based collaborative filtering. Proc SIAM Int Conf Data Mining 2(16):59–74 Yu K, Xu X, Tao J et al (2002) Instance selection techniques for memory-based collaborative filtering. Proc SIAM Int Conf Data Mining 2(16):59–74
39.
Zurück zum Zitat Bress S, Saake G (2013) Why it is time for a HyPE: a hybrid query processing engine for efficient GPU co-processing in DBMS. Proc Int Conf Very Large Data Bases 6(12):1398–1403 Bress S, Saake G (2013) Why it is time for a HyPE: a hybrid query processing engine for efficient GPU co-processing in DBMS. Proc Int Conf Very Large Data Bases 6(12):1398–1403
40.
Zurück zum Zitat Farivar R, Rebolledo D, Chan E et al (2008) A parallel implementation of k-means clustering on GPUs. In: Proceedings of the international conference on parallel and distributed processing techniques and applications, pp 340–345 Farivar R, Rebolledo D, Chan E et al (2008) A parallel implementation of k-means clustering on GPUs. In: Proceedings of the international conference on parallel and distributed processing techniques and applications, pp 340–345
41.
Zurück zum Zitat Garcia V, Debreuve E, Barlaud M (2008) Fast k-nearest neighbor search using GPU. In: Proceedings of the IEEE computer vision and pattern recognition workshops, pp 1–6 Garcia V, Debreuve E, Barlaud M (2008) Fast k-nearest neighbor search using GPU. In: Proceedings of the IEEE computer vision and pattern recognition workshops, pp 1–6
42.
Zurück zum Zitat Steinkraus D, Buck I, Simard PY (2005) Using GPUs for machine learning algorithms. In: Proceedings of the IEEE international conference on document analysis and recognition, pp 1115–1120 Steinkraus D, Buck I, Simard PY (2005) Using GPUs for machine learning algorithms. In: Proceedings of the IEEE international conference on document analysis and recognition, pp 1115–1120
43.
Zurück zum Zitat Gao Z, Yuying L (2012) Improving the collaborative filtering recommender system by using GPU. In: Proceedings of the IEEE international conference on cyber-enabled distributed computing and knowledge discovery, pp 330–333 Gao Z, Yuying L (2012) Improving the collaborative filtering recommender system by using GPU. In: Proceedings of the IEEE international conference on cyber-enabled distributed computing and knowledge discovery, pp 330–333
44.
Zurück zum Zitat Kato K, Hosino T (2010) Solving k-nearest neighbor problem on multiple graphics processors. In: Proceedings of the IEEE/ACM international conference on cluster, cloud and grid computing, pp 769–773 Kato K, Hosino T (2010) Solving k-nearest neighbor problem on multiple graphics processors. In: Proceedings of the IEEE/ACM international conference on cluster, cloud and grid computing, pp 769–773
45.
Zurück zum Zitat Li R, Zhang Y, Yu H et al (2011) A social network-aware top-N recommender system using GPU. In: Proceedings of the ACM/IEEE joint conference on digital libraries, pp 287–296 Li R, Zhang Y, Yu H et al (2011) A social network-aware top-N recommender system using GPU. In: Proceedings of the ACM/IEEE joint conference on digital libraries, pp 287–296
46.
Zurück zum Zitat Rodrigues A, Jorge AM, Dutra I (2015) Accelerating recommender systems using GPUs. In: Proceedings of the 30th ACM/SIGAPP symposium on applied computing, pp 879–884 Rodrigues A, Jorge AM, Dutra I (2015) Accelerating recommender systems using GPUs. In: Proceedings of the 30th ACM/SIGAPP symposium on applied computing, pp 879–884
47.
Zurück zum Zitat Wang Z, Liu Y, Chiu S (2014) An efficient parallel collaborative filtering algorithm on multi-GPU platform. J Supercomput 72(6):2080–2094CrossRef Wang Z, Liu Y, Chiu S (2014) An efficient parallel collaborative filtering algorithm on multi-GPU platform. J Supercomput 72(6):2080–2094CrossRef
48.
Zurück zum Zitat Ali M, Gerea C, Raman BS et al (2009) Microsoft CEP server and online behavioral targeting. Proc Int Conf Very Large Data Bases 2(2):1558–1561 Ali M, Gerea C, Raman BS et al (2009) Microsoft CEP server and online behavioral targeting. Proc Int Conf Very Large Data Bases 2(2):1558–1561
49.
Zurück zum Zitat HewaNadungodage C, Xia Y, Lee JJ et al (2013) GPU accelerated item-based collaborative filtering for big-data applications. In: Proceedings of the IEEE BigData conference, pp 175–180 HewaNadungodage C, Xia Y, Lee JJ et al (2013) GPU accelerated item-based collaborative filtering for big-data applications. In: Proceedings of the IEEE BigData conference, pp 175–180
50.
Zurück zum Zitat Doychev D, Lawlor A, Rafter R et al (2014) An analysis of recommender algorithms for online news. In: CLEF working notes for CLEF 2014 conference, pp 825–836 Doychev D, Lawlor A, Rafter R et al (2014) An analysis of recommender algorithms for online news. In: CLEF working notes for CLEF 2014 conference, pp 825–836
51.
Zurück zum Zitat Lommatzsch A, Albayrak S (2015) Real-time recommendations for user-item streams. In: Proceedings of the ACM/SIGAPP symposium on applied computing, pp 1039–1046 Lommatzsch A, Albayrak S (2015) Real-time recommendations for user-item streams. In: Proceedings of the ACM/SIGAPP symposium on applied computing, pp 1039–1046
52.
Zurück zum Zitat Verbitskiy I, Probst P, Lommatzsch A (2015) Developing and evaluation of a highly scalable news recommender system. In: CLEF working notes for CLEF 2015 conference, CEUR, vol. 1391 Verbitskiy I, Probst P, Lommatzsch A (2015) Developing and evaluation of a highly scalable news recommender system. In: CLEF working notes for CLEF 2015 conference, CEUR, vol. 1391
53.
Zurück zum Zitat Werner S, Andreas L (2014) Optimizing and evaluating stream-based news recommendation algorithms. In: CLEF working notes for CLEF 2014 conference, pp 813–824 Werner S, Andreas L (2014) Optimizing and evaluating stream-based news recommendation algorithms. In: CLEF working notes for CLEF 2014 conference, pp 813–824
54.
Zurück zum Zitat Kille B, Hopfgartner F, Brodt T et al (2013) The plista dataset. In: Proceedings of the ACM NRS workshop, pp 2–16 Kille B, Hopfgartner F, Brodt T et al (2013) The plista dataset. In: Proceedings of the ACM NRS workshop, pp 2–16
55.
Zurück zum Zitat Cremonesi P, Koren Y, Turrin R (2010) Performance of recommender algorithms on top-N recommendation tasks. In: Proceedings of the ACM RecSys, pp 39–46 Cremonesi P, Koren Y, Turrin R (2010) Performance of recommender algorithms on top-N recommendation tasks. In: Proceedings of the ACM RecSys, pp 39–46
Metadaten
Titel
A GPU-oriented online recommendation algorithm for efficient processing of time-varying continuous data streams
verfasst von
Chandima HewaNadungodage
Yuni Xia
John Jaehwan Lee
Publikationsdatum
08.07.2016
Verlag
Springer London
Erschienen in
Knowledge and Information Systems / Ausgabe 3/2017
Print ISSN: 0219-1377
Elektronische ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-016-0967-3

Weitere Artikel der Ausgabe 3/2017

Knowledge and Information Systems 3/2017 Zur Ausgabe