Skip to main content
Top

2017 | OriginalPaper | Chapter

Web-Scale Personalized Real-Time Recommender System on Suumo

Authors : Shiyingxue Li, Shimpei Nomura, Yohei Kikuta, Kazuma Arino

Published in: Advances in Knowledge Discovery and Data Mining

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper we investigate the performance of machine learning based recommender system with real-time log streaming on a large real-estate site, in the views of system robustness, business productivity and algorithm performance. Our proposed recommender system, providing personalized contents as opposed to item/query based recommendation, consists of a real-time log processor, auto-scaling recommender API and machine learning modules. System is carefully designed to let data scientists focus on improving core algorithms and features (instead of taking care of distributing systems) and achieves weekly release cycle in production environment. On Suumo, the largest real-estate portal site in Japan, the system returns more than 99.9% of the API calls successfully in real-time and shows finally a 250% improvement of conversion rate compared to the existing recommendation. With its flexible nature, we would also expect the system to be applied in various kinds of real-time recommendation in the near future.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Joachims, T.: Optimizing search engines using clickthrough data. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 133–142. ACM, New York (2002) Joachims, T.: Optimizing search engines using clickthrough data. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 133–142. ACM, New York (2002)
2.
go back to reference Hopfgartner, F., Kille, B., Heintz, T., Turrin, R.: Real-time recommendation of streamed data. In: Proceedings of the 9th ACM Conference on Recommender Systems, pp. 361–362. ACM, New York (2015) Hopfgartner, F., Kille, B., Heintz, T., Turrin, R.: Real-time recommendation of streamed data. In: Proceedings of the 9th ACM Conference on Recommender Systems, pp. 361–362. ACM, New York (2015)
3.
go back to reference Freno, A., Saveski, M., Jenatton, R., Archambeau, C.: One-pass ranking models for low-latency product recommendations. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1789–1798. ACM, New York (2015) Freno, A., Saveski, M., Jenatton, R., Archambeau, C.: One-pass ranking models for low-latency product recommendations. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1789–1798. ACM, New York (2015)
4.
go back to reference Wang, F., Yuan, C., Xu, X., van Beek, P.: Supervised and semi-supervised online boosting tree for industrial machine vision application. In: Proceedings of the Fifth International Workshop on Knowledge Discovery from Sensor Data, pp. 43–51. ACM, New York (2011) Wang, F., Yuan, C., Xu, X., van Beek, P.: Supervised and semi-supervised online boosting tree for industrial machine vision application. In: Proceedings of the Fifth International Workshop on Knowledge Discovery from Sensor Data, pp. 43–51. ACM, New York (2011)
5.
go back to reference Bottou, L., Le Cun, Y.: Large scale online learning. Adv. Neural Inf. Process. Syst. 16, 217 (2004) Bottou, L., Le Cun, Y.: Large scale online learning. Adv. Neural Inf. Process. Syst. 16, 217 (2004)
7.
go back to reference Schleier-Smith, J.: An architecture for agile machine learning in real-time applications. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2059–2068. ACM, New York (2015) Schleier-Smith, J.: An architecture for agile machine learning in real-time applications. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2059–2068. ACM, New York (2015)
8.
go back to reference Huang, Y., Cui, B., Zhang, W., Jiang, J., Xu, Y.: Tencentrec: real-time stream recommendation in practice. In: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, pp. 227–238. ACM, New York (2015) Huang, Y., Cui, B., Zhang, W., Jiang, J., Xu, Y.: Tencentrec: real-time stream recommendation in practice. In: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, pp. 227–238. ACM, New York (2015)
9.
go back to reference Yuan, X., Lee, J.-H., Kim, S.-J., Kim, Y.-H.: Toward a user-oriented recommendation system for real estate websites. Inf. Syst. 38(2), 231–243 (2013)CrossRef Yuan, X., Lee, J.-H., Kim, S.-J., Kim, Y.-H.: Toward a user-oriented recommendation system for real estate websites. Inf. Syst. 38(2), 231–243 (2013)CrossRef
10.
go back to reference Ho, H.-P., Chang, C.-T., Cheng-Yuan, K.: House selection via the internet by considering homebuyers risk attitudes with s-shaped utility functions. Eur. J. Oper. Res. 241(1), 188–201 (2015)MathSciNetCrossRefMATH Ho, H.-P., Chang, C.-T., Cheng-Yuan, K.: House selection via the internet by considering homebuyers risk attitudes with s-shaped utility functions. Eur. J. Oper. Res. 241(1), 188–201 (2015)MathSciNetCrossRefMATH
11.
go back to reference Wang, Y., Liao, X., Wu, H., Wu, J.: Incremental collaborative filtering considering temporal effects. arXiv preprint arXiv:1203.5415 (2012) Wang, Y., Liao, X., Wu, H., Wu, J.: Incremental collaborative filtering considering temporal effects. arXiv preprint arXiv:​1203.​5415 (2012)
12.
go back to reference Iwanaga, J., Nabetani, K., Kajiwara, Y., Igarashi, K.: About the recommendation method based on the frequency and recency. J. Oper. Res. Soc. Jpn. 2013, 194–195 (2013) (in Japanese) Iwanaga, J., Nabetani, K., Kajiwara, Y., Igarashi, K.: About the recommendation method based on the frequency and recency. J. Oper. Res. Soc. Jpn. 2013, 194–195 (2013) (in Japanese)
14.
go back to reference Rendle, S.: Factorization machines. In: 2010 IEEE 10th International Conference on Data Mining (ICDM), pp. 995–1000. IEEE (2010) Rendle, S.: Factorization machines. In: 2010 IEEE 10th International Conference on Data Mining (ICDM), pp. 995–1000. IEEE (2010)
16.
go back to reference Chen, T., He, T.: XGboost: extreme gradient boosting. R package version 0.4-2 (2015) Chen, T., He, T.: XGboost: extreme gradient boosting. R package version 0.4-2 (2015)
17.
go back to reference Bergstra, J., Yamins, D., Cox, D.D.: Hyperopt: a python library for optimizing the hyperparameters of machine learning algorithms. In: Proceedings of the 12th Python in Science Conference, pp. 13–20 (2013) Bergstra, J., Yamins, D., Cox, D.D.: Hyperopt: a python library for optimizing the hyperparameters of machine learning algorithms. In: Proceedings of the 12th Python in Science Conference, pp. 13–20 (2013)
Metadata
Title
Web-Scale Personalized Real-Time Recommender System on Suumo
Authors
Shiyingxue Li
Shimpei Nomura
Yohei Kikuta
Kazuma Arino
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-57529-2_41

Premium Partner