Skip to main content
Top

2019 | OriginalPaper | Chapter

A Practical Deep Online Ranking System in E-commerce Recommendation

Authors : Yan Yan, Zitao Liu, Meng Zhao, Wentao Guo, Weipeng P. Yan, Yongjun Bao

Published in: Machine Learning and Knowledge Discovery in Databases

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

User online shopping experience in modern e-commerce websites critically relies on real-time personalized recommendations. However, building a productionized recommender system still remains challenging due to a massive collection of items, a huge number of online users, and requirements for recommendations to be responsive to user actions. In this work, we present our relevant, responsive, and scalable deep online ranking system (DORS) that we developed and deployed in our company. DORS is implemented in a three-level architecture which includes (1) candidate retrieval that retrieves a board set of candidates with various business rules enforced; (2) deep neural network ranking model that takes advantage of available user and item specific features and their interactions; (3) multi-arm bandits based online re-ranking that dynamically takes user real-time feedback and re-ranks the final recommended items in scale. Given a user as a query, DORS is able to precisely capture users’ real-time purchasing intents and help users reach to product purchases. Both offline and online experimental results show that DORS provides more personalized online ranking results and makes more revenue.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
Real time is defined as under 200 ms.
 
2
Session is defined as a 30-min window in this paper.
 
3
The motivation for optimizing GMV is related to the e-commerce company’s business model. Since investors and shareholders utilize the settled GMV from all e-commerce transactions generated to estimate the current health and future potential of the corresponding company, maximizing GMV becomes critical. In general, if each item’s GMV sets to be \(\mathbf {1}\), optimizing GMV degrades to optimizing the sales conversion.
 
4
We could not release the exact number of operating servers due to the company confidentiality.
 
Literature
1.
go back to reference Agarwal, D., Chen, B.C., Elango, P.: Fast online learning through offline initialization for time-sensitive recommendation. In: KDD, pp. 703–712. ACM (2010) Agarwal, D., Chen, B.C., Elango, P.: Fast online learning through offline initialization for time-sensitive recommendation. In: KDD, pp. 703–712. ACM (2010)
2.
go back to reference Auer, P., Cesa-Bianchi, N., Fischer, P.: Finite-time analysis of the multiarmed bandit problem. Mach. Learn. 47(2–3), 235–256 (2002)CrossRef Auer, P., Cesa-Bianchi, N., Fischer, P.: Finite-time analysis of the multiarmed bandit problem. Mach. Learn. 47(2–3), 235–256 (2002)CrossRef
3.
go back to reference Basak, D., Pal, S., Patranabis, D.C.: Support vector regression. Neural Inf. Process.-Lett. Rev. 11(10), 203–224 (2007) Basak, D., Pal, S., Patranabis, D.C.: Support vector regression. Neural Inf. Process.-Lett. Rev. 11(10), 203–224 (2007)
4.
go back to reference Burges, C., et al.: Learning to rank using gradient descent. In: ICML, pp. 89–96. ACM (2005) Burges, C., et al.: Learning to rank using gradient descent. In: ICML, pp. 89–96. ACM (2005)
5.
go back to reference Cao, Z., Qin, T., Liu, T.Y., Tsai, M.F., Li, H.: Learning to rank: from pairwise approach to listwise approach. In: ICML, pp. 129–136. ACM (2007) Cao, Z., Qin, T., Liu, T.Y., Tsai, M.F., Li, H.: Learning to rank: from pairwise approach to listwise approach. In: ICML, pp. 129–136. ACM (2007)
6.
go back to reference Chang, S., et al.: Streaming recommender systems. In: WWW, pp. 381–389 (2017) Chang, S., et al.: Streaming recommender systems. In: WWW, pp. 381–389 (2017)
7.
go back to reference Chen, C., Yin, H., Yao, J., Cui, B.: TeRec: a temporal recommender system over tweet stream. VLDB 6(12), 1254–1257 (2013) Chen, C., Yin, H., Yao, J., Cui, B.: TeRec: a temporal recommender system over tweet stream. VLDB 6(12), 1254–1257 (2013)
8.
go back to reference Cherkassky, V., Ma, Y.: Practical selection of SVM parameters and noise estimation for SVM regression. Neural Netw. 17(1), 113–126 (2004)CrossRef Cherkassky, V., Ma, Y.: Practical selection of SVM parameters and noise estimation for SVM regression. Neural Netw. 17(1), 113–126 (2004)CrossRef
9.
go back to reference Davidson, J., et al.: The YouTube video recommendation system. In: RecSys, pp. 293–296. ACM (2010) Davidson, J., et al.: The YouTube video recommendation system. In: RecSys, pp. 293–296. ACM (2010)
10.
go back to reference Diaz-Aviles, E., Drumond, L., Schmidt-Thieme, L., Nejdl, W.: Real-time top-n recommendation in social streams. In: RecSys, pp. 59–66. ACM (2012) Diaz-Aviles, E., Drumond, L., Schmidt-Thieme, L., Nejdl, W.: Real-time top-n recommendation in social streams. In: RecSys, pp. 59–66. ACM (2012)
11.
go back to reference Ding, Y., Li, X.: Time weight collaborative filtering. In: CIKM, pp. 485–492. ACM (2005) Ding, Y., Li, X.: Time weight collaborative filtering. In: CIKM, pp. 485–492. ACM (2005)
12.
go back to reference Gao, H., Tang, J., Hu, X., Liu, H.: Exploring temporal effects for location recommendation on location-based social networks. In: RecSys, pp. 93–100. ACM (2013) Gao, H., Tang, J., Hu, X., Liu, H.: Exploring temporal effects for location recommendation on location-based social networks. In: RecSys, pp. 93–100. ACM (2013)
13.
go back to reference Gomez-Uribe, C.A., Hunt, N.: The Netflix recommender system: algorithms, business value, and innovation. TMIS 6(4), 13 (2016) Gomez-Uribe, C.A., Hunt, N.: The Netflix recommender system: algorithms, business value, and innovation. TMIS 6(4), 13 (2016)
14.
go back to reference Guan, Z., Bu, J., Mei, Q., Chen, C., Wang, C.: Personalized tag recommendation using graph-based ranking on multi-type interrelated objects. In: SIGIR, pp. 540–547. ACM (2009) Guan, Z., Bu, J., Mei, Q., Chen, C., Wang, C.: Personalized tag recommendation using graph-based ranking on multi-type interrelated objects. In: SIGIR, pp. 540–547. ACM (2009)
15.
go back to reference Gultekin, S., Paisley, J.: A collaborative Kalman filter for time-evolving dyadic processes. In: ICDM, pp. 140–149. IEEE (2014) Gultekin, S., Paisley, J.: A collaborative Kalman filter for time-evolving dyadic processes. In: ICDM, pp. 140–149. IEEE (2014)
16.
go back to reference Hannon, J., Bennett, M., Smyth, B.: Recommending Twitter users to follow using content and collaborative filtering approaches. In: RecSys, pp. 199–206. ACM (2010) Hannon, J., Bennett, M., Smyth, B.: Recommending Twitter users to follow using content and collaborative filtering approaches. In: RecSys, pp. 199–206. ACM (2010)
17.
go back to reference Koren, Y.: Collaborative filtering with temporal dynamics. Commun. ACM 53(4), 89–97 (2010)CrossRef Koren, Y.: Collaborative filtering with temporal dynamics. Commun. ACM 53(4), 89–97 (2010)CrossRef
18.
go back to reference Lang, K.: NewsWeeder: learning to filter netnews. In: Proceedings of the 12th International Machine Learning Conference (ML 1995) (1995)CrossRef Lang, K.: NewsWeeder: learning to filter netnews. In: Proceedings of the 12th International Machine Learning Conference (ML 1995) (1995)CrossRef
19.
go back to reference Langford, J., Zhang, T.: The epoch-greedy algorithm for multi-armed bandits with side information. In: NIPS, pp. 817–824 (2008) Langford, J., Zhang, T.: The epoch-greedy algorithm for multi-armed bandits with side information. In: NIPS, pp. 817–824 (2008)
20.
go back to reference Liu, Y., Miao, J., Zhang, M., Ma, S., Ru, L.: How do users describe their information need: query recommendation based on snippet click model. Expert Syst. Appl. 38(11), 13847–13856 (2011) Liu, Y., Miao, J., Zhang, M., Ma, S., Ru, L.: How do users describe their information need: query recommendation based on snippet click model. Expert Syst. Appl. 38(11), 13847–13856 (2011)
21.
go back to reference Lu, D., et al.: Cross-media event extraction and recommendation. In: NAACL, pp. 72–76 (2016) Lu, D., et al.: Cross-media event extraction and recommendation. In: NAACL, pp. 72–76 (2016)
22.
go back to reference Lu, Z., Agarwal, D., Dhillon, I.S.: A spatio-temporal approach to collaborative filtering. In: RecSys, pp. 13–20. ACM (2009) Lu, Z., Agarwal, D., Dhillon, I.S.: A spatio-temporal approach to collaborative filtering. In: RecSys, pp. 13–20. ACM (2009)
23.
go back to reference Rendle, S.: Factorization machines. In: ICDM, pp. 995–1000. IEEE (2010) Rendle, S.: Factorization machines. In: ICDM, pp. 995–1000. IEEE (2010)
24.
go back to reference Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized Markov chains for next-basket recommendation. In: WWW, pp. 811–820. ACM (2010) Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized Markov chains for next-basket recommendation. In: WWW, pp. 811–820. ACM (2010)
25.
go back to reference Rendle, S., Schmidt-Thieme, L.: Online-updating regularized kernel matrix factorization models for large-scale recommender systems. In: RecSys, pp. 251–258. ACM (2008) Rendle, S., Schmidt-Thieme, L.: Online-updating regularized kernel matrix factorization models for large-scale recommender systems. In: RecSys, pp. 251–258. ACM (2008)
26.
go back to reference Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: WWW, pp. 285–295. ACM (2001) Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: WWW, pp. 285–295. ACM (2001)
27.
go back to reference Severyn, A., Moschitti, A.: Learning to rank short text pairs with convolutional deep neural networks. In: SIGIR, pp. 373–382. ACM (2015) Severyn, A., Moschitti, A.: Learning to rank short text pairs with convolutional deep neural networks. In: SIGIR, pp. 373–382. ACM (2015)
28.
go back to reference Tang, J., Hu, X., Gao, H., Liu, H.: Exploiting local and global social context for recommendation. In: IJCAI, vol. 13, pp. 2712–2718 (2013) Tang, J., Hu, X., Gao, H., Liu, H.: Exploiting local and global social context for recommendation. In: IJCAI, vol. 13, pp. 2712–2718 (2013)
29.
go back to reference Tang, J., Hu, X., Liu, H.: Social recommendation: a review. Soc. Netw. Anal. Min. 3(4), 1113–1133 (2013)CrossRef Tang, J., Hu, X., Liu, H.: Social recommendation: a review. Soc. Netw. Anal. Min. 3(4), 1113–1133 (2013)CrossRef
30.
go back to reference Thompson, W.R.: On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika 25(3/4), 285–294 (1933)CrossRef Thompson, W.R.: On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika 25(3/4), 285–294 (1933)CrossRef
31.
go back to reference Watkins, C.J.C.H.: Learning from delayed rewards. Ph.D. thesis, University of Cambridge, England (1989) Watkins, C.J.C.H.: Learning from delayed rewards. Ph.D. thesis, University of Cambridge, England (1989)
32.
go back to reference Xiang, L., et al.: Temporal recommendation on graphs via long-and short-term preference fusion. In: KDD, pp. 723–732. ACM (2010) Xiang, L., et al.: Temporal recommendation on graphs via long-and short-term preference fusion. In: KDD, pp. 723–732. ACM (2010)
33.
go back to reference Xiong, L., Chen, X., Huang, T.K., Schneider, J., Carbonell, J.G.: Temporal collaborative filtering with bayesian probabilistic tensor factorization. In: SDM. pp. 211–222. SIAM (2010) Xiong, L., Chen, X., Huang, T.K., Schneider, J., Carbonell, J.G.: Temporal collaborative filtering with bayesian probabilistic tensor factorization. In: SDM. pp. 211–222. SIAM (2010)
34.
go back to reference Yin, D., Hong, L., Xue, Z., Davison, B.D.: Temporal dynamics of user interests in tagging systems. In: AAAI (2011) Yin, D., Hong, L., Xue, Z., Davison, B.D.: Temporal dynamics of user interests in tagging systems. In: AAAI (2011)
35.
go back to reference Yu, X., et al.: Personalized entity recommendation: A heterogeneous information network approach. In: WSDM. pp. 283–292. ACM (2014) Yu, X., et al.: Personalized entity recommendation: A heterogeneous information network approach. In: WSDM. pp. 283–292. ACM (2014)
36.
go back to reference Zhang, Y., Zhang, M., Liu, Y., Ma, S., Feng, S.: Localized matrix factorization for recommendation based on matrix block diagonal forms. In: WWW (2013) Zhang, Y., Zhang, M., Liu, Y., Ma, S., Feng, S.: Localized matrix factorization for recommendation based on matrix block diagonal forms. In: WWW (2013)
Metadata
Title
A Practical Deep Online Ranking System in E-commerce Recommendation
Authors
Yan Yan
Zitao Liu
Meng Zhao
Wentao Guo
Weipeng P. Yan
Yongjun Bao
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-10997-4_12

Premium Partner