Skip to main content

2013 | OriginalPaper | Buchkapitel

5. Markov Decision Processes for Customer Lifetime Value

verfasst von : Wai-Ki Ching, Ximin Huang, Michael K. Ng, Tak-Kuen Siu

Erschienen in: Markov Chains

Verlag: Springer US

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this chapter a stochastic dynamic programming model with a Markov chain is proposed to capture customer behavior. The advantage of using Markov chains is that the model can take into account the customers switching between the company and its competitors. Therefore customer relationships can be described in a probabilistic way, see for instance Pfeifer and Carraway [170]. Stochastic dynamic programming is then applied to solve the optimal allocation of the promotion budget for maximizing the Customer Lifetime Value (CLV). The proposed model is then applied to practical data in a computer services company.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adke S, Deshmukh D (1988) Limit distribution of a high order Markov chain. J Roy Stat Soc Ser B 50:105–108 Adke S, Deshmukh D (1988) Limit distribution of a high order Markov chain. J Roy Stat Soc Ser B 50:105–108
3.
Zurück zum Zitat Altman E (1999) Constrained markov decision processes. Chapman and Hall/CRC, London Altman E (1999) Constrained markov decision processes. Chapman and Hall/CRC, London
13.
Zurück zum Zitat Berger P, Nasr N (1998) Customer lifetime value: marketing models and applications. J Interact Market 12:17–30CrossRef Berger P, Nasr N (1998) Customer lifetime value: marketing models and applications. J Interact Market 12:17–30CrossRef
14.
Zurück zum Zitat Berger P, Nasr N (2001) The allocation of promotion budget to maximize customer equity. Omega 29:49–61CrossRef Berger P, Nasr N (2001) The allocation of promotion budget to maximize customer equity. Omega 29:49–61CrossRef
20.
Zurück zum Zitat Blattberg R, Deighton J (1996) Manage market by the customer equity. Harv Bus Rev 73:136–144 Blattberg R, Deighton J (1996) Manage market by the customer equity. Harv Bus Rev 73:136–144
34.
Zurück zum Zitat Buzacott J, Shanthikumar J (1993) Stochastic models of manufacturing systems. Prentice-Hall International Editions, New Jersey Buzacott J, Shanthikumar J (1993) Stochastic models of manufacturing systems. Prentice-Hall International Editions, New Jersey
35.
Zurück zum Zitat Carpenter P (1995) Customer lifetime value: do the math. Market Comput 15:18–19 Carpenter P (1995) Customer lifetime value: do the math. Market Comput 15:18–19
39.
Zurück zum Zitat Chan R, Ng M (1996) Conjugate gradient method for Toeplitz systems. SIAM Rev 38:427–482CrossRef Chan R, Ng M (1996) Conjugate gradient method for Toeplitz systems. SIAM Rev 38:427–482CrossRef
41.
Zurück zum Zitat Ching W (1997) Circulant preconditioners for failure prone manufacturing systems. Linear Algebra Appl 266:161–180CrossRef Ching W (1997) Circulant preconditioners for failure prone manufacturing systems. Linear Algebra Appl 266:161–180CrossRef
45.
Zurück zum Zitat Ching W (2001) Machine repairing models for production systems. Int J Product Econ 70:257–266CrossRef Ching W (2001) Machine repairing models for production systems. Int J Product Econ 70:257–266CrossRef
47.
Zurück zum Zitat Ching W (2001) Markovian approximation for manufacturing systems of unreliable machines in Tandem. Int J Naval Res Logist 48:65–78CrossRef Ching W (2001) Markovian approximation for manufacturing systems of unreliable machines in Tandem. Int J Naval Res Logist 48:65–78CrossRef
48.
Zurück zum Zitat Ching W (2003) Iterative methods for queuing systems with batch arrivals and negative customers. BIT 43:285–296CrossRef Ching W (2003) Iterative methods for queuing systems with batch arrivals and negative customers. BIT 43:285–296CrossRef
49.
Zurück zum Zitat Ching W, Chan R, Zhou X (1997) Circulant preconditioners for Markov modulated poisson processes and their applications to manufacturing systems. SIAM J Matrix Anal Appl 18:464–481CrossRef Ching W, Chan R, Zhou X (1997) Circulant preconditioners for Markov modulated poisson processes and their applications to manufacturing systems. SIAM J Matrix Anal Appl 18:464–481CrossRef
50.
Zurück zum Zitat Ching W, Fung E, Ng M (2002) A multivariate Markov chain model for categorical data sequences and its applications in demand predictions. IMA J Manag Math 13:187–199CrossRef Ching W, Fung E, Ng M (2002) A multivariate Markov chain model for categorical data sequences and its applications in demand predictions. IMA J Manag Math 13:187–199CrossRef
51.
Zurück zum Zitat Ching W, Fung E, Ng M (2003) A higher-order Markov model for the Newsboy’s problem. JOper Res Soc 54:291–298CrossRef Ching W, Fung E, Ng M (2003) A higher-order Markov model for the Newsboy’s problem. JOper Res Soc 54:291–298CrossRef
61.
Zurück zum Zitat Ching W, Ng M, So M (2004) Customer migration, campaign budgeting, revenue estimation: the elasticity of Markov decision process on customer lifetime value. Electron Int J Adv Model Optim 6(2):65–80 Ching W, Ng M, So M (2004) Customer migration, campaign budgeting, revenue estimation: the elasticity of Markov decision process on customer lifetime value. Electron Int J Adv Model Optim 6(2):65–80
62.
Zurück zum Zitat Ching W, Ng M, Wong K (2003) Higher-order Markov decision process and its applications in customer lifetime values. In: The 32nd international conference on computers and industrial engineering, vol 2, Limerick, Ireland, pp 821–826, 2003 Ching W, Ng M, Wong K (2003) Higher-order Markov decision process and its applications in customer lifetime values. In: The 32nd international conference on computers and industrial engineering, vol 2, Limerick, Ireland, pp 821–826, 2003
64.
Zurück zum Zitat Ching W, Ng M, Wong K, Atlman E (2004) Customer lifetime value: a stochastic programming approach. J Oper Res Soc 55:860–868CrossRef Ching W, Ng M, Wong K, Atlman E (2004) Customer lifetime value: a stochastic programming approach. J Oper Res Soc 55:860–868CrossRef
73.
Zurück zum Zitat Ching W, Yuen W, Ng M, Zhang S (2006) A linear programming approach for solving optimal advertising policy. IMA J Manag Math 17:83–96CrossRef Ching W, Yuen W, Ng M, Zhang S (2006) A linear programming approach for solving optimal advertising policy. IMA J Manag Math 17:83–96CrossRef
82.
Zurück zum Zitat DuWors R, Haines G (1990) Event history analysis measure of brand loyalty. J Market Res 27:485–493CrossRef DuWors R, Haines G (1990) Event history analysis measure of brand loyalty. J Market Res 27:485–493CrossRef
121.
Zurück zum Zitat Hughes A, Wang P (1995) Media selection for database marketers. J Direct Market 9:79–84CrossRef Hughes A, Wang P (1995) Media selection for database marketers. J Direct Market 9:79–84CrossRef
123.
Zurück zum Zitat Jackson B (1985) Winning and keeping industrial customers. Lexington Books, Lexington, MA Jackson B (1985) Winning and keeping industrial customers. Lexington Books, Lexington, MA
124.
Zurück zum Zitat Jain D, Singh S (2002) Customer lifetime value research in marketing: a review and future directions. J Interact Market 16:34–46CrossRef Jain D, Singh S (2002) Customer lifetime value research in marketing: a review and future directions. J Interact Market 16:34–46CrossRef
134.
Zurück zum Zitat Kotler P, Armstrong G (1995) Principle of marketing, 7th edn. Prentice Hall, Englewood Cliffs Kotler P, Armstrong G (1995) Principle of marketing, 7th edn. Prentice Hall, Englewood Cliffs
145.
Zurück zum Zitat Leung H, Ching W, Leung I (2008) A stochastic optimization model for consecutive promotion. Qual Technol Quant Manag 5:403–414 Leung H, Ching W, Leung I (2008) A stochastic optimization model for consecutive promotion. Qual Technol Quant Manag 5:403–414
148.
Zurück zum Zitat Lilien L, Kotler P, Moorthy K (1992) Marketing models. Prentice Hall, Englewood Cliffs Lilien L, Kotler P, Moorthy K (1992) Marketing models. Prentice Hall, Englewood Cliffs
150.
Zurück zum Zitat Lin C, Lin Y (2007) Robust analysis on promotion duration for two competitive brands. J Oper Res Soc 1:1–8 Lin C, Lin Y (2007) Robust analysis on promotion duration for two competitive brands. J Oper Res Soc 1:1–8
159.
Zurück zum Zitat Mesak H (2003) On deriving and validating comparative statics of a symmetric model of advertising competition. Comput Oper Res 30:1791–1806CrossRef Mesak H (2003) On deriving and validating comparative statics of a symmetric model of advertising competition. Comput Oper Res 30:1791–1806CrossRef
160.
Zurück zum Zitat Mesak H, Calloway J (1999) Hybrid subgames and copycat games in a pulsing model of advertising competition. J Oper Res Soc 50:837–849 Mesak H, Calloway J (1999) Hybrid subgames and copycat games in a pulsing model of advertising competition. J Oper Res Soc 50:837–849
161.
Zurück zum Zitat Mesak H, Means T (1998) Modelling advertising budgeting and allocation decisions using modified multinomial logit market share models. J Oper Res Soc 49:1260–1269 Mesak H, Means T (1998) Modelling advertising budgeting and allocation decisions using modified multinomial logit market share models. J Oper Res Soc 49:1260–1269
162.
Zurück zum Zitat Mesak H, Zhang H (2001) Optimal advertising pulsation policies: a dynamic programming approach. J Oper Res Soc 11:1244–1255CrossRef Mesak H, Zhang H (2001) Optimal advertising pulsation policies: a dynamic programming approach. J Oper Res Soc 11:1244–1255CrossRef
170.
Zurück zum Zitat Pfeifer P, Carraway R (2000) Modeling customer relationships as Markov chain. J Int Market 14:43–55 Pfeifer P, Carraway R (2000) Modeling customer relationships as Markov chain. J Int Market 14:43–55
181.
Zurück zum Zitat Ross S (2000) Introduction to probability models, 7th edn. Academic, New York Ross S (2000) Introduction to probability models, 7th edn. Academic, New York
207.
Zurück zum Zitat White D (1993) Markov decision processes. Wiley, Chichester White D (1993) Markov decision processes. Wiley, Chichester
208.
Zurück zum Zitat Winston W (1994) Operations research: applications and algorithms, Belmont Calif., 3rd edn. Duxbury, North Scituate Winston W (1994) Operations research: applications and algorithms, Belmont Calif., 3rd edn. Duxbury, North Scituate
Metadaten
Titel
Markov Decision Processes for Customer Lifetime Value
verfasst von
Wai-Ki Ching
Ximin Huang
Michael K. Ng
Tak-Kuen Siu
Copyright-Jahr
2013
Verlag
Springer US
DOI
https://doi.org/10.1007/978-1-4614-6312-2_5