Skip to main content
Erschienen in: Dynamic Games and Applications 2/2018

18.07.2017

Tauberian Theorem for Value Functions

verfasst von: Dmitry Khlopin

Erschienen in: Dynamic Games and Applications | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For two-person dynamic zero-sum games (both discrete and continuous settings), we investigate the limit of value functions of finite horizon games with long-run average cost as the time horizon tends to infinity and the limit of value functions of \(\lambda \)-discounted games as the discount tends to zero. We prove that the Dynamic Programming Principle for value functions directly leads to the Tauberian theorem—that the existence of a uniform limit of the value functions for one of the families implies that the other one also uniformly converges to the same limit. No assumptions on strategies are necessary. To this end, we consider a mapping that takes each payoff to the corresponding value function and preserves the sub- and superoptimality principles (the Dynamic Programming Principle). With their aid, we obtain certain inequalities on asymptotics of sub- and supersolutions, which lead to the Tauberian theorem. In particular, we consider the case of differential games without relying on the existence of the saddle point; a very simple stochastic game model is also considered.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Alvarez O, Bardi M (2007) Ergodic problems in differential games. In: Jørgensen S, Quincampoix M, Vincent TL (eds) Advances in dynamic game theory. Birkhäuser, Boston, pp 131–152 Alvarez O, Bardi M (2007) Ergodic problems in differential games. In: Jørgensen S, Quincampoix M, Vincent TL (eds) Advances in dynamic game theory. Birkhäuser, Boston, pp 131–152
4.
Zurück zum Zitat Bardi M (2009) On differential games with long-time-average cost. In: Jørgensen S, Quincampoix M, Vincent TL (eds) Advances in dynamic games and their applications. Birkhäuser, Boston, pp 3–18 Bardi M (2009) On differential games with long-time-average cost. In: Jørgensen S, Quincampoix M, Vincent TL (eds) Advances in dynamic games and their applications. Birkhäuser, Boston, pp 3–18
5.
Zurück zum Zitat Bardi M, Capuzzo-Dolcetta I (1997) Optimal control and viscosity solutions of Hamilton–Jacobi–Bellman equations. Birkhauser, BostonCrossRefMATH Bardi M, Capuzzo-Dolcetta I (1997) Optimal control and viscosity solutions of Hamilton–Jacobi–Bellman equations. Birkhauser, BostonCrossRefMATH
6.
Zurück zum Zitat Barles G, Souganidis PE (2000) On the large time behavior of solutions of Hamilton–Jacobi equations. SIAM J Math Anal 31(4):925–939MathSciNetCrossRefMATH Barles G, Souganidis PE (2000) On the large time behavior of solutions of Hamilton–Jacobi equations. SIAM J Math Anal 31(4):925–939MathSciNetCrossRefMATH
8.
Zurück zum Zitat Bingham NH, Goldie CM, Teugels JL (1989) Regular variation. Cambridge University Press, CambridgeMATH Bingham NH, Goldie CM, Teugels JL (1989) Regular variation. Cambridge University Press, CambridgeMATH
10.
Zurück zum Zitat Buckdahn R, Cardaliaguet P, Quincampoix M (2011) Some recent aspects of differential game theory. Dyn Games Appl 1(1):74–114MathSciNetCrossRefMATH Buckdahn R, Cardaliaguet P, Quincampoix M (2011) Some recent aspects of differential game theory. Dyn Games Appl 1(1):74–114MathSciNetCrossRefMATH
11.
Zurück zum Zitat Cannarsa P, Quincampoix M (2015) Vanishing discount limit and nonexpansive optimal control and differential games. SIAM J Control Optim 53(4):1789–1814MathSciNetCrossRefMATH Cannarsa P, Quincampoix M (2015) Vanishing discount limit and nonexpansive optimal control and differential games. SIAM J Control Optim 53(4):1789–1814MathSciNetCrossRefMATH
12.
Zurück zum Zitat Carlson DA, Haurie AB, Leizarowitz A (1991) Optimal control on infinite time horizon. Springer, BerlinCrossRefMATH Carlson DA, Haurie AB, Leizarowitz A (1991) Optimal control on infinite time horizon. Springer, BerlinCrossRefMATH
13.
Zurück zum Zitat Chentsov AG, Khlopin DV (2000) Some constructions of extension of game problems with information discrimination. J Autom Inf Sci 32(12):1–11CrossRef Chentsov AG, Khlopin DV (2000) Some constructions of extension of game problems with information discrimination. J Autom Inf Sci 32(12):1–11CrossRef
15.
Zurück zum Zitat Elliott RJ, Kalton N (1972) The existence of value for differential games. Memoirs of the American Mathematical Society, vol 126. AMS, Providence Elliott RJ, Kalton N (1972) The existence of value for differential games. Memoirs of the American Mathematical Society, vol 126. AMS, Providence
16.
Zurück zum Zitat Evans L, Souganidis PE (1984) Differential games and representation formulas for solutions of Hamilton–Jacobi–Isaacs equations. Indiana Univ Math J 33:773–797MathSciNetCrossRefMATH Evans L, Souganidis PE (1984) Differential games and representation formulas for solutions of Hamilton–Jacobi–Isaacs equations. Indiana Univ Math J 33:773–797MathSciNetCrossRefMATH
17.
Zurück zum Zitat Fathi A (1998) Sur la convergence du semi-groupe de Lax-Oleinik. Comptes Rendus de l’Academie des Sciences-Series I-Mathematics 327(3):267–270MathSciNetMATH Fathi A (1998) Sur la convergence du semi-groupe de Lax-Oleinik. Comptes Rendus de l’Academie des Sciences-Series I-Mathematics 327(3):267–270MathSciNetMATH
18.
Zurück zum Zitat Feller W (1971) An introduction to probability theory and its applications, vol II, 2nd edn. Wiley, New YorkMATH Feller W (1971) An introduction to probability theory and its applications, vol II, 2nd edn. Wiley, New YorkMATH
19.
Zurück zum Zitat Fisac JF, Sastry SS (2015) The pursuit-evasion-defense differential game in dynamic constrained environments. In: 2015 IEEE 54th annual conference on decision and control (CDC), December 15-18, 2015, IEEE, pp 4549–4556 Fisac JF, Sastry SS (2015) The pursuit-evasion-defense differential game in dynamic constrained environments. In: 2015 IEEE 54th annual conference on decision and control (CDC), December 15-18, 2015, IEEE, pp 4549–4556
20.
Zurück zum Zitat Gaitsgory V (1985) Application of the averaging method for constructing suboptimal solutions of singularly perturbed problems of optimal control. Automa Rem Contr+ 9:22–30MathSciNet Gaitsgory V (1985) Application of the averaging method for constructing suboptimal solutions of singularly perturbed problems of optimal control. Automa Rem Contr+ 9:22–30MathSciNet
21.
Zurück zum Zitat Gaitsgory V, Quincampoix M (2013) On sets of occupational measures generated by a deterministic control system on an infinite time horizon. Nonlinear Anal Theor 88:27–41MathSciNetCrossRefMATH Gaitsgory V, Quincampoix M (2013) On sets of occupational measures generated by a deterministic control system on an infinite time horizon. Nonlinear Anal Theor 88:27–41MathSciNetCrossRefMATH
23.
Zurück zum Zitat Hardy GH (1949) Divergent series. Clarendon Press, OxfordMATH Hardy GH (1949) Divergent series. Clarendon Press, OxfordMATH
25.
Zurück zum Zitat Khlopin DV (2014) On uniform Tauberian theorems for dynamic games, Math Sb, (in print) (in Russian) In English translate: arXiv preprint arXiv:1412.7331 Khlopin DV (2014) On uniform Tauberian theorems for dynamic games, Math Sb, (in print) (in Russian) In English translate: arXiv preprint arXiv:​1412.​7331
26.
Zurück zum Zitat Khlopin DV (2015) Uniform Tauberian theorem for differential games. Mat Teor Igr Prilozh 1:92-120 (in Russian). In English translate: Automat Rem Contr+, 2016 77(4):734–750 Khlopin DV (2015) Uniform Tauberian theorem for differential games. Mat Teor Igr Prilozh 1:92-120 (in Russian). In English translate: Automat Rem Contr+, 2016 77(4):734–750
28.
30.
Zurück zum Zitat Krasovskii NN, Subbotin AI (1974) Positional differential games. Nauka, Moscow (in Russian)MATH Krasovskii NN, Subbotin AI (1974) Positional differential games. Nauka, Moscow (in Russian)MATH
32.
Zurück zum Zitat Laraki R, Sorin S (2014) Recursive games. In: Young P, Zamir S (eds) Advances in zero-sum dynamic games. Handbook of game theory, pp 27–95 Laraki R, Sorin S (2014) Recursive games. In: Young P, Zamir S (eds) Advances in zero-sum dynamic games. Handbook of game theory, pp 27–95
34.
Zurück zum Zitat Li X, Quincampoix M, Renault J (2016) Limit value for optimal control with general means. Discrete Contin Dyn Syst Ser A 36:2113–2132MathSciNetCrossRefMATH Li X, Quincampoix M, Renault J (2016) Limit value for optimal control with general means. Discrete Contin Dyn Syst Ser A 36:2113–2132MathSciNetCrossRefMATH
35.
Zurück zum Zitat Li X, Venel X (2016) Recursive games: uniform value, Tauberian theorem and the Mertens conjecture “\(\max \min =\lim v_n=\lim v_{\lambda }\). Int J Game Theory 45(1):155–189CrossRefMATH Li X, Venel X (2016) Recursive games: uniform value, Tauberian theorem and the Mertens conjecture “\(\max \min =\lim v_n=\lim v_{\lambda }\). Int J Game Theory 45(1):155–189CrossRefMATH
36.
Zurück zum Zitat Lions P, Papanicolaou G, Varadhan SRS (1988) Homogenization of Hamilton–Jacobi equations. Unpublished preprint Lions P, Papanicolaou G, Varadhan SRS (1988) Homogenization of Hamilton–Jacobi equations. Unpublished preprint
39.
Zurück zum Zitat Øksendal B (2013) Stochastic differential equations: an introduction with applications. Springer, New YorkMATH Øksendal B (2013) Stochastic differential equations: an introduction with applications. Springer, New YorkMATH
40.
Zurück zum Zitat Oliu-Barton M, Vigeral G (2013) A uniform Tauberian theorem in optimal control. In: Advances in dynamic games. Birkhäuser, Boston, pp 199–215. Erratum: HAL preprint hal:00661833v3, 2016 Oliu-Barton M, Vigeral G (2013) A uniform Tauberian theorem in optimal control. In: Advances in dynamic games. Birkhäuser, Boston, pp 199–215. Erratum: HAL preprint hal:00661833v3, 2016
41.
Zurück zum Zitat Quincampoix M, Renault J (2011) On the existence of a limit value in some non expansive optimal control problems. SIAM J Control Optim 49(5):2118–2132MathSciNetCrossRefMATH Quincampoix M, Renault J (2011) On the existence of a limit value in some non expansive optimal control problems. SIAM J Control Optim 49(5):2118–2132MathSciNetCrossRefMATH
45.
Zurück zum Zitat Ryll-Nardzewski C (1964) A theory of pursuit and evasion. In: Dresher M, Shapley LS, Tucker AW (eds) Advances in game theory. Princeton University Press, Princeton, pp 113–126 Ryll-Nardzewski C (1964) A theory of pursuit and evasion. In: Dresher M, Shapley LS, Tucker AW (eds) Advances in game theory. Princeton University Press, Princeton, pp 113–126
46.
47.
Zurück zum Zitat Subbotin AI (1995) Generalized solutions of first order PDEs. Birkhauser, BostonCrossRef Subbotin AI (1995) Generalized solutions of first order PDEs. Birkhauser, BostonCrossRef
48.
49.
Zurück zum Zitat Ziliotto B (2016) A Tauberian theorem for nonexpansive operators and applications to zero-sum stochastic games. Math Oper Res 41(4):1522–1534MathSciNetCrossRefMATH Ziliotto B (2016) A Tauberian theorem for nonexpansive operators and applications to zero-sum stochastic games. Math Oper Res 41(4):1522–1534MathSciNetCrossRefMATH
Metadaten
Titel
Tauberian Theorem for Value Functions
verfasst von
Dmitry Khlopin
Publikationsdatum
18.07.2017
Verlag
Springer US
Erschienen in
Dynamic Games and Applications / Ausgabe 2/2018
Print ISSN: 2153-0785
Elektronische ISSN: 2153-0793
DOI
https://doi.org/10.1007/s13235-017-0227-5

Weitere Artikel der Ausgabe 2/2018

Dynamic Games and Applications 2/2018 Zur Ausgabe