Top

Published in:

2015 | OriginalPaper | Chapter

4. Stochastic Differential Games

Author : Makiko Nisio

Published in: Stochastic Control Theory

Publisher: Springer Japan

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this chapter, we will deal with zero-sum two-player time-homogeneous stochastic differential games and viscosity solutions of the Isaacs equations arising from such games, via the dynamic programming principle.In Sect. 4.1, we are concerned with basic concepts and definitions and we introduce stochastic differential games, referring to (Controlled MarkovProcesses and viscosity solutions, 2nd edn. Springer, New York 2006), XI. Then, using a semi-discretization argument, we study the DPP for lower- and upper-value functions in Sect. 4.2. In Sect. 4.3, we will consider the Isaacs equations, via semigroups related to DPP. In Sect. 4.4, we consider a link between stochastic controls and differential games via risk sensitive controls.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Viscosity Solutions for HJB Equations

next chapter Stochastic Parabolic Equations

[A03]

R.A. Adams, Sobolev Spaces, 2nd edn. (Academic, Amsterdam/Boston, 2003)MATH

[BC09]

A. Bain, D. Crisan, Fundamentals of Stochastic Filtering (Springer, New York/ London, 2009)CrossRefMATH

[Be52]

R. Bellman, On the theory of dynamic programming. Proc. Nat. Sci. U.S.A. 38, 716–719 (1952)CrossRefMATH

[Be57]

R. Bellman, Dynamic Programming (Princeton University Press, Princeton, 1957)MATH

[Be75]

V.E. Benes, Composition and invariance methods for solvinig some stochastic control problems. Adv. Appl. Prob. 7, 299–329 (1975)CrossRefMATHMathSciNet

[BSW80]

V.E. Venes, L.A. Shepp, H.S. Witsenhaussen, Some solvable stochastic control problems. Stochastics 4, 39–83 (1980)CrossRefMathSciNet

[Be92]

A. Bensoussan, Stochastic Control of Partially Observable Systems (Cambridge University Press, Cambridge/New York, 1992)CrossRefMATH

[BN90]

A. Bensoussan, M. Nisio, Nonlinear semigroup arising in the control of diffusions with partial observation. Stoch. Stoch. Rep. 30, 1–45 (1990)CrossRefMATHMathSciNet

[BP99]

T.R. Bieleckii, S.R. Pliska, Risk sensitive dynamic asset management. Appl. Math. Optim. 39, 337–366 (1999)CrossRefMathSciNet

[BS73]

F. Black, M. Scholes, The pricing of options and corporate liabilities. J. Polit. Econ. 81, 637–659 (1973)CrossRef

[BM07]

R. Buckdahn, J. Ma, Pathwise stochastic control problems and stochastic HJB equations. SIAM J. Control Optim. 45, 2224–2256 (2007)CrossRefMATHMathSciNet

[Br06]

S. Brendle, Portfolio selection under incomplete information. Stoch. Proc. Appl. 116, 701–723 (2006)CrossRefMATHMathSciNet

[CPY09]

M.H. Chsng, T. Pang, J. Yong, Optimal stopping problem for stochastic differential equations with random cofficients. SIAM J. Control Optim. 48, 941–971 (2009)CrossRefMathSciNet

[CI90]

M.G. Crandall, H. Ishii, The maximum principle for semicontinuous functions. Differ. Integral Equ. 3, 1001–1014 (1990)MATHMathSciNet

[CIL92]

M.G. Crandall, H. Ishii, P.L. Lions, A user’s guide to viscosity solutions. Bull. AMS NS 27, 1–67 (1992)CrossRefMATHMathSciNet

[DaPZ92]

G. Da Prato, J. Zabczyk, Stochastic Equations in Infinite Dimenmensions (Cambridge University Press, Cambridge, 1992)CrossRef

[ElKPQ97]

N. El Karoui, S. Peng, M.C. Quenez, Backward stochastic differential equations in finance. Math. Finance 7, 1–71 (1997)CrossRefMATHMathSciNet

[ElKQ95]

N. El Karoui, M.C. Quenez, Dynamic programming and pricing of contingent claims in an incomplete market. SIAM. J. Control Optim. 33, 29–66 (1950)CrossRef

[E83]

L.C. Evans, Classical solutions of Hamilton-Jacobi-Bellman equation for uniformly elliptic operators. Trans. AMS 275, 245–255 (1983)CrossRef

[E98]

L.C. Evans, Partial Differential Equations. GSM19 (AMS, Providence, 1998)

[FH11]

W.H. Fleming, D. Hernandez-Hernandez, On the value of stochastic differential games. Commun. Stoch. Anal. 5, 341–351 (2011)MathSciNet

[FKSh10]

W.H. Fleming, H. Kaise, S.J. Sheu, Max-plus stochastic control and risk sensitivity. Appl. Math. Optim 62, 81–144 (2010)CrossRefMATHMathSciNet

[FMcE95]

W.H. Fleming, W.H. McEneaney, Risk sensitive control on infinite time horizon. SIAM J. Control Optim. 33, 1881–1915 (1995)CrossRefMATHMathSciNet

[FR75]

W.H. Fleming, R.W. Rishel, Deterministic and Stochastic Optimal Control (Springer, Berlin/New York, 1975)CrossRefMATH

[FSh99]

W.H. Fleming, S.J. Sheu, Optimal long term growth rate of expected utility of wealth. Ann. Appl. Prob. 9, 871–903 (1999)CrossRefMATHMathSciNet

[FSh00]

W.H. Fleming, S.J. Sheu, Risk sensitive control and an optimal investment model. Math. Finance 10, 197–213 (2000)CrossRefMATHMathSciNet

[FSh02]

W.H. Fleming, S.J. Sheu, Risk sensitive control and an optimal investment model II. Ann. Appl. Prob. 12, 730–767 (2002)CrossRefMATHMathSciNet

[FS06]

W.H. Fleming, H.M. Soner, Controlled MarkovProcesses and Viscosity Solutions, 2nd edn. (Springer, New York 2006)

[FSo89]

W.H. Fleming, P.E. Souganidis, On the existence of value function of two-plsyer, zero-sum stochastic differential games. Indiana Math. J. 38, 293–314 (1989)CrossRefMATHMathSciNet

[FKK72]

M. Fujisaki, G. Kallianpur, H. Kunita, Stochastic differential equations for the nonlinear filtering problem. Osaka J. Math. 9, 19–40 (1972)MATHMathSciNet

[GŚ00]

F. Gozzi, A. Świech, Hamilton-Jacobi-bellman equations for the optimal control of the Duncan-Mortensen-Zakai equation. J. Funct. Analy. 172, 466–510 (2000)CrossRefMATH

[HP81]

J.M. Harrison, S.R. Pliska, Martingales and stochastic integrals in the theory of continuous ytading. Stoch. Proc. Appl. 11, 215–260 (1981)CrossRefMATHMathSciNet

[HP83]

J.M. Harrison, S.R. Pliska, Stochastic calculus model of continuous trading; complete markets. Stoch. Proc. Appl. 15, 313–316 (1983)CrossRefMATHMathSciNet

[HNSh10]

H. Hata, H. Nagai, S.I. Sheu, Asymptotics of the probability minimizing a down-side risk. Ann. Appl. Prob. 20, 52–89 (2010)CrossRefMATHMathSciNet

[HS10]

H. Hata, J. Sekine, Explicit solution to a certain nonELQG risk-sensitive stochastic control problem. Appl. Math. Optim. 62, 341–380 (2010)CrossRefMATHMathSciNet

[IW81]

N. Ikeda, S. Watanabe, Stochastic Differential Equations and Diffusion Processes (North Holland, Amsterdam/New York, 1981)MATH

[Is92]

H. Ishii, Viscosity solutions for a class of Hamilton-Jacobi equations in Hilbert spaces. J. Funct. Anal. 105, 301–341 (1992)CrossRefMATHMathSciNet

[I42]

K. Itô, Differential equations determining Markov processes. Zenkoku Shijo Sugaku Danwakai 244, 1352–1400 (1942). (In Japanese)

[I51]

K. Itô, On Stochastic Differential Equations. Memoirs of the American Mathematical Society, vol. 4 (AMS, New York City, 1951)

[JLL90]

P. Jaillet, D. Lamberton, B. Lapeyer, Variational inequalities and the pricing of American options. Acta Appl. Math. 21, 263–289 (1990)CrossRefMATHMathSciNet

[KS91]

I. Karatzas, S.E. Sheve, Brownian Motion and Stochastic Calculus, 2nd edn. (Springer, New York, 1991)MATH

[KS98]

I. Karatzas, S.E. Sheve, Methods of Mathematical Finance (Springer, New York, 1998)CrossRefMATH

[Ko04]

S. Koike, A Biginner’s Guide to the Theory of Viscisity Solutions. MSJ Memoirs, vol. 13 (JMS, Tokyo, 2004)

[KN02]

K. Kuroda, H. Nagai, Risk sensitive portfolio optimization and infinite time horizon. Stoch. Stoch. Rep. 73, 309–331 (2002)CrossRefMATHMathSciNet

[Kr09]

N.V. Krylov, Controlled Diffusion Processes, 2nd edn. (Springer, Berlin, 2009)MATH

[Ku67]

H.J. Kushner, Dynamical equations for optimal nonlinear filtering. J. Differ. Equ. 3, 179–190 (1967)CrossRefMATHMathSciNet

[La83]

S. Lang, Real Analysis, 2nd edn. (Addison-Wesley, New York, 1983)MATH

[L83]

P.L. Lions, Optimal control of diffusion processes and Hamilton-Jacobi-Bellman equations I. J. Commun. PDE. 8, 1101–1134 (1983)CrossRefMATH

[L88]

P.L. Lions, Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. Part I. The case of bounded stochastic evolution. Acta Math. 161, 243–278 (1988)MATH

[L89]

P.L. Lions, Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. Part II. Optimal control of Zakai equation, in Stochastic Partial Differential Equations and Applications II, ed. by G. Da Prato, L. Tubaro. Lecture Notes in Mathematics, vol. 1390 (Springer, Berlin/Heidelberg, 1989), pp. 147–170. Part III. Uniqueness of viscosity solutions for general second order equations. J. Funct. Anal. 86, 1–18 (1989)

[LN83]

P.L. Lions, M. Nisio, A uniqueness result for the semigroup associated with HJB equations. Proc. Jpn. Acad. 58, 273–276 (1983)CrossRefMathSciNet

[LS01]

R.S. Liptser, A.N. Shiryayev, Statistics of Random Processes I, II, 2nd edn. (Springer, New York/Berlin, 2001)CrossRef

[Ma00]

C. Martini, American option prices as unique viscosity solutions to degenerate HJB equations, Rapport de rech, INRIA, 2000

[Me71]

R.C. Merton, Optimal consumption and portfolio rules in continuous time. J. Econ. Theory 3, 373–413 (1971)CrossRefMATHMathSciNet

[Me73]

R.C. Merton, Theory of rational option pricing. Bell J. Econ. Manag. Sci. 4, 141–183 (1973)CrossRefMathSciNet

[M88]

M. Metivier, Stochastic Partial Differential Equations in Infinite Dimensional Spaces (Scuola Superiore, Pisa, 1988)MATH

[My66]

P.A. Meyer, Probability and Potentials (Blaisdell, Waltham, 1966)MATH

[Mo10]

H. Morimoto, Stochastic Control and Mathematical Modeling, Applications in Economics (Cambridge University Press, Cambridge/New York, 2010)CrossRefMATH

[Na03]

H. Nagai, Optimal strategies for risk sensitive portfolio optimization problems for general factor models. SIAM J. Control Optim. 41, 1779–1800 (2003)CrossRefMATHMathSciNet

[N76]

M. Nisio, On a nonlinear semigroup attached to stochastic optimal control. Pull. RIMS 12, 513–537 (1976)CrossRefMATHMathSciNet

[N78]

M. Nisio, On nonlinear semigroups for Markov processes associated with optimal stopping. Appl. Math. Optim. 4, 143–169 (1978)CrossRefMATHMathSciNet

[N81]

M. Nisio, Lecture on Stochastic Control Theory. ISI Lecture Notes, vol. 9 (McMillan India, Delhi 1981)

[N88]

M. Nisio, Stochastic differential games and viscosity solutions of Isaacs equations. Nagoya Math. J. 110, 163–184 (1988)MATHMathSciNet

[P79]

E. Pardoux, Stochastic partial differential equations and filtering of diffusion processes. Stochastics 3, 127–167 (1979)CrossRefMATHMathSciNet

[P93]

E. Pardoux, Stochastic partial differential equations, a review. Bull. Sc. Math. 117, 29–47 (1993)MATHMathSciNet

[PP90]

E. Pardoux, S. Peng, Adapted solution of backward stoshastic equation. Syst. Control Lett. 14, 55–61 (1990)CrossRefMATHMathSciNet

[Pe92]

S. Peng, Stochastic Hamilton-Jacobi-Bellman equations. SIAM J. Control Optim. 30, 284–304 (1992)CrossRefMATHMathSciNet

[Ph02]

H. Pham, Smooth solutions to optimal investment models with stochastic volatilities and portfolio constraints. Appl. Math. Optim. 46, 55–78 (2002)CrossRefMATHMathSciNet

[R90]

B.L. Rozovskii, Stochastic Evolution Systems (Kluwer Academic, Dordrecht/Boston, 1990)CrossRefMATH

[S08]

A.N. Shiryayev, Optimal Stopping Rules, 2nd edn. (Springer, Berlin/Heidelberg 2008)

[St11]

L. Stettner, Penalty method for finite horizon stopping problems. SIAM J. Control Optim. 49, 1078–1099 (2011)CrossRefMATHMathSciNet

[SV79]

D.V. Strook, S.R.S. Varadhan, Multidimensional Diffusion Processes (Springer, Berlin/New York, 1979)

[W71]

J.C. Willems, Least squares stationary optimal control and the algebraic Ricatti equation. IEEE. Trans. Auto. Control 16, 621–635 (1971)CrossRefMathSciNet

[Wo68]

W.M. Wonham, on a matrix Ricatti equation of stochastic control. SIAM J. Control Optim. 6, 681–697 (1968)

[Y80]

K. Yosida, Functional Analysis, 6th edn. (Springer, Berlin/New York, 1980)CrossRefMATH

[YZ99]

J. Yong, X.Y. Zhou, Stochastic Controls, Hamiltonian Systems and HJB Equations (Springer, New York, 1999)MATH

Title: Stochastic Differential Games
Author: Makiko Nisio
Publisher: Springer Japan
Book: Stochastic Control Theory
Print ISBN: 978-4-431-55122-5

Electronic ISBN: 978-4-431-55123-2

Copyright Year: 2015
DOI: https://doi.org/10.1007/978-4-431-55123-2_4

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"