Skip to main content
Top
Published in: Dynamic Games and Applications 3/2019

05-07-2018

Continuous-Time Markov Games with Asymmetric Information

Author: Fabien Gensbittel

Published in: Dynamic Games and Applications | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We study a two-player zero-sum stochastic differential game with asymmetric information where the payoff depends on a controlled continuous-time Markov chain X with finite state space which is only observed by player 1. This model was already studied in Cardaliaguet et al (Math Oper Res 41(1):49–71, 2016) through an approximating sequence of discrete-time games. Our first contribution is the proof of the existence of the value in the continuous-time model based on duality techniques. This value is shown to be the unique solution of the same Hamilton–Jacobi equation with convexity constraints which characterized the limit value obtained in Cardaliaguet et al. (2016). Our second main contribution is to provide a simpler equivalent formulation for this Hamilton–Jacobi equation using directional derivatives and exposed points, which we think is interesting for its own sake as the associated comparison principle has a very simple proof which avoids all the technical machinery of viscosity solutions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Recall that we may replace global maximum/minimum by local maximum/minimum in the definitions of viscosity solutions, see, e.g., [10].
 
Literature
1.
go back to reference Alvarez O, Lasry JM, Lions PL (1997) Convex viscosity solutions and state constraints. Journal de mathématiques pures et appliquées 76(3):265–288MathSciNetMATHCrossRef Alvarez O, Lasry JM, Lions PL (1997) Convex viscosity solutions and state constraints. Journal de mathématiques pures et appliquées 76(3):265–288MathSciNetMATHCrossRef
2.
go back to reference Bremaud P (1981) Point processes and queues: martingale dynamics. Springer series in statistics. Springer-Verlag, BerlinMATHCrossRef Bremaud P (1981) Point processes and queues: martingale dynamics. Springer series in statistics. Springer-Verlag, BerlinMATHCrossRef
3.
go back to reference Buckdahn R, Quincampoix M, Rainer C, Xu Y (2016) Differential games with asymmetric information and without Isaacs’ condition. Int. J. Game Theory 45(4):795–816MathSciNetMATHCrossRef Buckdahn R, Quincampoix M, Rainer C, Xu Y (2016) Differential games with asymmetric information and without Isaacs’ condition. Int. J. Game Theory 45(4):795–816MathSciNetMATHCrossRef
8.
go back to reference Cardaliaguet P, Rainer C (2012) Games with incomplete information in continuous time and for continuous types. Dyn Games Appl 2(2):206–227MathSciNetMATHCrossRef Cardaliaguet P, Rainer C (2012) Games with incomplete information in continuous time and for continuous types. Dyn Games Appl 2(2):206–227MathSciNetMATHCrossRef
9.
go back to reference Cardaliaguet P, Rainer C, Rosenberg D, Vieille N (2016) Markov games with frequent actions and incomplete information. Math Oper Res 41(1):49–71MathSciNetMATHCrossRef Cardaliaguet P, Rainer C, Rosenberg D, Vieille N (2016) Markov games with frequent actions and incomplete information. Math Oper Res 41(1):49–71MathSciNetMATHCrossRef
10.
go back to reference Crandall MG, Ishii H, Lions PL (1992) User’s guide to viscosity solutions of second order partial differential equations. Bull Am Math Soc 27:1–67MathSciNetMATHCrossRef Crandall MG, Ishii H, Lions PL (1992) User’s guide to viscosity solutions of second order partial differential equations. Bull Am Math Soc 27:1–67MathSciNetMATHCrossRef
13.
go back to reference Gensbittel F (2016) Continuous-time limit of dynamic games with incomplete information and a more informed player. Int J Game Theory 45(1–2):321–352MathSciNetMATHCrossRef Gensbittel F (2016) Continuous-time limit of dynamic games with incomplete information and a more informed player. Int J Game Theory 45(1–2):321–352MathSciNetMATHCrossRef
15.
go back to reference Gensbittel F, Rainer C (2018) A two player zero-sum game where only one player observes a Brownian motion. Dyn Games Appl 8(2):280–314MathSciNetMATHCrossRef Gensbittel F, Rainer C (2018) A two player zero-sum game where only one player observes a Brownian motion. Dyn Games Appl 8(2):280–314MathSciNetMATHCrossRef
16.
go back to reference Gensbittel F, Renault J (2015) The value of Markov chain games with incomplete information on both sides. Math Oper Res 40(4):820–841MathSciNetMATHCrossRef Gensbittel F, Renault J (2015) The value of Markov chain games with incomplete information on both sides. Math Oper Res 40(4):820–841MathSciNetMATHCrossRef
18.
19.
go back to reference Jimenez C, Quincampoix M, Xu Y (2016) Differential games with incomplete information on a continuum of initial positions and without Isaacs condition. Dyn Games Appl 6(1):82–96MathSciNetMATHCrossRef Jimenez C, Quincampoix M, Xu Y (2016) Differential games with incomplete information on a continuum of initial positions and without Isaacs condition. Dyn Games Appl 6(1):82–96MathSciNetMATHCrossRef
20.
go back to reference Jimenez C, Quincampoix M (2018) Hamilton Jacobi Isaacs equations for differential games with asymmetric information on probabilistic initial condition. J Math Anal Appl 457(2):1422–1451MathSciNetMATHCrossRef Jimenez C, Quincampoix M (2018) Hamilton Jacobi Isaacs equations for differential games with asymmetric information on probabilistic initial condition. J Math Anal Appl 457(2):1422–1451MathSciNetMATHCrossRef
21.
go back to reference Mertens JF, Zamir S (1971) The value of two-person zero-sum repeated games with incomplete information. Int J Game Theory 1(1):39–64MathSciNetMATHCrossRef Mertens JF, Zamir S (1971) The value of two-person zero-sum repeated games with incomplete information. Int J Game Theory 1(1):39–64MathSciNetMATHCrossRef
22.
24.
go back to reference Parthasarathy KR (2005) Probability measures on metric spaces, vol 352. American Mathematical Society, ProvidenceMATH Parthasarathy KR (2005) Probability measures on metric spaces, vol 352. American Mathematical Society, ProvidenceMATH
26.
go back to reference Sorin S (2002) A first course on zero-sum repeated games. Springer, BerlinMATH Sorin S (2002) A first course on zero-sum repeated games. Springer, BerlinMATH
27.
go back to reference Wu X (2017) Existence of value for differential games with incomplete information and signals on initial states and payoffs. J Math Anal Appl 446(2):1196–1218MathSciNetMATHCrossRef Wu X (2017) Existence of value for differential games with incomplete information and signals on initial states and payoffs. J Math Anal Appl 446(2):1196–1218MathSciNetMATHCrossRef
Metadata
Title
Continuous-Time Markov Games with Asymmetric Information
Author
Fabien Gensbittel
Publication date
05-07-2018
Publisher
Springer US
Published in
Dynamic Games and Applications / Issue 3/2019
Print ISSN: 2153-0785
Electronic ISSN: 2153-0793
DOI
https://doi.org/10.1007/s13235-018-0273-7

Other articles of this Issue 3/2019

Dynamic Games and Applications 3/2019 Go to the issue

Premium Partner