Skip to main content
Top
Published in: Dynamic Games and Applications 3/2021

17-02-2021

A Mean Field Approach for Discounted Zero-Sum Games in a Class of Systems of Interacting Objects

Authors: Carmen G. Higuera-Chan, J. Adolfo Minjárez-Sosa

Published in: Dynamic Games and Applications | Issue 3/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The paper deals with systems composed of a large number of N interacting objects (e.g., agents, particles) controlled by two players defining a stochastic zero-sum game. The objects can be classified according to a finite set of classes or categories over which they move randomly. Because N is too large, the game problem is studied following a mean field approach. That is, a zero-sum game model \(\mathcal {GM}_{N}\), where the states are the proportions of objects in each class, is introduced. Then, letting \(N\rightarrow \infty \) (the mean field limit) we obtain a new game model \(\mathcal {GM}\), independent on N, which is easier to analyze than \(\mathcal {GM}_{N}\). Considering a discounted optimality criterion, our objective is to prove that an optimal pair of strategies in \(\mathcal {GM}\) is an approximate optimal pair as \(N\rightarrow \infty \) in the original game model \(\mathcal {GM}_{N}\).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Accacio B, Backhoff-Veraguas J, Carmona R (2019) Extended mean field control problems: stochastic maximum principle and transport perspective. SIAM J Control Optim 57(6):3666–3693MathSciNetCrossRef Accacio B, Backhoff-Veraguas J, Carmona R (2019) Extended mean field control problems: stochastic maximum principle and transport perspective. SIAM J Control Optim 57(6):3666–3693MathSciNetCrossRef
2.
go back to reference Ait Rami M et al (2001) Indefinite stochastic linear quadratic control and generalized differential Riccati equation. SIAM J Control Optim 40:1296–1311MathSciNetCrossRef Ait Rami M et al (2001) Indefinite stochastic linear quadratic control and generalized differential Riccati equation. SIAM J Control Optim 40:1296–1311MathSciNetCrossRef
3.
go back to reference Bensoussan A, Frehse J, Yam P (2010) Mean field games and mean field control theory. Springer, New YorkMATH Bensoussan A, Frehse J, Yam P (2010) Mean field games and mean field control theory. Springer, New YorkMATH
4.
go back to reference Carmona R, Delarue F (2018) Probabilistic theory of mean field games with applications I. Springer, BerinCrossRef Carmona R, Delarue F (2018) Probabilistic theory of mean field games with applications I. Springer, BerinCrossRef
5.
go back to reference Carmona R, Delarue F (2018) Probabilistic theory of mean field games with applications II. Springer, BerlinCrossRef Carmona R, Delarue F (2018) Probabilistic theory of mean field games with applications II. Springer, BerlinCrossRef
6.
go back to reference Dynkin EB, Yushkevich AA (1979) Controlled Markov processes. Springer, New YorkCrossRef Dynkin EB, Yushkevich AA (1979) Controlled Markov processes. Springer, New YorkCrossRef
7.
go back to reference Elliott R, Li X, Ni YH (2013) Discrete time mean-field stochastic linear-quadratic optimal control problems. Automatica 49:3222–3233MathSciNetCrossRef Elliott R, Li X, Ni YH (2013) Discrete time mean-field stochastic linear-quadratic optimal control problems. Automatica 49:3222–3233MathSciNetCrossRef
8.
go back to reference Gast N, Gaujal B (2011) A mean field approach for optimization in discrete time. Discrete Event Dyn Syst 21:63–101MathSciNetCrossRef Gast N, Gaujal B (2011) A mean field approach for optimization in discrete time. Discrete Event Dyn Syst 21:63–101MathSciNetCrossRef
9.
go back to reference Gast N, Gaujal B, Le Boudec JY (2012) Mean field for Markov decision processes: from discrete to continuous optimization. IEEE Trans Autom Control 57:2266–2280MathSciNetCrossRef Gast N, Gaujal B, Le Boudec JY (2012) Mean field for Markov decision processes: from discrete to continuous optimization. IEEE Trans Autom Control 57:2266–2280MathSciNetCrossRef
10.
go back to reference Gomes DA, Pimentel EA, Voskanyan V (2016) Regularity theory for mean-field game systems. Springer, New YorkCrossRef Gomes DA, Pimentel EA, Voskanyan V (2016) Regularity theory for mean-field game systems. Springer, New YorkCrossRef
11.
go back to reference González-Sánchez D, Luque-Vásquez F, Minjárez-Sosa JA (2019) Zero-sum Markov games with random state-actions-dependent discount factors: existence of optimal strategies. Dyn Games Appl 9:103–121MathSciNetCrossRef González-Sánchez D, Luque-Vásquez F, Minjárez-Sosa JA (2019) Zero-sum Markov games with random state-actions-dependent discount factors: existence of optimal strategies. Dyn Games Appl 9:103–121MathSciNetCrossRef
12.
go back to reference Hafayed M (2013) A mean-field necessary and sufficient conditions for optimal singular stochastic control. Commun Math Stat 1:417–435MathSciNetCrossRef Hafayed M (2013) A mean-field necessary and sufficient conditions for optimal singular stochastic control. Commun Math Stat 1:417–435MathSciNetCrossRef
13.
go back to reference Hernández-Lerma O, Lasserre JB (1996) Discrete-time Markov control processes: basic optimality criteria. Springer, New YorkCrossRef Hernández-Lerma O, Lasserre JB (1996) Discrete-time Markov control processes: basic optimality criteria. Springer, New YorkCrossRef
14.
go back to reference Higuera-Chan CG, Jasso-Fuentes H, Minjárez-Sosa JA (2016) Discrete-time control for systems of interacting objects with unknown random disturbance distributions: a mean field approach. Appl Math Optim 74:197–227MathSciNetCrossRef Higuera-Chan CG, Jasso-Fuentes H, Minjárez-Sosa JA (2016) Discrete-time control for systems of interacting objects with unknown random disturbance distributions: a mean field approach. Appl Math Optim 74:197–227MathSciNetCrossRef
15.
go back to reference Higuera-Chan CG, Jasso-Fuentes H, Minjárez-Sosa JA (2017) Control systems of iteracting objects modeled as a game against nature under a mean field approach. J Dyn Games 4:59–74MathSciNetCrossRef Higuera-Chan CG, Jasso-Fuentes H, Minjárez-Sosa JA (2017) Control systems of iteracting objects modeled as a game against nature under a mean field approach. J Dyn Games 4:59–74MathSciNetCrossRef
16.
go back to reference Jaśkiewicz A, Nowak A (2006) Zero-sum ergodic stochastic games with Feller transition probabilities. SIAM J Control Optim 45:773–789MathSciNetCrossRef Jaśkiewicz A, Nowak A (2006) Zero-sum ergodic stochastic games with Feller transition probabilities. SIAM J Control Optim 45:773–789MathSciNetCrossRef
18.
go back to reference Laura-Guarachi LR, Hernández-Lerma O (2015) The Mitra–Wan model: a discrete-time optimal control problem. Nat Resource Model 28:152–168MathSciNetCrossRef Laura-Guarachi LR, Hernández-Lerma O (2015) The Mitra–Wan model: a discrete-time optimal control problem. Nat Resource Model 28:152–168MathSciNetCrossRef
19.
go back to reference Le Boudec JY, McDonald D, Mundinger J (2007) A generic mean field convergence result for systems of interacting objects. In: 4th international conference on quantitative evaluation of systems, Edinburg, pp 3-18 Le Boudec JY, McDonald D, Mundinger J (2007) A generic mean field convergence result for systems of interacting objects. In: 4th international conference on quantitative evaluation of systems, Edinburg, pp 3-18
20.
go back to reference Minjárez-Sosa JA (2020) Zero-sum discrete-time Markov games with unknown disturbance distribution: discounted and average criteria. Springer, BerlinCrossRef Minjárez-Sosa JA (2020) Zero-sum discrete-time Markov games with unknown disturbance distribution: discounted and average criteria. Springer, BerlinCrossRef
21.
go back to reference Peyrard N, Sabbadin R (2006) Mean field approximation of the policy iteration algorithm for graph-based Markov decision processes. In: Proceedings of ECAI, pp 595–599 Peyrard N, Sabbadin R (2006) Mean field approximation of the policy iteration algorithm for graph-based Markov decision processes. In: Proceedings of ECAI, pp 595–599
22.
go back to reference Piazza A, Pagnoncelli BK (2015) The stochastic Mitra–Wan forestry model: risk neutral and risk averse cases. J Econ 115:175–194CrossRef Piazza A, Pagnoncelli BK (2015) The stochastic Mitra–Wan forestry model: risk neutral and risk averse cases. J Econ 115:175–194CrossRef
23.
go back to reference Saldi N, Basar T, Raginsky M (2018) Markov–Nash equilibria in mean-field games with discounted cost. SIAM J Control Optim 56(6):4256–4287MathSciNetCrossRef Saldi N, Basar T, Raginsky M (2018) Markov–Nash equilibria in mean-field games with discounted cost. SIAM J Control Optim 56(6):4256–4287MathSciNetCrossRef
24.
go back to reference Song T, Liu B (2020) Discrete-time stochastic mean-field linear quadratic optimal control problem with finite horizon. Asian J Control 57:1–11 Song T, Liu B (2020) Discrete-time stochastic mean-field linear quadratic optimal control problem with finite horizon. Asian J Control 57:1–11
25.
go back to reference Wiecek P (2020) Discrete-time ergodic mean-field games with average reward on compact spaces. Dyn Games Appl 10:222–256MathSciNetCrossRef Wiecek P (2020) Discrete-time ergodic mean-field games with average reward on compact spaces. Dyn Games Appl 10:222–256MathSciNetCrossRef
Metadata
Title
A Mean Field Approach for Discounted Zero-Sum Games in a Class of Systems of Interacting Objects
Authors
Carmen G. Higuera-Chan
J. Adolfo Minjárez-Sosa
Publication date
17-02-2021
Publisher
Springer US
Published in
Dynamic Games and Applications / Issue 3/2021
Print ISSN: 2153-0785
Electronic ISSN: 2153-0793
DOI
https://doi.org/10.1007/s13235-021-00377-0

Other articles of this Issue 3/2021

Dynamic Games and Applications 3/2021 Go to the issue

Premium Partner