Skip to main content
Top
Published in: Dynamic Games and Applications 2/2019

07-06-2018

Risk-Sensitive Average Equilibria for Discrete-Time Stochastic Games

Authors: Qingda Wei, Xian Chen

Published in: Dynamic Games and Applications | Issue 2/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we study the risk-sensitive average payoff criterion for the nonzero-sum discrete-time stochastic games with a denumerable state space. The risk-sensitivity coefficient can take positive values and negative values. Under the suitable conditions, we show the existence of a solution to the coupled equations by a technique of the discounted approximation, and obtain the existence of a stationary Nash equilibrium. Moreover, we present some verifiable sufficient conditions imposed on the primitive data of the model for the verification of our assumption and use an example to illustrate that our conditions are weaker than those in the existing literature.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aliprantis C, Border K (2007) Infinite dimensional analysis. Springer, New YorkMATH Aliprantis C, Border K (2007) Infinite dimensional analysis. Springer, New YorkMATH
2.
3.
go back to reference Basu A, Ghosh MK (2018) Nonzero-sum risk-sensitive stochastic games on a countable state space. Math Oper Res 43:516–532MathSciNetCrossRef Basu A, Ghosh MK (2018) Nonzero-sum risk-sensitive stochastic games on a countable state space. Math Oper Res 43:516–532MathSciNetCrossRef
5.
go back to reference Bertsekas DP, Shreve SE (1996) Stochastic optimal control: the discrete-time case. Athena Scientific, BelmontMATH Bertsekas DP, Shreve SE (1996) Stochastic optimal control: the discrete-time case. Athena Scientific, BelmontMATH
6.
go back to reference Cavazos-Cadena R (2009) The risk-sensitive Poisson equation for a communicating Markov chain on a denumerable state space. Kybernetika 45:716–736MathSciNetMATH Cavazos-Cadena R (2009) The risk-sensitive Poisson equation for a communicating Markov chain on a denumerable state space. Kybernetika 45:716–736MathSciNetMATH
7.
go back to reference Cavazos-Cadena R (2010) Optimality equations and inequalities in a class of risk-sensitive average cost Markov decision chains. Math Methods Oper Res 71:47–84MathSciNetCrossRefMATH Cavazos-Cadena R (2010) Optimality equations and inequalities in a class of risk-sensitive average cost Markov decision chains. Math Methods Oper Res 71:47–84MathSciNetCrossRefMATH
8.
go back to reference Cavazos-Cadena R, Hernández-Hernández D (2011) Discounted approximations for risk-sensitive average criteria in Markov decision chains with finite state space. Math Oper Res 36:133–146MathSciNetCrossRefMATH Cavazos-Cadena R, Hernández-Hernández D (2011) Discounted approximations for risk-sensitive average criteria in Markov decision chains with finite state space. Math Oper Res 36:133–146MathSciNetCrossRefMATH
9.
go back to reference Di Masi GB, Stettner L (1999) Risk-sensitive control of discrete-time Markov processes with infinite horizon. SIAM J Control Optim 38:61–78MathSciNetCrossRefMATH Di Masi GB, Stettner L (1999) Risk-sensitive control of discrete-time Markov processes with infinite horizon. SIAM J Control Optim 38:61–78MathSciNetCrossRefMATH
10.
go back to reference Di Masi GB, Stettner L (2000) Infinite horizon risk sensitive control of discrete-time Markov processes with small risk. Syst Control Lett 40:15–20MathSciNetCrossRefMATH Di Masi GB, Stettner L (2000) Infinite horizon risk sensitive control of discrete-time Markov processes with small risk. Syst Control Lett 40:15–20MathSciNetCrossRefMATH
11.
go back to reference Di Masi GB, Stettner L (2007) Infinite horizon risk sensitive control of discrete time Markov processes under minorization property. SIAM J Control Optim 46:231–252MathSciNetCrossRefMATH Di Masi GB, Stettner L (2007) Infinite horizon risk sensitive control of discrete time Markov processes under minorization property. SIAM J Control Optim 46:231–252MathSciNetCrossRefMATH
12.
go back to reference Filar J, Vrieze K (1997) Competitive Markov decision processes. Springer, New YorkMATH Filar J, Vrieze K (1997) Competitive Markov decision processes. Springer, New YorkMATH
13.
go back to reference Hernández-Hernández D, Marcus SI (1999) Existence of risk-sensitive optimal stationary policies for controlled Markov processes. Appl Math Optim 40:273–285MathSciNetCrossRefMATH Hernández-Hernández D, Marcus SI (1999) Existence of risk-sensitive optimal stationary policies for controlled Markov processes. Appl Math Optim 40:273–285MathSciNetCrossRefMATH
14.
go back to reference Hernández-Lerma O, Lasserre JB (1996) Discrete-time Markov control processes: basic optimality criteria. Springer, New YorkCrossRefMATH Hernández-Lerma O, Lasserre JB (1996) Discrete-time Markov control processes: basic optimality criteria. Springer, New YorkCrossRefMATH
15.
go back to reference Hernández-Lerma O, Lasserre JB (1999) Further topics on discrete-time Markov control processes. Springer, New YorkCrossRefMATH Hernández-Lerma O, Lasserre JB (1999) Further topics on discrete-time Markov control processes. Springer, New YorkCrossRefMATH
17.
18.
go back to reference Nowak AS (2003) On a new class of nonzero-sum discounted stochastic games having stationary Nash equilibrium points. Intern J Game Theory 32:121–132MathSciNetCrossRefMATH Nowak AS (2003) On a new class of nonzero-sum discounted stochastic games having stationary Nash equilibrium points. Intern J Game Theory 32:121–132MathSciNetCrossRefMATH
20.
21.
go back to reference Puterman ML (1994) Markov decision processes: discrete stochastic dynamic programming. Wiley, New YorkCrossRefMATH Puterman ML (1994) Markov decision processes: discrete stochastic dynamic programming. Wiley, New YorkCrossRefMATH
23.
go back to reference Weil P (1993) Precautionary savings and the permanent income hypothesis. Rev Econ Stud 60:367–383CrossRefMATH Weil P (1993) Precautionary savings and the permanent income hypothesis. Rev Econ Stud 60:367–383CrossRefMATH
Metadata
Title
Risk-Sensitive Average Equilibria for Discrete-Time Stochastic Games
Authors
Qingda Wei
Xian Chen
Publication date
07-06-2018
Publisher
Springer US
Published in
Dynamic Games and Applications / Issue 2/2019
Print ISSN: 2153-0785
Electronic ISSN: 2153-0793
DOI
https://doi.org/10.1007/s13235-018-0267-5

Other articles of this Issue 2/2019

Dynamic Games and Applications 2/2019 Go to the issue

Premium Partner