Skip to main content

2015 | OriginalPaper | Buchkapitel

On Gradient Like Properties of Population Games, Learning Models and Self Reinforced Processes

verfasst von : Michel Benaim

Erschienen in: Dynamics, Games and Science

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We consider ordinary differential equations on the unit simplex of \(\mathbb{R}^{n}\) that naturally occur in population games, models of learning and self reinforced random processes. Generalizing and relying on an idea introduced in Dupuis and Fisher (On the construction of Lyapunov functions for nonlinear Markov processes via relative entropy, 2011), we provide conditions ensuring that these dynamics are gradient like and satisfy a suitable “angle condition”. This is used to prove that omega limit sets and chain transitive sets (under certain smoothness assumptions) consist of equilibria; and that, in the real analytic case, every trajectory converges toward an equilibrium. In the reversible case, the dynamics are shown to be C 1 close to a gradient vector field. Properties of equilibria -with a special emphasis on potential games—and structural stability questions are also considered.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
By this we mean that L is the restriction to Δ of a C 1 map defined in a neighborhood of Δ in \(aff(\varDelta ) =\{ x \in \mathbb{R}^{n}\,:\sum _{i}x_{1} = 1\}\).
 
Literatur
2.
Zurück zum Zitat Benaïm, M.: Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités, XXXIII. Lecture Notes in Mathematics, vol. 1709, pp. 1–68. Springer, Berlin (1999) Benaïm, M.: Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités, XXXIII. Lecture Notes in Mathematics, vol. 1709, pp. 1–68. Springer, Berlin (1999)
3.
Zurück zum Zitat Benaïm, M., Hirsch, M.W.: Asymptotic pseudotrajectories and chain recurrent flows, with applications. J. Dyn. Diff. Equ. 8(1), 141–176 (1996). MR 1388167 (97d:58165) Benaïm, M., Hirsch, M.W.: Asymptotic pseudotrajectories and chain recurrent flows, with applications. J. Dyn. Diff. Equ. 8(1), 141–176 (1996). MR 1388167 (97d:58165)
4.
Zurück zum Zitat Benaïm, M., Raimond, O.: Self interacting diffusions iii: symmetric interactions. Ann. Probab. 33(5), 1716–1759 (2005)CrossRefMATH Benaïm, M., Raimond, O.: Self interacting diffusions iii: symmetric interactions. Ann. Probab. 33(5), 1716–1759 (2005)CrossRefMATH
5.
6.
Zurück zum Zitat Benaïm, M., Benjamini, O., Chen, J., Lima, Y.: A generalized polya’s urn with graph based interactions. Rand. Struct. Algorithms 46(4), 614–634 (2015)CrossRef Benaïm, M., Benjamini, O., Chen, J., Lima, Y.: A generalized polya’s urn with graph based interactions. Rand. Struct. Algorithms 46(4), 614–634 (2015)CrossRef
7.
Zurück zum Zitat Benaïm, M., Raimond, O., Schapira, B.: Strongly reinforced vertex-reinforced random walks on the complete graph. ALEA. Latin Am. J. Probab. Math. Stat. 10(2), 767–782 (2013)MATH Benaïm, M., Raimond, O., Schapira, B.: Strongly reinforced vertex-reinforced random walks on the complete graph. ALEA. Latin Am. J. Probab. Math. Stat. 10(2), 767–782 (2013)MATH
8.
Zurück zum Zitat Chen, J.: Lucas, C.: Generalized polya’s urn: convergence at linearity (2013, preprint) [arXiv:1306.5465] Chen, J.: Lucas, C.: Generalized polya’s urn: convergence at linearity (2013, preprint) [arXiv:1306.5465]
9.
Zurück zum Zitat Chill, R., Haraux, A., Ali-Jendoubi, M., Applications of the lojasiewicz simon, gradient inequality to gradient-like evolution equations. Anal. Appl. 7(4), 351–372 (2009)MathSciNetCrossRefMATH Chill, R., Haraux, A., Ali-Jendoubi, M., Applications of the lojasiewicz simon, gradient inequality to gradient-like evolution equations. Anal. Appl. 7(4), 351–372 (2009)MathSciNetCrossRefMATH
10.
Zurück zum Zitat Dupuis, P., Fisher, M.: On the construction of Lyapunov functions for nonlinear Markov processes via relative entropy. Lefschetz Center for Dynamical Systems (2011, preprint) Dupuis, P., Fisher, M.: On the construction of Lyapunov functions for nonlinear Markov processes via relative entropy. Lefschetz Center for Dynamical Systems (2011, preprint)
11.
Zurück zum Zitat Freildin, M., Wentzell, A.D.: Random Perturbations of Dynamical Sytems, 3rd edn. Springer, Heidelberg (2012) Freildin, M., Wentzell, A.D.: Random Perturbations of Dynamical Sytems, 3rd edn. Springer, Heidelberg (2012)
12.
Zurück zum Zitat Hirsch, M.W.: Differential Topology, vol. 33. Springer, New York (1976)MATH Hirsch, M.W.: Differential Topology, vol. 33. Springer, New York (1976)MATH
13.
Zurück zum Zitat Hofbauer, J., Sigmund, K.: Evolutionary Games and Population Dynamics. Cambridge University Press, Cambridge (1998)CrossRefMATH Hofbauer, J., Sigmund, K.: Evolutionary Games and Population Dynamics. Cambridge University Press, Cambridge (1998)CrossRefMATH
14.
Zurück zum Zitat Hofbauer, J., Sorin, S., Viossat, Y.: Time average replicator and best reply dynamics. Math. Oper. Res. 34(2), 263–269 (2009)MathSciNetCrossRefMATH Hofbauer, J., Sorin, S., Viossat, Y.: Time average replicator and best reply dynamics. Math. Oper. Res. 34(2), 263–269 (2009)MathSciNetCrossRefMATH
15.
Zurück zum Zitat Kurtz, T.G.: Solutions of ordinary differential equations as limits of pure jump markov processes. J. Appl. Probab. 7, 49–58 (1970)MathSciNetCrossRefMATH Kurtz, T.G.: Solutions of ordinary differential equations as limits of pure jump markov processes. J. Appl. Probab. 7, 49–58 (1970)MathSciNetCrossRefMATH
16.
Zurück zum Zitat Lojasiewicz, S.: Une propriété topologique des sous-ensembles analytiques réels. Les Équations aux Dérivées Partielles, pp. 87–89. Éditions du C.N.R.S, Paris (1963) Lojasiewicz, S.: Une propriété topologique des sous-ensembles analytiques réels. Les Équations aux Dérivées Partielles, pp. 87–89. Éditions du C.N.R.S, Paris (1963)
17.
Zurück zum Zitat Merlet, B., Nguyen, T.N.: Convergence to equilibrium for discretizations of gradient-like flows on riemannian manifolds. Differ. Integr. Equ. 26(5–6), 571–602 (2013)MathSciNetMATH Merlet, B., Nguyen, T.N.: Convergence to equilibrium for discretizations of gradient-like flows on riemannian manifolds. Differ. Integr. Equ. 26(5–6), 571–602 (2013)MathSciNetMATH
18.
Zurück zum Zitat Palis, J., de Melo, W.: Geometric Theory of Dynamical Systems. Springer, New York (1980) Palis, J., de Melo, W.: Geometric Theory of Dynamical Systems. Springer, New York (1980)
20.
Zurück zum Zitat Pemantle, R.: A survey of random processes with reinforcement. Probab. Surv. 4, 1–79 (2007). MR 2282181 (2007k:60230) Pemantle, R.: A survey of random processes with reinforcement. Probab. Surv. 4, 1–79 (2007). MR 2282181 (2007k:60230)
21.
Zurück zum Zitat Robinson, C.: Dynamical Systems: Stability, Symbolic Dynamics and Chaos, 2nd edn. CRC Press, Boca Raton (1999)MATH Robinson, C.: Dynamical Systems: Stability, Symbolic Dynamics and Chaos, 2nd edn. CRC Press, Boca Raton (1999)MATH
22.
Zurück zum Zitat Sandholm, W.H.: Population Games and Evolutionary Dynamics. MIT, Cambridge (2010)MATH Sandholm, W.H.: Population Games and Evolutionary Dynamics. MIT, Cambridge (2010)MATH
23.
Zurück zum Zitat Sandholm, W.H.: Population games and deterministic evolutionary dynamics. In: Young, H.P., Zamir, S. (eds.) Handbook of Game Theory, vol. 4, pp. 703–775. North Holland (2015) Sandholm, W.H.: Population games and deterministic evolutionary dynamics. In: Young, H.P., Zamir, S. (eds.) Handbook of Game Theory, vol. 4, pp. 703–775. North Holland (2015)
24.
Zurück zum Zitat van der Hofstad, R., Holmes, M., Kuznetsov, A., Ruszel, W.: Strongly reinforced polya urns with graph-based competition (2014, preprint) [arXiv:1406.0449] van der Hofstad, R., Holmes, M., Kuznetsov, A., Ruszel, W.: Strongly reinforced polya urns with graph-based competition (2014, preprint) [arXiv:1406.0449]
Metadaten
Titel
On Gradient Like Properties of Population Games, Learning Models and Self Reinforced Processes
verfasst von
Michel Benaim
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16118-1_8