Skip to main content
Top

2015 | OriginalPaper | Chapter

On Gradient Like Properties of Population Games, Learning Models and Self Reinforced Processes

Author : Michel Benaim

Published in: Dynamics, Games and Science

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We consider ordinary differential equations on the unit simplex of \(\mathbb{R}^{n}\) that naturally occur in population games, models of learning and self reinforced random processes. Generalizing and relying on an idea introduced in Dupuis and Fisher (On the construction of Lyapunov functions for nonlinear Markov processes via relative entropy, 2011), we provide conditions ensuring that these dynamics are gradient like and satisfy a suitable “angle condition”. This is used to prove that omega limit sets and chain transitive sets (under certain smoothness assumptions) consist of equilibria; and that, in the real analytic case, every trajectory converges toward an equilibrium. In the reversible case, the dynamics are shown to be C 1 close to a gradient vector field. Properties of equilibria -with a special emphasis on potential games—and structural stability questions are also considered.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
By this we mean that L is the restriction to Δ of a C 1 map defined in a neighborhood of Δ in \(aff(\varDelta ) =\{ x \in \mathbb{R}^{n}\,:\sum _{i}x_{1} = 1\}\).
 
Literature
2.
go back to reference Benaïm, M.: Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités, XXXIII. Lecture Notes in Mathematics, vol. 1709, pp. 1–68. Springer, Berlin (1999) Benaïm, M.: Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités, XXXIII. Lecture Notes in Mathematics, vol. 1709, pp. 1–68. Springer, Berlin (1999)
3.
go back to reference Benaïm, M., Hirsch, M.W.: Asymptotic pseudotrajectories and chain recurrent flows, with applications. J. Dyn. Diff. Equ. 8(1), 141–176 (1996). MR 1388167 (97d:58165) Benaïm, M., Hirsch, M.W.: Asymptotic pseudotrajectories and chain recurrent flows, with applications. J. Dyn. Diff. Equ. 8(1), 141–176 (1996). MR 1388167 (97d:58165)
4.
go back to reference Benaïm, M., Raimond, O.: Self interacting diffusions iii: symmetric interactions. Ann. Probab. 33(5), 1716–1759 (2005)CrossRefMATH Benaïm, M., Raimond, O.: Self interacting diffusions iii: symmetric interactions. Ann. Probab. 33(5), 1716–1759 (2005)CrossRefMATH
5.
6.
go back to reference Benaïm, M., Benjamini, O., Chen, J., Lima, Y.: A generalized polya’s urn with graph based interactions. Rand. Struct. Algorithms 46(4), 614–634 (2015)CrossRef Benaïm, M., Benjamini, O., Chen, J., Lima, Y.: A generalized polya’s urn with graph based interactions. Rand. Struct. Algorithms 46(4), 614–634 (2015)CrossRef
7.
go back to reference Benaïm, M., Raimond, O., Schapira, B.: Strongly reinforced vertex-reinforced random walks on the complete graph. ALEA. Latin Am. J. Probab. Math. Stat. 10(2), 767–782 (2013)MATH Benaïm, M., Raimond, O., Schapira, B.: Strongly reinforced vertex-reinforced random walks on the complete graph. ALEA. Latin Am. J. Probab. Math. Stat. 10(2), 767–782 (2013)MATH
8.
go back to reference Chen, J.: Lucas, C.: Generalized polya’s urn: convergence at linearity (2013, preprint) [arXiv:1306.5465] Chen, J.: Lucas, C.: Generalized polya’s urn: convergence at linearity (2013, preprint) [arXiv:1306.5465]
9.
go back to reference Chill, R., Haraux, A., Ali-Jendoubi, M., Applications of the lojasiewicz simon, gradient inequality to gradient-like evolution equations. Anal. Appl. 7(4), 351–372 (2009)MathSciNetCrossRefMATH Chill, R., Haraux, A., Ali-Jendoubi, M., Applications of the lojasiewicz simon, gradient inequality to gradient-like evolution equations. Anal. Appl. 7(4), 351–372 (2009)MathSciNetCrossRefMATH
10.
go back to reference Dupuis, P., Fisher, M.: On the construction of Lyapunov functions for nonlinear Markov processes via relative entropy. Lefschetz Center for Dynamical Systems (2011, preprint) Dupuis, P., Fisher, M.: On the construction of Lyapunov functions for nonlinear Markov processes via relative entropy. Lefschetz Center for Dynamical Systems (2011, preprint)
11.
go back to reference Freildin, M., Wentzell, A.D.: Random Perturbations of Dynamical Sytems, 3rd edn. Springer, Heidelberg (2012) Freildin, M., Wentzell, A.D.: Random Perturbations of Dynamical Sytems, 3rd edn. Springer, Heidelberg (2012)
12.
go back to reference Hirsch, M.W.: Differential Topology, vol. 33. Springer, New York (1976)MATH Hirsch, M.W.: Differential Topology, vol. 33. Springer, New York (1976)MATH
13.
go back to reference Hofbauer, J., Sigmund, K.: Evolutionary Games and Population Dynamics. Cambridge University Press, Cambridge (1998)CrossRefMATH Hofbauer, J., Sigmund, K.: Evolutionary Games and Population Dynamics. Cambridge University Press, Cambridge (1998)CrossRefMATH
14.
15.
go back to reference Kurtz, T.G.: Solutions of ordinary differential equations as limits of pure jump markov processes. J. Appl. Probab. 7, 49–58 (1970)MathSciNetCrossRefMATH Kurtz, T.G.: Solutions of ordinary differential equations as limits of pure jump markov processes. J. Appl. Probab. 7, 49–58 (1970)MathSciNetCrossRefMATH
16.
go back to reference Lojasiewicz, S.: Une propriété topologique des sous-ensembles analytiques réels. Les Équations aux Dérivées Partielles, pp. 87–89. Éditions du C.N.R.S, Paris (1963) Lojasiewicz, S.: Une propriété topologique des sous-ensembles analytiques réels. Les Équations aux Dérivées Partielles, pp. 87–89. Éditions du C.N.R.S, Paris (1963)
17.
go back to reference Merlet, B., Nguyen, T.N.: Convergence to equilibrium for discretizations of gradient-like flows on riemannian manifolds. Differ. Integr. Equ. 26(5–6), 571–602 (2013)MathSciNetMATH Merlet, B., Nguyen, T.N.: Convergence to equilibrium for discretizations of gradient-like flows on riemannian manifolds. Differ. Integr. Equ. 26(5–6), 571–602 (2013)MathSciNetMATH
18.
go back to reference Palis, J., de Melo, W.: Geometric Theory of Dynamical Systems. Springer, New York (1980) Palis, J., de Melo, W.: Geometric Theory of Dynamical Systems. Springer, New York (1980)
20.
go back to reference Pemantle, R.: A survey of random processes with reinforcement. Probab. Surv. 4, 1–79 (2007). MR 2282181 (2007k:60230) Pemantle, R.: A survey of random processes with reinforcement. Probab. Surv. 4, 1–79 (2007). MR 2282181 (2007k:60230)
21.
go back to reference Robinson, C.: Dynamical Systems: Stability, Symbolic Dynamics and Chaos, 2nd edn. CRC Press, Boca Raton (1999)MATH Robinson, C.: Dynamical Systems: Stability, Symbolic Dynamics and Chaos, 2nd edn. CRC Press, Boca Raton (1999)MATH
22.
go back to reference Sandholm, W.H.: Population Games and Evolutionary Dynamics. MIT, Cambridge (2010)MATH Sandholm, W.H.: Population Games and Evolutionary Dynamics. MIT, Cambridge (2010)MATH
23.
go back to reference Sandholm, W.H.: Population games and deterministic evolutionary dynamics. In: Young, H.P., Zamir, S. (eds.) Handbook of Game Theory, vol. 4, pp. 703–775. North Holland (2015) Sandholm, W.H.: Population games and deterministic evolutionary dynamics. In: Young, H.P., Zamir, S. (eds.) Handbook of Game Theory, vol. 4, pp. 703–775. North Holland (2015)
24.
go back to reference van der Hofstad, R., Holmes, M., Kuznetsov, A., Ruszel, W.: Strongly reinforced polya urns with graph-based competition (2014, preprint) [arXiv:1406.0449] van der Hofstad, R., Holmes, M., Kuznetsov, A., Ruszel, W.: Strongly reinforced polya urns with graph-based competition (2014, preprint) [arXiv:1406.0449]
Metadata
Title
On Gradient Like Properties of Population Games, Learning Models and Self Reinforced Processes
Author
Michel Benaim
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-16118-1_8

Premium Partner