Skip to main content
Top

2017 | OriginalPaper | Chapter

Complex Dynamics of Single Agent Choice Governed by Dual-Channel Multi-Mode Reinforcement Learning

Authors : Ihor Lubashevsky, Arkady Zgonnikov, Sergey Maslov, Namik Goussein-zade

Published in: Strategic Innovative Marketing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

According to the modern theory of adaption of socioeconomic systems to unknown environments only the interaction between agents can be responsible for various emergent phenomena governed by decision-making and agent learning. Previously we advocated the idea that adopting a more complex model for the agent individual behavior including rational and irrational reasons for decision-making, a more diverse spectrum of macro-level behaviors can be expected. To justify this idea we have developed a model based on the reinforcement learning paradigm extended to including an additional channel of processing information; an agent is biased by novelty seeking, the intrinsic inclination for exploration. In the present paper we demonstrate that the behavior of the single novelty-seeking agent may be extremely irregular and the concepts of chaos can be used to characterize it.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Cloninger, C. (2004). Feeling good: the science of well-being. New York: Oxford University Press. Cloninger, C. (2004). Feeling good: the science of well-being. New York: Oxford University Press.
go back to reference Deci, E., & Ryan, R. (1985). Intrinsic motivation and self-determination in human behavior. Springer. Deci, E., & Ryan, R. (1985). Intrinsic motivation and self-determination in human behavior. Springer.
go back to reference Kianercy, A., & Galstyan, A. (2012). Dynamics of Boltzmann Q learning in two-player two-action games. Physical Review E, 85(4), 041145.CrossRef Kianercy, A., & Galstyan, A. (2012). Dynamics of Boltzmann Q learning in two-player two-action games. Physical Review E, 85(4), 041145.CrossRef
go back to reference Kuhnen, C., & Chiao, J. (2009). Genetic determinants of financial risk taking. PLoS ONE, 4(2), e4362.CrossRef Kuhnen, C., & Chiao, J. (2009). Genetic determinants of financial risk taking. PLoS ONE, 4(2), e4362.CrossRef
go back to reference Lee, T.-H., & Crompton, J. (1992). Measuring novelty seeking in tourism. Annals of Tourism Research, 19(4), 732–751.CrossRef Lee, T.-H., & Crompton, J. (1992). Measuring novelty seeking in tourism. Annals of Tourism Research, 19(4), 732–751.CrossRef
go back to reference Leslie, D. S., & Collins, E. (2005). Individual Q-learning in normal form games. SIAM Journal on Control and Optimization, 44(2), 495–514.CrossRef Leslie, D. S., & Collins, E. (2005). Individual Q-learning in normal form games. SIAM Journal on Control and Optimization, 44(2), 495–514.CrossRef
go back to reference Lubashevsky, I., & Kanemoto, S. (2010). Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics. The European Physical Journal B-Condensed Matter and Complex Systems, 76(1), 69–85.CrossRef Lubashevsky, I., & Kanemoto, S. (2010). Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics. The European Physical Journal B-Condensed Matter and Complex Systems, 76(1), 69–85.CrossRef
go back to reference Ryan, R., & Deci, E. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78.CrossRef Ryan, R., & Deci, E. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78.CrossRef
go back to reference Sato, Y., & Crutchfield, J. (2003). Coupled replicator equations for the dynamics of learning in multiagent systems. Physical Review E, 67(1), 015206.CrossRef Sato, Y., & Crutchfield, J. (2003). Coupled replicator equations for the dynamics of learning in multiagent systems. Physical Review E, 67(1), 015206.CrossRef
go back to reference Sato, Y., Akiyama, E., & Farmer, J. (2002). Chaos in learning a simple two-person game. Proceedings of the National Academy of Sciences, 99(7), 4748–4751.CrossRef Sato, Y., Akiyama, E., & Farmer, J. (2002). Chaos in learning a simple two-person game. Proceedings of the National Academy of Sciences, 99(7), 4748–4751.CrossRef
go back to reference Zgonnikov, A., & Lubashevsky, I. (2014). Unstable dynamics of adaptation in unknown environment due to novelty seeking. Advances in Complex Systems, 17(3 & 4), 1450013 (17 pages). Zgonnikov, A., & Lubashevsky, I. (2014). Unstable dynamics of adaptation in unknown environment due to novelty seeking. Advances in Complex Systems, 17(3 & 4), 1450013 (17 pages).
Metadata
Title
Complex Dynamics of Single Agent Choice Governed by Dual-Channel Multi-Mode Reinforcement Learning
Authors
Ihor Lubashevsky
Arkady Zgonnikov
Sergey Maslov
Namik Goussein-zade
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-33865-1_68

Premium Partner