Skip to main content
Top

2018 | OriginalPaper | Chapter

Goal-Directed Behavior Control Based on the Mechanism of Neuromodulation

Authors : Dongshu Wang, Hui Shan, Lei Liu

Published in: Advances in Brain Inspired Cognitive Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Due to the role of the brain’s neuromodulatory system, biological organisms have the capacity of responding to the ever-changing environment rapidly. This work presents that the mechanism of the neuromodulatory systems through a developmental network can provide a control framework for the artificial agent to regulate its behavior. With the dopamine, serotonin, acetylcholine and norepinephrine modulation, the agent can operate autonomously, effectively carry out specific functions, e.g., to pursue a friend and avoid the enemy, and make suitable and instant decision when the environment changes. Goal-directed pursuing behavior in two simulation scenarios demonstrate the effect of the proposed neural modulatory systems, such as attentional effort, reinforcement learning and addressing the unexpected uncertainty.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Krichmar, J.L.: The neuromodulatory system: a framework for survival and adaptive behavior in a challenging world. Adapt. Behav. 16, 385–399 (2008)CrossRef Krichmar, J.L.: The neuromodulatory system: a framework for survival and adaptive behavior in a challenging world. Adapt. Behav. 16, 385–399 (2008)CrossRef
2.
go back to reference Kakade, S., Dayan, P.: Dopamine: generalization and bonuses. Neural Netw. 15, 549–559 (2002)CrossRef Kakade, S., Dayan, P.: Dopamine: generalization and bonuses. Neural Netw. 15, 549–559 (2002)CrossRef
3.
go back to reference Cavallaro, S.: Genomic analysis of serotonin receptors in learning and memory. Behav. Brain Res. 195(1), 2–6 (2008)CrossRef Cavallaro, S.: Genomic analysis of serotonin receptors in learning and memory. Behav. Brain Res. 195(1), 2–6 (2008)CrossRef
4.
go back to reference Dayan, P.: Twenty-five lessons from computational neuromodulation. Neuron 76, 240–256 (2012)CrossRef Dayan, P.: Twenty-five lessons from computational neuromodulation. Neuron 76, 240–256 (2012)CrossRef
5.
go back to reference Yu, A.J., Dayan, P.: Uncertainty, neuromodulation, and attention. Neuron 46, 681–692 (2005)CrossRef Yu, A.J., Dayan, P.: Uncertainty, neuromodulation, and attention. Neuron 46, 681–692 (2005)CrossRef
6.
go back to reference Talanov, M., et al.: Simulation of serotonin mechanisms in NEUCOGAR cognitive architecture. Procedia Comput. Sci. 123, 473–478 (2018)CrossRef Talanov, M., et al.: Simulation of serotonin mechanisms in NEUCOGAR cognitive architecture. Procedia Comput. Sci. 123, 473–478 (2018)CrossRef
7.
go back to reference Takahashi, Y.K., Langdon, A.J., Niv, Y., Schoenbaum, G.: Temporal specificity of reward prediction errors signaled by putative dopamine neurons in rat VTA depends on ventral striatum. Neuron 91, 182–193 (2016)CrossRef Takahashi, Y.K., Langdon, A.J., Niv, Y., Schoenbaum, G.: Temporal specificity of reward prediction errors signaled by putative dopamine neurons in rat VTA depends on ventral striatum. Neuron 91, 182–193 (2016)CrossRef
8.
go back to reference Lau, B., Monteiro, T., Paton, J.J.: The many worlds hypothesis of dopamine prediction error: implications of a parallel circuit architecture in the basal ganglia. Curr. Opin. Neurobiol. 46, 241–247 (2017)CrossRef Lau, B., Monteiro, T., Paton, J.J.: The many worlds hypothesis of dopamine prediction error: implications of a parallel circuit architecture in the basal ganglia. Curr. Opin. Neurobiol. 46, 241–247 (2017)CrossRef
9.
go back to reference Okon-Singer, H.: The role of attention bias to threat in anxiety: mechanisms, modulators and open questions. Curr. Opin. Behav. Sci. 19, 26–30 (2018)CrossRef Okon-Singer, H.: The role of attention bias to threat in anxiety: mechanisms, modulators and open questions. Curr. Opin. Behav. Sci. 19, 26–30 (2018)CrossRef
10.
go back to reference Payzan-LeNestour, E., Dunne, S., Bossaerts, P., ODoherty, J.P.: The neural representation of unexpected uncertainty during value-based decision making. Neuron 79, 191–201 (2013)CrossRef Payzan-LeNestour, E., Dunne, S., Bossaerts, P., ODoherty, J.P.: The neural representation of unexpected uncertainty during value-based decision making. Neuron 79, 191–201 (2013)CrossRef
11.
go back to reference Wang, D., Chen, J., Liu, L.: How internal neurons represent the short context: an emergent perspective. Prog. Artif. Intell. 6(1), 67–77 (2017)CrossRef Wang, D., Chen, J., Liu, L.: How internal neurons represent the short context: an emergent perspective. Prog. Artif. Intell. 6(1), 67–77 (2017)CrossRef
15.
go back to reference Daly, J., Brown, J., Weng, J.: Neuromorphic motivated systems. In: Proceedings of International Joint Conference on Neural Networks, San Jose, California, USA, 31 July–5 August 2011, pp. 2917–2924 (2011) Daly, J., Brown, J., Weng, J.: Neuromorphic motivated systems. In: Proceedings of International Joint Conference on Neural Networks, San Jose, California, USA, 31 July–5 August 2011, pp. 2917–2924 (2011)
Metadata
Title
Goal-Directed Behavior Control Based on the Mechanism of Neuromodulation
Authors
Dongshu Wang
Hui Shan
Lei Liu
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-00563-4_21

Premium Partner