Skip to main content
Erschienen in: Artificial Life and Robotics 1/2021

09.08.2020 | Original Article

An adaptive behavior decision model of mobile robot based on the neuromodulation

verfasst von: Dongshu Wang, Kai Yang, Lei Liu

Erschienen in: Artificial Life and Robotics | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

How to effectively improve the behavior decision ability in unknown environment is a great challenge for mobile robots. Traditional methods suffer from the low efficiency and large computation load. Motivated by the regulation effect of serotonin and dopamine on human behavior, a novel adaptive behavior decision model for mobile robot is proposed in this work. This model integrates two kinds of adjustment factors that mimic the effects of two neuromodulators, serotonin and dopamine, to regulate the behavior decision of a mobile robot in unknown environment. Adjustment factor \(\mathbf {p}\) is designed to simulate the function of the serotonin and make the robot avoid obstacles effectively, while the adjustment factor \(\mathbf {r}\) is designed to simulate the function of the dopamine and make the robot approach the target quickly. Both of the adjustment functions can be adaptively regulated with the robot’s movement. Static and dynamic simulation results show that this neuromodulatory model has excellent collision avoidance capacity which can avoid the obstacles fluently, and the trajectory obtained tends to be optimal. Moreover, it is relatively simple, thus can effectively reduce the computation time and the load capacity, and greatly improve the running efficiency of the mobile robot in unknown environment.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ahmed SA, Opalov AV, Shakev NG, Popov VL (2018) Model-free detection and following of moving objects by an omnidirectional mobile robot using 2d range data. IFAC-Papers OnLine 51(22):226–231CrossRef Ahmed SA, Opalov AV, Shakev NG, Popov VL (2018) Model-free detection and following of moving objects by an omnidirectional mobile robot using 2d range data. IFAC-Papers OnLine 51(22):226–231CrossRef
2.
Zurück zum Zitat Asher DE, Craig AB, Andrew Z et al (2013) A dynamic, embodied paradigm to investigate the role of serotonin in decision-making. Front Integr Neurosci 7:1–6CrossRef Asher DE, Craig AB, Andrew Z et al (2013) A dynamic, embodied paradigm to investigate the role of serotonin in decision-making. Front Integr Neurosci 7:1–6CrossRef
3.
Zurück zum Zitat Aston-Jones G, Cohen J (2005) An integrative theory of locus coeruleus-norepine- phrine function: Adaptive gain and optimal performance. Annu Rev Neurosci 28:403–450CrossRef Aston-Jones G, Cohen J (2005) An integrative theory of locus coeruleus-norepine- phrine function: Adaptive gain and optimal performance. Annu Rev Neurosci 28:403–450CrossRef
4.
Zurück zum Zitat Boureau Y, Dayan P (2011) Opponency revisited: competition and cooperation between dopamine and serotonin. Neuro-psychopharmacology 36(1):74–97CrossRef Boureau Y, Dayan P (2011) Opponency revisited: competition and cooperation between dopamine and serotonin. Neuro-psychopharmacology 36(1):74–97CrossRef
5.
Zurück zum Zitat Carlucho I, Paula MD, Acosta GG (2019) Double q-pid algorithm for mobile robot control. Expert Syst Appl 137:292–307CrossRef Carlucho I, Paula MD, Acosta GG (2019) Double q-pid algorithm for mobile robot control. Expert Syst Appl 137:292–307CrossRef
6.
Zurück zum Zitat Cools R, Roberts A, Robbins T (2008) erotoninergic regulation of emotional and behavioral control processes. Trends Cogn Sci 12(1):1–40CrossRef Cools R, Roberts A, Robbins T (2008) erotoninergic regulation of emotional and behavioral control processes. Trends Cogn Sci 12(1):1–40CrossRef
7.
Zurück zum Zitat Corbetta M, Patel G, Shulman G (2008) The reorienting system of the human brain: from environment to theory of mind. Neuron 58:306–324CrossRef Corbetta M, Patel G, Shulman G (2008) The reorienting system of the human brain: from environment to theory of mind. Neuron 58:306–324CrossRef
8.
Zurück zum Zitat Cox BR, Krichmar JL (2009) Neuromodulation as a robot controller, a brain-inspired strategy for controlling autonomous robots. IEEE Robot Autom Mag 16(9):72–80CrossRef Cox BR, Krichmar JL (2009) Neuromodulation as a robot controller, a brain-inspired strategy for controlling autonomous robots. IEEE Robot Autom Mag 16(9):72–80CrossRef
9.
Zurück zum Zitat Crockett M, Siegel J, Kurth-Nelson Z et al (2015) Dissociable effects of serotonin and dopamine on the valuation of harm in moral decision making. Curr Biol 25(14):1852–1859CrossRef Crockett M, Siegel J, Kurth-Nelson Z et al (2015) Dissociable effects of serotonin and dopamine on the valuation of harm in moral decision making. Curr Biol 25(14):1852–1859CrossRef
10.
Zurück zum Zitat Crockett MJ, Apergis-Schoute A, Herrmann B, Lieberman M, Muller U, Robbins TW, Clark L (2013) Serotonin modulates striatal responses to fairness and retaliation in humans. J Neurosci 33(8):3505–3513CrossRef Crockett MJ, Apergis-Schoute A, Herrmann B, Lieberman M, Muller U, Robbins TW, Clark L (2013) Serotonin modulates striatal responses to fairness and retaliation in humans. J Neurosci 33(8):3505–3513CrossRef
11.
Zurück zum Zitat Dasgupta S, Worgotter F, Manoonpong P (2014) Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control. Front Neural Circ 8:1–21 Dasgupta S, Worgotter F, Manoonpong P (2014) Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control. Front Neural Circ 8:1–21
12.
Zurück zum Zitat Ehrlich K, Cheng G (2019) A feasibility study for validating robot actions using eeg-based error-related potentials. Int J Soc Robot 11:271–283CrossRef Ehrlich K, Cheng G (2019) A feasibility study for validating robot actions using eeg-based error-related potentials. Int J Soc Robot 11:271–283CrossRef
13.
Zurück zum Zitat Fang L, Gao F (2018) Type design and behavior control for six legged robots. Chin J Mech Eng 31:1–12CrossRef Fang L, Gao F (2018) Type design and behavior control for six legged robots. Chin J Mech Eng 31:1–12CrossRef
14.
Zurück zum Zitat Kakade S, Dayan P (2002) Dopamine: generalization and bonuses. Neural Netw 15:549–559CrossRef Kakade S, Dayan P (2002) Dopamine: generalization and bonuses. Neural Netw 15:549–559CrossRef
15.
Zurück zum Zitat Kattner F, Cochrane A, Cox CR, Gorman TE, Green CS (2017) Perceptual learning generalization from sequential perceptual training as a change in learning rate. Curr Biol 27:840–846CrossRef Kattner F, Cochrane A, Cox CR, Gorman TE, Green CS (2017) Perceptual learning generalization from sequential perceptual training as a change in learning rate. Curr Biol 27:840–846CrossRef
16.
Zurück zum Zitat Krichmar JL (2012) A biologically inspired action selection algorithm based on principles of neuromodulation. In: Proceedings of the WCCI 2012 IEEE World Congress on Computational Intelligence, pp 1–8 Krichmar JL (2012) A biologically inspired action selection algorithm based on principles of neuromodulation. In: Proceedings of the WCCI 2012 IEEE World Congress on Computational Intelligence, pp 1–8
17.
Zurück zum Zitat Krichmar JL (2013) A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior. Front Neurorobot 7:1–17 Krichmar JL (2013) A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior. Front Neurorobot 7:1–17
18.
Zurück zum Zitat Law CT, Gold JI (2008) Neural correlates of perceptual learning in a sensory motor, but not a sensory, cortical area. Nat Neurosci 11(4):505–513CrossRef Law CT, Gold JI (2008) Neural correlates of perceptual learning in a sensory motor, but not a sensory, cortical area. Nat Neurosci 11(4):505–513CrossRef
19.
Zurück zum Zitat Meneses A, Perez-Garcia G (2007) 5-ht1a receptors and memory. Neurosci Biobehav Rev 31(5):705–727CrossRef Meneses A, Perez-Garcia G (2007) 5-ht1a receptors and memory. Neurosci Biobehav Rev 31(5):705–727CrossRef
20.
Zurück zum Zitat Merrick KE (2010) A comparative study of value systems for self-motivated exploration and learning by robots. IEEE Trans Auton Ment Dev 2:119–131CrossRef Merrick KE (2010) A comparative study of value systems for self-motivated exploration and learning by robots. IEEE Trans Auton Ment Dev 2:119–131CrossRef
21.
Zurück zum Zitat Mirus F, Axenie C, Stewart TC, Conradt J (2018) Neuromorphic sensorimotor adaptation for robotic mobile manipulation: From sensing to behaviour. Cogn Syst Res 50:52–66CrossRef Mirus F, Axenie C, Stewart TC, Conradt J (2018) Neuromorphic sensorimotor adaptation for robotic mobile manipulation: From sensing to behaviour. Cogn Syst Res 50:52–66CrossRef
22.
Zurück zum Zitat Mohanta JC, Anupam K (2019) A knowledge based fuzzy-probabilistic roadmap method for mobile robot navigation. Appl Soft Comput 79:391–409CrossRef Mohanta JC, Anupam K (2019) A knowledge based fuzzy-probabilistic roadmap method for mobile robot navigation. Appl Soft Comput 79:391–409CrossRef
23.
Zurück zum Zitat Patle BK, Parhi DRK, Jagadeesh A, Kashyap SK (2019) Application of probability to enhance the performance of fuzzy based mobile robot navigation. Appl Soft Comput 75:265–283CrossRef Patle BK, Parhi DRK, Jagadeesh A, Kashyap SK (2019) Application of probability to enhance the performance of fuzzy based mobile robot navigation. Appl Soft Comput 75:265–283CrossRef
24.
Zurück zum Zitat Popov VL, Ahmed SA, Topalov AV, Shakev NG (2018) Development of mobile robot target recognition and following behaviour using deep convolutional neural network and 2d range data. IFAC-Papers OnLine 51(30):210–215CrossRef Popov VL, Ahmed SA, Topalov AV, Shakev NG (2018) Development of mobile robot target recognition and following behaviour using deep convolutional neural network and 2d range data. IFAC-Papers OnLine 51(30):210–215CrossRef
25.
Zurück zum Zitat Ramos K, Stanley M (2018) Anxiety disorders in late life. Psychiatr Clin N Am 41(1):55–64CrossRef Ramos K, Stanley M (2018) Anxiety disorders in late life. Psychiatr Clin N Am 41(1):55–64CrossRef
26.
Zurück zum Zitat Seo C, Guru A, Jin M, Ito B, Sleezer B, Ho Y, Wang E, Boada C, Krupa N, Kullakanda D, Shen C, Warden M (2019) Intense threat switches dorsal raphe serotonin neurons to a paradoxical operational mode. Science 363(6426):538–542CrossRef Seo C, Guru A, Jin M, Ito B, Sleezer B, Ho Y, Wang E, Boada C, Krupa N, Kullakanda D, Shen C, Warden M (2019) Intense threat switches dorsal raphe serotonin neurons to a paradoxical operational mode. Science 363(6426):538–542CrossRef
27.
Zurück zum Zitat Wang D, Duan Y, Weng J (2018) Motivated optimal developmental learning for sequential tasks without using rigid time discounts. IEEE Trans Neural Netw Learn Syst 29(10):4917–4931CrossRef Wang D, Duan Y, Weng J (2018) Motivated optimal developmental learning for sequential tasks without using rigid time discounts. IEEE Trans Neural Netw Learn Syst 29(10):4917–4931CrossRef
28.
Zurück zum Zitat Wang D, Hu Y, Ma T (2020) Mobile robot navigation with the combination of supervised learning in cerebellum and reward-based learning in basal ganglia. Cogn Syst Res 59:1–14CrossRef Wang D, Hu Y, Ma T (2020) Mobile robot navigation with the combination of supervised learning in cerebellum and reward-based learning in basal ganglia. Cogn Syst Res 59:1–14CrossRef
29.
Zurück zum Zitat Wang D, Si W, Luo Y, Wang H, Ma T (2019) Goal-directed autonomous navigation of mobile robot based on the principle of neuromodulation. Netw Comput Neural Syst 30(1–4):79–106CrossRef Wang D, Si W, Luo Y, Wang H, Ma T (2019) Goal-directed autonomous navigation of mobile robot based on the principle of neuromodulation. Netw Comput Neural Syst 30(1–4):79–106CrossRef
30.
Zurück zum Zitat Wen S, Chen X, Ma C (2015) The q-learning obstacle avoidance algorithm based on ekf-slam for nao autonomous walking under unknown environments. Robot Autonom Syst 72:29–36CrossRef Wen S, Chen X, Ma C (2015) The q-learning obstacle avoidance algorithm based on ekf-slam for nao autonomous walking under unknown environments. Robot Autonom Syst 72:29–36CrossRef
31.
Zurück zum Zitat Xie X, Yu C (2018) Double training downshifts the threshold vs. noise contrast (tvc) functions with perceptual learning and transfer. Vis Res 152:3–9CrossRef Xie X, Yu C (2018) Double training downshifts the threshold vs. noise contrast (tvc) functions with perceptual learning and transfer. Vis Res 152:3–9CrossRef
32.
Zurück zum Zitat Xu L (2018) Fault-tolerant iterative learning control for mobile robots non-repetitive trajectory tracking with output constraints. Automatica 94:63–71MathSciNetCrossRef Xu L (2018) Fault-tolerant iterative learning control for mobile robots non-repetitive trajectory tracking with output constraints. Automatica 94:63–71MathSciNetCrossRef
33.
Zurück zum Zitat Zhao P, Yuan J, Wang H, Mi T (2019) Research on autonomous decision-making method of plume tracking robot based on decision tree. Comput Eng Appl 55(14):254–259 Zhao P, Yuan J, Wang H, Mi T (2019) Research on autonomous decision-making method of plume tracking robot based on decision tree. Comput Eng Appl 55(14):254–259
Metadaten
Titel
An adaptive behavior decision model of mobile robot based on the neuromodulation
verfasst von
Dongshu Wang
Kai Yang
Lei Liu
Publikationsdatum
09.08.2020
Verlag
Springer Japan
Erschienen in
Artificial Life and Robotics / Ausgabe 1/2021
Print ISSN: 1433-5298
Elektronische ISSN: 1614-7456
DOI
https://doi.org/10.1007/s10015-020-00629-z

Weitere Artikel der Ausgabe 1/2021

Artificial Life and Robotics 1/2021 Zur Ausgabe

Neuer Inhalt