Skip to main content

2016 | OriginalPaper | Buchkapitel

Autonomous Learning Needs a Second Environmental Feedback Loop

verfasst von : Hazem Toutounji, Frank Pasemann

Erschienen in: Computational Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Deriving a successful neural control of behavior of autonomous and embodied systems poses a great challenge. The difficulty lies in finding suitable learning mechanisms, and in specifying under what conditions learning becomes necessary. Here, we provide a solution to the second issue in the form of an additional feedback loop that augments the sensorimotor loop in which autonomous systems live. The second feedback loop provides proprioceptive signals, allowing the assessment of behavior through self-monitoring, and accordingly, the control of learning. We show how the behaviors can be defined with the aid of this framework, and we show that, in combination with simple stochastic plasticity mechanisms, behaviors are successfully learned.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Dean, J.: Animats and what they can tell us. Trends Cogn. Sci. 2(2), 60–67 (1998) CrossRef Dean, J.: Animats and what they can tell us. Trends Cogn. Sci. 2(2), 60–67 (1998) CrossRef
2.
Zurück zum Zitat Meyer, J.A.: The animat approach to cognitive science. In: Roitblat, H. Meyer, J.A. (eds.) Comparative Approaches to Cognitive Science, pp. 27–44. The MIT Press/Bradford Books (1995) Meyer, J.A.: The animat approach to cognitive science. In: Roitblat, H. Meyer, J.A. (eds.) Comparative Approaches to Cognitive Science, pp. 27–44. The MIT Press/Bradford Books (1995)
3.
Zurück zum Zitat Meyer, J.A., Guillot, A.: Biologically inspired robots. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 1395–1422. Springer (2008) Meyer, J.A., Guillot, A.: Biologically inspired robots. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 1395–1422. Springer (2008)
4.
Zurück zum Zitat Pfeifer, R., Bongard, J.: How the body shapes the way we think: a new view of intelligence. MIT press (2007) Pfeifer, R., Bongard, J.: How the body shapes the way we think: a new view of intelligence. MIT press (2007)
5.
Zurück zum Zitat Ross Ashby, W.: Design for a brain: the origin of adaptive behavior (2nd edn). Chapman and Hall, London UK (1960) Ross Ashby, W.: Design for a brain: the origin of adaptive behavior (2nd edn). Chapman and Hall, London UK (1960)
6.
Zurück zum Zitat Di Paolo, E.A.: Organismically-inspired robotics: homeostatic adaptation and teleology beyond the closed sensorimotor loop. In: Murase, K., Asakura, T. (eds.) Dynamical Systems Approach to Embodiment and Sociality, pp. 19–42. Advanced Knowledge International, Adelaide, Australia (2003) Di Paolo, E.A.: Organismically-inspired robotics: homeostatic adaptation and teleology beyond the closed sensorimotor loop. In: Murase, K., Asakura, T. (eds.) Dynamical Systems Approach to Embodiment and Sociality, pp. 19–42. Advanced Knowledge International, Adelaide, Australia (2003)
7.
Zurück zum Zitat Ziemke, Tom: The embodied self: theories, hunches and robot models. J. Conscious. Stud. 14(7), 167–179 (2007) Ziemke, Tom: The embodied self: theories, hunches and robot models. J. Conscious. Stud. 14(7), 167–179 (2007)
8.
Zurück zum Zitat Ikegami, T., Suzuki, K.: From a homeostatic to a homeodynamic self. BioSystems 91(2), 388–400 (2008) CrossRef Ikegami, T., Suzuki, K.: From a homeostatic to a homeodynamic self. BioSystems 91(2), 388–400 (2008) CrossRef
9.
Zurück zum Zitat Der, R.: Artificial life from the principle of homeokinesis. In: Proceedings of the German Workshop on Artificial Life (2008) Der, R.: Artificial life from the principle of homeokinesis. In: Proceedings of the German Workshop on Artificial Life (2008)
10.
Zurück zum Zitat Hebb. D.O.: The Organization of Behavior. Wiley, New York (1949) Hebb. D.O.: The Organization of Behavior. Wiley, New York (1949)
11.
Zurück zum Zitat Cooper, L.N., Intrator, N., Blais, B.S., Shouval, H.Z.: Theory of Cortical Plasticity. World Scientific (2004) Cooper, L.N., Intrator, N., Blais, B.S., Shouval, H.Z.: Theory of Cortical Plasticity. World Scientific (2004)
12.
Zurück zum Zitat Turrigiano, G.G., Nelson, S.B.: Homeostatic plasticity in the developing nervous system. Nat. Rev. Neurosci. 5(2), 97–107 (2004) CrossRef Turrigiano, G.G., Nelson, S.B.: Homeostatic plasticity in the developing nervous system. Nat. Rev. Neurosci. 5(2), 97–107 (2004) CrossRef
13.
Zurück zum Zitat Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(9), 533–536 (1986) CrossRef Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(9), 533–536 (1986) CrossRef
14.
Zurück zum Zitat Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA 79(8), 2554–2558 (1982) MathSciNetCrossRef Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA 79(8), 2554–2558 (1982) MathSciNetCrossRef
15.
Zurück zum Zitat Jennings, H.S.: Contributions to the study of the behavior of lower organisms. Number 16, Carnegie institution of Washington (1904) Jennings, H.S.: Contributions to the study of the behavior of lower organisms. Number 16, Carnegie institution of Washington (1904)
16.
Zurück zum Zitat Smith, T., Husbands, P., Philippides, A., O’Shea, M.: Neuronal plasticity and temporal adaptivity: Gasnet robot control networks. Adapt. Behav. 10(3–4), 161–183 (2002) CrossRef Smith, T., Husbands, P., Philippides, A., O’Shea, M.: Neuronal plasticity and temporal adaptivity: Gasnet robot control networks. Adapt. Behav. 10(3–4), 161–183 (2002) CrossRef
17.
Zurück zum Zitat Timmis, J., Neal, M., Thorniley, J.: An adaptive neuro-endocrine system for robotic systems. In: Proceedings of the IEEE Workshop on Robotic Intelligence in Informationally Structured Space, RIISS’09, pp. 129–136 (2009) Timmis, J., Neal, M., Thorniley, J.: An adaptive neuro-endocrine system for robotic systems. In: Proceedings of the IEEE Workshop on Robotic Intelligence in Informationally Structured Space, RIISS’09, pp. 129–136 (2009)
18.
Zurück zum Zitat Moioli, R.C., Vargas, P.A., Husbands, P.: A multiple hormone approach to the homeostatic control of conflicting behaviours in an autonomous mobile robot. In: Proceedings of IEEE Congress on Evolutionary Computation, CEC’09, pp. 47–54 (2009) Moioli, R.C., Vargas, P.A., Husbands, P.: A multiple hormone approach to the homeostatic control of conflicting behaviours in an autonomous mobile robot. In: Proceedings of IEEE Congress on Evolutionary Computation, CEC’09, pp. 47–54 (2009)
19.
Zurück zum Zitat Rempis, C., Thomas, V., Bachmann, F., Pasemann, F.: NERD—Neurodynamics and Evolutionary Robotics Development Kit. In: Simulation, Modeling, and Programming for Autonomous Robots, pp. 121–132. Springer (2010) Rempis, C., Thomas, V., Bachmann, F., Pasemann, F.: NERD—Neurodynamics and Evolutionary Robotics Development Kit. In: Simulation, Modeling, and Programming for Autonomous Robots, pp. 121–132. Springer (2010)
Metadaten
Titel
Autonomous Learning Needs a Second Environmental Feedback Loop
verfasst von
Hazem Toutounji
Frank Pasemann
Copyright-Jahr
2016
Verlag
Springer International Publishing
DOI
https://doi.org/10.1007/978-3-319-23392-5_25