Skip to main content
Erschienen in: Evolutionary Intelligence 2/2014

01.08.2014 | Special Issue

Simultaneous versus incremental learning of multiple skills by modular robots

verfasst von: C. Rossi, A. E. Eiben

Erschienen in: Evolutionary Intelligence | Ausgabe 2/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper is concerned with the problem of learning multiple skills by modular robots. The main question we address is whether it is better to learn multiple skills simultaneously (all-at-once) or incrementally (one-by-one). We conduct an experimental study with modular robots of various morphologies that need to acquire three different but correlated skills, efficient locomotion, navigation towards a target point, and obstacle avoidance, using a real-time, on-board evolution as the learning method. The results indicate that the one-by-one strategy is more efficient and more stable than the all-at-once strategy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Webots system by Cyberbotics, www.​cyberbotics.​com.
 
2
Early work on such learning strategy for the problem at hand has shown that an individual mutation rate for each gene does not provide an advantage, w.r.t having a common mutation rate for all genes, see [28].
 
3
Recall that the Infancy stage is part of a cycle—the Triangle of Life—where individuals mate sto generate new offspring.
 
Literatur
1.
Zurück zum Zitat Auerbach JE, Bongard JC (2009) How robot morphology and training order affect the learning of multiple behaviors. In: Proceedings of the IEEE congress on evolutionary computation (CEC’2009). IEEE Press, pp 39–46 Auerbach JE, Bongard JC (2009) How robot morphology and training order affect the learning of multiple behaviors. In: Proceedings of the IEEE congress on evolutionary computation (CEC’2009). IEEE Press, pp 39–46
2.
Zurück zum Zitat Auerbach JE, Bongard JC (2012) On the relationship between environmental and mechanical complexity in evolved robots. In: Adami C, Bryson D, Ofria C, Pennock R (eds) Proceedings of artificial life, vol 13. MIT Press, pp 309–316 Auerbach JE, Bongard JC (2012) On the relationship between environmental and mechanical complexity in evolved robots. In: Adami C, Bryson D, Ofria C, Pennock R (eds) Proceedings of artificial life, vol 13. MIT Press, pp 309–316
3.
Zurück zum Zitat Bongard J (2011) Morphological and environmental scaffolding synergize when evolving robot controllers. In: Krasnogor N (ed) Proceedings of the 13th genetic and evolutionary computation conference (GECCO-2011). ACM, pp 179–186 Bongard J (2011) Morphological and environmental scaffolding synergize when evolving robot controllers. In: Krasnogor N (ed) Proceedings of the 13th genetic and evolutionary computation conference (GECCO-2011). ACM, pp 179–186
4.
Zurück zum Zitat Bongard J, Zykov V, Lipson H (2006) Resilient machines through continuous self-modeling. Science 314(5802):1118–1121CrossRef Bongard J, Zykov V, Lipson H (2006) Resilient machines through continuous self-modeling. Science 314(5802):1118–1121CrossRef
5.
Zurück zum Zitat Bongard JC (2008) Behavior chaining: incremental behavior integration for evolutionary robotics. In: Bullock S, Noble J, Watson R, Bedau M (eds) Proceedings of artificial life XI. MIT Press, pp 64–71 Bongard JC (2008) Behavior chaining: incremental behavior integration for evolutionary robotics. In: Bullock S, Noble J, Watson R, Bedau M (eds) Proceedings of artificial life XI. MIT Press, pp 64–71
6.
Zurück zum Zitat Chavas J, Corne C, Horvai P, Kodjabachian J, Meyer J.-A (1998) Incremental evolution of neural controllers for robust obstacle-avoidance in Khepera. In: Husbands P, Meyer J.-A (eds) Proceedings of the 1st European workshop on Evolutionary Robotics-EvoRobot98. Springer, Berlin, pp 227–247 Chavas J, Corne C, Horvai P, Kodjabachian J, Meyer J.-A (1998) Incremental evolution of neural controllers for robust obstacle-avoidance in Khepera. In: Husbands P, Meyer J.-A (eds) Proceedings of the 1st European workshop on Evolutionary Robotics-EvoRobot98. Springer, Berlin, pp 227–247
7.
Zurück zum Zitat Christensen DJ, Larsen JC, Støy K (2013) Fault-tolerant gait learning and morphology optimization of a polymorphic walking robot. Evol Syst (to appear). doi:10.1007/s12530-013-9088-3 Christensen DJ, Larsen JC, Støy K (2013) Fault-tolerant gait learning and morphology optimization of a polymorphic walking robot. Evol Syst (to appear). doi:10.​1007/​s12530-013-9088-3
8.
Zurück zum Zitat Christensen DJ, Schultz UP, Støy K (2013) A distributed and morphology-independent strategy for adaptive locomotion in self-reconfigurable modular robots. Robotics Auton Syst 61(9):1021–1035CrossRef Christensen DJ, Schultz UP, Støy K (2013) A distributed and morphology-independent strategy for adaptive locomotion in self-reconfigurable modular robots. Robotics Auton Syst 61(9):1021–1035CrossRef
9.
Zurück zum Zitat Clune J, Beckmann BE, Ofria C, Pennock RT (2009) Evolving coordinated quadruped gaits with the HyperNEAT generative encoding. In: IEEE congress on evolutionary computation (CEC) 2009. IEEE Press, pp 2764–2771 Clune J, Beckmann BE, Ofria C, Pennock RT (2009) Evolving coordinated quadruped gaits with the HyperNEAT generative encoding. In: IEEE congress on evolutionary computation (CEC) 2009. IEEE Press, pp 2764–2771
10.
Zurück zum Zitat Colorado J, Barrientos A, Rossi C, Garzón M, Galán M, del Cerro J (2010) Efficient locomotion on non-wheeled snake-like robots. In: Filipe J, Andrade-Cetto J, Ferrier JL (eds) ICINCO (2). INSTICC Press, pp 246–251 Colorado J, Barrientos A, Rossi C, Garzón M, Galán M, del Cerro J (2010) Efficient locomotion on non-wheeled snake-like robots. In: Filipe J, Andrade-Cetto J, Ferrier JL (eds) ICINCO (2). INSTICC Press, pp 246–251
11.
Zurück zum Zitat D’Angelo M, Weel B, Eiben A (2013) Online gait learning for modular robots with arbitrary shapes and sizes. In: Dediu AH, Martín-Vide C, Truthe B, Vega-Rodríguez MA (eds) Second international conference on the theory and practice of natural computing (TPNC 2013), no. 8273 in LNCS. Springer, Berlin, pp 45–56 D’Angelo M, Weel B, Eiben A (2013) Online gait learning for modular robots with arbitrary shapes and sizes. In: Dediu AH, Martín-Vide C, Truthe B, Vega-Rodríguez MA (eds) Second international conference on the theory and practice of natural computing (TPNC 2013), no. 8273 in LNCS. Springer, Berlin, pp 45–56
12.
Zurück zum Zitat Dorigo M, Colombetti M (1994) Robot shaping: developing autonomous agents through learning. Artif Intell 2:321–370CrossRef Dorigo M, Colombetti M (1994) Robot shaping: developing autonomous agents through learning. Artif Intell 2:321–370CrossRef
13.
Zurück zum Zitat Eiben AE, Bredeche N, Hoogendoorn M, Stradner J, Timmis J, Tyrrell A, Winfield A (2013) The triangle of life: evolving robots in real-time and real-space. In: Lió P, Miglino O, Nicosia G, Nolfi S, Pavone M (eds) Advances in artificial life, (ECAL) 2013. MIT Press, pp 1056–1063 Eiben AE, Bredeche N, Hoogendoorn M, Stradner J, Timmis J, Tyrrell A, Winfield A (2013) The triangle of life: evolving robots in real-time and real-space. In: Lió P, Miglino O, Nicosia G, Nolfi S, Pavone M (eds) Advances in artificial life, (ECAL) 2013. MIT Press, pp 1056–1063
14.
Zurück zum Zitat Eiben AE, Kernbach S, Haasdijk E (2012) Embodied artificial evolution. Evol Intell 5(4):261–272CrossRef Eiben AE, Kernbach S, Haasdijk E (2012) Embodied artificial evolution. Evol Intell 5(4):261–272CrossRef
15.
Zurück zum Zitat Filliat D, Kodjabachian J, Meyer JA (1999) Evolution of neural controllers for locomotion and obstacle-avoidance in a 6-legged robot. Connect Sci 11(3–4):223–240 Filliat D, Kodjabachian J, Meyer JA (1999) Evolution of neural controllers for locomotion and obstacle-avoidance in a 6-legged robot. Connect Sci 11(3–4):223–240
16.
Zurück zum Zitat Haasdijk E, Rusu AA, Eiben AE (2010) HyperNEAT for locomotion control in modular robots. In: Hornby GS, Sekanina L, Haddow PC (eds) Evolvable systems: from biology to hardware, lecture notes in computer science, vol 5216. Springer, Berlin, pp 169–180 Haasdijk E, Rusu AA, Eiben AE (2010) HyperNEAT for locomotion control in modular robots. In: Hornby GS, Sekanina L, Haddow PC (eds) Evolvable systems: from biology to hardware, lecture notes in computer science, vol 5216. Springer, Berlin, pp 169–180
17.
Zurück zum Zitat Hamann H, Stradner J, Schmickl T, Crailsheim K (2010) A hormone-based controller for evolutionary multi-modular robotics: from single modules to gait learning. In: IEEE congress on evolutionary computation (CEC) 2010. IEEE Press, pp 1–8 Hamann H, Stradner J, Schmickl T, Crailsheim K (2010) A hormone-based controller for evolutionary multi-modular robotics: from single modules to gait learning. In: IEEE congress on evolutionary computation (CEC) 2010. IEEE Press, pp 1–8
18.
Zurück zum Zitat Ijspeert AJ (2008) Central pattern generators for locomotion control in animals and robots: a review. Neural Netw 21(4):642–653CrossRef Ijspeert AJ (2008) Central pattern generators for locomotion control in animals and robots: a review. Neural Netw 21(4):642–653CrossRef
19.
Zurück zum Zitat Kamimura A, Kurokawa H, Yoshida E, Murata S, Tomita K, Kokaji S (2005) Automatic locomotion design and experiments for a modular robotic system. IEEE/ASME Trans Mechatron 10(3):314–325CrossRef Kamimura A, Kurokawa H, Yoshida E, Murata S, Tomita K, Kokaji S (2005) Automatic locomotion design and experiments for a modular robotic system. IEEE/ASME Trans Mechatron 10(3):314–325CrossRef
20.
Zurück zum Zitat Kamimura A, Kurokawa H, Yoshida E, Tomita K, Kokaji S, Murata S (2004) Distributed adaptive locomotion by a modular robotic system, M-TRAN II. In: Proceedings of 2004 IEEE/RSJ international conference on intelligent robots and systems (IROS) 2004, vol 3. IEEE Press, pp 2370–2377 Kamimura A, Kurokawa H, Yoshida E, Tomita K, Kokaji S, Murata S (2004) Distributed adaptive locomotion by a modular robotic system, M-TRAN II. In: Proceedings of 2004 IEEE/RSJ international conference on intelligent robots and systems (IROS) 2004, vol 3. IEEE Press, pp 2370–2377
21.
Zurück zum Zitat Lessin D, Fussel D, Miikkulainen R (2013) Open-ended behavioral complexity for evolved virtual creatures. In: Proceedings of the fifteenth annual conference on genetic and evolutionary computation conference (GECCO-2013). ACM, pp 335–342 Lessin D, Fussel D, Miikkulainen R (2013) Open-ended behavioral complexity for evolved virtual creatures. In: Proceedings of the fifteenth annual conference on genetic and evolutionary computation conference (GECCO-2013). ACM, pp 335–342
22.
Zurück zum Zitat Pfeifer R, Bongard JC (2007) How the body shapes the way we think. A new view of intelligence. MIT Press, Cambridge Pfeifer R, Bongard JC (2007) How the body shapes the way we think. A new view of intelligence. MIT Press, Cambridge
23.
Zurück zum Zitat Shen H, Yosinski J, Kormushev P, Caldwell DG, Lipson H (2012) Learning fast quadruped robot gaits with the RL PoWER spline parameterization. Cybern Inf Technol 12(3):66–75 Shen H, Yosinski J, Kormushev P, Caldwell DG, Lipson H (2012) Learning fast quadruped robot gaits with the RL PoWER spline parameterization. Cybern Inf Technol 12(3):66–75
24.
Zurück zum Zitat Shen WM, Salemi B, Will P (2000) Hormones for self-reconfigurable robots. In: Pagello E, Groen F, Arai T, Dillman R, Stentz A (eds) Proceedings of the 6th international conference on intelligent autonomous systems (IAS-6). IOS Press, pp 918–925 Shen WM, Salemi B, Will P (2000) Hormones for self-reconfigurable robots. In: Pagello E, Groen F, Arai T, Dillman R, Stentz A (eds) Proceedings of the 6th international conference on intelligent autonomous systems (IAS-6). IOS Press, pp 918–925
25.
Zurück zum Zitat Spröwitz A, Moeckel R, Maye J, Ijspeert AJ (2008) Learning to move in modular robots using central pattern generators and online optimization. Int J Robot Res 27(3–4):423–443CrossRef Spröwitz A, Moeckel R, Maye J, Ijspeert AJ (2008) Learning to move in modular robots using central pattern generators and online optimization. Int J Robot Res 27(3–4):423–443CrossRef
26.
Zurück zum Zitat Stone P (2000) Layered learning in multiagent systems: a winning approach to robotic soccer. MIT Press, Cambridge Stone P (2000) Layered learning in multiagent systems: a winning approach to robotic soccer. MIT Press, Cambridge
27.
Zurück zum Zitat Suarez DM, Rossi C (2014) Evolutionary learning of basic functionalities for snake-like robots. In: Armada MA, Sanfeliu A, Ferre M (eds) ROBOT2013: first iberian robotics conference, advances in intelligent systems and computing, vol 252. Springer, Berlin, pp 391–406 Suarez DM, Rossi C (2014) Evolutionary learning of basic functionalities for snake-like robots. In: Armada MA, Sanfeliu A, Ferre M (eds) ROBOT2013: first iberian robotics conference, advances in intelligent systems and computing, vol 252. Springer, Berlin, pp 391–406
28.
Zurück zum Zitat Suarez DPM, Rossi C (2013) A comparison between different encoding strategies for snake-like robot controllers. In: Proceedings of the EvoStar 2013, lecture notes in computer science 7835, pp 560–568 Suarez DPM, Rossi C (2013) A comparison between different encoding strategies for snake-like robot controllers. In: Proceedings of the EvoStar 2013, lecture notes in computer science 7835, pp 560–568
29.
Zurück zum Zitat Wood D, Bruner J, Ross G (1976) The role of tutoring in problem solving. J Child Psychol Psychiatry 17(2):89–100CrossRef Wood D, Bruner J, Ross G (1976) The role of tutoring in problem solving. J Child Psychol Psychiatry 17(2):89–100CrossRef
30.
Zurück zum Zitat Yim M (1993) A reconfigurable modular robot with many modes of locomotion. In: Proceedings of international conference on advanced mechatronics. Japan Society of Mechanical Engineers, Tokio, Japan, pp 283–288 Yim M (1993) A reconfigurable modular robot with many modes of locomotion. In: Proceedings of international conference on advanced mechatronics. Japan Society of Mechanical Engineers, Tokio, Japan, pp 283–288
31.
Zurück zum Zitat Yosinski J, Clune J, Hidalgo D, Nguyen S, Zagal J, Lipson H (2011) Evolving robot gaits in hardware: the HyperNEAT generative encoding vs. parameter optimization. In: Lenaerts T, Giacobini M, Bersini H, Bourgine P, Dorigo M, Doursat R (eds) Advances in artificial life (ECAL) 2011. MIT Press, pp 890–897 Yosinski J, Clune J, Hidalgo D, Nguyen S, Zagal J, Lipson H (2011) Evolving robot gaits in hardware: the HyperNEAT generative encoding vs. parameter optimization. In: Lenaerts T, Giacobini M, Bersini H, Bourgine P, Dorigo M, Doursat R (eds) Advances in artificial life (ECAL) 2011. MIT Press, pp 890–897
Metadaten
Titel
Simultaneous versus incremental learning of multiple skills by modular robots
verfasst von
C. Rossi
A. E. Eiben
Publikationsdatum
01.08.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Evolutionary Intelligence / Ausgabe 2/2014
Print ISSN: 1864-5909
Elektronische ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-014-0109-3

Weitere Artikel der Ausgabe 2/2014

Evolutionary Intelligence 2/2014 Zur Ausgabe