Skip to main content

2018 | OriginalPaper | Buchkapitel

Directed Locomotion for Modular Robots with Evolvable Morphologies

verfasst von : Gongjin Lan, Milan Jelisavcic, Diederik M. Roijers, Evert Haasdijk, A. E. Eiben

Erschienen in: Parallel Problem Solving from Nature – PPSN XV

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Morphologically evolving robot systems need to include a learning period right after ‘birth’ to acquire a controller that fits the newly created body. In this paper, we investigate learning one skill in particular: walking in a given direction. To this end, we apply the HyperNEAT algorithm guided by a fitness function that balances the distance travelled in a direction and the deviation between the desired and the actually travelled directions. We validate this method on a variety of modular robots with different shapes and sizes and observe that the best controllers produce trajectories that accurately follow the correct direction and reach a considerable distance in the given test interval.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aoi, S., Manoonpong, P., Ambe, Y., Matsuno, F., Wörgötter, F.: Adaptive control strategies for interlimb coordination in legged robots: a review. Front. Neurorobotics 11, 39 (2017)CrossRef Aoi, S., Manoonpong, P., Ambe, Y., Matsuno, F., Wörgötter, F.: Adaptive control strategies for interlimb coordination in legged robots: a review. Front. Neurorobotics 11, 39 (2017)CrossRef
2.
Zurück zum Zitat Auerbach, J., et al.: RoboGen: robot generation through artificial evolution. In: Sayama, H., Rieffel, J., Risi, S., Doursat, R., Lipson, H. (eds.) Artificial Life 14: Proceedings of the Fourteenth International Conference on the Synthesis and Simulation of Living Systems, pp. 136–137. The MIT Press, New York, July 2014 Auerbach, J., et al.: RoboGen: robot generation through artificial evolution. In: Sayama, H., Rieffel, J., Risi, S., Doursat, R., Lipson, H. (eds.) Artificial Life 14: Proceedings of the Fourteenth International Conference on the Synthesis and Simulation of Living Systems, pp. 136–137. The MIT Press, New York, July 2014
3.
Zurück zum Zitat Auerbach, J.E., Bongard, J.C.: On the relationship between environmental and morphological complexity in evolved robots. In: Proceedings of the 14th Annual Conference on Genetic and Evolutionary Computation, pp. 521–528. GECCO 2012. ACM, New York (2012) Auerbach, J.E., Bongard, J.C.: On the relationship between environmental and morphological complexity in evolved robots. In: Proceedings of the 14th Annual Conference on Genetic and Evolutionary Computation, pp. 521–528. GECCO 2012. ACM, New York (2012)
4.
Zurück zum Zitat Beer, R.D.: The Dynamics of Brain–Body–Environment Systems: A Status Report (2008) Beer, R.D.: The Dynamics of Brain–Body–Environment Systems: A Status Report (2008)
5.
Zurück zum Zitat Bongard, J., Zykov, V., Lipson, H.: Resilient machines through continuous self-modeling. Science 314(5802), 1118–1121 (2006)CrossRef Bongard, J., Zykov, V., Lipson, H.: Resilient machines through continuous self-modeling. Science 314(5802), 1118–1121 (2006)CrossRef
6.
Zurück zum Zitat Bongard, J.C.: Evolutionary robotics. Commun. ACM 56(8), 74–83 (2013)CrossRef Bongard, J.C.: Evolutionary robotics. Commun. ACM 56(8), 74–83 (2013)CrossRef
7.
Zurück zum Zitat Chatterjee, S., et al.: Reinforcement learning approach to generate goal-directed locomotion of a snake-like robot with screw-drive units. In: 2014 23rd International Conference on Robotics in Alpe-Adria-Danube Region (RAAD), pp. 1–7, September 2014 Chatterjee, S., et al.: Reinforcement learning approach to generate goal-directed locomotion of a snake-like robot with screw-drive units. In: 2014 23rd International Conference on Robotics in Alpe-Adria-Danube Region (RAAD), pp. 1–7, September 2014
8.
Zurück zum Zitat Clune, J., Beckmann, B.E., Ofria, C., Pennock, R.T.: Evolving coordinated quadruped gaits with the hyperneat generative encoding. In: 2009 IEEE Congress on Evolutionary Computation, pp. 2764–2771, May 2009 Clune, J., Beckmann, B.E., Ofria, C., Pennock, R.T.: Evolving coordinated quadruped gaits with the hyperneat generative encoding. In: 2009 IEEE Congress on Evolutionary Computation, pp. 2764–2771, May 2009
9.
Zurück zum Zitat Cully, A., Clune, J., Tarapore, D., Mouret, J.B.: Robots that can adapt like animals. Nature 521, 503 (2015)CrossRef Cully, A., Clune, J., Tarapore, D., Mouret, J.B.: Robots that can adapt like animals. Nature 521, 503 (2015)CrossRef
10.
Zurück zum Zitat Doncieux, S., Bredeche, N., Mouret, J.B., Eiben, A.: Evolutionary robotics: what, why, and where to. Front. Robot. AI 2(4) (2015) Doncieux, S., Bredeche, N., Mouret, J.B., Eiben, A.: Evolutionary robotics: what, why, and where to. Front. Robot. AI 2(4) (2015)
11.
Zurück zum Zitat Eiben, A., et al.: The triangle of life: evolving robots in real-time and real-space. In: Liò, P., Miglino, O., Nicosia, G., Nolfi, S., Pavone, M. (eds.) Advances In Artificial Life, ECAL 2013, pp. 1056–1063. MIT Press (2013) Eiben, A., et al.: The triangle of life: evolving robots in real-time and real-space. In: Liò, P., Miglino, O., Nicosia, G., Nolfi, S., Pavone, M. (eds.) Advances In Artificial Life, ECAL 2013, pp. 1056–1063. MIT Press (2013)
12.
Zurück zum Zitat Eiben, A., Kernbach, S., Haasdijk, E.: Embodied artificial evolution. Evol. Intell. 5(4), 261–272 (2012)CrossRef Eiben, A., Kernbach, S., Haasdijk, E.: Embodied artificial evolution. Evol. Intell. 5(4), 261–272 (2012)CrossRef
13.
Zurück zum Zitat Eiben, A., Smith, J.: From evolutionary computation to the evolution of things. Nature 521(7553), 476–482 (2015)CrossRef Eiben, A., Smith, J.: From evolutionary computation to the evolution of things. Nature 521(7553), 476–482 (2015)CrossRef
15.
Zurück zum Zitat Grillner, S., Wallén, P., Saitoh, K., Kozlov, A., Robertson, B.: Neural bases of goal-directed locomotion in vertebrates-an overview. Brain Res. Rev. 57(1), 2–12 (2008)CrossRef Grillner, S., Wallén, P., Saitoh, K., Kozlov, A., Robertson, B.: Neural bases of goal-directed locomotion in vertebrates-an overview. Brain Res. Rev. 57(1), 2–12 (2008)CrossRef
19.
Zurück zum Zitat Ijspeert, A.J.: Central pattern generators for locomotion control in animals and robots: a review. Neural Netw. 21(4), 642–653 (2008). Robotics and NeuroscienceCrossRef Ijspeert, A.J.: Central pattern generators for locomotion control in animals and robots: a review. Neural Netw. 21(4), 642–653 (2008). Robotics and NeuroscienceCrossRef
20.
Zurück zum Zitat Ijspeert, A.J., Crespi, A., Ryczko, D., Cabelguen, J.M.: From swimming to walking with a salamander robot driven by a spinal cord model. Science 315(5817), 1416–1420 (2007)CrossRef Ijspeert, A.J., Crespi, A., Ryczko, D., Cabelguen, J.M.: From swimming to walking with a salamander robot driven by a spinal cord model. Science 315(5817), 1416–1420 (2007)CrossRef
21.
Zurück zum Zitat Jelisavcic, M., et al.: Real-world evolution of robot morphologies: a proof of concept. Artif. Life 23(2), 206–235 (2017)CrossRef Jelisavcic, M., et al.: Real-world evolution of robot morphologies: a proof of concept. Artif. Life 23(2), 206–235 (2017)CrossRef
22.
Zurück zum Zitat Jelisavcic, M., Carlo, M.D., Haasdijk, E., Eiben, A.E.: Improving RL power for on-line evolution of gaits in modular robots. In: 2016 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1–8, December 2016 Jelisavcic, M., Carlo, M.D., Haasdijk, E., Eiben, A.E.: Improving RL power for on-line evolution of gaits in modular robots. In: 2016 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1–8, December 2016
23.
Zurück zum Zitat Jelisavcic, M., Haasdijk, E., Eiben, A.: Acquiring moving skills in robots with evolvable morphologies: recent results and outlook. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, GECCO 2017 (2017) Jelisavcic, M., Haasdijk, E., Eiben, A.: Acquiring moving skills in robots with evolvable morphologies: recent results and outlook. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, GECCO 2017 (2017)
24.
Zurück zum Zitat Kamimura, A., Kurokawa, H., Yoshida, E., Murata, S., Tomita, K., Kokaji, S.: Automatic locomotion design and experiments for a modular robotic system. IEEE/ASME Trans. Mech. 10(3), 314–325 (2005)CrossRef Kamimura, A., Kurokawa, H., Yoshida, E., Murata, S., Tomita, K., Kokaji, S.: Automatic locomotion design and experiments for a modular robotic system. IEEE/ASME Trans. Mech. 10(3), 314–325 (2005)CrossRef
25.
Zurück zum Zitat Kamimura, A., Kurokawa, H., Yoshida, E., Tomita, K., Kokaji, S., Murata, S.: Distributed adaptive locomotion by a modular robotic system, M-TRAN II. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No. 04CH37566), vol. 3, pp. 2370–2377, September 2004 Kamimura, A., Kurokawa, H., Yoshida, E., Tomita, K., Kokaji, S., Murata, S.: Distributed adaptive locomotion by a modular robotic system, M-TRAN II. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No. 04CH37566), vol. 3, pp. 2370–2377, September 2004
26.
Zurück zum Zitat Kohl, N., Stone, P.: Policy gradient reinforcement learning for fast quadrupedal locomotion. In: IEEE International Conference on 2004 Proceedings of Robotics and Automation, ICRA 2004, vol. 3, pp. 2619–2624 (2004) Kohl, N., Stone, P.: Policy gradient reinforcement learning for fast quadrupedal locomotion. In: IEEE International Conference on 2004 Proceedings of Robotics and Automation, ICRA 2004, vol. 3, pp. 2619–2624 (2004)
27.
Zurück zum Zitat Marder, E., Bucher, D.: Central pattern generators and the control of rhythmic movements. Curr. Biol. 11(23), R986–R996 (2001)CrossRef Marder, E., Bucher, D.: Central pattern generators and the control of rhythmic movements. Curr. Biol. 11(23), R986–R996 (2001)CrossRef
28.
Zurück zum Zitat Matos, V., Santos, C.P.: Towards goal-directed biped locomotion: combining CPGs and motion primitives. Robot. Auton. Syst. 62(12), 1669–1690 (2014)CrossRef Matos, V., Santos, C.P.: Towards goal-directed biped locomotion: combining CPGs and motion primitives. Robot. Auton. Syst. 62(12), 1669–1690 (2014)CrossRef
29.
Zurück zum Zitat Paul, S., Chatzilygeroudis, K., Ciosek, K., Mouret, J.B., Osborne, M.A., Whiteson, S.: Alternating optimisation and quadrature for robust control. In: The Thirty-Second AAAI Conference on Artificial Intelligence, AAAI 2018 (2018) Paul, S., Chatzilygeroudis, K., Ciosek, K., Mouret, J.B., Osborne, M.A., Whiteson, S.: Alternating optimisation and quadrature for robust control. In: The Thirty-Second AAAI Conference on Artificial Intelligence, AAAI 2018 (2018)
30.
Zurück zum Zitat Pfeifer, R., Bongard, J.C.: How the Body Shapes the Way We Think: A New View of Intelligence (Bradford Books). The MIT Press, Cambridge (2006) Pfeifer, R., Bongard, J.C.: How the Body Shapes the Way We Think: A New View of Intelligence (Bradford Books). The MIT Press, Cambridge (2006)
31.
Zurück zum Zitat Roijers, D.M., Whiteson, S.: Multi-objective decision making. Synth. Lect. Artif. Intell. Mach. Learn. 11(1), 1–129 (2017)CrossRef Roijers, D.M., Whiteson, S.: Multi-objective decision making. Synth. Lect. Artif. Intell. Mach. Learn. 11(1), 1–129 (2017)CrossRef
32.
Zurück zum Zitat Sproewitz, A., Moeckel, R., Maye, J., Ijspeert, A.J.: Learning to move in modular robots using central pattern generators and online optimization. Int. J. Robot. Res. 27(3–4), 423–443 (2008)CrossRef Sproewitz, A., Moeckel, R., Maye, J., Ijspeert, A.J.: Learning to move in modular robots using central pattern generators and online optimization. Int. J. Robot. Res. 27(3–4), 423–443 (2008)CrossRef
33.
Zurück zum Zitat Stanley, K.O.: Compositional pattern producing networks: a novel abstraction of development. Genet. Program. Evolvable Mach. 8(2), 131–162 (2007)CrossRef Stanley, K.O.: Compositional pattern producing networks: a novel abstraction of development. Genet. Program. Evolvable Mach. 8(2), 131–162 (2007)CrossRef
34.
Zurück zum Zitat Stanley, K.O., Miikkulainen, R.: Evolving neural networks through augmenting topologies. Evol. Comput. 10(2), 99–127 (2002)CrossRef Stanley, K.O., Miikkulainen, R.: Evolving neural networks through augmenting topologies. Evol. Comput. 10(2), 99–127 (2002)CrossRef
35.
Zurück zum Zitat Weel, B., D’Angelo, M., Haasdijk, E., Eiben, A.: Online gait learning for modular robots with arbitrary shapes and sizes. Artif. life 23(1), 80–104 (2017)CrossRef Weel, B., D’Angelo, M., Haasdijk, E., Eiben, A.: Online gait learning for modular robots with arbitrary shapes and sizes. Artif. life 23(1), 80–104 (2017)CrossRef
36.
Zurück zum Zitat Yosinski, J., Clune, J., Hidalgo, D., Nguyen, S., Zagal, J.C., Lipson, H.: Evolving robot gaits in hardware: the hyperneat generative encoding vs. parameter optimization. In: Proceedings of the 20th European Conference on Artificial Life, pp. 890–897 (2011) Yosinski, J., Clune, J., Hidalgo, D., Nguyen, S., Zagal, J.C., Lipson, H.: Evolving robot gaits in hardware: the hyperneat generative encoding vs. parameter optimization. In: Proceedings of the 20th European Conference on Artificial Life, pp. 890–897 (2011)
Metadaten
Titel
Directed Locomotion for Modular Robots with Evolvable Morphologies
verfasst von
Gongjin Lan
Milan Jelisavcic
Diederik M. Roijers
Evert Haasdijk
A. E. Eiben
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-99253-2_38

Premium Partner