Skip to main content
Top

2018 | OriginalPaper | Chapter

Combining MAP-Elites and Incremental Evolution to Generate Gaits for a Mammalian Quadruped Robot

Authors : Jørgen Nordmoen, Kai Olav Ellefsen, Kyrre Glette

Published in: Applications of Evolutionary Computation

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Four-legged mammals are capable of showing a great variety of movement patterns, ranging from a simple walk to more complex movement such as trots and gallops. Imbuing this diversity to quadruped robots is of interest in order to improve both mobility and reach. Within the field of Evolutionary Robotics, Quality Diversity techniques have shown a remarkable ability to produce not only effective, but also highly diverse solutions. When applying this approach to four-legged robots an initial problem is to create viable movement patterns that do not fall. This difficulty stems from the challenging fitness gradient due to the mammalian morphology. In this paper we propose a solution to overcome this problem by implementing incremental evolution within the Quality Diversity framework. This allows us to evolve controllers that become more complex while at the same time utilizing the diversity produced by Quality Diversity. We show that our approach is able to generate high fitness solutions early in the search process, keep these solutions and perform a more open-ended search towards the end of evolution.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wettergreen, D., Thorpe, C.: Gait generation for legged robots. In: IEEE International Conference on Intelligent Robots and Systems (1992) Wettergreen, D., Thorpe, C.: Gait generation for legged robots. In: IEEE International Conference on Intelligent Robots and Systems (1992)
2.
go back to reference Bares, J.E., Whittaker, W.L.: Configuration of autonomous walkers for extreme terrain. Int. J. Robot. Res. 12(6), 535–559 (1993)CrossRef Bares, J.E., Whittaker, W.L.: Configuration of autonomous walkers for extreme terrain. Int. J. Robot. Res. 12(6), 535–559 (1993)CrossRef
3.
go back to reference Hornby, G.S., Takamura, S., Yokono, J., Hanagata, O., Yamamoto, T., Fujita, M.: Evolving robust gaits with AIBO. In: IEEE International Conference on Robotics and Automation, Proceedings, ICRA2000, vol. 3, pp. 3040–3045. IEEE (2000) Hornby, G.S., Takamura, S., Yokono, J., Hanagata, O., Yamamoto, T., Fujita, M.: Evolving robust gaits with AIBO. In: IEEE International Conference on Robotics and Automation, Proceedings, ICRA2000, vol. 3, pp. 3040–3045. IEEE (2000)
4.
go back to reference Doncieux, S., Bredeche, N., Mouret, J.B., Eiben, A.E.G.: Evolutionary robotics: what, why, and where to. Front. Robot. AI 2, 4 (2015)CrossRef Doncieux, S., Bredeche, N., Mouret, J.B., Eiben, A.E.G.: Evolutionary robotics: what, why, and where to. Front. Robot. AI 2, 4 (2015)CrossRef
5.
go back to reference Pugh, J.K., Soros, L.B., Stanley, K.O.: Quality diversity: a new frontier for evolutionary computation. Front. Robot. AI 3, 40 (2016)CrossRef Pugh, J.K., Soros, L.B., Stanley, K.O.: Quality diversity: a new frontier for evolutionary computation. Front. Robot. AI 3, 40 (2016)CrossRef
6.
go back to reference Lehman, J., Stanley, K.O.: Exploiting open-endedness to solve problems through the search for novelty. In: ALIFE, pp. 329–336 (2008) Lehman, J., Stanley, K.O.: Exploiting open-endedness to solve problems through the search for novelty. In: ALIFE, pp. 329–336 (2008)
8.
go back to reference Cully, A., Clune, J., Tarapore, D., Mouret, J.B.: Robots that can adapt like animals. Nature 521(7553), 503–507 (2015)CrossRef Cully, A., Clune, J., Tarapore, D., Mouret, J.B.: Robots that can adapt like animals. Nature 521(7553), 503–507 (2015)CrossRef
9.
go back to reference Cully, A., Mouret, J.B.: Behavioral repertoire learning in robotics. In: Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation, pp. 175–182. ACM (2013) Cully, A., Mouret, J.B.: Behavioral repertoire learning in robotics. In: Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation, pp. 175–182. ACM (2013)
10.
go back to reference Duarte, M., Gomes, J., Oliveira, S.M., Christensen, A.L.: EvoRBC: evolutionary repertoire-based control for robots with arbitrary locomotion complexity. In: Proceedings of the 18th Annual Conference on Genetic and Evolutionary Computation. ACM (2016) Duarte, M., Gomes, J., Oliveira, S.M., Christensen, A.L.: EvoRBC: evolutionary repertoire-based control for robots with arbitrary locomotion complexity. In: Proceedings of the 18th Annual Conference on Genetic and Evolutionary Computation. ACM (2016)
11.
go back to reference Cully, A., Mouret, J.B.: Evolving a behavioral repertoire for a walking robot. Evol. Comput. 24(1), 59–88 (2016)CrossRef Cully, A., Mouret, J.B.: Evolving a behavioral repertoire for a walking robot. Evol. Comput. 24(1), 59–88 (2016)CrossRef
14.
go back to reference Yosinski, J., Clune, J., Hidalgo, D., Nguyen, S., Zagal, J., Lipson, H.: Evolving robot gaits in hardware: the HyperNEAT generative encoding vs. parameter optimization. In: Proceedings of the 20th European Conference on Artificial Life, pp. 890–897 (2011) Yosinski, J., Clune, J., Hidalgo, D., Nguyen, S., Zagal, J., Lipson, H.: Evolving robot gaits in hardware: the HyperNEAT generative encoding vs. parameter optimization. In: Proceedings of the 20th European Conference on Artificial Life, pp. 890–897 (2011)
15.
go back to reference Gomez, F., Miikkulainen, R.: Incremental evolution of complex general behavior. Adapt. Behav. 5(3–4), 317–342 (1997)CrossRef Gomez, F., Miikkulainen, R.: Incremental evolution of complex general behavior. Adapt. Behav. 5(3–4), 317–342 (1997)CrossRef
16.
go back to reference Silva, F., Duarte, M., Correia, L., Oliveira, S.M., Christensen, A.L.: Open issues in evolutionary robotics. Evol. Comput. 24(2), 205–236 (2016)CrossRef Silva, F., Duarte, M., Correia, L., Oliveira, S.M., Christensen, A.L.: Open issues in evolutionary robotics. Evol. Comput. 24(2), 205–236 (2016)CrossRef
17.
go back to reference Brooks, R.A.: A robot that walks; emergent behaviors from a carefully evolved network. Neural Comput. 1(2), 253–262 (1989)CrossRef Brooks, R.A.: A robot that walks; emergent behaviors from a carefully evolved network. Neural Comput. 1(2), 253–262 (1989)CrossRef
18.
go back to reference Matarić, M., Cliff, D.: Challenges in evolving controllers for physical robots. Robot. Autonom. Syst. 19(1), 67–83 (1996)CrossRef Matarić, M., Cliff, D.: Challenges in evolving controllers for physical robots. Robot. Autonom. Syst. 19(1), 67–83 (1996)CrossRef
19.
go back to reference Billard, A., Ijspeert, A.J.: Biologically inspired neural controllers for motor control in a quadruped robot. In: Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks, IJCNN 2000, vol. 6, pp. 637–641. IEEE (2000) Billard, A., Ijspeert, A.J.: Biologically inspired neural controllers for motor control in a quadruped robot. In: Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks, IJCNN 2000, vol. 6, pp. 637–641. IEEE (2000)
20.
go back to reference Clune, J., Beckmann, B.E., Ofria, C., Pennock, R.T.: Evolving coordinated quadruped gaits with the HyperNEAT generative encoding. In: 2009 IEEE Congress on Evolutionary Computation, pp. 2764–2771. IEEE (2009) Clune, J., Beckmann, B.E., Ofria, C., Pennock, R.T.: Evolving coordinated quadruped gaits with the HyperNEAT generative encoding. In: 2009 IEEE Congress on Evolutionary Computation, pp. 2764–2771. IEEE (2009)
21.
22.
go back to reference Zykov, V., Bongard, J., Lipson, H.: Evolving dynamic gaits on a physical robot. In: Proceedings of Genetic and Evolutionary Computation Conference, Late Breaking Paper, GECCO, vol. 4 (2004) Zykov, V., Bongard, J., Lipson, H.: Evolving dynamic gaits on a physical robot. In: Proceedings of Genetic and Evolutionary Computation Conference, Late Breaking Paper, GECCO, vol. 4 (2004)
23.
go back to reference Nygaard, T.F., Tørresen, J., Glette, K.: Multi-objective evolution of fast and stable gaits on a physical quadruped robotic platform. In: 2016 IEEE Symposium Series on Computational Intelligence (SSCI) (2016) Nygaard, T.F., Tørresen, J., Glette, K.: Multi-objective evolution of fast and stable gaits on a physical quadruped robotic platform. In: 2016 IEEE Symposium Series on Computational Intelligence (SSCI) (2016)
24.
go back to reference Tarapore, D., Clune, J., Cully, A., Mouret, J.B.: How do different encodings influence the performance of the MAP-Elites algorithm? In: Genetic and Evolutionary Computation Conference (2016) Tarapore, D., Clune, J., Cully, A., Mouret, J.B.: How do different encodings influence the performance of the MAP-Elites algorithm? In: Genetic and Evolutionary Computation Conference (2016)
25.
go back to reference Mouret, J.B., Doncieux, S.: Overcoming the bootstrap problem in evolutionary robotics using behavioral diversity. In: 2009 IEEE Congress on Evolutionary Computation, pp. 1161–1168. IEEE (2009) Mouret, J.B., Doncieux, S.: Overcoming the bootstrap problem in evolutionary robotics using behavioral diversity. In: 2009 IEEE Congress on Evolutionary Computation, pp. 1161–1168. IEEE (2009)
26.
go back to reference Filliat, D., Kodjabachian, J., Meyer, J.A., et al.: Incremental evolution of neural controllers for navigation in a 6-legged robot. In: Proceedings of the Fourth International Symposium on Artificial Life and Robots, pp. 753–760 (1999) Filliat, D., Kodjabachian, J., Meyer, J.A., et al.: Incremental evolution of neural controllers for navigation in a 6-legged robot. In: Proceedings of the Fourth International Symposium on Artificial Life and Robots, pp. 753–760 (1999)
27.
go back to reference Whiteson, S., Kohl, N., Miikkulainen, R., Stone, P.: Evolving soccer keepaway players through task decomposition. Mach. Learn. 59(1), 5–30 (2005)CrossRefMATH Whiteson, S., Kohl, N., Miikkulainen, R., Stone, P.: Evolving soccer keepaway players through task decomposition. Mach. Learn. 59(1), 5–30 (2005)CrossRefMATH
28.
go back to reference Christensen, A.L., Dorigo, M.: Incremental evolution of robot controllers for a highly integrated task. In: Nolfi, S., Baldassarre, G., Calabretta, R., Hallam, J.C.T., Marocco, D., Meyer, J.-A., Miglino, O., Parisi, D. (eds.) SAB 2006. LNCS (LNAI), vol. 4095, pp. 473–484. Springer, Heidelberg (2006). https://doi.org/10.1007/11840541_39 CrossRef Christensen, A.L., Dorigo, M.: Incremental evolution of robot controllers for a highly integrated task. In: Nolfi, S., Baldassarre, G., Calabretta, R., Hallam, J.C.T., Marocco, D., Meyer, J.-A., Miglino, O., Parisi, D. (eds.) SAB 2006. LNCS (LNAI), vol. 4095, pp. 473–484. Springer, Heidelberg (2006). https://​doi.​org/​10.​1007/​11840541_​39 CrossRef
29.
go back to reference Bongard, J.: Morphological change in machines accelerates the evolution of robust behavior. Proc. Nat. Acad. Sci. 108(4), 1234–1239 (2011)CrossRef Bongard, J.: Morphological change in machines accelerates the evolution of robust behavior. Proc. Nat. Acad. Sci. 108(4), 1234–1239 (2011)CrossRef
30.
go back to reference Bongard, J.: Morphological and environmental scaffolding synergize when evolving robot controllers: artificial life/robotics/evolvable hardware. In: Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, pp. 179–186. ACM (2011) Bongard, J.: Morphological and environmental scaffolding synergize when evolving robot controllers: artificial life/robotics/evolvable hardware. In: Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, pp. 179–186. ACM (2011)
32.
go back to reference Auerbach, J.E., Iacca, G., Floreano, D.: Gaining insight into quality diversity. In: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion, pp. 1061–1064. ACM (2016) Auerbach, J.E., Iacca, G., Floreano, D.: Gaining insight into quality diversity. In: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion, pp. 1061–1064. ACM (2016)
33.
go back to reference Lehman, J., Stanley, K.O.: Evolving a diversity of virtual creatures through novelty search and local competition. In: Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, pp. 211–218. ACM (2011) Lehman, J., Stanley, K.O.: Evolving a diversity of virtual creatures through novelty search and local competition. In: Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, pp. 211–218. ACM (2011)
34.
go back to reference Mouret, J.B., Doncieux, S.: SFERESv2: evolvin’ in the multi-core world. In: Proceedings of Congress on Evolutionary Computation (CEC), pp. 4079–4086 (2010) Mouret, J.B., Doncieux, S.: SFERESv2: evolvin’ in the multi-core world. In: Proceedings of Congress on Evolutionary Computation (CEC), pp. 4079–4086 (2010)
Metadata
Title
Combining MAP-Elites and Incremental Evolution to Generate Gaits for a Mammalian Quadruped Robot
Authors
Jørgen Nordmoen
Kai Olav Ellefsen
Kyrre Glette
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-77538-8_48

Premium Partner