Skip to main content
Top

2013 | OriginalPaper | Chapter

2. A Practical Platform for On-Line Genetic Programming for Robotics

Authors : Terence Soule, Robert B. Heckendorn

Published in: Genetic Programming Theory and Practice X

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

There is growing interest in on-line evolution forautonomous robots. On-line learningis critical to achieve high levels of autonomy in the face of dynamic environments, tasks, and other variable elements encountered in real world environments. Although a number of successes have been achieved with on-line evolution, these successes are largely limited to fairly simple learning paradigms, e.g. training small neural networks of relatively few weights and in simulated environments. The shortage of more complex learning paradigms is largely due to the limitations of affordable robotic platforms, which tend to be woefully underpowered for such applications.
In this paper we introduce a simple robotics platform based on Commodity Off The Shelf (COTS) designprinciples that makes on-line genetic programming for robotics practical and affordable. We compare the relative strengths and weaknesses of a number of different build options. As a proof-of-concept we compare three variations of evolutionary learning models for a color-following problem on a robot based on one of the designs: a simple neural network learning framework of the type typically seen in current research, a more extensive learning model that could not be supported by traditional low-cost research robots, and a simple evolutionary algorithm, but using standard tree-based genetic programming representation, which is also beyond the scope of traditional low-cost research robots. Our results show that the more powerful evolutionary models enabled by more powerful robots significantly improves the on-line evolutionary performance and thus that there are practical benefits to the COTS based

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
We refer to this as a sleep phase because it does have certain parallels to human sleep. It has been conclusively shown that sleep is an important part of learning and memory. In much the same way the sleep phase described here gives the robot additional time to learn from its training data.
 
Literature
go back to reference Bergbreiter S, Pister K (2003) Cotsbots: An off-the-shelf platform for distributed robotics. In: Intelligent Robots and Systems, 2003.(IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, IEEE, vol 2, pp 1632–1637 Bergbreiter S, Pister K (2003) Cotsbots: An off-the-shelf platform for distributed robotics. In: Intelligent Robots and Systems, 2003.(IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, IEEE, vol 2, pp 1632–1637
go back to reference Capi G, Toda H (2010) Evolution of neural controllers for robot navigation in human environments. Journal of Computer Science 6(8):837–843CrossRef Capi G, Toda H (2010) Evolution of neural controllers for robot navigation in human environments. Journal of Computer Science 6(8):837–843CrossRef
go back to reference Clune J, Beckmann B, Ofria C, Pennock R (2009) Evolving coordinated quadruped gaits with the hyperneat generative encoding. In: Evolutionary Computation, 2009. CEC’09. IEEE Congress on, IEEE, pp 2764–2771 Clune J, Beckmann B, Ofria C, Pennock R (2009) Evolving coordinated quadruped gaits with the hyperneat generative encoding. In: Evolutionary Computation, 2009. CEC’09. IEEE Congress on, IEEE, pp 2764–2771
go back to reference Council NI (2008) Disruptive civil technologies: Six technologies with potential impacts on u.s. interests out to 2025 Council NI (2008) Disruptive civil technologies: Six technologies with potential impacts on u.s. interests out to 2025
go back to reference Drchal J, Koutník J, Snorek M (2009) Hyperneat controlled robots learn how to drive on roads in simulated environment. In: Evolutionary Computation, 2009. CEC’09. IEEE Congress on, IEEE, pp 1087–1092 Drchal J, Koutník J, Snorek M (2009) Hyperneat controlled robots learn how to drive on roads in simulated environment. In: Evolutionary Computation, 2009. CEC’09. IEEE Congress on, IEEE, pp 1087–1092
go back to reference Floreano D, Nolfi S (1997) God save the red queen! competition in co-evolutionary robotics. Genetic programming 1997 Floreano D, Nolfi S (1997) God save the red queen! competition in co-evolutionary robotics. Genetic programming 1997
go back to reference Haasdijk E, Atta-ul Qayyum A, Eiben A (2011) Racing to improve on-line, on-board evolutionary robotics. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, pp 187–194 Haasdijk E, Atta-ul Qayyum A, Eiben A (2011) Racing to improve on-line, on-board evolutionary robotics. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, pp 187–194
go back to reference Hinchey M, Sterritt R, Rouff C (2007) Swarms and swarm intelligence. Computer 40(4):111–113CrossRef Hinchey M, Sterritt R, Rouff C (2007) Swarms and swarm intelligence. Computer 40(4):111–113CrossRef
go back to reference Kakalis N, Ventikos Y (2008) Robotic swarm concept for efficient oil spill confrontation. Journal of hazardous materials 154(1–3):880–887CrossRef Kakalis N, Ventikos Y (2008) Robotic swarm concept for efficient oil spill confrontation. Journal of hazardous materials 154(1–3):880–887CrossRef
go back to reference Karafotias G, Haasdijk E, Eiben A, Haasdijk E, Eiben A, Winfield A, Haasdijk E, Rusu A, Eiben A, Eiben A, et al (2011) An algorithm for distributed on-line, on-board evolutionary robotics. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, pp 171–178 Karafotias G, Haasdijk E, Eiben A, Haasdijk E, Eiben A, Winfield A, Haasdijk E, Rusu A, Eiben A, Eiben A, et al (2011) An algorithm for distributed on-line, on-board evolutionary robotics. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, pp 171–178
go back to reference Mondada F, Floreano D, Guignard A, Deneubourg J, Gambardella L, Nolfi S, Dorigo M (2002) Search for rescue: an application for the swarm-bot self-assembling robot concept. Tech. rep., Citeseer Mondada F, Floreano D, Guignard A, Deneubourg J, Gambardella L, Nolfi S, Dorigo M (2002) Search for rescue: an application for the swarm-bot self-assembling robot concept. Tech. rep., Citeseer
go back to reference Mondada F, Bonani M, Raemy X, Pugh J, Cianci C, Klaptocz A, Magnenat S, Zufferey J, Floreano D, Martinoli A (2009) The e-puck, a robot designed for education in engineering. In: Proceedings of the 9th conference on autonomous robot systems and competitions, vol 1, pp 59–65 Mondada F, Bonani M, Raemy X, Pugh J, Cianci C, Klaptocz A, Magnenat S, Zufferey J, Floreano D, Martinoli A (2009) The e-puck, a robot designed for education in engineering. In: Proceedings of the 9th conference on autonomous robot systems and competitions, vol 1, pp 59–65
go back to reference Mullen R, Barman S, Remagnino P, Monekosso D (2011) Towards autonomous robot swarms for multi-target localisation and monitoring with applications to counter ied operations. International Journal of Intelligent Defence Support Systems 4(1):87–107CrossRef Mullen R, Barman S, Remagnino P, Monekosso D (2011) Towards autonomous robot swarms for multi-target localisation and monitoring with applications to counter ied operations. International Journal of Intelligent Defence Support Systems 4(1):87–107CrossRef
go back to reference Nolfi S (2012) Co-evolving predator and prey robots. Adaptive Behavior 20(1):10–15CrossRef Nolfi S (2012) Co-evolving predator and prey robots. Adaptive Behavior 20(1):10–15CrossRef
go back to reference Russell S, Norvig P (2010) Artificial intelligence: a modern approach. Prentice hall Russell S, Norvig P (2010) Artificial intelligence: a modern approach. Prentice hall
go back to reference Sathyanath S, Sahin F (2002) Application of artificial immune system based intelligent multi agent model to a mine detection problem. In: Systems, Man and Cybernetics, 2002 IEEE International Conference on, IEEE, vol 3, pp 6–pp Sathyanath S, Sahin F (2002) Application of artificial immune system based intelligent multi agent model to a mine detection problem. In: Systems, Man and Cybernetics, 2002 IEEE International Conference on, IEEE, vol 3, pp 6–pp
go back to reference Schlachter F, Schwarzer C, Kernbach S, Michiels N, Levi P (2010) Incremental online evolution and adaptation of neural networks for robot control in dynamic environments. In: ADAPTIVE 2010, The Second International Conference on Adaptive and Self-Adaptive Systems and Applications, pp 111–116 Schlachter F, Schwarzer C, Kernbach S, Michiels N, Levi P (2010) Incremental online evolution and adaptation of neural networks for robot control in dynamic environments. In: ADAPTIVE 2010, The Second International Conference on Adaptive and Self-Adaptive Systems and Applications, pp 111–116
go back to reference Soule T, Heckendorn R (2011) Cotsbots: computationally powerful, low-cost robots for computer science curriculums. Journal of Computing Sciences in Colleges 27(1):180–187 Soule T, Heckendorn R (2011) Cotsbots: computationally powerful, low-cost robots for computer science curriculums. Journal of Computing Sciences in Colleges 27(1):180–187
go back to reference Talaga P, Oh J.C (2009) Combining aima and lego mindstorms in an artificial intelligence course to build real world robots. Journal of Computing Sciences in Colleges 24(3):56–64 Talaga P, Oh J.C (2009) Combining aima and lego mindstorms in an artificial intelligence course to build real world robots. Journal of Computing Sciences in Colleges 24(3):56–64
go back to reference Zarzhitsky D, Spears D, Spears W (2005) Swarms for chemical plume tracing. In: Swarm Intelligence Symposium, 2005. SIS 2005. Proceedings 2005 IEEE, IEEE, pp 249–256 Zarzhitsky D, Spears D, Spears W (2005) Swarms for chemical plume tracing. In: Swarm Intelligence Symposium, 2005. SIS 2005. Proceedings 2005 IEEE, IEEE, pp 249–256
Metadata
Title
A Practical Platform for On-Line Genetic Programming for Robotics
Authors
Terence Soule
Robert B. Heckendorn
Copyright Year
2013
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-6846-2_2

Premium Partner