Skip to main content
Top
Published in: Evolutionary Intelligence 3/2012

01-09-2012 | Special Issue

Kernel representations for evolving continuous functions

Authors: Tobias Glasmachers, Jan Koutník, Jürgen Schmidhuber

Published in: Evolutionary Intelligence | Issue 3/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

To parameterize continuous functions for evolutionary learning, we use kernel expansions in nested sequences of function spaces of growing complexity. This approach is particularly powerful when dealing with non-convex constraints and discontinuous objective functions. Kernel methods offer a number of beneficial properties for parameterizing continuous functions, such as smoothness and locality, which make them attractive as a basis for mutation operators. Beyond such practical considerations, kernel methods make heavy use of inner products in function space and offer a well established regularization framework. We show how evolutionary computation can profit from these properties. Searching function spaces of iteratively increasing complexity allows the solution to evolve from a simple first guess to a complex and highly refined function. At transition points where the evolution strategy is confronted with the next level of functional complexity, the kernel framework can be used to project the search distribution into the extended search space. The feasibility of the method is demonstrated on challenging trajectory planning problems where redundant robots have to avoid obstacles.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Care has to be taken that the function space is restricted to L 2 functions, that is, functions of finite norm.
 
2
For any (not necessarily square) matrix M we write M −1 for the Moore–Penrose pseudo-inverse.
 
Literature
1.
go back to reference Alfaro T, Rojas MCR (2005) An on-the-fly evolutionary algorithm for robot motion planning. In: ICES, pp 119–130 Alfaro T, Rojas MCR (2005) An on-the-fly evolutionary algorithm for robot motion planning. In: ICES, pp 119–130
2.
go back to reference Barraquand J, Latombe JC (1991) Robot motion planning: a distributed representation approach. Int J Robot Res 10(6):628–649CrossRef Barraquand J, Latombe JC (1991) Robot motion planning: a distributed representation approach. Int J Robot Res 10(6):628–649CrossRef
4.
go back to reference Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifiers. In: Proceedings of the fifth annual workshop on computational learning theory. COLT ’92, ACM, New York, NY, USA, pp 144–152 Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifiers. In: Proceedings of the fifth annual workshop on computational learning theory. COLT ’92, ACM, New York, NY, USA, pp 144–152
5.
go back to reference Conkur ES, Buckingham R (1997) Manoeuvring highly redundant manipulators. Robotica 15:435–447CrossRef Conkur ES, Buckingham R (1997) Manoeuvring highly redundant manipulators. Robotica 15:435–447CrossRef
6.
go back to reference Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
7.
go back to reference Denker A, Atherton D (1994) No-overshoot control of robotic manipulators in the presence of obstacles. J Robot Syst 11(7):665–678CrossRef Denker A, Atherton D (1994) No-overshoot control of robotic manipulators in the presence of obstacles. J Robot Syst 11(7):665–678CrossRef
8.
go back to reference Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Springer, BerlinMATH Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Springer, BerlinMATH
9.
go back to reference Floreano D, Mitri S, Perez-Uribe A, Keller L (2008) Evolution of altruistic robots. In: Proceedings of the WCCI 2008, vol 5050. Springer, Berlin, pp 232–248 Floreano D, Mitri S, Perez-Uribe A, Keller L (2008) Evolution of altruistic robots. In: Proceedings of the WCCI 2008, vol 5050. Springer, Berlin, pp 232–248
10.
go back to reference Glasmachers T, Schaul T, Schmidhuber J (2010) A natural evolution strategy for multi-objective optimization. In: Parallel problem solving from nature (PPSN) Glasmachers T, Schaul T, Schmidhuber J (2010) A natural evolution strategy for multi-objective optimization. In: Parallel problem solving from nature (PPSN)
11.
go back to reference Glasmachers T, Schaul T, Sun Y, Wierstra D, Schmidhuber J (2010) Exponential natural evolution strategies. In: Genetic and evolutionary computation conference (GECCO), Portland, OR Glasmachers T, Schaul T, Sun Y, Wierstra D, Schmidhuber J (2010) Exponential natural evolution strategies. In: Genetic and evolutionary computation conference (GECCO), Portland, OR
12.
go back to reference Gomez F, Schmidhuber J, Miikkulainen R (2006) Efficient non-linear control through neuroevolution. In: Fürnkranz J, Scheffer T, Spiliopoulou M (eds) Proceeding of the European conference on machine learning, No. 4212 in LNAI, Springer, pp 654–662 Gomez F, Schmidhuber J, Miikkulainen R (2006) Efficient non-linear control through neuroevolution. In: Fürnkranz J, Scheffer T, Spiliopoulou M (eds) Proceeding of the European conference on machine learning, No. 4212 in LNAI, Springer, pp 654–662
13.
go back to reference Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9(2):159–195CrossRef Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9(2):159–195CrossRef
14.
go back to reference Harding S, Miller JF (2005) Evolution of robot controller using Cartesian genetic programming. Genetic programming, pp 62–73 Harding S, Miller JF (2005) Evolution of robot controller using Cartesian genetic programming. Genetic programming, pp 62–73
15.
go back to reference Hayashi A (1994) Geometrical motion planning for highly redundant manipulators using a continuous model. PhD thesis, University of Texas Austin Hayashi A (1994) Geometrical motion planning for highly redundant manipulators using a continuous model. PhD thesis, University of Texas Austin
16.
go back to reference Iossifidis I, Schöner G (2006) Dynamical systems approach for the autonomous avoidance of obstacles and joint-limits for an redundant robot arm. In: IEEE/RSJ international conference on intelligent robots and systems, pp 580–585 Iossifidis I, Schöner G (2006) Dynamical systems approach for the autonomous avoidance of obstacles and joint-limits for an redundant robot arm. In: IEEE/RSJ international conference on intelligent robots and systems, pp 580–585
17.
go back to reference Kavraki L, Svestka P, Latombe JC, Overmars M (1996) Probabilistic roadmaps for path planning in high-dimensional configuration spaces. In: IEEE international conference on robotics and automation, pp. 566–580 Kavraki L, Svestka P, Latombe JC, Overmars M (1996) Probabilistic roadmaps for path planning in high-dimensional configuration spaces. In: IEEE international conference on robotics and automation, pp. 566–580
18.
19.
go back to reference Koutník J, Gomez FJ, Schmidhuber J (2010) Evolving neural networks in compressed weight space. In: GECCO, pp 619–626 Koutník J, Gomez FJ, Schmidhuber J (2010) Evolving neural networks in compressed weight space. In: GECCO, pp 619–626
22.
go back to reference Mitrovic D, Klanke S, Vijayakumar S (2010) Adaptive optimal feedback control with learned internal dynamics models. In: Sigaud O, Peters J (eds) From motor learning to interaction learning in robots. Springer, Berlin, pp 65–84 Mitrovic D, Klanke S, Vijayakumar S (2010) Adaptive optimal feedback control with learned internal dynamics models. In: Sigaud O, Peters J (eds) From motor learning to interaction learning in robots. Springer, Berlin, pp 65–84
23.
go back to reference Nolfi S, Marocco D (2001) Evolving robots able to integrate sensory-motor information over time. Theory Biosci 120:287–310 Nolfi S, Marocco D (2001) Evolving robots able to integrate sensory-motor information over time. Theory Biosci 120:287–310
24.
go back to reference Rechenberg I, Eigen M (1973) Evolutionsstrategie: Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann-Holzboog, Stuttgart Rechenberg I, Eigen M (1973) Evolutionsstrategie: Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann-Holzboog, Stuttgart
25.
go back to reference Schaul T, Glasmachers T, Schmidhuber J (2011) High dimensions and heavy tails for natural evolution strategies. In: Proceedings of the genetic and evolutionary computation conference (GECCO) Schaul T, Glasmachers T, Schmidhuber J (2011) High dimensions and heavy tails for natural evolution strategies. In: Proceedings of the genetic and evolutionary computation conference (GECCO)
26.
go back to reference Scholkopf B, Smola A, Muller KR (1998) Nonlinear component analysis as a Kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef Scholkopf B, Smola A, Muller KR (1998) Nonlinear component analysis as a Kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef
27.
go back to reference Sun Y, Wierstra D, Schaul T, Schmidhuber J (2009) Efficient natural evolution strategies. In: Genetic and evolutionary computation conference (GECCO) Sun Y, Wierstra D, Schaul T, Schmidhuber J (2009) Efficient natural evolution strategies. In: Genetic and evolutionary computation conference (GECCO)
28.
go back to reference Sun Y, Wierstra D, Schaul T, Schmidhuber J (2009) Stochastic search using the natural gradient. In: International conference on machine learning (ICML) Sun Y, Wierstra D, Schaul T, Schmidhuber J (2009) Stochastic search using the natural gradient. In: International conference on machine learning (ICML)
29.
go back to reference Vapnik V (1997) The support vector method. In: ICANN, pp 263–271 Vapnik V (1997) The support vector method. In: ICANN, pp 263–271
30.
go back to reference Vapnik VN (1998) Statistical learning theory. Wiley-Interscience, Hoboken Vapnik VN (1998) Statistical learning theory. Wiley-Interscience, Hoboken
31.
go back to reference Wierstra D, Schaul T, Peters J, Schmidhuber J (2008) Natural evolution strategies. In: Proceedings of the congress on evolutionary computation (CEC08), Hongkong. IEEE Press Wierstra D, Schaul T, Peters J, Schmidhuber J (2008) Natural evolution strategies. In: Proceedings of the congress on evolutionary computation (CEC08), Hongkong. IEEE Press
32.
go back to reference Woolley BG, Stanley KO (2010) Evolving a single scalable controller for an octopus arm with a variable number of segments. In: PPSN (2), pp 270–279 Woolley BG, Stanley KO (2010) Evolving a single scalable controller for an octopus arm with a variable number of segments. In: PPSN (2), pp 270–279
33.
go back to reference Yekutieli Y, Sagiv-Zohar R, Aharonov R, Engel Y, Hochner B, Flash T (2005) A dynamic model of the octopus arm. I. Biomechanics of the octopus reaching movement. J Neurophysiol 94(2):1443–1458CrossRef Yekutieli Y, Sagiv-Zohar R, Aharonov R, Engel Y, Hochner B, Flash T (2005) A dynamic model of the octopus arm. I. Biomechanics of the octopus reaching movement. J Neurophysiol 94(2):1443–1458CrossRef
Metadata
Title
Kernel representations for evolving continuous functions
Authors
Tobias Glasmachers
Jan Koutník
Jürgen Schmidhuber
Publication date
01-09-2012
Publisher
Springer-Verlag
Published in
Evolutionary Intelligence / Issue 3/2012
Print ISSN: 1864-5909
Electronic ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-012-0070-y

Other articles of this Issue 3/2012

Evolutionary Intelligence 3/2012 Go to the issue

Premium Partner