Skip to main content
Erschienen in: Natural Computing 1/2009

01.03.2009

Niching with derandomized evolution strategies in artificial and real-world landscapes

verfasst von: Ofer M. Shir, Thomas Bäck

Erschienen in: Natural Computing | Ausgabe 1/2009

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We introduce a framework of derandomized evolution strategies (ES) niching techniques. A survey of these techniques, based on 5 variants of derandomized ES, is presented, based on the fixed niche radius approach. The core mechanisms range from the very first derandomized approach to self-adaptation of ES to the sophisticated https://static-content.springer.com/image/art%3A10.1007%2Fs11047-007-9065-5/MediaObjects/11047_2007_9065_Figa_HTML.gif Covariance Matrix Adaptation (CMA). They are applied to artificial as well as real-world multimodal continuous landscapes, of different levels of difficulty and various dimensions, and compared with the maximum-peak-ratio (MPR) performance analysis tool. While characterizing the performance of the different derandomized variants in the context of niching, some conclusions concerning the niching formation process of the different mechanisms are drawn, and the hypothesis of a trade-off between learning time and niching acceleration is numerically confirmed. Niching with (1 + λ)-CMA core mechanism is shown to experimentally outperform all the other variants, especially on the real-world problem. Some theoretical arguments supporting the advantage of a plus-strategy for niching are discussed. For the real-world application in hand, taken from the field of Quantum Control, we show that the niching framework can overcome some degeneracy in the search space, and obtain different conceptual designs using problem-specific diversity measurements.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Matlab source-code of the 5 routines is available at: http://​www.​liacs.​nl/​home/​oshir/​NichingES/​
 
2
The careful reader should note that 'population’ is used here exclusively in the context of quantum mechanics, e.g., populating quantum levels.
 
Literatur
Zurück zum Zitat Avigad G, Moshaiov A, Brauner N (2004) Concept-based interactive brainstorming in engineering design. J Adv Comput Intell Intell Inform 8(5):454–459 Avigad G, Moshaiov A, Brauner N (2004) Concept-based interactive brainstorming in engineering design. J Adv Comput Intell Intell Inform 8(5):454–459
Zurück zum Zitat Bäck T (1994) Selective pressure in evolutionary algorithms: A characterization of selection mechanisms. In: Michalewicz Z, Schaffer JD, Schwefel HP, Fogel DB, Kitano H (eds) Proceedings of the first IEEE conference evolutionary computation (ICEC’94), Orlando FL, vol 1. IEEE Press, Piscataway, NJ, USA, pp 57–62 Bäck T (1994) Selective pressure in evolutionary algorithms: A characterization of selection mechanisms. In: Michalewicz Z, Schaffer JD, Schwefel HP, Fogel DB, Kitano H (eds) Proceedings of the first IEEE conference evolutionary computation (ICEC’94), Orlando FL, vol 1. IEEE Press, Piscataway, NJ, USA, pp 57–62
Zurück zum Zitat Bäck T (1996) Evolutionary algorithms in theory and practice. Oxford University Press, New York, NY, USAMATH Bäck T (1996) Evolutionary algorithms in theory and practice. Oxford University Press, New York, NY, USAMATH
Zurück zum Zitat Deb K, Goldberg DE (1989) An investigation of niche and species formation in genetic function optimization. In: Proceedings of the third international conference on genetic algorithms, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA Deb K, Goldberg DE (1989) An investigation of niche and species formation in genetic function optimization. In: Proceedings of the third international conference on genetic algorithms, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA
Zurück zum Zitat Demiralp M, Rabitz H (1993) Optimally controlled quantum molecular dynamics: a perturbation formulation and the existence of multiple solutions. Phys Rev A 47(2):809–816CrossRef Demiralp M, Rabitz H (1993) Optimally controlled quantum molecular dynamics: a perturbation formulation and the existence of multiple solutions. Phys Rev A 47(2):809–816CrossRef
Zurück zum Zitat Goldberg DE, Richardson J (1987) Genetic algorithms with sharing for multimodal function optimization. In: Proceedings of the second international conference on genetic algorithms on genetic algorithms and their application. Lawrence Erlbaum Associates Inc, Mahwah, NJ, USA, pp 41–49 Goldberg DE, Richardson J (1987) Genetic algorithms with sharing for multimodal function optimization. In: Proceedings of the second international conference on genetic algorithms on genetic algorithms and their application. Lawrence Erlbaum Associates Inc, Mahwah, NJ, USA, pp 41–49
Zurück zum Zitat Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9(2):159–195CrossRef Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9(2):159–195CrossRef
Zurück zum Zitat Hansen N, Ostermeier A, Gawelczyk A (1995) On the adaptation of arbitrary normal mutation distributions in evolution strategies: the generating set adaptation. In: Proceedings of the sixth international conference on genetic algorithms (ICGA6) Hansen N, Ostermeier A, Gawelczyk A (1995) On the adaptation of arbitrary normal mutation distributions in evolution strategies: the generating set adaptation. In: Proceedings of the sixth international conference on genetic algorithms (ICGA6)
Zurück zum Zitat Igel C, Suttorp T, Hansen N (2006) A computational efficient covariance matrix update and a (1+1)-CMA for evolution strategies. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2005), ACM Press, pp 453–460 Igel C, Suttorp T, Hansen N (2006) A computational efficient covariance matrix update and a (1+1)-CMA for evolution strategies. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2005), ACM Press, pp 453–460
Zurück zum Zitat Igel C, Hansen N, Roth S (2007) Covariance matrix adaptation for multi-objective optimization. Evol Comput 15(1):1–28CrossRef Igel C, Hansen N, Roth S (2007) Covariance matrix adaptation for multi-objective optimization. Evol Comput 15(1):1–28CrossRef
Zurück zum Zitat Kimura M (1983) The neutral theory of molecular evolution. Cambridge University Press, Cambridge Kimura M (1983) The neutral theory of molecular evolution. Cambridge University Press, Cambridge
Zurück zum Zitat Kramer O, Schwefel HP (2006) On three new approaches to handle constraints within evolution strategies. Nat Comput Int J 5(4):363–385CrossRefMathSciNet Kramer O, Schwefel HP (2006) On three new approaches to handle constraints within evolution strategies. Nat Comput Int J 5(4):363–385CrossRefMathSciNet
Zurück zum Zitat Mahfoud S (1995) Niching methods for genetic algorithms. PhD thesis, University of Illinois at Urbana, Champaign Mahfoud S (1995) Niching methods for genetic algorithms. PhD thesis, University of Illinois at Urbana, Champaign
Zurück zum Zitat Miller B, Shaw M (1996) Genetic algorithms with dynamic niche sharing for multimodal function optimization. In: Proceedings of the 1996 IEEE international conference on evolutionary computation (ICEC’96), New York, NY, USA Miller B, Shaw M (1996) Genetic algorithms with dynamic niche sharing for multimodal function optimization. In: Proceedings of the 1996 IEEE international conference on evolutionary computation (ICEC’96), New York, NY, USA
Zurück zum Zitat Nuernberger P, Vogt G, Brixner T, Gerber G (2007) Femtosecond quantum control of molecular dynamics in the condensed phase. Phys Chem Chem Phys 9(20):2470–2497CrossRef Nuernberger P, Vogt G, Brixner T, Gerber G (2007) Femtosecond quantum control of molecular dynamics in the condensed phase. Phys Chem Chem Phys 9(20):2470–2497CrossRef
Zurück zum Zitat Ostermeier A, Gawelczyk A, Hansen N (1993) A derandomized approach to self adaptation of evolution strategies. Technical report, TU, Berlin Ostermeier A, Gawelczyk A, Hansen N (1993) A derandomized approach to self adaptation of evolution strategies. Technical report, TU, Berlin
Zurück zum Zitat Ostermeier A, Gawelczyk A, Hansen N (1994) Step-size adaptation based on non-local use of selection information. In: PPSN. Volume 866 of lecture notes in computer science, Springer Ostermeier A, Gawelczyk A, Hansen N (1994) Step-size adaptation based on non-local use of selection information. In: PPSN. Volume 866 of lecture notes in computer science, Springer
Zurück zum Zitat Rabitz H, de Vivie-Riedle R, Mutzkus M, Kompa K (2000) Whither the future of controlling quantum phenomena? Science 288:824–828CrossRef Rabitz H, de Vivie-Riedle R, Mutzkus M, Kompa K (2000) Whither the future of controlling quantum phenomena? Science 288:824–828CrossRef
Zurück zum Zitat Rosca-Pruna F, Vrakking M (2002) Revival structures in picosecond laser-induced alignment of i2 molecules. J Chem Phys 116(15):6579–6588CrossRef Rosca-Pruna F, Vrakking M (2002) Revival structures in picosecond laser-induced alignment of i2 molecules. J Chem Phys 116(15):6579–6588CrossRef
Zurück zum Zitat Schönemann L, Emmerich M, Preuss M (2004) On the extiction of sub-populations on multimodal landscapes. In: Proceedings of the international conference on Bioinspired optimization methods and their applications, BIOMA 2004, Jožef Stefan Institute, Slovenia, pp 31–40 Schönemann L, Emmerich M, Preuss M (2004) On the extiction of sub-populations on multimodal landscapes. In: Proceedings of the international conference on Bioinspired optimization methods and their applications, BIOMA 2004, Jožef Stefan Institute, Slovenia, pp 31–40
Zurück zum Zitat Shir OM, Bäck T (2005a) Dynamic niching in evolution strategies with covariance matrix adaptation. In: Proceedings of the 2005 congress on evolutionary computation CEC-2005, IEEE Press, Piscataway, NJ, USA Shir OM, Bäck T (2005a) Dynamic niching in evolution strategies with covariance matrix adaptation. In: Proceedings of the 2005 congress on evolutionary computation CEC-2005, IEEE Press, Piscataway, NJ, USA
Zurück zum Zitat Shir OM, Bäck T (2005b) Niching in evolution strategies. Technical report, Technical Report TR-2005-01, LIACS, Leiden University Shir OM, Bäck T (2005b) Niching in evolution strategies. Technical report, Technical Report TR-2005-01, LIACS, Leiden University
Zurück zum Zitat Shir OM, Bäck T (2006) Niche radius adaptation in the CMA-ES niching algorithm. In: Parallel problem solving from nature—PPSN IX, 9th international conference, Reykjavik, Iceland, September 9–13, 2006, Proceedings. Volume 4193 of lecture notes in computer science, Springer, pp 142–151 Shir OM, Bäck T (2006) Niche radius adaptation in the CMA-ES niching algorithm. In: Parallel problem solving from nature—PPSN IX, 9th international conference, Reykjavik, Iceland, September 9–13, 2006, Proceedings. Volume 4193 of lecture notes in computer science, Springer, pp 142–151
Zurück zum Zitat Shir OM, Kok JN, Vrakking MJ, Bäck T (2007) Gaining insight into laser pulse shaping by evolution strategies. In: IWINAC. Volume 4527 of lecture notes in computer science, Springer Shir OM, Kok JN, Vrakking MJ, Bäck T (2007) Gaining insight into laser pulse shaping by evolution strategies. In: IWINAC. Volume 4527 of lecture notes in computer science, Springer
Zurück zum Zitat Siedschlag C, Shir OM, Bäck T, Vrakking MJJ (2006) Evolutionary algorithms in the optimization of dynamic molecular alignment. Opt Commun 264:511–518CrossRef Siedschlag C, Shir OM, Bäck T, Vrakking MJJ (2006) Evolutionary algorithms in the optimization of dynamic molecular alignment. Opt Commun 264:511–518CrossRef
Zurück zum Zitat Suganthan PN, Hansen N, Liang JJ, Deb K, Chen YP, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the cec 2005 special session on real-parameter optimization. Technical report, Nanyang Technological University, Singapore Suganthan PN, Hansen N, Liang JJ, Deb K, Chen YP, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the cec 2005 special session on real-parameter optimization. Technical report, Nanyang Technological University, Singapore
Zurück zum Zitat Törn A, Zilinskas A (1987) Global optimization, vol 350. Springer Törn A, Zilinskas A (1987) Global optimization, vol 350. Springer
Zurück zum Zitat Warren WS, Rabitz HA, Dahleh M (1993) Coherent control of quantum dynamics: the dream is alive. Science 259:1581–1589CrossRefMathSciNet Warren WS, Rabitz HA, Dahleh M (1993) Coherent control of quantum dynamics: the dream is alive. Science 259:1581–1589CrossRefMathSciNet
Zurück zum Zitat Weinacht TC, Bucksbaum PH (2002) Using feedback for coherent control of quantum systems. J Opt B 4:R35–R52 Weinacht TC, Bucksbaum PH (2002) Using feedback for coherent control of quantum systems. J Opt B 4:R35–R52
Metadaten
Titel
Niching with derandomized evolution strategies in artificial and real-world landscapes
verfasst von
Ofer M. Shir
Thomas Bäck
Publikationsdatum
01.03.2009
Verlag
Springer Netherlands
Erschienen in
Natural Computing / Ausgabe 1/2009
Print ISSN: 1567-7818
Elektronische ISSN: 1572-9796
DOI
https://doi.org/10.1007/s11047-007-9065-5

Weitere Artikel der Ausgabe 1/2009

Natural Computing 1/2009 Zur Ausgabe