Skip to main content
Erschienen in: Soft Computing 12/2009

01.10.2009 | Focus

Learning behavior in abstract memory schemes for dynamic optimization problems

verfasst von: Hendrik Richter, Shengxiang Yang

Erschienen in: Soft Computing | Ausgabe 12/2009

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Integrating memory into evolutionary algorithms is one major approach to enhance their performance in dynamic environments. An abstract memory scheme has been recently developed for evolutionary algorithms in dynamic environments, where the abstraction of good solutions is stored in the memory instead of good solutions themselves to improve future problem solving. This paper further investigates this abstract memory with a focus on understanding the relationship between learning and memory, which is an important but poorly studied issue for evolutionary algorithms in dynamic environments. The experimental study shows that the abstract memory scheme enables learning processes and hence efficiently improves the performance of evolutionary algorithms in dynamic environments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Arnold DV, Beyer HG (2006) Optimum tracking with evolution strategies. Evol Comput 14(3):291–308CrossRef Arnold DV, Beyer HG (2006) Optimum tracking with evolution strategies. Evol Comput 14(3):291–308CrossRef
Zurück zum Zitat Bosman PAN (2007) Learning and anticipation in online dynamic optimization. In: Yang S, Ong YS, Jin Y (eds) Evolutionary computation in dynamic and uncertain environments, chap 6. Springer, Berlin, pp 129–152 Bosman PAN (2007) Learning and anticipation in online dynamic optimization. In: Yang S, Ong YS, Jin Y (eds) Evolutionary computation in dynamic and uncertain environments, chap 6. Springer, Berlin, pp 129–152
Zurück zum Zitat Boumaza AM (2005) Learning environment dynamics from self-adaptation. GECCO workshops 2005. pp 48–54 Boumaza AM (2005) Learning environment dynamics from self-adaptation. GECCO workshops 2005. pp 48–54
Zurück zum Zitat Branke J (1999) Memory enhanced evolutionary algorithms for changing optimization problems. In: Proceedings of the 1999 IEEE congress on evolutionary computation. pp 1875–1882 Branke J (1999) Memory enhanced evolutionary algorithms for changing optimization problems. In: Proceedings of the 1999 IEEE congress on evolutionary computation. pp 1875–1882
Zurück zum Zitat Branke J (2002) Evolutionary optimization in dynamic environments. Kluwer, Dordrecht Branke J (2002) Evolutionary optimization in dynamic environments. Kluwer, Dordrecht
Zurück zum Zitat Branke J, Kaußler T, Schmidt C, Schmeck H (2000) A multi-population approach to dynamic optimization problems. In: Proceedings of the 4th international conference on adaptive computing in design and manufacturing. pp 299–308 Branke J, Kaußler T, Schmidt C, Schmeck H (2000) A multi-population approach to dynamic optimization problems. In: Proceedings of the 4th international conference on adaptive computing in design and manufacturing. pp 299–308
Zurück zum Zitat Cover TM, Thomas JA (2006) Elements of information theory. Wiley, HobokenMATH Cover TM, Thomas JA (2006) Elements of information theory. Wiley, HobokenMATH
Zurück zum Zitat Fitch R, Hengst B, Suc D, Calbert G, Scholz J (2005) Structural abstraction experiments in reinforcement learning. In: AI 2005 advances in artificial intelligence. pp 164–175 Fitch R, Hengst B, Suc D, Calbert G, Scholz J (2005) Structural abstraction experiments in reinforcement learning. In: AI 2005 advances in artificial intelligence. pp 164–175
Zurück zum Zitat Ho WC, Nehaniv C, Dautenhahn K (2005) Autobiographic agents in dynamic virtual environments—performance comparison for different memory control architectures. In: Proceedings of the 2005 IEEE congress on evolutionary computing, pp 573–580 Ho WC, Nehaniv C, Dautenhahn K (2005) Autobiographic agents in dynamic virtual environments—performance comparison for different memory control architectures. In: Proceedings of the 2005 IEEE congress on evolutionary computing, pp 573–580
Zurück zum Zitat Jin Y, Branke J (2005) Evolutionary optimization in uncertain environments—a survey. IEEE Trans Evol Comput 9(3):303–317CrossRef Jin Y, Branke J (2005) Evolutionary optimization in uncertain environments—a survey. IEEE Trans Evol Comput 9(3):303–317CrossRef
Zurück zum Zitat Lewis EHJ, Ritchie G (1998) A comparison of dominance mechanisms and simple mutation on non-stationary problems. In: Parallel problem solving from nature-PPSN V, pp 139–148 Lewis EHJ, Ritchie G (1998) A comparison of dominance mechanisms and simple mutation on non-stationary problems. In: Parallel problem solving from nature-PPSN V, pp 139–148
Zurück zum Zitat Lieberman DA (2004) Learning and memory: an integrative approach. Wadsworth, Belmont Lieberman DA (2004) Learning and memory: an integrative approach. Wadsworth, Belmont
Zurück zum Zitat Michalski RS (2000) Learnable evolution model: evolutionary processes guided by machine learning. Mach Learn 38(1):9–40MATHCrossRef Michalski RS (2000) Learnable evolution model: evolutionary processes guided by machine learning. Mach Learn 38(1):9–40MATHCrossRef
Zurück zum Zitat Mitchell TM (1997) Machine learning. McGraw-Hill, New YorkMATH Mitchell TM (1997) Machine learning. McGraw-Hill, New YorkMATH
Zurück zum Zitat Morrison RW, De Jong KA (2000) Triggered hypermutation revisited. In: Proceedings of the 2000 IEEE congress on evolutionary computing, pp 1025–1032 Morrison RW, De Jong KA (2000) Triggered hypermutation revisited. In: Proceedings of the 2000 IEEE congress on evolutionary computing, pp 1025–1032
Zurück zum Zitat Morrison RW (2004) Designing evolutionary algorithms for dynamic environments. Springer, BerlinMATH Morrison RW (2004) Designing evolutionary algorithms for dynamic environments. Springer, BerlinMATH
Zurück zum Zitat Richter H (2005) A study of dynamic severity in chaotic fitness landscapes. In: Proceedings of the 2005 IEEE congress on evolutionary computing, pp 2824–2831 Richter H (2005) A study of dynamic severity in chaotic fitness landscapes. In: Proceedings of the 2005 IEEE congress on evolutionary computing, pp 2824–2831
Zurück zum Zitat Richter H, Yang S (2008) Memory based on abstraction for dynamic fitness functions. In: EvoWorkshops 2008: applications of evolutionary computing, LNCS, vol 4974, pp 597–606 Richter H, Yang S (2008) Memory based on abstraction for dynamic fitness functions. In: EvoWorkshops 2008: applications of evolutionary computing, LNCS, vol 4974, pp 597–606
Zurück zum Zitat Simões A, Costa E (2007) Variable-size memory evolutionary algorithm to deal with dynamic environments. In: EvoWorkshops 2007: applications of evolutionary computing, LNCS, vol 4448, pp 617–626 Simões A, Costa E (2007) Variable-size memory evolutionary algorithm to deal with dynamic environments. In: EvoWorkshops 2007: applications of evolutionary computing, LNCS, vol 4448, pp 617–626
Zurück zum Zitat Tinós R, Yang S (2007) A self-organizing random immigrants genetic algorithm for dynamic optimization problems. Genetic Programming and Evolvable Machines 8(3):255–286CrossRef Tinós R, Yang S (2007) A self-organizing random immigrants genetic algorithm for dynamic optimization problems. Genetic Programming and Evolvable Machines 8(3):255–286CrossRef
Zurück zum Zitat Yang S (2005) Population-based incremental learning with memory scheme for changing environments. Proc. of the 2005 Genetic and Evol Comput Conf., vol 1, pp 711–718 Yang S (2005) Population-based incremental learning with memory scheme for changing environments. Proc. of the 2005 Genetic and Evol Comput Conf., vol 1, pp 711–718
Zurück zum Zitat Yang S (2006) Associative memory scheme for genetic algorithms in dynamic environments. In: EvoWorkshops 2006: applications of evolutionary computing, LNCS, vol 3907, pp 788–799 Yang S (2006) Associative memory scheme for genetic algorithms in dynamic environments. In: EvoWorkshops 2006: applications of evolutionary computing, LNCS, vol 3907, pp 788–799
Zurück zum Zitat Yang S, Yao X (2008) Population-based incremental learning with associative memory for dynamic environments. IEEE Trans Evol Comput 12(5):542–561CrossRef Yang S, Yao X (2008) Population-based incremental learning with associative memory for dynamic environments. IEEE Trans Evol Comput 12(5):542–561CrossRef
Metadaten
Titel
Learning behavior in abstract memory schemes for dynamic optimization problems
verfasst von
Hendrik Richter
Shengxiang Yang
Publikationsdatum
01.10.2009
Verlag
Springer-Verlag
Erschienen in
Soft Computing / Ausgabe 12/2009
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-009-0420-6

Weitere Artikel der Ausgabe 12/2009

Soft Computing 12/2009 Zur Ausgabe

Editorial

Editorial