Skip to main content
Erschienen in:
Buchtitelbild

2016 | OriginalPaper | Buchkapitel

Local Fitness Meta-Models with Nearest Neighbor Regression

verfasst von : Oliver Kramer

Erschienen in: Applications of Evolutionary Computation

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In blackbox function optimization, the results of fitness function evaluations can be used to train a regression model. This meta-model can be used to replace function evaluations and thus reduce the number of fitness function evaluations in evolution strategies (ES). In this paper, we show that a reduction of the number of fitness function evaluations of a (1+1)-ES is possible with a combination of a nearest neighbor regression model, a local archive of fitness function evaluations, and a comparatively simple meta-model management. We analyze the reduction of fitness function evaluations on set of benchmark functions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
2.
Zurück zum Zitat Bouzarkouna, Z., Auger, A., Ding, D.Y.: Local-meta-model CMA-ES for partially separable functions. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 869–876 (2011) Bouzarkouna, Z., Auger, A., Ding, D.Y.: Local-meta-model CMA-ES for partially separable functions. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 869–876 (2011)
3.
Zurück zum Zitat Cruz-Vega, I., Garcia-Limon, M., Escalante, H.J.: Adaptive-surrogate based on a neuro-fuzzy network and granular computing. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 761–768 (2014) Cruz-Vega, I., Garcia-Limon, M., Escalante, H.J.: Adaptive-surrogate based on a neuro-fuzzy network and granular computing. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 761–768 (2014)
4.
Zurück zum Zitat Delgado, M.F., Cernadas, E., Barro, S., Amorim, D.G.: Do we need hundreds of classifiers to solve real world classification problems? J. Mach. Learn. Res. 15(1), 3133–3181 (2014)MathSciNetMATH Delgado, M.F., Cernadas, E., Barro, S., Amorim, D.G.: Do we need hundreds of classifiers to solve real world classification problems? J. Mach. Learn. Res. 15(1), 3133–3181 (2014)MathSciNetMATH
5.
Zurück zum Zitat Elsayed, S.M., Ray, T., Sarker, R.A.: A surrogate-assisted differential evolution algorithm with dynamic parameters selection for solving expensive optimization problems. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 1062–1068 (2014) Elsayed, S.M., Ray, T., Sarker, R.A.: A surrogate-assisted differential evolution algorithm with dynamic parameters selection for solving expensive optimization problems. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 1062–1068 (2014)
6.
Zurück zum Zitat Jin, Y., Olhofer, M., Sendhoff, B.: On evolutionary optimization with approximate fitness functions. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 786–793 (2000) Jin, Y., Olhofer, M., Sendhoff, B.: On evolutionary optimization with approximate fitness functions. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 786–793 (2000)
7.
Zurück zum Zitat Kramer, O., Schlachter, U., Spreckels, V.: An adaptive penalty function with meta-modeling for constrained problems. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 1350–1354 (2013) Kramer, O., Schlachter, U., Spreckels, V.: An adaptive penalty function with meta-modeling for constrained problems. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 1350–1354 (2013)
8.
Zurück zum Zitat Kruisselbrink, J.W., Emmerich, M.T.M., Deutz, A.H., Bäck, T.: A robust optimization approach using kriging metamodels for robustness approximation in the CMA-ES. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 1–8 (2010) Kruisselbrink, J.W., Emmerich, M.T.M., Deutz, A.H., Bäck, T.: A robust optimization approach using kriging metamodels for robustness approximation in the CMA-ES. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 1–8 (2010)
9.
Zurück zum Zitat Liao, Q., Zhou, A., Zhang, G.: A locally weighted metamodel for pre-selection in evolutionary optimization. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 2483–2490 (2014) Liao, Q., Zhou, A., Zhang, G.: A locally weighted metamodel for pre-selection in evolutionary optimization. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 2483–2490 (2014)
10.
Zurück zum Zitat Loshchilov, I., Schoenauer, M., Sebag, M.: A mono surrogate for multiobjective optimization. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 471–478 (2010) Loshchilov, I., Schoenauer, M., Sebag, M.: A mono surrogate for multiobjective optimization. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 471–478 (2010)
11.
Zurück zum Zitat Loshchilov, I., Schoenauer, M., Sebag, M.: Self-adaptive surrogate-assisted covariance matrix adaptation evolution strategy. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 321–328 (2012) Loshchilov, I., Schoenauer, M., Sebag, M.: Self-adaptive surrogate-assisted covariance matrix adaptation evolution strategy. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 321–328 (2012)
12.
Zurück zum Zitat Loshchilov, I., Schoenauer, M., Sebag, M.: Intensive surrogate model exploitation in self-adaptive surrogate-assisted cma-es (saacm-es). In: Genetic and Evolutionary Computation Conference (GECCO), pp. 439–446 (2013) Loshchilov, I., Schoenauer, M., Sebag, M.: Intensive surrogate model exploitation in self-adaptive surrogate-assisted cma-es (saacm-es). In: Genetic and Evolutionary Computation Conference (GECCO), pp. 439–446 (2013)
13.
Zurück zum Zitat Martínez, S.Z., Coello, C.A.C.: A multi-objective meta-model assisted memetic algorithm with non gradient-based local search. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 537–538 (2010) Martínez, S.Z., Coello, C.A.C.: A multi-objective meta-model assisted memetic algorithm with non gradient-based local search. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 537–538 (2010)
14.
Zurück zum Zitat Preuss, M., Rudolph, G., Wessing, S.: Tuning optimization algorithms for real-world problems by means of surrogate modeling. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 401–408 (2010) Preuss, M., Rudolph, G., Wessing, S.: Tuning optimization algorithms for real-world problems by means of surrogate modeling. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 401–408 (2010)
15.
Zurück zum Zitat Rechenberg, I.: Evolutionsstrategie - Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann-Holzboog, Stuttgart (1973) Rechenberg, I.: Evolutionsstrategie - Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann-Holzboog, Stuttgart (1973)
16.
Zurück zum Zitat Rosales-Pérez, A., Coello, C.A.C., Gonzalez, J.A., García, C.A.R., Escalante, H.J.: A hybrid surrogate-based approach for evolutionary multi-objective optimization. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 2548–2555 (2013) Rosales-Pérez, A., Coello, C.A.C., Gonzalez, J.A., García, C.A.R., Escalante, H.J.: A hybrid surrogate-based approach for evolutionary multi-objective optimization. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 2548–2555 (2013)
17.
Zurück zum Zitat Verbeeck, D., Maes, F., Grave, K.D., Blockeel, H.: Multi-objective optimization with surrogate trees. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 679–686 (2013) Verbeeck, D., Maes, F., Grave, K.D., Blockeel, H.: Multi-objective optimization with surrogate trees. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 679–686 (2013)
18.
Zurück zum Zitat Willmes, L., Bäck, T., Jin, Y., Sendhoff, B.: Comparing neural networks and kriging for fitness approximation in evolutionary optimization. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 663–670 (2003) Willmes, L., Bäck, T., Jin, Y., Sendhoff, B.: Comparing neural networks and kriging for fitness approximation in evolutionary optimization. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC), pp. 663–670 (2003)
Metadaten
Titel
Local Fitness Meta-Models with Nearest Neighbor Regression
verfasst von
Oliver Kramer
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-31153-1_1