Skip to main content

2018 | OriginalPaper | Buchkapitel

A Simple Proof for the Usefulness of Crossover in Black-Box Optimization

verfasst von : Eduardo Carvalho Pinto, Carola Doerr

Erschienen in: Parallel Problem Solving from Nature – PPSN XV

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The idea to recombine two or more search points into a new solution is one of the main design principles of evolutionary computation (EC). Its usefulness in the combinatorial optimization context, however, is subject to a highly controversial discussion between EC practitioners and the broader Computer Science research community. While the former, naturally, report significant speedups procured by crossover, the belief that sexual reproduction cannot advance the search for high-quality solutions seems common, for example, amongst theoretical computer scientists. Examples that help understand the role of crossover in combinatorial optimization are needed to promote an intensified discussion on this subject.
We contribute with this work an example of a crossover-based genetic algorithm (GA) that provably outperforms any mutation-based black-box heuristic on a classic benchmark problem. The appeal of our examples lies in its simplicity: the proof of the result uses standard mathematical techniques and can be taught in a basic algorithms lecture.
Our theoretical result is complemented by an empirical evaluation, which demonstrates that the superiority of the GA holds already for quite small problem instances.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
See Sect. 3 for a discussion of the fact that sampling the parent without replacement improves the expected optimization time of this algorithm on OneMax. We do not apply this modified parent selection rule in the greedy \((\mu +1)\) GA\(_{\text {mod}}\) to highlight that the main improvement stems from the modified mutation step.
 
Literatur
1.
Zurück zum Zitat Pinto, E.C., Doerr, C.: Discussion of a more practice-aware runtime analysis for evolutionary algorithms. In: EA 2017, pp. 298–305 (2017) Pinto, E.C., Doerr, C.: Discussion of a more practice-aware runtime analysis for evolutionary algorithms. In: EA 2017, pp. 298–305 (2017)
3.
Zurück zum Zitat Corus, D., Oliveto, P.S.: Standard steady state genetic algorithms can hillclimb faster than mutation-only evolutionary algorithms. IEEE Trans. Evol. Comput. (2018, to appear) Corus, D., Oliveto, P.S.: Standard steady state genetic algorithms can hillclimb faster than mutation-only evolutionary algorithms. IEEE Trans. Evol. Comput. (2018, to appear)
4.
Zurück zum Zitat Doerr, B., Doerr, C.: The impact of random initialization on the runtime of randomized search heuristics. Algorithmica 75, 529–553 (2016)MathSciNetCrossRef Doerr, B., Doerr, C.: The impact of random initialization on the runtime of randomized search heuristics. Algorithmica 75, 529–553 (2016)MathSciNetCrossRef
5.
Zurück zum Zitat Doerr, B., Doerr, C.: Optimal static and self-adjusting parameter choices for the \((1+(\lambda,\lambda ))\) genetic algorithm. Algorithmica 80, 1658–1709 (2018)MathSciNetCrossRef Doerr, B., Doerr, C.: Optimal static and self-adjusting parameter choices for the \((1+(\lambda,\lambda ))\) genetic algorithm. Algorithmica 80, 1658–1709 (2018)MathSciNetCrossRef
6.
Zurück zum Zitat Doerr, B., Doerr, C., Ebel, F.: From black-box complexity to designing new genetic algorithms. Theor. Comput. Sci. 567, 87–104 (2015)MathSciNetCrossRef Doerr, B., Doerr, C., Ebel, F.: From black-box complexity to designing new genetic algorithms. Theor. Comput. Sci. 567, 87–104 (2015)MathSciNetCrossRef
7.
Zurück zum Zitat Doerr, B., Doerr, C., Yang, J.: Optimal parameter choices via precise black-box analysis. In: GECCO 2016, pp. 1123–1130. ACM (2016) Doerr, B., Doerr, C., Yang, J.: Optimal parameter choices via precise black-box analysis. In: GECCO 2016, pp. 1123–1130. ACM (2016)
8.
Zurück zum Zitat Doerr, B., Happ, E., Klein, C.: Crossover can provably be useful in evolutionary computation. Theor. Comput. Sci. 425, 17–33 (2012)MathSciNetCrossRef Doerr, B., Happ, E., Klein, C.: Crossover can provably be useful in evolutionary computation. Theor. Comput. Sci. 425, 17–33 (2012)MathSciNetCrossRef
9.
Zurück zum Zitat Doerr, B., Johannsen, D., Kötzing, T., Lehre, P.K., Wagner, M., Winzen, C.: Faster black-box algorithms through higher arity operators. In: FOGA 2011, pp. 163–172. ACM (2011) Doerr, B., Johannsen, D., Kötzing, T., Lehre, P.K., Wagner, M., Winzen, C.: Faster black-box algorithms through higher arity operators. In: FOGA 2011, pp. 163–172. ACM (2011)
11.
Zurück zum Zitat Jansen, T., Wegener, I.: The analysis of evolutionary algorithms - a proof that crossover really can help. Algorithmica 34, 47–66 (2002)MathSciNetCrossRef Jansen, T., Wegener, I.: The analysis of evolutionary algorithms - a proof that crossover really can help. Algorithmica 34, 47–66 (2002)MathSciNetCrossRef
12.
Zurück zum Zitat Jansen, T., Zarges, C.: Analysis of evolutionary algorithms: from computational complexity analysis to algorithm engineering. In: FOGA 2011, pp. 1–14. ACM (2011) Jansen, T., Zarges, C.: Analysis of evolutionary algorithms: from computational complexity analysis to algorithm engineering. In: FOGA 2011, pp. 1–14. ACM (2011)
14.
Zurück zum Zitat Sudholt, D.: Crossover speeds up building-block assembly. In: GECCO 2012, pp. 689–702. ACM (2012) Sudholt, D.: Crossover speeds up building-block assembly. In: GECCO 2012, pp. 689–702. ACM (2012)
15.
Zurück zum Zitat Sudholt, D.: A new method for lower bounds on the running time of evolutionary algorithms. IEEE Trans. Evol. Comput. 17, 418–435 (2013)CrossRef Sudholt, D.: A new method for lower bounds on the running time of evolutionary algorithms. IEEE Trans. Evol. Comput. 17, 418–435 (2013)CrossRef
16.
Zurück zum Zitat Sudholt, D.: How crossover speeds up building block assembly in genetic algorithms. Evol. Comput. 25, 237–274 (2017)CrossRef Sudholt, D.: How crossover speeds up building block assembly in genetic algorithms. Evol. Comput. 25, 237–274 (2017)CrossRef
17.
Zurück zum Zitat Witt, C.: Tight bounds on the optimization time of a randomized search heuristic on linear functions. Comb. Probab. Comput. 22, 294–318 (2013)MathSciNetCrossRef Witt, C.: Tight bounds on the optimization time of a randomized search heuristic on linear functions. Comb. Probab. Comput. 22, 294–318 (2013)MathSciNetCrossRef
Metadaten
Titel
A Simple Proof for the Usefulness of Crossover in Black-Box Optimization
verfasst von
Eduardo Carvalho Pinto
Carola Doerr
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-99259-4_3

Premium Partner