Skip to main content
Erschienen in: Soft Computing 8/2017

04.11.2015 | Methodologies and Application

Differential Evolution with Grid-Based Parameter Adaptation

verfasst von: Vasileios A. Tatsis, Konstantinos E. Parsopoulos

Erschienen in: Soft Computing | Ausgabe 8/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The reduction of human intervention in tuning metaheuristic optimization algorithms has been an ongoing research pursuit. Differential Evolution is a very popular algorithm that counts a large number of variants. However, its efficiency has been shown to depend on the type of its crossover operators (binomial or exponential), mutation operators, as well as on the two parameters that dominate these procedures. Making proper decisions on these parameters has proved to be a laborious, problem-dependent task. We propose a parameter adaptation technique that allows the algorithm to dynamically determine the most suitable crossover type and parameter values during its execution. The technique is based on a search procedure in the discretized parameter search space, using estimations of the algorithm’s performance. The proposed approach is tested and statistically validated on an established high-dimensional test suite. Also, comparisons with other algorithms are reported, verifying the competitiveness of the proposed approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Auger A, Hansen N (2005) A restart CMA evolution strategy with increasing population size. In: Proceedings of the 2005 IEEE congress on evolutionary computation, pp 769–1776 Auger A, Hansen N (2005) A restart CMA evolution strategy with increasing population size. In: Proceedings of the 2005 IEEE congress on evolutionary computation, pp 769–1776
Zurück zum Zitat Bäck T (1996) Evolutionary algorithms in theory and practice: evolution strategies, evolutionary programming, genetic algorithms. Oxford University Press, New York Bäck T (1996) Evolutionary algorithms in theory and practice: evolution strategies, evolutionary programming, genetic algorithms. Oxford University Press, New York
Zurück zum Zitat Brest J, Bošković B, Zamuda A (2012) Self-adaptive differential evolution algorithm with a small and varying population size. In: WCCI 2012 IEEE World congress on computational intelligence Brest J, Bošković B, Zamuda A (2012) Self-adaptive differential evolution algorithm with a small and varying population size. In: WCCI 2012 IEEE World congress on computational intelligence
Zurück zum Zitat Brest J, Greiner S, Bošković B, Mernik M, Žumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657CrossRef Brest J, Greiner S, Bošković B, Mernik M, Žumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657CrossRef
Zurück zum Zitat Brest J, Maucec MS (2011) Self-adaptive differential evolution algorithm using population size reduction and three strategies. Soft Comput 15:2157–2174CrossRef Brest J, Maucec MS (2011) Self-adaptive differential evolution algorithm using population size reduction and three strategies. Soft Comput 15:2157–2174CrossRef
Zurück zum Zitat Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31CrossRef Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31CrossRef
Zurück zum Zitat de Oca MAM, Aydin D, Stützle T (2011) An incremental particle swarm for large-scale optimization problems: an example of tuning-in-the-loop (re)design of optimization algorithms. Soft Comput 15:2233–2255CrossRef de Oca MAM, Aydin D, Stützle T (2011) An incremental particle swarm for large-scale optimization problems: an example of tuning-in-the-loop (re)design of optimization algorithms. Soft Comput 15:2233–2255CrossRef
Zurück zum Zitat Duarte A, Martí R, Gortazar F (2011) Path relinking for large scale global optimization. Soft Comput 15:2257–2273CrossRef Duarte A, Martí R, Gortazar F (2011) Path relinking for large scale global optimization. Soft Comput 15:2257–2273CrossRef
Zurück zum Zitat Eiben AE, Hinterding R, Michalewicz Z (1999) Parameter control in evolutionary algorithms. IEEE Trans Evol Comput 3(2):124–141CrossRef Eiben AE, Hinterding R, Michalewicz Z (1999) Parameter control in evolutionary algorithms. IEEE Trans Evol Comput 3(2):124–141CrossRef
Zurück zum Zitat Eiben AE, Smit SK (2011) Evolutionary algorithm parameters and methods to tune them. In: Hamadi Y, Monfroy E, Saubion F (eds) Autonomous search, chap. 2. Springer, Berlin, pp 15–36 Eiben AE, Smit SK (2011) Evolutionary algorithm parameters and methods to tune them. In: Hamadi Y, Monfroy E, Saubion F (eds) Autonomous search, chap. 2. Springer, Berlin, pp 15–36
Zurück zum Zitat Eshelman LJ, Schaffer JD (1993) Real-coded genetic algorithms and interval-schemata. Found Genet Algorithms 2:187–202 Eshelman LJ, Schaffer JD (1993) Real-coded genetic algorithms and interval-schemata. Found Genet Algorithms 2:187–202
Zurück zum Zitat García-Martínez C, Rodríguez FJ, Lozano M (2011) Role differentiation and malleable mating for differential evolution: an analysis on large scale optimisation. Soft Comput 15:2109–2126CrossRef García-Martínez C, Rodríguez FJ, Lozano M (2011) Role differentiation and malleable mating for differential evolution: an analysis on large scale optimisation. Soft Comput 15:2109–2126CrossRef
Zurück zum Zitat García-Nieto J, Alba E (2011) Restart particle swarm optimization with velocity modulation: a scalability test. Soft Comput 15:2221–2232CrossRef García-Nieto J, Alba E (2011) Restart particle swarm optimization with velocity modulation: a scalability test. Soft Comput 15:2221–2232CrossRef
Zurück zum Zitat Gardeux V, Chelouah R, Siarry P, Glover F (2011) EM323: a line search based algorithm for solving high-dimensional continuous non-linear optimization problems. Soft Comput 15:2275–2285CrossRef Gardeux V, Chelouah R, Siarry P, Glover F (2011) EM323: a line search based algorithm for solving high-dimensional continuous non-linear optimization problems. Soft Comput 15:2275–2285CrossRef
Zurück zum Zitat Hoos HH (2011) Automated algorithm configuration and parameter tuning. In: Hamadi Y, Monfroy E, Saubion F (eds) Autonomous search, chap. 3. Springer, Berlin, pp 37–72 Hoos HH (2011) Automated algorithm configuration and parameter tuning. In: Hamadi Y, Monfroy E, Saubion F (eds) Autonomous search, chap. 3. Springer, Berlin, pp 37–72
Zurück zum Zitat LaTorre A, Muelas S, Peña J (2011) A MOS-based dynamic memetic differential evolution algorithm for continuous optimization a scalability test. Soft Comput 15:2187–2199CrossRef LaTorre A, Muelas S, Peña J (2011) A MOS-based dynamic memetic differential evolution algorithm for continuous optimization a scalability test. Soft Comput 15:2187–2199CrossRef
Zurück zum Zitat LaTorre A, Muelas S, Peña J (2012) Multiple offspring sampling in large scale global optimization. In: 2012 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8 LaTorre A, Muelas S, Peña J (2012) Multiple offspring sampling in large scale global optimization. In: 2012 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8
Zurück zum Zitat Lozano M, Herrera F, Molina D (2011) Editorial scalability of evolutionary algorithms and other metaheuristics for large-scale continuous optimization problems. Soft Comput 15:2085–2087CrossRef Lozano M, Herrera F, Molina D (2011) Editorial scalability of evolutionary algorithms and other metaheuristics for large-scale continuous optimization problems. Soft Comput 15:2085–2087CrossRef
Zurück zum Zitat Molina D, Lozano M, Sánchez AM, Herrera F (2011) Memetic algorithms based on local search chains for large scale continuous optimisation problems: MA-SSW-Chains. Soft Comput 15:2201–2220CrossRef Molina D, Lozano M, Sánchez AM, Herrera F (2011) Memetic algorithms based on local search chains for large scale continuous optimisation problems: MA-SSW-Chains. Soft Comput 15:2201–2220CrossRef
Zurück zum Zitat Neumaier A, Fendl H, Schilly H, Leitner T (2011) VXQR: derivative-free unconstrained optimization based on QR factorizations. Soft Comput 15:2287–2298CrossRef Neumaier A, Fendl H, Schilly H, Leitner T (2011) VXQR: derivative-free unconstrained optimization based on QR factorizations. Soft Comput 15:2287–2298CrossRef
Zurück zum Zitat Parsopoulos K, Vrahatis M (2010) Particle swarm optimization and intelligence: advances and applications. Information Science Publishing (IGI Global) Parsopoulos K, Vrahatis M (2010) Particle swarm optimization and intelligence: advances and applications. Information Science Publishing (IGI Global)
Zurück zum Zitat Piotrowski AP (2013) Adaptive memetic differential evolution with global and local neighborhood-based mutation operators. Inf Sci 241:164–194CrossRef Piotrowski AP (2013) Adaptive memetic differential evolution with global and local neighborhood-based mutation operators. Inf Sci 241:164–194CrossRef
Zurück zum Zitat Poláková R, Tvrdík J, Bujok P (2014) Controlled restart in differential evolution applied to CEC2014 benchmark functions. In: IEEE congress on evolutionary computation Poláková R, Tvrdík J, Bujok P (2014) Controlled restart in differential evolution applied to CEC2014 benchmark functions. In: IEEE congress on evolutionary computation
Zurück zum Zitat Price KV, Storn RM, Lampinen JA (2005) Differential evolution: a practical approach to global optimization. Springer, BerlinMATH Price KV, Storn RM, Lampinen JA (2005) Differential evolution: a practical approach to global optimization. Springer, BerlinMATH
Zurück zum Zitat Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRef Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRef
Zurück zum Zitat Qing A (2009) Differential evolution: fundamentals and applications in electrical engineering. Wiley-IEEE Press, New York Qing A (2009) Differential evolution: fundamentals and applications in electrical engineering. Wiley-IEEE Press, New York
Zurück zum Zitat Segura C, Coello CAC, Segredo E, León C (2015) On the adaptation of the mutation scale factor in differential evolution. Optim Lett 9(1):189–198MathSciNetCrossRefMATH Segura C, Coello CAC, Segredo E, León C (2015) On the adaptation of the mutation scale factor in differential evolution. Optim Lett 9(1):189–198MathSciNetCrossRefMATH
Zurück zum Zitat Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359MathSciNetCrossRefMATH Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359MathSciNetCrossRefMATH
Zurück zum Zitat Tanabe R, Fukunaga A (2013) Success-history based parameter adaptation for differential evolution. In: IEEE congress on evolutionary computation Tanabe R, Fukunaga A (2013) Success-history based parameter adaptation for differential evolution. In: IEEE congress on evolutionary computation
Zurück zum Zitat Tanabe R, Fukunaga A (2014) Improving the search performance of SHADE using linear population size reduction. In: IEEE congress on evolutionary computation Tanabe R, Fukunaga A (2014) Improving the search performance of SHADE using linear population size reduction. In: IEEE congress on evolutionary computation
Zurück zum Zitat Tang K, Yao X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the cec2008 special session and competition on large scale global optimization. Nature Inspired Computation and Applications Laboratory, USTC, China, pp 153–177 Tang K, Yao X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the cec2008 special session and competition on large scale global optimization. Nature Inspired Computation and Applications Laboratory, USTC, China, pp 153–177
Zurück zum Zitat Tvrdík J (2006) Competitive differential evolution. In: 12th international coference on soft computing Tvrdík J (2006) Competitive differential evolution. In: 12th international coference on soft computing
Zurück zum Zitat Tvrdík J, Poláková R (2013) Competitive differential evolution applied to CEC 2013 problems. In: 2013 IEEE Congress on evolutionary computation (CEC). IEEE, pp 1651–1657 Tvrdík J, Poláková R (2013) Competitive differential evolution applied to CEC 2013 problems. In: 2013 IEEE Congress on evolutionary computation (CEC). IEEE, pp 1651–1657
Zurück zum Zitat Wang H, Wu Z, Rahnamayan S (2011) Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems. Soft Comput 15:2127–2140CrossRef Wang H, Wu Z, Rahnamayan S (2011) Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems. Soft Comput 15:2127–2140CrossRef
Zurück zum Zitat Weber M, Neri F, Tirronen V (2011) Shuffle or update parallel differential evolution for large scale optimization. Soft Comput 15:2089–2107CrossRef Weber M, Neri F, Tirronen V (2011) Shuffle or update parallel differential evolution for large scale optimization. Soft Comput 15:2089–2107CrossRef
Zurück zum Zitat Weber M, Tirronen V, Neri F (2010) Scale factor inheritance mechanism in distributed differential evolution. Soft Comput 14:1187–1207CrossRef Weber M, Tirronen V, Neri F (2010) Scale factor inheritance mechanism in distributed differential evolution. Soft Comput 14:1187–1207CrossRef
Zurück zum Zitat Yang Z, Tang K, Yao X (2011) Scalability of generalized adaptive differential evolution for large-scale continuous optimization. Soft Comput 15:2141–2155CrossRef Yang Z, Tang K, Yao X (2011) Scalability of generalized adaptive differential evolution for large-scale continuous optimization. Soft Comput 15:2141–2155CrossRef
Zurück zum Zitat Zaharie D (2007) A comparative analysis of crossover variants in differential evolution. In: Proceedings of IMCSIT, pp 171–181 Zaharie D (2007) A comparative analysis of crossover variants in differential evolution. In: Proceedings of IMCSIT, pp 171–181
Zurück zum Zitat Zaharie D (2009) Influence of crossover on the behavior of differential evolution algorithms. Appl Soft Comput 9(3):1126–1138CrossRef Zaharie D (2009) Influence of crossover on the behavior of differential evolution algorithms. Appl Soft Comput 9(3):1126–1138CrossRef
Zurück zum Zitat Zaharie D, Petcu D (2005) Parallel implementation of multi-population differential evolution. In: Concurrent information processing and computing, pp 223–232 Zaharie D, Petcu D (2005) Parallel implementation of multi-population differential evolution. In: Concurrent information processing and computing, pp 223–232
Zurück zum Zitat Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13:945–958CrossRef Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13:945–958CrossRef
Zurück zum Zitat Zhao S, Suganthan P, Das S (2011) Self-adaptive differential evolution with multi-trajectory search for large-scale optimization. Soft Comput 15(11):2175–2185CrossRef Zhao S, Suganthan P, Das S (2011) Self-adaptive differential evolution with multi-trajectory search for large-scale optimization. Soft Comput 15(11):2175–2185CrossRef
Metadaten
Titel
Differential Evolution with Grid-Based Parameter Adaptation
verfasst von
Vasileios A. Tatsis
Konstantinos E. Parsopoulos
Publikationsdatum
04.11.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 8/2017
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-015-1911-2

Weitere Artikel der Ausgabe 8/2017

Soft Computing 8/2017 Zur Ausgabe

Premium Partner