Skip to main content
Erschienen in: Soft Computing 13/2018

03.06.2017 | Methodologies and Application

A new differential evolution algorithm for solving multimodal optimization problems with high dimensionality

verfasst von: Shouheng Tuo, Junying Zhang, Xiguo Yuan, Longquan Yong

Erschienen in: Soft Computing | Ausgabe 13/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Differential evolution (DE) is an efficient intelligent optimization algorithm which has been widely applied to real-world problems, however poor in solution quality and convergence performance for complex multimodal optimization problems. To tackle this problem, a new improving strategy for DE algorithm is presented, in which crossover operator, mutation operator and a new local variables adjustment strategy are integrated together to make the DE more efficient and effective. An improved dynamic crossover rate is adopted to manage the three operators, so to decrease the computational cost of DE. To investigate the performance of the proposed DE algorithm, some frequently referred mutation operators, i.e., DE/rand/1, DE/Best/1, DE/current-to-best/1, DE/Best/2, DE/rand/2, are employed, respectively, in proposed method for comparing with standard DE algorithm which also uses the same mutation operators as our method. Three state-of-the-art evolutionary algorithms (SaDE, CoDE and CMAES) and seven large-scale optimization algorithms on seven high-dimensional optimization problems of CEC2008 are compared with the proposed algorithm. We employ Wilcoxon Signed-Rank Test to further test the difference significance of performance between our algorithm and other compared algorithms. Experimental results demonstrate that the proposed algorithm is more effective in solution quality but with less CPU time (e.g., when dimensionality equals 1000, its mean optimal fitness is less than \(1\hbox {e}{-}9\) and the CPU time reduces by about 19.3% for function Schwefel 2.26), even with a very small population size, no matter which mutation operator is adopted.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Bhowmik P, Das S, Konar A, Das S, Nagar AK (2010) A new differential evolution with improved mutation strategy. In: Proceedings of the 2010 IEEE congress on evolutionary computation, pp 1–8 Bhowmik P, Das S, Konar A, Das S, Nagar AK (2010) A new differential evolution with improved mutation strategy. In: Proceedings of the 2010 IEEE congress on evolutionary computation, pp 1–8
Zurück zum Zitat Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657CrossRef Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657CrossRef
Zurück zum Zitat Brest J, Zamuda A, Boskovic B, Maucec MS (2008) High-dimensional real-parameter optimization using self-adaptive differential evolution algorithm with population size reduction. Evol Comput 47:2032–2039 Brest J, Zamuda A, Boskovic B, Maucec MS (2008) High-dimensional real-parameter optimization using self-adaptive differential evolution algorithm with population size reduction. Evol Comput 47:2032–2039
Zurück zum Zitat Cai Z, Gong W, Ling CX, Zhang H (2011) A clustering-based differential evolution for global optimization. Appl Soft Comput 11(1):1363–1379CrossRef Cai Z, Gong W, Ling CX, Zhang H (2011) A clustering-based differential evolution for global optimization. Appl Soft Comput 11(1):1363–1379CrossRef
Zurück zum Zitat Civicioglu P (2013) Backtracking search optimization algorithm for numerical optimization problems. Appl Math Comput 219(15):8121–8144MathSciNetMATH Civicioglu P (2013) Backtracking search optimization algorithm for numerical optimization problems. Appl Math Comput 219(15):8121–8144MathSciNetMATH
Zurück zum Zitat Das S, Abraham A, Chakraborty UK, Konar A (2009) Differential evolution using a neighborhood-based mutation operator. IEEE Trans Evol Comput 13(3):526–553CrossRef Das S, Abraham A, Chakraborty UK, Konar A (2009) Differential evolution using a neighborhood-based mutation operator. IEEE Trans Evol Comput 13(3):526–553CrossRef
Zurück zum Zitat Das S, Konar A, Chakraborty UK, (2005) Two improved differential evolution schemes for faster global search. In: Genetic and evolutionary computation conference, GECCO, 2005 proceedings. Washington DC, USA, June, pp 991–998 Das S, Konar A, Chakraborty UK, (2005) Two improved differential evolution schemes for faster global search. In: Genetic and evolutionary computation conference, GECCO, 2005 proceedings. Washington DC, USA, June, pp 991–998
Zurück zum Zitat Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18CrossRef Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18CrossRef
Zurück zum Zitat Gamperle R, Muller S, Koumoutsakos P (2002) A parameter study for differential evolution[C]. In: Proceedings WSEAS international conference on advances in intelligent systems, fuzzy systems, evolutionary computation, pp 293–298 Gamperle R, Muller S, Koumoutsakos P (2002) A parameter study for differential evolution[C]. In: Proceedings WSEAS international conference on advances in intelligent systems, fuzzy systems, evolutionary computation, pp 293–298
Zurück zum Zitat Ghosh A, Das S, Chowdhury A, Giri R (2011) An improved differential evolution algorithm with fitness-based adaptation of the control parameters. Inf Sci 181(18):3749–3765MathSciNetCrossRef Ghosh A, Das S, Chowdhury A, Giri R (2011) An improved differential evolution algorithm with fitness-based adaptation of the control parameters. Inf Sci 181(18):3749–3765MathSciNetCrossRef
Zurück zum Zitat Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9(2):159–195CrossRef Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9(2):159–195CrossRef
Zurück zum Zitat Herrera F, Lozano M, Molina D (2010) Test suite for the special issue of soft computing on scalability of evolutionary algorithms and other meta-heuristics for large scale continuous optimization problems. Technical report, SCI2S, University of Granada, Spain. http://sci2s.ugr.es/eamhco/CFP.php Herrera F, Lozano M, Molina D (2010) Test suite for the special issue of soft computing on scalability of evolutionary algorithms and other meta-heuristics for large scale continuous optimization problems. Technical report, SCI2S, University of Granada, Spain. http://​sci2s.​ugr.​es/​eamhco/​CFP.​php
Zurück zum Zitat Hsieh ST, Sun TY, Liu CC, Tsai SJ (2008) Solving large scale global optimization using improved particle swarm optimizer. In: IEEE congress on evolutionary computation, CEC 2008, June 1–6, 2008, Hong Kong, China, pp 1777–1784 Hsieh ST, Sun TY, Liu CC, Tsai SJ (2008) Solving large scale global optimization using improved particle swarm optimizer. In: IEEE congress on evolutionary computation, CEC 2008, June 1–6, 2008, Hong Kong, China, pp 1777–1784
Zurück zum Zitat Islam SM, Das S, Ghosh S, Roy S, Suganthan PN (2012) An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization. IEEE Trans Syst Man Cybern B (Cybern) 42(2):482–500CrossRef Islam SM, Das S, Ghosh S, Roy S, Suganthan PN (2012) An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization. IEEE Trans Syst Man Cybern B (Cybern) 42(2):482–500CrossRef
Zurück zum Zitat Jia D, Zheng G, Khan MK (2011) An effective memetic differential evolution algorithm based on chaotic local search. Inf Sci 181(15):3175–3187CrossRef Jia D, Zheng G, Khan MK (2011) An effective memetic differential evolution algorithm based on chaotic local search. Inf Sci 181(15):3175–3187CrossRef
Zurück zum Zitat Joshi R, Sanderson AC (1997) Minimal representation multisensory fusion using differential evolution. IEEE Trans Syst Man Cybern 38:266–273 Joshi R, Sanderson AC (1997) Minimal representation multisensory fusion using differential evolution. IEEE Trans Syst Man Cybern 38:266–273
Zurück zum Zitat Kitayama S, Arakawa M, Yamazaki K (2011) Differential evolution as the global optimization technique and its application to structural optimization. Appl Soft Comput 11(4):3792–3803CrossRef Kitayama S, Arakawa M, Yamazaki K (2011) Differential evolution as the global optimization technique and its application to structural optimization. Appl Soft Comput 11(4):3792–3803CrossRef
Zurück zum Zitat Kovačević D, Mladenović N, Petrović B, Milošević P (2014) DE-VNS: self-adaptive differential evolution with crossover neighborhood search for continuous global optimization. Comput Oper Res 52:157–169MathSciNetCrossRefMATH Kovačević D, Mladenović N, Petrović B, Milošević P (2014) DE-VNS: self-adaptive differential evolution with crossover neighborhood search for continuous global optimization. Comput Oper Res 52:157–169MathSciNetCrossRefMATH
Zurück zum Zitat Liao T Warren (2010) Two hybrid differential evolution algorithms for engineering design optimization. Appl Soft Comput 10(4):1188–1199CrossRef Liao T Warren (2010) Two hybrid differential evolution algorithms for engineering design optimization. Appl Soft Comput 10(4):1188–1199CrossRef
Zurück zum Zitat Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput 9(6):448–462 Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput 9(6):448–462
Zurück zum Zitat Liu W, Song H, Liang JJ, Qu B, Qin AK (2014) Neural network based on self-adaptive differential evolution for ultra-short-term power load forecasting. In: International conference on intelligent computing, pp 403–412. Springer International Publishing Liu W, Song H, Liang JJ, Qu B, Qin AK (2014) Neural network based on self-adaptive differential evolution for ultra-short-term power load forecasting. In: International conference on intelligent computing, pp 403–412. Springer International Publishing
Zurück zum Zitat Macnish C, Yao X (2008) Direction matters in high-dimensional optimisation. In: IEEE congress on evolutionary computation, CEC 2008, June 1–6, 2008, Hong Kong, China, pp 2372–2379 Macnish C, Yao X (2008) Direction matters in high-dimensional optimisation. In: IEEE congress on evolutionary computation, CEC 2008, June 1–6, 2008, Hong Kong, China, pp 2372–2379
Zurück zum Zitat Neri F, Iacca G, Mininno E (2011) Disturbed exploitation compact differential evolution for limited memory optimization problems. Inf Sci 181(12):2469–2487MathSciNetCrossRef Neri F, Iacca G, Mininno E (2011) Disturbed exploitation compact differential evolution for limited memory optimization problems. Inf Sci 181(12):2469–2487MathSciNetCrossRef
Zurück zum Zitat Noman N, Iba H (2008) Accelerating differential evolution using an adaptive local search. IEEE Trans Evol Comput 12(1):107–125CrossRef Noman N, Iba H (2008) Accelerating differential evolution using an adaptive local search. IEEE Trans Evol Comput 12(1):107–125CrossRef
Zurück zum Zitat Pan QK, Wang L, Gao L, Li WD (2011) An effective hybrid discrete differential evolution algorithm for the flow shop scheduling with intermediate buffers. Inf Sci 181(3):668–685CrossRef Pan QK, Wang L, Gao L, Li WD (2011) An effective hybrid discrete differential evolution algorithm for the flow shop scheduling with intermediate buffers. Inf Sci 181(3):668–685CrossRef
Zurück zum Zitat Price K, Storn RM, Lampinen JA (2006) Differential evolution: a practical approach to global optimization. Springer Science & Business Media, BerlinMATH Price K, Storn RM, Lampinen JA (2006) Differential evolution: a practical approach to global optimization. Springer Science & Business Media, BerlinMATH
Zurück zum Zitat Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417 (SaDE)CrossRef Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417 (SaDE)CrossRef
Zurück zum Zitat Rahnamayan S, Tizhoosh HR, Salama MMA (2008) Opposition-based differential evolution. IEEE Trans Evol Comput 12(1):64–79CrossRef Rahnamayan S, Tizhoosh HR, Salama MMA (2008) Opposition-based differential evolution. IEEE Trans Evol Comput 12(1):64–79CrossRef
Zurück zum Zitat Storn R, Price KV (1996) Minimizing the real functions of the ICEC’96 contest by differential evolution. In: International conference on evolutionary computation, pp 842–844 Storn R, Price KV (1996) Minimizing the real functions of the ICEC’96 contest by differential evolution. In: International conference on evolutionary computation, pp 842–844
Zurück zum Zitat Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces, vol 3. ICSI, BerkeleyMATH Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces, vol 3. ICSI, BerkeleyMATH
Zurück zum Zitat Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359MathSciNetCrossRefMATH Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359MathSciNetCrossRefMATH
Zurück zum Zitat Tang K, Yáo X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization. Nature Inspired Computation and Applications Laboratory, USTC, pp 153–177. http://nical.ustc.edu.cn/cec10ss.php Tang K, Yáo X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization. Nature Inspired Computation and Applications Laboratory, USTC, pp 153–177. http://​nical.​ustc.​edu.​cn/​cec10ss.​php
Zurück zum Zitat Tang K, Yáo X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization. Nature Inspired Computation and Applications Laboratory, USTC, pp 153–177. http://www.ntu.edu.sg/home/EPNSugan/, 2008 Tang K, Yáo X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization. Nature Inspired Computation and Applications Laboratory, USTC, pp 153–177. http://​www.​ntu.​edu.​sg/​home/​EPNSugan/​, 2008
Zurück zum Zitat Tasgetiren MF, Suganthan PN (2006) A multi-populated differential evolution algorithm for solving constrained optimization problem. In: Proceedings of the 2006 IEEE congress on evolutionary computation (CEC’2006). IEEE Press, Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada, pp 33–40 Tasgetiren MF, Suganthan PN (2006) A multi-populated differential evolution algorithm for solving constrained optimization problem. In: Proceedings of the 2006 IEEE congress on evolutionary computation (CEC’2006). IEEE Press, Sheraton Vancouver Wall Centre Hotel, Vancouver, BC, Canada, pp 33–40
Zurück zum Zitat Tseng LY, Chen C (2008) Multiple trajectory search for large scale global optimization. Evolutionary computation, 2008. CEC 2008 (IEEE world congress on computational intelligence). IEEE congress on, pp 3052–3059 Tseng LY, Chen C (2008) Multiple trajectory search for large scale global optimization. Evolutionary computation, 2008. CEC 2008 (IEEE world congress on computational intelligence). IEEE congress on, pp 3052–3059
Zurück zum Zitat Wang FS, Su TL, Jang HJ (2001) Hybrid differential evolution for problems of kinetic parameter estimation and dynamic optimization of an ethanol fermentation process. Ind Eng Chem Res 40(13):2876–2885CrossRef Wang FS, Su TL, Jang HJ (2001) Hybrid differential evolution for problems of kinetic parameter estimation and dynamic optimization of an ethanol fermentation process. Ind Eng Chem Res 40(13):2876–2885CrossRef
Zurück zum Zitat Wang Y, Liu H, Cai Z, Zhou Y (2007) An orthogonal design based constrained evolutionary optimization algorithm. Eng Optim 39(6):715–736MathSciNetCrossRef Wang Y, Liu H, Cai Z, Zhou Y (2007) An orthogonal design based constrained evolutionary optimization algorithm. Eng Optim 39(6):715–736MathSciNetCrossRef
Zurück zum Zitat Wang L, Pan QK, Suganthan PN, Wang WH, Wang YM (2010) A novel hybrid discrete differential evolution algorithm for blocking flow shop scheduling problems. Comput Oper Res 37(3):509–520MathSciNetCrossRefMATH Wang L, Pan QK, Suganthan PN, Wang WH, Wang YM (2010) A novel hybrid discrete differential evolution algorithm for blocking flow shop scheduling problems. Comput Oper Res 37(3):509–520MathSciNetCrossRefMATH
Zurück zum Zitat Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66 (CoDE)CrossRef Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66 (CoDE)CrossRef
Zurück zum Zitat Wang Y, Cai Z, Zhang Q (2012) Enhancing the search ability of differential evolution through orthogonal crossover. Inf Sci 185(1):153–177 (OXDE)MathSciNetCrossRef Wang Y, Cai Z, Zhang Q (2012) Enhancing the search ability of differential evolution through orthogonal crossover. Inf Sci 185(1):153–177 (OXDE)MathSciNetCrossRef
Zurück zum Zitat Wang Y, Dang C (2007) An evolutionary algorithm for global optimization based on level set evolution and Latin squares. IEEE Trans Evol Comput 11(5):579–595CrossRef Wang Y, Dang C (2007) An evolutionary algorithm for global optimization based on level set evolution and Latin squares. IEEE Trans Evol Comput 11(5):579–595CrossRef
Zurück zum Zitat Wang Y, Li B (2008) A restart univariate estimation of distribution algorithm: sampling under mixed Gaussian and Lévy probability distribution. In: Evolutionary computation, pp 3917–3924 Wang Y, Li B (2008) A restart univariate estimation of distribution algorithm: sampling under mixed Gaussian and Lévy probability distribution. In: Evolutionary computation, pp 3917–3924
Zurück zum Zitat Weber M, Neri F, Tirronen V (2011) A study on scale factor in distributed differential evolution. Inf Sci 181(12):2488–2511CrossRef Weber M, Neri F, Tirronen V (2011) A study on scale factor in distributed differential evolution. Inf Sci 181(12):2488–2511CrossRef
Zurück zum Zitat Xu Rui, Venayagamoorthy Ganesh K, Wunsch II Donald C (2007) Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization. Neural Netw 20(8):917–927CrossRefMATH Xu Rui, Venayagamoorthy Ganesh K, Wunsch II Donald C (2007) Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization. Neural Netw 20(8):917–927CrossRefMATH
Zurück zum Zitat Zaharie D, Petcu D (2003) Parallel implementation of multi-population differential evolution. In: Proceedings of the NATO advanced research workshop on concurrent information processing and computing, pp 223–232 Zaharie D, Petcu D (2003) Parallel implementation of multi-population differential evolution. In: Proceedings of the NATO advanced research workshop on concurrent information processing and computing, pp 223–232
Zurück zum Zitat Zamuda A, Brest J, Boskovic B, Zumer V (2008) Large scale global optimization using differential evolution with self-adaptation and cooperative co-evolution. Evol Comput 268:3718–3725 Zamuda A, Brest J, Boskovic B, Zumer V (2008) Large scale global optimization using differential evolution with self-adaptation and cooperative co-evolution. Evol Comput 268:3718–3725
Zurück zum Zitat Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958CrossRef Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958CrossRef
Zurück zum Zitat Zhao SZ, Liang JJ, Suganthan PN, Tasgetiren MF(2008) Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization. In: Evolutionary computation, pp 3845–3852 Zhao SZ, Liang JJ, Suganthan PN, Tasgetiren MF(2008) Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization. In: Evolutionary computation, pp 3845–3852
Zurück zum Zitat Zhou Y, Li X, Gao L (2013) A differential evolution algorithm with intersect mutation operator. Appl Soft Comput 13(1):390–401CrossRef Zhou Y, Li X, Gao L (2013) A differential evolution algorithm with intersect mutation operator. Appl Soft Comput 13(1):390–401CrossRef
Metadaten
Titel
A new differential evolution algorithm for solving multimodal optimization problems with high dimensionality
verfasst von
Shouheng Tuo
Junying Zhang
Xiguo Yuan
Longquan Yong
Publikationsdatum
03.06.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 13/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2632-5

Weitere Artikel der Ausgabe 13/2018

Soft Computing 13/2018 Zur Ausgabe