Skip to main content
Erschienen in: Soft Computing 5/2011

01.05.2011 | Original Paper

Improving the performance of differential evolution algorithm using Cauchy mutation

verfasst von: Musrrat Ali, Millie Pant

Erschienen in: Soft Computing | Ausgabe 5/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Differential evolution (DE) is a powerful yet simple evolutionary algorithm for optimization of real-valued, multimodal functions. DE is generally considered as a reliable, accurate and robust optimization technique. However, the algorithm suffers from premature convergence and/or slow convergence rate resulting in poor solution quality and/or larger number of function evaluation resulting in large CPU time for optimizing the computationally expensive objective functions. Therefore, an attempt to speed up DE is considered necessary. This research introduces a modified differential evolution (MDE) that enhances the convergence rate without compromising with the solution quality. The proposed MDE algorithm maintains a failure_counter (FC) to keep a tab on the performance of the algorithm by scanning or monitoring the individuals. Finally, the individuals that fail to show any improvement in the function value for a successive number of generations are subject to Cauchy mutation with the hope of pulling them out of a local attractor which may be the cause of their deteriorating performance. The performance of proposed MDE is investigated on a comprehensive set of 15 standard benchmark problems with varying degrees of complexities and 7 nontraditional problems suggested in the special session of CEC2008. Numerical results and statistical analysis show that the proposed modifications help in locating the global optimal solution in lesser numbers of function evaluation in comparison with basic DE and several other contemporary optimization algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Abbass H (2002) The self-adaptive pareto differential evolution algorithm. In: Proceedings of the 2002 congress on evolutionary computation, pp 831–836 Abbass H (2002) The self-adaptive pareto differential evolution algorithm. In: Proceedings of the 2002 congress on evolutionary computation, pp 831–836
Zurück zum Zitat Andre J, Siarry P, Dognon T (2001) An improvement of the standard genetic algorithm fighting premature convergence in continuous optimization. Adv Eng Software 32:49–60CrossRef Andre J, Siarry P, Dognon T (2001) An improvement of the standard genetic algorithm fighting premature convergence in continuous optimization. Adv Eng Software 32:49–60CrossRef
Zurück zum Zitat Birru HK, Chellapilla K, Rao SS (1999) Local search operators in fast evolutionary programming. Proc IEEE Int Conf Evol Comput 2:1506–1513 Birru HK, Chellapilla K, Rao SS (1999) Local search operators in fast evolutionary programming. Proc IEEE Int Conf Evol Comput 2:1506–1513
Zurück zum Zitat Brest J, Boskovic B, Greiner S, Zumer V, Maucec MS (2007) Performance comparison of self-adaptive and adaptive differential evolution algorithms. Soft Comput 11(7):617–629 Brest J, Boskovic B, Greiner S, Zumer V, Maucec MS (2007) Performance comparison of self-adaptive and adaptive differential evolution algorithms. Soft Comput 11(7):617–629
Zurück zum Zitat Caponio A, Neri F, Tirronen V (2009) Superfit control adaptation in memetic differential evolution frameworks. Soft Comput 13:811–831 Caponio A, Neri F, Tirronen V (2009) Superfit control adaptation in memetic differential evolution frameworks. Soft Comput 13:811–831
Zurück zum Zitat Coelho LS, Krohling RA (2003) Predictive controller tuning using modified particle swarm optimization based on Cauchy and Gaussian distributions. In: Proceedings of the 8th on-line world conference on soft computing in industrial applications. WSC8 Coelho LS, Krohling RA (2003) Predictive controller tuning using modified particle swarm optimization based on Cauchy and Gaussian distributions. In: Proceedings of the 8th on-line world conference on soft computing in industrial applications. WSC8
Zurück zum Zitat Fan H-Y, Lampinen J (2003) A trigonometric mutation operation to differential evolution. J Glob Optim 27:105–129 Fan H-Y, Lampinen J (2003) A trigonometric mutation operation to differential evolution. J Glob Optim 27:105–129
Zurück zum Zitat Gamperle R, Muller SD, Koumoutsakos A (2002) Parameter study for differential evolution. In: WSEAS NNA-FSFS-EC 2002. Interlaken, Switzerland Gamperle R, Muller SD, Koumoutsakos A (2002) Parameter study for differential evolution. In: WSEAS NNA-FSFS-EC 2002. Interlaken, Switzerland
Zurück zum Zitat García S, Molina D, Lozano M, Herrera F (2009a) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics 15:617–644CrossRefMATH García S, Molina D, Lozano M, Herrera F (2009a) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics 15:617–644CrossRefMATH
Zurück zum Zitat García S, Fernández A, Luengo J, Herrera f (2009b) A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft Comput 13:10:959–977. doi:10.1007/s00500-008-0392-y García S, Fernández A, Luengo J, Herrera f (2009b) A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft Comput 13:10:959–977. doi:10.​1007/​s00500-008-0392-y
Zurück zum Zitat Hendtlass T (2001) A combined swarm differential evolution algorithm for optimization problems. In: Proceedings of the fourteenth international conference on industrial and engineering applications of artificial intelligence and expert systems. Lecture notes in computer science. Springer, Berlin, vol 2070, pp 11–18 Hendtlass T (2001) A combined swarm differential evolution algorithm for optimization problems. In: Proceedings of the fourteenth international conference on industrial and engineering applications of artificial intelligence and expert systems. Lecture notes in computer science. Springer, Berlin, vol 2070, pp 11–18
Zurück zum Zitat Hrstka O, Kucerová A (2004) Improvement of real coded genetic algorithm based on differential operators preventing premature convergence. Adv Eng Software 35:237–246CrossRef Hrstka O, Kucerová A (2004) Improvement of real coded genetic algorithm based on differential operators preventing premature convergence. Adv Eng Software 35:237–246CrossRef
Zurück zum Zitat Kannan S, Slochanal S, Subbaraj P, Padhy N (2004) Application of particle swarm optimization technique and its variants to generation expansion planning. Electr Power Syst Res 70(3):203–210CrossRef Kannan S, Slochanal S, Subbaraj P, Padhy N (2004) Application of particle swarm optimization technique and its variants to generation expansion planning. Electr Power Syst Res 70(3):203–210CrossRef
Zurück zum Zitat Lampinen J, Zelinka I (2000) On stagnation of the differential evolution algorithm. In: Ošmera P (ed) Proceedings of MENDEL 2000, 6th international mendel conference on soft computing. Brno, Czech Republic, pp 76–83 Lampinen J, Zelinka I (2000) On stagnation of the differential evolution algorithm. In: Ošmera P (ed) Proceedings of MENDEL 2000, 6th international mendel conference on soft computing. Brno, Czech Republic, pp 76–83
Zurück zum Zitat Lan K-T, Lan C-H (2008) Notes on the distinction of Gaussian and Cauchy mutations. In: Eighth international conference on intelligent systems design and applications, vol 1, pp 272–277 Lan K-T, Lan C-H (2008) Notes on the distinction of Gaussian and Cauchy mutations. In: Eighth international conference on intelligent systems design and applications, vol 1, pp 272–277
Zurück zum Zitat Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput Fusion Found Methodol Appl 9(6):448–462MATH Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput Fusion Found Methodol Appl 9(6):448–462MATH
Zurück zum Zitat Noman N, Iba H (2005) Enhancing differential evolution performance with local search for high dimensional function optimization. In: Proceedings of the 2005 conference on genetic and evolutionary computation, pp 967–974 Noman N, Iba H (2005) Enhancing differential evolution performance with local search for high dimensional function optimization. In: Proceedings of the 2005 conference on genetic and evolutionary computation, pp 967–974
Zurück zum Zitat Noman N, Iba H (2008) Accelerating differential evolution using an adaptive local search. IEEE Trans Evol Comput 12(1):107–125CrossRef Noman N, Iba H (2008) Accelerating differential evolution using an adaptive local search. IEEE Trans Evol Comput 12(1):107–125CrossRef
Zurück zum Zitat Omran M, Engelbrecht A, Salman A (2005a) Differential evolution methods for unsupervised image classification. Proc IEEE Congr Evol Comput 2:966–973CrossRef Omran M, Engelbrecht A, Salman A (2005a) Differential evolution methods for unsupervised image classification. Proc IEEE Congr Evol Comput 2:966–973CrossRef
Zurück zum Zitat Omran M, Salman A, Engelbrecht AP (2005b) Self-adaptive differential evolution, computational intelligence and security, PT 1. In: Proceedings lecture notes in artificial intelligence, vol 3801, pp 192–199 Omran M, Salman A, Engelbrecht AP (2005b) Self-adaptive differential evolution, computational intelligence and security, PT 1. In: Proceedings lecture notes in artificial intelligence, vol 3801, pp 192–199
Zurück zum Zitat Pant M, Ali M, Singh VP (2009) Parent centric differential evolution algorithm for global optimization. Opsearch 46(2):153–168CrossRefMATHMathSciNet Pant M, Ali M, Singh VP (2009) Parent centric differential evolution algorithm for global optimization. Opsearch 46(2):153–168CrossRefMATHMathSciNet
Zurück zum Zitat Price K (1999) An introduction to DE. In: Corne D, Marco D, Glover F (eds) New ideas in optimization. McGraw-Hill, London (UK), pp 78–108 Price K (1999) An introduction to DE. In: Corne D, Marco D, Glover F (eds) New ideas in optimization. McGraw-Hill, London (UK), pp 78–108
Zurück zum Zitat Qin K, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRef Qin K, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRef
Zurück zum Zitat Rahnamayan S, Wang GG (2008) Solving large scale optimization problems by opposition based differential evolution (ODE). WSEAS Trans Comput 7(10):1792–1804 Rahnamayan S, Wang GG (2008) Solving large scale optimization problems by opposition based differential evolution (ODE). WSEAS Trans Comput 7(10):1792–1804
Zurück zum Zitat Rahnamayan S, Tizhoosh HR, Salama MMA (2008) Opposition-based differential evolution. IEEE Trans Evol Comput 12(1):64–79CrossRef Rahnamayan S, Tizhoosh HR, Salama MMA (2008) Opposition-based differential evolution. IEEE Trans Evol Comput 12(1):64–79CrossRef
Zurück zum Zitat Ronkkonen J, Kukkonen S, Price KV (2005) Real parameter optimization with differential evolution. In: Proceedings of IEEE congress on evolutionary computation (CEC-2005). IEEE Press, vol 1, pp 506–513 Ronkkonen J, Kukkonen S, Price KV (2005) Real parameter optimization with differential evolution. In: Proceedings of IEEE congress on evolutionary computation (CEC-2005). IEEE Press, vol 1, pp 506–513
Zurück zum Zitat Rudolph G (1997) Local convergence rates of simple evolutionary algorithms with Cauchy mutations. IEEE Trans Evol Comput 1(1):249–256CrossRef Rudolph G (1997) Local convergence rates of simple evolutionary algorithms with Cauchy mutations. IEEE Trans Evol Comput 1(1):249–256CrossRef
Zurück zum Zitat Shih FY, Edupuganti VG (2009) A differential evolution based algorithm for breaking the visual steganaliytic system. Soft Comput 13(4):345–353 Shih FY, Edupuganti VG (2009) A differential evolution based algorithm for breaking the visual steganaliytic system. Soft Comput 13(4):345–353
Zurück zum Zitat Stacey A, Jancie M, Grundy I (2003) Particle swarm optimization with mutation. In: Proceeding of IEEE congress on evolutionary computation, pp 1425–1430 Stacey A, Jancie M, Grundy I (2003) Particle swarm optimization with mutation. In: Proceeding of IEEE congress on evolutionary computation, pp 1425–1430
Zurück zum Zitat Storn R (1995) Differential evolution design for an IIR-filter with requirements for magnitude and group delay. Technical Report TR-95-026. International Computer Science Institute, Berkeley, CA Storn R (1995) Differential evolution design for an IIR-filter with requirements for magnitude and group delay. Technical Report TR-95-026. International Computer Science Institute, Berkeley, CA
Zurück zum Zitat Talbi H, Batouche M (2004) Hybrid particle swarm with differential evolution for multimodal image registration. Proc IEEE Int Conf Indust Technol 3:1567–1573 Talbi H, Batouche M (2004) Hybrid particle swarm with differential evolution for multimodal image registration. Proc IEEE Int Conf Indust Technol 3:1567–1573
Zurück zum Zitat Tang K, Yao X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization, Technical Report, Nature Inspired Computation and Applications Laboratory, USTC, China. http://nical.ustc.edu.cn/cec08ss.php Tang K, Yao X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization, Technical Report, Nature Inspired Computation and Applications Laboratory, USTC, China. http://​nical.​ustc.​edu.​cn/​cec08ss.​php
Zurück zum Zitat Teng NS, Teo J, Hijazi MHA (2009) Self-adaptive population sizing for a tune-free differential evolution. Soft Comput 13(7):709–724 Teng NS, Teo J, Hijazi MHA (2009) Self-adaptive population sizing for a tune-free differential evolution. Soft Comput 13(7):709–724
Zurück zum Zitat Vesterstroem J, Thomsen R (2004) A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. Proc Congr Evol Comput 2:1980–1987 Vesterstroem J, Thomsen R (2004) A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. Proc Congr Evol Comput 2:1980–1987
Zurück zum Zitat Wang H, Liu Y, Li C, Zeng S (2006) A hybrid particle swarm algorithm with Cauchy mutation. In: IEEE swarm intelligence symposium 2007 (SIS 2007), Honolulu, Hawaii, USA (in press) Wang H, Liu Y, Li C, Zeng S (2006) A hybrid particle swarm algorithm with Cauchy mutation. In: IEEE swarm intelligence symposium 2007 (SIS 2007), Honolulu, Hawaii, USA (in press)
Zurück zum Zitat Xu W, Gu X (2009) A hybrid particle swarm optimization approach with prior crossover differential evolution. In: Proceedings of GEC09, pp 671–677 Xu W, Gu X (2009) A hybrid particle swarm optimization approach with prior crossover differential evolution. In: Proceedings of GEC09, pp 671–677
Zurück zum Zitat Yang Z, Tang K, Yao X (2008a) Self-adaptive differential evolution with neighborhood search. In: Proceedings of IEEE congress on evolutionary computation (CEC-2008), Hong Kong, pp 1110–1116 Yang Z, Tang K, Yao X (2008a) Self-adaptive differential evolution with neighborhood search. In: Proceedings of IEEE congress on evolutionary computation (CEC-2008), Hong Kong, pp 1110–1116
Zurück zum Zitat Yang Z, Tang K, Yao X (2008b) Large scale evolutionary optimization using Cooperative Co evolution. Inf Sci 178(15):2985–2999CrossRefMathSciNet Yang Z, Tang K, Yao X (2008b) Large scale evolutionary optimization using Cooperative Co evolution. Inf Sci 178(15):2985–2999CrossRefMathSciNet
Zurück zum Zitat Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102CrossRef Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102CrossRef
Zurück zum Zitat Zaharie D (2003) Control of population diversity and adaptation in differential evolution algorithms. In: Matousek D, Osmera P (eds) Proceedings of MENDEL 2003, 9th international conference on soft computing. Brno, Czech Republic, pp 41–46 Zaharie D (2003) Control of population diversity and adaptation in differential evolution algorithms. In: Matousek D, Osmera P (eds) Proceedings of MENDEL 2003, 9th international conference on soft computing. Brno, Czech Republic, pp 41–46
Zurück zum Zitat Zaharie D, Petcu D (2003) Adaptive pareto differential evolution and its parallelization. In: Proceedings of 5th international conference on parallel processing and applied mathematics. Czestochowa, Poland, vol 3019, pp 261–268 Zaharie D, Petcu D (2003) Adaptive pareto differential evolution and its parallelization. In: Proceedings of 5th international conference on parallel processing and applied mathematics. Czestochowa, Poland, vol 3019, pp 261–268
Zurück zum Zitat Zhang WJ, Xie XF (2003) DEPSO, hybrid particle swarm with differential evolution operator. IEEE Int Conf Syst Man Cybern 4:3816–3821 Zhang WJ, Xie XF (2003) DEPSO, hybrid particle swarm with differential evolution operator. IEEE Int Conf Syst Man Cybern 4:3816–3821
Zurück zum Zitat Zhang C, Ning J, Lu S, Ouyang D, Ding T (2009) A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization. Oper Res Lett 37:117–122CrossRefMATHMathSciNet Zhang C, Ning J, Lu S, Ouyang D, Ding T (2009) A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization. Oper Res Lett 37:117–122CrossRefMATHMathSciNet
Metadaten
Titel
Improving the performance of differential evolution algorithm using Cauchy mutation
verfasst von
Musrrat Ali
Millie Pant
Publikationsdatum
01.05.2011
Verlag
Springer-Verlag
Erschienen in
Soft Computing / Ausgabe 5/2011
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-010-0655-2

Weitere Artikel der Ausgabe 5/2011

Soft Computing 5/2011 Zur Ausgabe