Skip to main content
Top
Published in: Soft Computing 5/2011

01-05-2011 | Original Paper

Improving the performance of differential evolution algorithm using Cauchy mutation

Authors: Musrrat Ali, Millie Pant

Published in: Soft Computing | Issue 5/2011

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Differential evolution (DE) is a powerful yet simple evolutionary algorithm for optimization of real-valued, multimodal functions. DE is generally considered as a reliable, accurate and robust optimization technique. However, the algorithm suffers from premature convergence and/or slow convergence rate resulting in poor solution quality and/or larger number of function evaluation resulting in large CPU time for optimizing the computationally expensive objective functions. Therefore, an attempt to speed up DE is considered necessary. This research introduces a modified differential evolution (MDE) that enhances the convergence rate without compromising with the solution quality. The proposed MDE algorithm maintains a failure_counter (FC) to keep a tab on the performance of the algorithm by scanning or monitoring the individuals. Finally, the individuals that fail to show any improvement in the function value for a successive number of generations are subject to Cauchy mutation with the hope of pulling them out of a local attractor which may be the cause of their deteriorating performance. The performance of proposed MDE is investigated on a comprehensive set of 15 standard benchmark problems with varying degrees of complexities and 7 nontraditional problems suggested in the special session of CEC2008. Numerical results and statistical analysis show that the proposed modifications help in locating the global optimal solution in lesser numbers of function evaluation in comparison with basic DE and several other contemporary optimization algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Abbass H (2002) The self-adaptive pareto differential evolution algorithm. In: Proceedings of the 2002 congress on evolutionary computation, pp 831–836 Abbass H (2002) The self-adaptive pareto differential evolution algorithm. In: Proceedings of the 2002 congress on evolutionary computation, pp 831–836
go back to reference Andre J, Siarry P, Dognon T (2001) An improvement of the standard genetic algorithm fighting premature convergence in continuous optimization. Adv Eng Software 32:49–60CrossRef Andre J, Siarry P, Dognon T (2001) An improvement of the standard genetic algorithm fighting premature convergence in continuous optimization. Adv Eng Software 32:49–60CrossRef
go back to reference Birru HK, Chellapilla K, Rao SS (1999) Local search operators in fast evolutionary programming. Proc IEEE Int Conf Evol Comput 2:1506–1513 Birru HK, Chellapilla K, Rao SS (1999) Local search operators in fast evolutionary programming. Proc IEEE Int Conf Evol Comput 2:1506–1513
go back to reference Brest J, Boskovic B, Greiner S, Zumer V, Maucec MS (2007) Performance comparison of self-adaptive and adaptive differential evolution algorithms. Soft Comput 11(7):617–629 Brest J, Boskovic B, Greiner S, Zumer V, Maucec MS (2007) Performance comparison of self-adaptive and adaptive differential evolution algorithms. Soft Comput 11(7):617–629
go back to reference Caponio A, Neri F, Tirronen V (2009) Superfit control adaptation in memetic differential evolution frameworks. Soft Comput 13:811–831 Caponio A, Neri F, Tirronen V (2009) Superfit control adaptation in memetic differential evolution frameworks. Soft Comput 13:811–831
go back to reference Coelho LS, Krohling RA (2003) Predictive controller tuning using modified particle swarm optimization based on Cauchy and Gaussian distributions. In: Proceedings of the 8th on-line world conference on soft computing in industrial applications. WSC8 Coelho LS, Krohling RA (2003) Predictive controller tuning using modified particle swarm optimization based on Cauchy and Gaussian distributions. In: Proceedings of the 8th on-line world conference on soft computing in industrial applications. WSC8
go back to reference Fan H-Y, Lampinen J (2003) A trigonometric mutation operation to differential evolution. J Glob Optim 27:105–129 Fan H-Y, Lampinen J (2003) A trigonometric mutation operation to differential evolution. J Glob Optim 27:105–129
go back to reference Gamperle R, Muller SD, Koumoutsakos A (2002) Parameter study for differential evolution. In: WSEAS NNA-FSFS-EC 2002. Interlaken, Switzerland Gamperle R, Muller SD, Koumoutsakos A (2002) Parameter study for differential evolution. In: WSEAS NNA-FSFS-EC 2002. Interlaken, Switzerland
go back to reference García S, Molina D, Lozano M, Herrera F (2009a) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics 15:617–644CrossRefMATH García S, Molina D, Lozano M, Herrera F (2009a) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics 15:617–644CrossRefMATH
go back to reference García S, Fernández A, Luengo J, Herrera f (2009b) A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft Comput 13:10:959–977. doi:10.1007/s00500-008-0392-y García S, Fernández A, Luengo J, Herrera f (2009b) A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft Comput 13:10:959–977. doi:10.​1007/​s00500-008-0392-y
go back to reference Hendtlass T (2001) A combined swarm differential evolution algorithm for optimization problems. In: Proceedings of the fourteenth international conference on industrial and engineering applications of artificial intelligence and expert systems. Lecture notes in computer science. Springer, Berlin, vol 2070, pp 11–18 Hendtlass T (2001) A combined swarm differential evolution algorithm for optimization problems. In: Proceedings of the fourteenth international conference on industrial and engineering applications of artificial intelligence and expert systems. Lecture notes in computer science. Springer, Berlin, vol 2070, pp 11–18
go back to reference Hrstka O, Kucerová A (2004) Improvement of real coded genetic algorithm based on differential operators preventing premature convergence. Adv Eng Software 35:237–246CrossRef Hrstka O, Kucerová A (2004) Improvement of real coded genetic algorithm based on differential operators preventing premature convergence. Adv Eng Software 35:237–246CrossRef
go back to reference Kannan S, Slochanal S, Subbaraj P, Padhy N (2004) Application of particle swarm optimization technique and its variants to generation expansion planning. Electr Power Syst Res 70(3):203–210CrossRef Kannan S, Slochanal S, Subbaraj P, Padhy N (2004) Application of particle swarm optimization technique and its variants to generation expansion planning. Electr Power Syst Res 70(3):203–210CrossRef
go back to reference Lampinen J, Zelinka I (2000) On stagnation of the differential evolution algorithm. In: Ošmera P (ed) Proceedings of MENDEL 2000, 6th international mendel conference on soft computing. Brno, Czech Republic, pp 76–83 Lampinen J, Zelinka I (2000) On stagnation of the differential evolution algorithm. In: Ošmera P (ed) Proceedings of MENDEL 2000, 6th international mendel conference on soft computing. Brno, Czech Republic, pp 76–83
go back to reference Lan K-T, Lan C-H (2008) Notes on the distinction of Gaussian and Cauchy mutations. In: Eighth international conference on intelligent systems design and applications, vol 1, pp 272–277 Lan K-T, Lan C-H (2008) Notes on the distinction of Gaussian and Cauchy mutations. In: Eighth international conference on intelligent systems design and applications, vol 1, pp 272–277
go back to reference Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput Fusion Found Methodol Appl 9(6):448–462MATH Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput Fusion Found Methodol Appl 9(6):448–462MATH
go back to reference Noman N, Iba H (2005) Enhancing differential evolution performance with local search for high dimensional function optimization. In: Proceedings of the 2005 conference on genetic and evolutionary computation, pp 967–974 Noman N, Iba H (2005) Enhancing differential evolution performance with local search for high dimensional function optimization. In: Proceedings of the 2005 conference on genetic and evolutionary computation, pp 967–974
go back to reference Noman N, Iba H (2008) Accelerating differential evolution using an adaptive local search. IEEE Trans Evol Comput 12(1):107–125CrossRef Noman N, Iba H (2008) Accelerating differential evolution using an adaptive local search. IEEE Trans Evol Comput 12(1):107–125CrossRef
go back to reference Omran M, Engelbrecht A, Salman A (2005a) Differential evolution methods for unsupervised image classification. Proc IEEE Congr Evol Comput 2:966–973CrossRef Omran M, Engelbrecht A, Salman A (2005a) Differential evolution methods for unsupervised image classification. Proc IEEE Congr Evol Comput 2:966–973CrossRef
go back to reference Omran M, Salman A, Engelbrecht AP (2005b) Self-adaptive differential evolution, computational intelligence and security, PT 1. In: Proceedings lecture notes in artificial intelligence, vol 3801, pp 192–199 Omran M, Salman A, Engelbrecht AP (2005b) Self-adaptive differential evolution, computational intelligence and security, PT 1. In: Proceedings lecture notes in artificial intelligence, vol 3801, pp 192–199
go back to reference Price K (1999) An introduction to DE. In: Corne D, Marco D, Glover F (eds) New ideas in optimization. McGraw-Hill, London (UK), pp 78–108 Price K (1999) An introduction to DE. In: Corne D, Marco D, Glover F (eds) New ideas in optimization. McGraw-Hill, London (UK), pp 78–108
go back to reference Qin K, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRef Qin K, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRef
go back to reference Rahnamayan S, Wang GG (2008) Solving large scale optimization problems by opposition based differential evolution (ODE). WSEAS Trans Comput 7(10):1792–1804 Rahnamayan S, Wang GG (2008) Solving large scale optimization problems by opposition based differential evolution (ODE). WSEAS Trans Comput 7(10):1792–1804
go back to reference Rahnamayan S, Tizhoosh HR, Salama MMA (2008) Opposition-based differential evolution. IEEE Trans Evol Comput 12(1):64–79CrossRef Rahnamayan S, Tizhoosh HR, Salama MMA (2008) Opposition-based differential evolution. IEEE Trans Evol Comput 12(1):64–79CrossRef
go back to reference Ronkkonen J, Kukkonen S, Price KV (2005) Real parameter optimization with differential evolution. In: Proceedings of IEEE congress on evolutionary computation (CEC-2005). IEEE Press, vol 1, pp 506–513 Ronkkonen J, Kukkonen S, Price KV (2005) Real parameter optimization with differential evolution. In: Proceedings of IEEE congress on evolutionary computation (CEC-2005). IEEE Press, vol 1, pp 506–513
go back to reference Rudolph G (1997) Local convergence rates of simple evolutionary algorithms with Cauchy mutations. IEEE Trans Evol Comput 1(1):249–256CrossRef Rudolph G (1997) Local convergence rates of simple evolutionary algorithms with Cauchy mutations. IEEE Trans Evol Comput 1(1):249–256CrossRef
go back to reference Shih FY, Edupuganti VG (2009) A differential evolution based algorithm for breaking the visual steganaliytic system. Soft Comput 13(4):345–353 Shih FY, Edupuganti VG (2009) A differential evolution based algorithm for breaking the visual steganaliytic system. Soft Comput 13(4):345–353
go back to reference Stacey A, Jancie M, Grundy I (2003) Particle swarm optimization with mutation. In: Proceeding of IEEE congress on evolutionary computation, pp 1425–1430 Stacey A, Jancie M, Grundy I (2003) Particle swarm optimization with mutation. In: Proceeding of IEEE congress on evolutionary computation, pp 1425–1430
go back to reference Storn R (1995) Differential evolution design for an IIR-filter with requirements for magnitude and group delay. Technical Report TR-95-026. International Computer Science Institute, Berkeley, CA Storn R (1995) Differential evolution design for an IIR-filter with requirements for magnitude and group delay. Technical Report TR-95-026. International Computer Science Institute, Berkeley, CA
go back to reference Talbi H, Batouche M (2004) Hybrid particle swarm with differential evolution for multimodal image registration. Proc IEEE Int Conf Indust Technol 3:1567–1573 Talbi H, Batouche M (2004) Hybrid particle swarm with differential evolution for multimodal image registration. Proc IEEE Int Conf Indust Technol 3:1567–1573
go back to reference Tang K, Yao X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization, Technical Report, Nature Inspired Computation and Applications Laboratory, USTC, China. http://nical.ustc.edu.cn/cec08ss.php Tang K, Yao X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization, Technical Report, Nature Inspired Computation and Applications Laboratory, USTC, China. http://​nical.​ustc.​edu.​cn/​cec08ss.​php
go back to reference Teng NS, Teo J, Hijazi MHA (2009) Self-adaptive population sizing for a tune-free differential evolution. Soft Comput 13(7):709–724 Teng NS, Teo J, Hijazi MHA (2009) Self-adaptive population sizing for a tune-free differential evolution. Soft Comput 13(7):709–724
go back to reference Vesterstroem J, Thomsen R (2004) A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. Proc Congr Evol Comput 2:1980–1987 Vesterstroem J, Thomsen R (2004) A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. Proc Congr Evol Comput 2:1980–1987
go back to reference Wang H, Liu Y, Li C, Zeng S (2006) A hybrid particle swarm algorithm with Cauchy mutation. In: IEEE swarm intelligence symposium 2007 (SIS 2007), Honolulu, Hawaii, USA (in press) Wang H, Liu Y, Li C, Zeng S (2006) A hybrid particle swarm algorithm with Cauchy mutation. In: IEEE swarm intelligence symposium 2007 (SIS 2007), Honolulu, Hawaii, USA (in press)
go back to reference Xu W, Gu X (2009) A hybrid particle swarm optimization approach with prior crossover differential evolution. In: Proceedings of GEC09, pp 671–677 Xu W, Gu X (2009) A hybrid particle swarm optimization approach with prior crossover differential evolution. In: Proceedings of GEC09, pp 671–677
go back to reference Yang Z, Tang K, Yao X (2008a) Self-adaptive differential evolution with neighborhood search. In: Proceedings of IEEE congress on evolutionary computation (CEC-2008), Hong Kong, pp 1110–1116 Yang Z, Tang K, Yao X (2008a) Self-adaptive differential evolution with neighborhood search. In: Proceedings of IEEE congress on evolutionary computation (CEC-2008), Hong Kong, pp 1110–1116
go back to reference Yang Z, Tang K, Yao X (2008b) Large scale evolutionary optimization using Cooperative Co evolution. Inf Sci 178(15):2985–2999CrossRefMathSciNet Yang Z, Tang K, Yao X (2008b) Large scale evolutionary optimization using Cooperative Co evolution. Inf Sci 178(15):2985–2999CrossRefMathSciNet
go back to reference Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102CrossRef Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102CrossRef
go back to reference Zaharie D (2003) Control of population diversity and adaptation in differential evolution algorithms. In: Matousek D, Osmera P (eds) Proceedings of MENDEL 2003, 9th international conference on soft computing. Brno, Czech Republic, pp 41–46 Zaharie D (2003) Control of population diversity and adaptation in differential evolution algorithms. In: Matousek D, Osmera P (eds) Proceedings of MENDEL 2003, 9th international conference on soft computing. Brno, Czech Republic, pp 41–46
go back to reference Zaharie D, Petcu D (2003) Adaptive pareto differential evolution and its parallelization. In: Proceedings of 5th international conference on parallel processing and applied mathematics. Czestochowa, Poland, vol 3019, pp 261–268 Zaharie D, Petcu D (2003) Adaptive pareto differential evolution and its parallelization. In: Proceedings of 5th international conference on parallel processing and applied mathematics. Czestochowa, Poland, vol 3019, pp 261–268
go back to reference Zhang WJ, Xie XF (2003) DEPSO, hybrid particle swarm with differential evolution operator. IEEE Int Conf Syst Man Cybern 4:3816–3821 Zhang WJ, Xie XF (2003) DEPSO, hybrid particle swarm with differential evolution operator. IEEE Int Conf Syst Man Cybern 4:3816–3821
go back to reference Zhang C, Ning J, Lu S, Ouyang D, Ding T (2009) A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization. Oper Res Lett 37:117–122CrossRefMATHMathSciNet Zhang C, Ning J, Lu S, Ouyang D, Ding T (2009) A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization. Oper Res Lett 37:117–122CrossRefMATHMathSciNet
Metadata
Title
Improving the performance of differential evolution algorithm using Cauchy mutation
Authors
Musrrat Ali
Millie Pant
Publication date
01-05-2011
Publisher
Springer-Verlag
Published in
Soft Computing / Issue 5/2011
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-010-0655-2

Other articles of this Issue 5/2011

Soft Computing 5/2011 Go to the issue

Premium Partner