Skip to main content
Top
Published in: Soft Computing 22/2017

27-06-2016 | Methodologies and Application

Prior knowledge guided differential evolution

Authors: Qinqin Fan, Xuefeng Yan, Yu Xue

Published in: Soft Computing | Issue 22/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Differential evolution (DE) has become one of the most popular paradigms of evolutionary algorithms. Over the past two decades, some prior knowledge has been obtained in the DE research community. It is an interesting topic to enhance the performance of DE by taking advantage of such prior knowledge. Along this line, a prior knowledge guided DE (called PKDE) is proposed in this paper. In PKDE, we extract two levels of prior knowledge, i.e., the macro- and micro-levels. In order to integrate these two levels of prior knowledge in an effective way, the control parameters of PKDE are tuned based on two distributions (i.e., Cauchy and normal distribution), with the aim of alleviating the premature convergence at the early stage and speeding up the convergence toward the global optimal solution at the later stage. In addition, the self-adaptive mutation strategy is implemented based on our previous study. PKDE is compared with eight DE variants and seven non-DE algorithms on two sets of benchmark test functions from IEEE CEC2005 and IEEE CEC2014. Systematic experiments demonstrate that the overall performance of PKDE is very competitive.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abbass HA (2002) The self-adaptive pareto differential evolution algorithm. In: Proceedings of the 2002 congress on evolutionary computation, pp 831–836 Abbass HA (2002) The self-adaptive pareto differential evolution algorithm. In: Proceedings of the 2002 congress on evolutionary computation, pp 831–836
go back to reference Akay B, Karaboga D (2012) A modified artificial bee colony algorithm for real-parameter optimization. Inf Sci 192:120–142CrossRef Akay B, Karaboga D (2012) A modified artificial bee colony algorithm for real-parameter optimization. Inf Sci 192:120–142CrossRef
go back to reference Ali M, Siarry P, Pant M (2012) An efficient differential evolution based algorithm for solving multi-objective optimization problems. Eur J Oper Res 217(2):404–416MathSciNetMATH Ali M, Siarry P, Pant M (2012) An efficient differential evolution based algorithm for solving multi-objective optimization problems. Eur J Oper Res 217(2):404–416MathSciNetMATH
go back to reference Auger A, Hansen N (2005) A restart CMA evolution strategy with increasing population size. In: IEEE congress on evolutionary computation, pp 1769–1776 Auger A, Hansen N (2005) A restart CMA evolution strategy with increasing population size. In: IEEE congress on evolutionary computation, pp 1769–1776
go back to reference Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657CrossRef Brest J, Greiner S, Boskovic B, Mernik M, Zumer V (2006) Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6):646–657CrossRef
go back to reference Brest J, Maučec MS (2008) Population size reduction for the differential evolution algorithm. Appl Intell 29(3):228–247CrossRef Brest J, Maučec MS (2008) Population size reduction for the differential evolution algorithm. Appl Intell 29(3):228–247CrossRef
go back to reference Cai Y, Wang J (2013) Differential evolution with neighborhood and direction information for numerical optimization. IEEE Trans Cybern 43(6):2202–2215CrossRef Cai Y, Wang J (2013) Differential evolution with neighborhood and direction information for numerical optimization. IEEE Trans Cybern 43(6):2202–2215CrossRef
go back to reference Chen L, Zheng Z, Liu H-L, Xie S (2014) An evolutionary algorithm based on covariance matrix leaning and searching preference for solving CEC 2014 benchmark problems. In: IEEE congress on evolutionary computation, pp 2672–2677 Chen L, Zheng Z, Liu H-L, Xie S (2014) An evolutionary algorithm based on covariance matrix leaning and searching preference for solving CEC 2014 benchmark problems. In: IEEE congress on evolutionary computation, pp 2672–2677
go back to reference Das S, Konar A, Chakraborty UK (2005) Two improved differential evolution schemes for faster global search. In: Proceedings of the 2005 conference on genetic and evolutionary computation, 2005. ACM, pp 991–998 Das S, Konar A, Chakraborty UK (2005) Two improved differential evolution schemes for faster global search. In: Proceedings of the 2005 conference on genetic and evolutionary computation, 2005. ACM, pp 991–998
go back to reference Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31CrossRef Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31CrossRef
go back to reference Eiben AE, Hinterding R, Michalewicz Z (1999) Parameter control in evolutionary algorithms. IEEE Trans Evol Comput 3(2):124–141 Eiben AE, Hinterding R, Michalewicz Z (1999) Parameter control in evolutionary algorithms. IEEE Trans Evol Comput 3(2):124–141
go back to reference Elsayed SM, Sarker RA, Essam DL (2011) Multi-operator based evolutionary algorithms for solving constrained optimization problems. Comput Oper Res 38(12):1877–1896MathSciNetCrossRefMATH Elsayed SM, Sarker RA, Essam DL (2011) Multi-operator based evolutionary algorithms for solving constrained optimization problems. Comput Oper Res 38(12):1877–1896MathSciNetCrossRefMATH
go back to reference Elsayed SM, Sarker RA, Essam DL, Hamza NM (2014) Testing united multi-operator evolutionary algorithms on the CEC2014 real-parameter numerical optimization. In: IEEE congress on evolutionary computation, pp 1650–1657 Elsayed SM, Sarker RA, Essam DL, Hamza NM (2014) Testing united multi-operator evolutionary algorithms on the CEC2014 real-parameter numerical optimization. In: IEEE congress on evolutionary computation, pp 1650–1657
go back to reference Erlich I, Rueda JL, Wildenhues S, Shewarega F (2014) Evaluating the mean–variance mapping optimization on the IEEE-CEC 2014 test suite. In: IEEE congress on evolutionary computation, pp 1625–1632 Erlich I, Rueda JL, Wildenhues S, Shewarega F (2014) Evaluating the mean–variance mapping optimization on the IEEE-CEC 2014 test suite. In: IEEE congress on evolutionary computation, pp 1625–1632
go back to reference Fan Q, Yan X (2015) Differential evolution algorithm with self-adaptive strategy and control parameters for P-xylene oxidation process optimization. Soft Comput 19(5):1363–1391CrossRef Fan Q, Yan X (2015) Differential evolution algorithm with self-adaptive strategy and control parameters for P-xylene oxidation process optimization. Soft Comput 19(5):1363–1391CrossRef
go back to reference Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675–701CrossRefMATH Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675–701CrossRefMATH
go back to reference Gämperle R, Müller SD, Koumoutsakos P (2002) A parameter study for differential evolution. Adv Intell Syst Fuzzy Syst Evolut Comput 10:293–298 Gämperle R, Müller SD, Koumoutsakos P (2002) A parameter study for differential evolution. Adv Intell Syst Fuzzy Syst Evolut Comput 10:293–298
go back to reference García S, Molina D, Lozano M, Herrera F (2009) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics 15(6):617–644CrossRefMATH García S, Molina D, Lozano M, Herrera F (2009) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics 15(6):617–644CrossRefMATH
go back to reference Ghosh A, Das S, Chowdhury A, Giri R (2011) An improved differential evolution algorithm with fitness-based adaptation of the control parameters. Inf Sci 181(18):3749–3765MathSciNetCrossRef Ghosh A, Das S, Chowdhury A, Giri R (2011) An improved differential evolution algorithm with fitness-based adaptation of the control parameters. Inf Sci 181(18):3749–3765MathSciNetCrossRef
go back to reference Gong W, Cai Z (2013) Differential evolution with ranking-based mutation operators. IEEE Trans Cybern 43(6):2066–2081CrossRef Gong W, Cai Z (2013) Differential evolution with ranking-based mutation operators. IEEE Trans Cybern 43(6):2066–2081CrossRef
go back to reference Islam SM, Das S, Ghosh S, Roy S, Suganthan PN (2012) An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization. IEEE Trans Syst Man Cybern B 42(2):482–500CrossRef Islam SM, Das S, Ghosh S, Roy S, Suganthan PN (2012) An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization. IEEE Trans Syst Man Cybern B 42(2):482–500CrossRef
go back to reference Kruskal WH, Wallis WA (1952) Use of ranks in one-criterion variance analysis. J Am Stat Assoc 47(260):583–621CrossRefMATH Kruskal WH, Wallis WA (1952) Use of ranks in one-criterion variance analysis. J Am Stat Assoc 47(260):583–621CrossRefMATH
go back to reference Liang J, Qu B, Suganthan P (2013) Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. In: Computational intelligence laboratory, zhengzhou Liang J, Qu B, Suganthan P (2013) Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. In: Computational intelligence laboratory, zhengzhou
go back to reference Liao T, Stützle T, Montes de Oca MA, Dorigo M (2014) A unified ant colony optimization algorithm for continuous optimization. Eur J Oper Res 234(3):597–609MathSciNetCrossRefMATH Liao T, Stützle T, Montes de Oca MA, Dorigo M (2014) A unified ant colony optimization algorithm for continuous optimization. Eur J Oper Res 234(3):597–609MathSciNetCrossRefMATH
go back to reference Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput 9(6):448–462CrossRefMATH Liu J, Lampinen J (2005) A fuzzy adaptive differential evolution algorithm. Soft Comput 9(6):448–462CrossRefMATH
go back to reference Mallipeddi R, Suganthan PN, Pan Q-K, Tasgetiren MF (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11(2):1679–1696CrossRef Mallipeddi R, Suganthan PN, Pan Q-K, Tasgetiren MF (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11(2):1679–1696CrossRef
go back to reference Mallipeddi R, Wu G, Lee M, Suganthan P (2014) Gaussian adaptation based parameter adaptation for differential evolution. In: IEEE congress on evolutionary computation, pp 1760–1767 Mallipeddi R, Wu G, Lee M, Suganthan P (2014) Gaussian adaptation based parameter adaptation for differential evolution. In: IEEE congress on evolutionary computation, pp 1760–1767
go back to reference Molina D, Lacroix B, Herrera F (2014) Influence of regions on the memetic algorithm for the CEC’2014 special session on real-parameter single objective optimisation. In: IEEE congress on evolutionary computation, pp 1633–1640 Molina D, Lacroix B, Herrera F (2014) Influence of regions on the memetic algorithm for the CEC’2014 special session on real-parameter single objective optimisation. In: IEEE congress on evolutionary computation, pp 1633–1640
go back to reference Neri F, Tirronen V (2010) Recent advances in differential evolution: a survey and experimental analysis. Artif Intell Rev 33(1–2):61–106CrossRef Neri F, Tirronen V (2010) Recent advances in differential evolution: a survey and experimental analysis. Artif Intell Rev 33(1–2):61–106CrossRef
go back to reference Pan Q-K, Suganthan PN, Wang L, Gao L, Mallipeddi R (2011) A differential evolution algorithm with self-adapting strategy and control parameters. Comput Oper Res 38(1):394–408MathSciNetCrossRefMATH Pan Q-K, Suganthan PN, Wang L, Gao L, Mallipeddi R (2011) A differential evolution algorithm with self-adapting strategy and control parameters. Comput Oper Res 38(1):394–408MathSciNetCrossRefMATH
go back to reference Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRef Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRef
go back to reference Ronkkonen J, Kukkonen S, Price KV (2005) Real-parameter optimization with differential evolution. In: IEEE congress on evolutionary computation, pp 506–513 Ronkkonen J, Kukkonen S, Price KV (2005) Real-parameter optimization with differential evolution. In: IEEE congress on evolutionary computation, pp 506–513
go back to reference Salman A, Engelbrecht AP, Omran MG (2007) Empirical analysis of self-adaptive differential evolution. Eur J Oper Res 183(2):785–804CrossRefMATH Salman A, Engelbrecht AP, Omran MG (2007) Empirical analysis of self-adaptive differential evolution. Eur J Oper Res 183(2):785–804CrossRefMATH
go back to reference Sarker R, Elsayed S, Ray T (2014) Differential evolution with dynamic parameters selection for optimization problems. IEEE Trans Evol Comput 18(5):689–707CrossRef Sarker R, Elsayed S, Ray T (2014) Differential evolution with dynamic parameters selection for optimization problems. IEEE Trans Evol Comput 18(5):689–707CrossRef
go back to reference Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces. ICSI, BerkeleyMATH Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces. ICSI, BerkeleyMATH
go back to reference Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359MathSciNetCrossRefMATH Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359MathSciNetCrossRefMATH
go back to reference Storn R, Price K, Lampinen J (2005) Differential evolution—a practical approach to global optimization. Springer, BerlinMATH Storn R, Price K, Lampinen J (2005) Differential evolution—a practical approach to global optimization. Springer, BerlinMATH
go back to reference Suganthan PN et al (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. In: KanGAL, Report 2005005 Suganthan PN et al (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. In: KanGAL, Report 2005005
go back to reference Tanabe R, Fukunaga AS (2014) Improving the search performance of SHADE using linear population size reduction. In: IEEE congress on evolutionary computation, pp 1658–1665 Tanabe R, Fukunaga AS (2014) Improving the search performance of SHADE using linear population size reduction. In: IEEE congress on evolutionary computation, pp 1658–1665
go back to reference Teng NS, Teo J, Hijazi MHA (2009) Self-adaptive population sizing for a tune-free differential evolution. Soft Comput 13(7):709–724CrossRef Teng NS, Teo J, Hijazi MHA (2009) Self-adaptive population sizing for a tune-free differential evolution. Soft Comput 13(7):709–724CrossRef
go back to reference Teo J (2005) Differential evolution with self-adaptive populations. In: Khosla R, Howlett RJ, Jain LC (eds) Knowledge-based intelligent information and engineering systems. Lecture notes in computer science, vol 3681. Springer, Berlin, pp 1284–1290 Teo J (2005) Differential evolution with self-adaptive populations. In: Khosla R, Howlett RJ, Jain LC (eds) Knowledge-based intelligent information and engineering systems. Lecture notes in computer science, vol 3681. Springer, Berlin, pp 1284–1290
go back to reference Teo J (2006) Exploring dynamic self-adaptive populations in differential evolution. Soft Comput 10(8):673–686CrossRef Teo J (2006) Exploring dynamic self-adaptive populations in differential evolution. Soft Comput 10(8):673–686CrossRef
go back to reference Tirronen V, Neri F (2009) Differential evolution with fitness diversity self-adaptation. In: Chiong R (ed) Nature-inspired algorithms for optimisation. Studies in computational intelligence, vol 193. Springer, Berlin, pp 199–234 Tirronen V, Neri F (2009) Differential evolution with fitness diversity self-adaptation. In: Chiong R (ed) Nature-inspired algorithms for optimisation. Studies in computational intelligence, vol 193. Springer, Berlin, pp 199–234
go back to reference Wang H, Rahnamayan S, Sun H, Omran MG (2013) Gaussian bare-bones differential evolution. IEEE Trans Cybern 43(2):634–647CrossRef Wang H, Rahnamayan S, Sun H, Omran MG (2013) Gaussian bare-bones differential evolution. IEEE Trans Cybern 43(2):634–647CrossRef
go back to reference Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66CrossRef Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66CrossRef
go back to reference Wang Y, Li H, Huang T, Li L (2014) Differential evolution based on covariance matrix learning and bimodal distribution parameter setting. Appl Soft Comput 18:232–247CrossRef Wang Y, Li H, Huang T, Li L (2014) Differential evolution based on covariance matrix learning and bimodal distribution parameter setting. Appl Soft Comput 18:232–247CrossRef
go back to reference Zaharie D (2002) Parameter adaptation in differential evolution by controlling the population diversity. In: Proceedings of the international workshop on symbolic and numeric algorithms for scientific computing 2002, pp 385–397 Zaharie D (2002) Parameter adaptation in differential evolution by controlling the population diversity. In: Proceedings of the international workshop on symbolic and numeric algorithms for scientific computing 2002, pp 385–397
go back to reference Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958CrossRef Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958CrossRef
go back to reference Zhu W, Tang Y, Fang J-A, Zhang W (2013) Adaptive population tuning scheme for differential evolution. Inf Sci 223:164–191CrossRef Zhu W, Tang Y, Fang J-A, Zhang W (2013) Adaptive population tuning scheme for differential evolution. Inf Sci 223:164–191CrossRef
go back to reference Zielinski K, Weitkemper P, Laur R, Kammeyer K (2006) Parameter study for differential evolution using a power allocation problem including interference cancellation. In: IEEE congress on evolutionary computation, pp 1857–1864 Zielinski K, Weitkemper P, Laur R, Kammeyer K (2006) Parameter study for differential evolution using a power allocation problem including interference cancellation. In: IEEE congress on evolutionary computation, pp 1857–1864
Metadata
Title
Prior knowledge guided differential evolution
Authors
Qinqin Fan
Xuefeng Yan
Yu Xue
Publication date
27-06-2016
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 22/2017
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-016-2235-6

Other articles of this Issue 22/2017

Soft Computing 22/2017 Go to the issue

Premium Partner