Skip to main content
Erschienen in: Neural Computing and Applications 2/2018

19.11.2016 | Original Article

Running-time analysis of evolutionary programming based on Lebesgue measure of searching space

verfasst von: Yushan Zhang, Han Huang, Zhiyong Lin, Zhifeng Hao, Guiwu Hu

Erschienen in: Neural Computing and Applications | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There have been many studies on the runtime analysis of evolutionary algorithms in discrete optimization, and however, relatively few homologous results have been obtained on continuous optimization, such as evolutionary programming (EP). This paper presents an analysis of the running time (as approximated by the mean first hitting time) of two EP algorithms based on Gaussian and Cauchy mutations, using an absorbing Markov process model. Given a constant variation, we analyze the running-time upper bound of special Gaussian mutation EP and Cauchy mutation EP, respectively. Our analysis shows that the upper bounds are impacted by individual number, problem dimension number, searching range, and the Lebesgue measure of the optimal neighborhood. Furthermore, we provide conditions whereby the mean running time of the considered EPs can be no more than a polynomial of n. The condition is that the Lebesgue measure of the optimal neighborhood is larger than a combinatorial computation of an exponential and the given polynomial of n. In the end, we present a case study on sphere function, and the experiment validates the theoretical result in the case study.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Fogel LJ, Owens AJ, Walsh MJ (1996) Artificial intelligence through simulated evolution. Wiley, New YorkMATH Fogel LJ, Owens AJ, Walsh MJ (1996) Artificial intelligence through simulated evolution. Wiley, New YorkMATH
2.
Zurück zum Zitat Fogel DB (1991) System identification through simulated evolution: a machine learning approach to modeling. Ginn Press, Washington Fogel DB (1991) System identification through simulated evolution: a machine learning approach to modeling. Ginn Press, Washington
3.
Zurück zum Zitat Fogel DB (1992) Evolving artificial intelligence. Dissertation, University of California at San Diego Fogel DB (1992) Evolving artificial intelligence. Dissertation, University of California at San Diego
4.
Zurück zum Zitat Fogel DB (1993) Applying evolutionary programming to selected traveling salesman problems. Cybern Syst 24(1):27–36MathSciNetCrossRef Fogel DB (1993) Applying evolutionary programming to selected traveling salesman problems. Cybern Syst 24(1):27–36MathSciNetCrossRef
5.
Zurück zum Zitat Bäck T, Schwefel HP (1993) An overview of evolutionary algorithms for parameter optimization. Evol Comput 1(1):1–23CrossRef Bäck T, Schwefel HP (1993) An overview of evolutionary algorithms for parameter optimization. Evol Comput 1(1):1–23CrossRef
6.
Zurück zum Zitat Schwefel HP (1995) Evolution and optimum seeking. Wiley, New YorkMATH Schwefel HP (1995) Evolution and optimum seeking. Wiley, New YorkMATH
7.
Zurück zum Zitat Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102CrossRef Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102CrossRef
8.
Zurück zum Zitat Lee CY, Yao X (2004) Evolutionary programming using mutations based on the Lvy probability distribution. IEEE Trans Evol Comput 8(1):1–13CrossRef Lee CY, Yao X (2004) Evolutionary programming using mutations based on the Lvy probability distribution. IEEE Trans Evol Comput 8(1):1–13CrossRef
9.
Zurück zum Zitat Rudolph G (2001) Self-adaptive mutations may lead to premature convergence. IEEE Trans Evol Comput 5(4):410–414CrossRef Rudolph G (2001) Self-adaptive mutations may lead to premature convergence. IEEE Trans Evol Comput 5(4):410–414CrossRef
10.
Zurück zum Zitat Rudolph G (1994) Convergence of non-elitist strategies. Proceedings of the first IEEE conference on evolutionary computation 600:63–66 Rudolph G (1994) Convergence of non-elitist strategies. Proceedings of the first IEEE conference on evolutionary computation 600:63–66
11.
Zurück zum Zitat Rudolph G (1996) Convergence of evolutionary algorithms in general search spaces. Proceedings of IEEE international conference on evolutionary computation 180:50–54CrossRef Rudolph G (1996) Convergence of evolutionary algorithms in general search spaces. Proceedings of IEEE international conference on evolutionary computation 180:50–54CrossRef
12.
13.
14.
Zurück zum Zitat Laumanns M, Thiele L, Zitzler E (2004) Running time analysis of multiobjective evolutionary algorithms on pseudo-boolean functions. IEEE Trans Evolut Comput 8(2):170–182CrossRefMATH Laumanns M, Thiele L, Zitzler E (2004) Running time analysis of multiobjective evolutionary algorithms on pseudo-boolean functions. IEEE Trans Evolut Comput 8(2):170–182CrossRefMATH
15.
Zurück zum Zitat Kumar R, Banerjee N (2006) Analysis of a multiobjective evolutionary algorithm on the 0C1 knapsack problem. Theor Comput Sci 358(1):104–120CrossRefMATH Kumar R, Banerjee N (2006) Analysis of a multiobjective evolutionary algorithm on the 0C1 knapsack problem. Theor Comput Sci 358(1):104–120CrossRefMATH
16.
Zurück zum Zitat Neumann F (2007) Expected runtimes of a simple evolutionary algorithm for the multi-objective minimum spanning tree problem. Eur J Oper Res 181(3):1620–1629MathSciNetCrossRefMATH Neumann F (2007) Expected runtimes of a simple evolutionary algorithm for the multi-objective minimum spanning tree problem. Eur J Oper Res 181(3):1620–1629MathSciNetCrossRefMATH
17.
Zurück zum Zitat Yu Y, Zhou ZH (2008) A new approach to estimating the expected first hitting time of evolutionary algorithms. Artif Intell 172(15):1809–1832MathSciNetCrossRefMATH Yu Y, Zhou ZH (2008) A new approach to estimating the expected first hitting time of evolutionary algorithms. Artif Intell 172(15):1809–1832MathSciNetCrossRefMATH
18.
Zurück zum Zitat Chen T, Tang K, Chen G et al (2012) A large population size can be unhelpful in evolutionary algorithms. Theor Comput Sci 436:54–70MathSciNetCrossRefMATH Chen T, Tang K, Chen G et al (2012) A large population size can be unhelpful in evolutionary algorithms. Theor Comput Sci 436:54–70MathSciNetCrossRefMATH
19.
Zurück zum Zitat Lehre PK, Yao X (2012) On the impact of mutation-selection balance on the runtime of evolutionary algorithms. IEEE Trans Evolut Comput 16(2):225–241CrossRef Lehre PK, Yao X (2012) On the impact of mutation-selection balance on the runtime of evolutionary algorithms. IEEE Trans Evolut Comput 16(2):225–241CrossRef
20.
21.
Zurück zum Zitat Chen T, He J, Sun G et al (2009) A new approach for analyzing average time complexity of population-based evolutionary algorithms on unimodal problems. IEEE Trans Syst Man Cybern Part B Cybern 39(5):1092–1106CrossRef Chen T, He J, Sun G et al (2009) A new approach for analyzing average time complexity of population-based evolutionary algorithms on unimodal problems. IEEE Trans Syst Man Cybern Part B Cybern 39(5):1092–1106CrossRef
22.
Zurück zum Zitat Yu Y, Yao X, Zhou ZH (2012) On the approximation ability of evolutionary optimization with application to minimum set cover. Artif Intell 180:20–33MathSciNetCrossRefMATH Yu Y, Yao X, Zhou ZH (2012) On the approximation ability of evolutionary optimization with application to minimum set cover. Artif Intell 180:20–33MathSciNetCrossRefMATH
23.
Zurück zum Zitat Zhou Y, He J, Nie Q (2009) A comparative runtime analysis of heuristic algorithms for satisfiability problems. Artif Intell 173(2):240–257MathSciNetCrossRefMATH Zhou Y, He J, Nie Q (2009) A comparative runtime analysis of heuristic algorithms for satisfiability problems. Artif Intell 173(2):240–257MathSciNetCrossRefMATH
24.
Zurück zum Zitat Oliveto PS, He J, Yao X (2009) Analysis of the-EA for finding approximate solutions to vertex cover problems. IEEE Trans Evol Comput 13(5):1006–1029CrossRef Oliveto PS, He J, Yao X (2009) Analysis of the-EA for finding approximate solutions to vertex cover problems. IEEE Trans Evol Comput 13(5):1006–1029CrossRef
25.
Zurück zum Zitat Lehre PK, Yao X (2014) Runtime analysis of the (1 + 1) EA on computing unique input output sequences. Inf Sci Int J 259:510–531MathSciNetMATH Lehre PK, Yao X (2014) Runtime analysis of the (1 + 1) EA on computing unique input output sequences. Inf Sci Int J 259:510–531MathSciNetMATH
26.
Zurück zum Zitat Lai X, Zhou Y, He J et al (2014) Performance analysis of evolutionary algorithms for the minimum label spanning tree problem. IEEE Trans Evolut Comput 18(6):860–872CrossRef Lai X, Zhou Y, He J et al (2014) Performance analysis of evolutionary algorithms for the minimum label spanning tree problem. IEEE Trans Evolut Comput 18(6):860–872CrossRef
27.
Zurück zum Zitat Zhou Y, Zhang J, Wang Y (2014) Performance analysis of the \((1+ 1)\) Evolutionary Algorithm for the multiprocessor scheduling problem. Algorithmica 5:1–21 Zhou Y, Zhang J, Wang Y (2014) Performance analysis of the \((1+ 1)\) Evolutionary Algorithm for the multiprocessor scheduling problem. Algorithmica 5:1–21
28.
29.
Zurück zum Zitat Witt C (2013) Tight bounds on the optimization time of a randomized search heuristic on linear functions. Combin Probab Comput 22(02):294–318MathSciNetCrossRefMATH Witt C (2013) Tight bounds on the optimization time of a randomized search heuristic on linear functions. Combin Probab Comput 22(02):294–318MathSciNetCrossRefMATH
30.
Zurück zum Zitat Witt C (2014) Fitness levels with tail bounds for the analysis of randomized search heuristics. Inf Process Lett 114(1):38–41MathSciNetCrossRefMATH Witt C (2014) Fitness levels with tail bounds for the analysis of randomized search heuristics. Inf Process Lett 114(1):38–41MathSciNetCrossRefMATH
31.
Zurück zum Zitat Sudholt D (2013) A new method for lower bounds on the running time of evolutionary algorithms. IEEE Trans Evolut Comput 17(3):418–435CrossRef Sudholt D (2013) A new method for lower bounds on the running time of evolutionary algorithms. IEEE Trans Evolut Comput 17(3):418–435CrossRef
32.
Zurück zum Zitat Jägerskpper J (2007) Algorithmic analysis of a basic evolutionary algorithm for continuous optimization. Theor Comput Sci 379(3):329–347MathSciNetCrossRef Jägerskpper J (2007) Algorithmic analysis of a basic evolutionary algorithm for continuous optimization. Theor Comput Sci 379(3):329–347MathSciNetCrossRef
33.
Zurück zum Zitat Jägerskpper J (2008) Lower bounds for randomized direct search with isotropic sampling. Oper Res Lett 36(3):327–332MathSciNetCrossRef Jägerskpper J (2008) Lower bounds for randomized direct search with isotropic sampling. Oper Res Lett 36(3):327–332MathSciNetCrossRef
34.
Zurück zum Zitat Agapie A, Agapie M, Baganu G (2013) Evolutionary algorithms for continuous-space optimisation. Int J Syst Sci 44(3):502–512MathSciNetCrossRefMATH Agapie A, Agapie M, Baganu G (2013) Evolutionary algorithms for continuous-space optimisation. Int J Syst Sci 44(3):502–512MathSciNetCrossRefMATH
35.
Zurück zum Zitat Agapie A, Agapie M, Rudolph G, Zbaganu G (2013) Convergence of evolutionary algorithms on the n-dimensional continuous space. IEEE Trans Cybern 43(5):1462–1472CrossRefMATH Agapie A, Agapie M, Rudolph G, Zbaganu G (2013) Convergence of evolutionary algorithms on the n-dimensional continuous space. IEEE Trans Cybern 43(5):1462–1472CrossRefMATH
36.
Zurück zum Zitat Chen Y, Zou X, He J (2011) Drift conditions for estimating the first hitting times of evolutionary algorithms. Int J Comput Math 88(1):37–50MathSciNetCrossRefMATH Chen Y, Zou X, He J (2011) Drift conditions for estimating the first hitting times of evolutionary algorithms. Int J Comput Math 88(1):37–50MathSciNetCrossRefMATH
Metadaten
Titel
Running-time analysis of evolutionary programming based on Lebesgue measure of searching space
verfasst von
Yushan Zhang
Han Huang
Zhiyong Lin
Zhifeng Hao
Guiwu Hu
Publikationsdatum
19.11.2016
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 2/2018
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2651-7

Weitere Artikel der Ausgabe 2/2018

Neural Computing and Applications 2/2018 Zur Ausgabe

Premium Partner