Skip to main content
Erschienen in:
Buchtitelbild

2020 | OriginalPaper | Buchkapitel

1. Evolutionary Computation and Meta-heuristics

verfasst von : Hitoshi Iba

Erschienen in: Deep Neural Evolution

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter presents several methods of evolutionary computation and meta-heuristics. Evolutionary computation is a computation technique that mimics the evolutionary mechanism of life to select, deform, and convolute data structures. Because of its high versatility, its applications are found in various fields. Meta-heuristics described in this chapter are considered as representatives of swarm intelligence, such as particle swarm optimization (PSO), artificial bee colony optimization (ABC), ant colony optimization (ACO), firefly algorithms, cuckoo search, etc. A benefit of these methods is global searching as well as local searching. Existence of local minima or saddle points could lead to a locally optimum solution when using gradient methods such as the steepest descent search. By contrast, the methods described in this chapter can escape from such local solutions by means of various kinds of operations. Methods of evolutionary computation and meta-heuristics are used in combination with deep learning to establish a framework of deep neural evolution, which will be described in later chapters.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Parasitized species are almost always fixed for each female cuckoo.
 
2
Furthermore, a cuckoo chick having just been hatched expels all the eggs of its host. For this reason, a cuckoo chick has a pit in its back to place its host’s egg, clambers up inside the nest and throw the egg out of the nest. This behavior was discovered by Edward Jenner, famous for smallpox vaccination.
 
3
It corresponds to allele in genotype under GA.
 
4
David Hilbert (1862–1943): German mathematician. At the second International Congress of Mathematicians (ICM) in Paris in 1900, he made a speech on “problems in mathematics,” where he stressed the importance of 23 unsolved problems and presented a prospect for future creative research through these problems. Some of them continue to be themes for research on mathematics and computer science.
 
5
Further discussions have been presented, and there is an insistence on the part of some individuals that it is a different method. Refer to https://​en.​wikipedia.​org/​wiki/​Harmony_​search and [12] for details.
 
Literatur
1.
Zurück zum Zitat Civicioglu, P., Besdok, E.: A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms. Artif. Intell. Rev. 39(4), 315–346 (2013)CrossRef Civicioglu, P., Besdok, E.: A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms. Artif. Intell. Rev. 39(4), 315–346 (2013)CrossRef
2.
Zurück zum Zitat Deb, K.D., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)CrossRef Deb, K.D., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)CrossRef
3.
Zurück zum Zitat Dorigo, M., Gambardella, L.M.: Ant colonies for the traveling salesman problem. Technical Report IRIDIA/97-12, Universite Libre de Bruxelles, Belgium (1997) Dorigo, M., Gambardella, L.M.: Ant colonies for the traveling salesman problem. Technical Report IRIDIA/97-12, Universite Libre de Bruxelles, Belgium (1997)
4.
Zurück zum Zitat Geem, Z.W., Kim, J.H., Loganathan, G.V.: A new heuristic optimization algorithm: harmony search. Simulation 76(2), 60–68 (2001). Physical Review E 79 (2009)CrossRef Geem, Z.W., Kim, J.H., Loganathan, G.V.: A new heuristic optimization algorithm: harmony search. Simulation 76(2), 60–68 (2001). Physical Review E 79 (2009)CrossRef
5.
Zurück zum Zitat Ghosh, A., Dehuri, S., Ghosh, S. (eds.): Objective Evolutionary Algorithms for Knowledge Discovery from Databases. Springer, Berlin (2008)MATH Ghosh, A., Dehuri, S., Ghosh, S. (eds.): Objective Evolutionary Algorithms for Knowledge Discovery from Databases. Springer, Berlin (2008)MATH
6.
Zurück zum Zitat Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison Wesley, Reading (1989) Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison Wesley, Reading (1989)
7.
Zurück zum Zitat He, C., Noman, N., Iba, H.: An improved artificial bee colony algorithm with non-separable operator. In: Proceeding of International Conference on Convergence and Hybrid Information Technology, pp. 203–210. Springer, Berlin (2012) He, C., Noman, N., Iba, H.: An improved artificial bee colony algorithm with non-separable operator. In: Proceeding of International Conference on Convergence and Hybrid Information Technology, pp. 203–210. Springer, Berlin (2012)
8.
Zurück zum Zitat Higashi, N., Iba, H.: Particle swarm optimization with Gaussian mutation. In: Proceedings of IEEE Swarm Intelligence Symposium (SIS03), pp.72–79. IEEE Press, New York (2003) Higashi, N., Iba, H.: Particle swarm optimization with Gaussian mutation. In: Proceedings of IEEE Swarm Intelligence Symposium (SIS03), pp.72–79. IEEE Press, New York (2003)
9.
Zurück zum Zitat Iba. H., Noman, N.: New frontiers in evolutionary algorithms: theory and applications. World Scientific, Singapore (2011). ISBN-10:1848166818 Iba. H., Noman, N.: New frontiers in evolutionary algorithms: theory and applications. World Scientific, Singapore (2011). ISBN-10:1848166818
10.
Zurück zum Zitat Iba, H., Aranha, C.C.: Practical Applications of Evolutionary Computation to Financial Engineering: Robust Techniques for Forecasting, Trading and Hedging. Springer, Berlin (2012) Iba, H., Aranha, C.C.: Practical Applications of Evolutionary Computation to Financial Engineering: Robust Techniques for Forecasting, Trading and Hedging. Springer, Berlin (2012)
11.
Zurück zum Zitat Iba, H.: Evolutionary Approach to Machine Learning and Deep Neural Networks—Neuro-Evolution and Gene Regulatory Networks. Springer, Berlin (2018). ISBN 978-981-13-0199-5CrossRef Iba, H.: Evolutionary Approach to Machine Learning and Deep Neural Networks—Neuro-Evolution and Gene Regulatory Networks. Springer, Berlin (2018). ISBN 978-981-13-0199-5CrossRef
12.
Zurück zum Zitat Iba, H.: AI and SWARM: Evolutionary Approach to Emergent Intelligence. CRC Press, West Palm Beach (2019). ISBN-13: 978-0367136314 Iba, H.: AI and SWARM: Evolutionary Approach to Emergent Intelligence. CRC Press, West Palm Beach (2019). ISBN-13: 978-0367136314
13.
Zurück zum Zitat Ishibuchi, H., Tsukamoto, N., Nojima, Y.: Evolutionary many-objective optimization: a short review. In: Proceeding of IEEE Congress on Evolutionary Computation, pp. 2419–2426 (2008) Ishibuchi, H., Tsukamoto, N., Nojima, Y.: Evolutionary many-objective optimization: a short review. In: Proceeding of IEEE Congress on Evolutionary Computation, pp. 2419–2426 (2008)
14.
Zurück zum Zitat Karaboga, D., Basturk, B.: A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Glob. Optim. 39, 459–471 (2007)MathSciNetCrossRef Karaboga, D., Basturk, B.: A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Glob. Optim. 39, 459–471 (2007)MathSciNetCrossRef
16.
Zurück zum Zitat Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings of IEEE the International Conference on Neural Networks, pp.1942–1948 (1995) Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings of IEEE the International Conference on Neural Networks, pp.1942–1948 (1995)
17.
Zurück zum Zitat Lipson, H., Pollack, J.B.: Automatic design and manufacture of robotic lifeforms. Nature 406, 974–978 (2000)CrossRef Lipson, H., Pollack, J.B.: Automatic design and manufacture of robotic lifeforms. Nature 406, 974–978 (2000)CrossRef
18.
Zurück zum Zitat Miller, J.F. (ed.): Cartesian Genetic Programming. Springer, Berlin (2011)MATH Miller, J.F. (ed.): Cartesian Genetic Programming. Springer, Berlin (2011)MATH
19.
20.
Zurück zum Zitat Sörensen, K., Sevaux, M., Glover, F.: A history of metaheuristics. arXiv:1704.00853v1 [cs.AI] 4 Apr 2017, to appear in Mart, R., Pardalos, P., Resende, M., Handbook of Heuristics. Springer, Berlin. Sörensen, K., Sevaux, M., Glover, F.: A history of metaheuristics. arXiv:1704.00853v1 [cs.AI] 4 Apr 2017, to appear in Mart, R., Pardalos, P., Resende, M., Handbook of Heuristics. Springer, Berlin.
21.
Zurück zum Zitat Weyland, D.: A rigorous analysis of the harmony search algorithm—how the research community can be misled by a “novel” methodology. Int. J. Appl. Metaheuristic Comput. 1(2), 50–60 (2010)CrossRef Weyland, D.: A rigorous analysis of the harmony search algorithm—how the research community can be misled by a “novel” methodology. Int. J. Appl. Metaheuristic Comput. 1(2), 50–60 (2010)CrossRef
22.
Zurück zum Zitat Yang, X.: Nature-Inspired Metaheuristic Algorithms, 2nd edn. Luniver Press, Frome (2010) Yang, X.: Nature-Inspired Metaheuristic Algorithms, 2nd edn. Luniver Press, Frome (2010)
23.
Zurück zum Zitat Yang, X.-S., Deb, S.: 2009 Cuckoo search via Levy flights. In: Proceeding of World Congress on Nature and Biologically Inspired Computing (NaBIC 2009), pp. 210–214. IEEE, New York (2009) Yang, X.-S., Deb, S.: 2009 Cuckoo search via Levy flights. In: Proceeding of World Congress on Nature and Biologically Inspired Computing (NaBIC 2009), pp. 210–214. IEEE, New York (2009)
Metadaten
Titel
Evolutionary Computation and Meta-heuristics
verfasst von
Hitoshi Iba
Copyright-Jahr
2020
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-3685-4_1