Skip to main content

2021 | OriginalPaper | Buchkapitel

Event-Driven Multi-algorithm Optimization: Mixing Swarm and Evolutionary Strategies

verfasst von : Mario García-Valdez, Juan J. Merelo

Erschienen in: Applications of Evolutionary Computation

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Researchers in nature-inspired optimization have recently proposed multi-population asynchronous algorithms that split the evolutionary process between different search paradigms working in collaboration. These algorithms execute the optimization strategy by reading streams of messages containing solution populations from message queues. After searching for a small number of iterations, new evolved populations are generated and sent back to a queue. Current research suggests that when we have many population-processing algorithms communicating in parallel, parameters intensifying exploration or exploitation in each population strike a dynamic that balances the two, exploring and exploiting simultaneously, maintaining an overall diversity, and improving the search. In this work, we propose a simple reactive migration, population-generation, and processing method for the asynchronous processing of multi-population, multi-strategy algorithms that achieves an improvement over homogeneous configurations. We evaluate this method by comparing a heterogeneous ensemble of multi-populations against a homogeneous solution consisting of a Genetic Algorithm (GA) and Particle Swarm Optimization (PSO) populations, using five problems from the noiseless BBOB toolbox for the optimization of continuous functions. Results show that compared with other asynchronous homogeneous population-based algorithms, this method offers better performance concerning the maximum number of evaluations needed to find a solution and the number runs where it found it.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Alba, E.: Parallel evolutionary algorithms can achieve super-linear performance. Inf. Process. Lett. 82(1), 7–13 (2002). Evolutionary ComputationMathSciNetCrossRef Alba, E.: Parallel evolutionary algorithms can achieve super-linear performance. Inf. Process. Lett. 82(1), 7–13 (2002). Evolutionary ComputationMathSciNetCrossRef
2.
Zurück zum Zitat Back, T.: Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms. Oxford University Press, Oxford (1996)CrossRef Back, T.: Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms. Oxford University Press, Oxford (1996)CrossRef
3.
Zurück zum Zitat Baluja, S.: Population-based incremental learning. a method for integrating genetic search based function optimization and competitive learning. Technical report, Carnegie-Mellon University, Pittsburgh PA, Department of Computer Science (1994) Baluja, S.: Population-based incremental learning. a method for integrating genetic search based function optimization and competitive learning. Technical report, Carnegie-Mellon University, Pittsburgh PA, Department of Computer Science (1994)
4.
Zurück zum Zitat Črepinšek, M., Liu, S.H., Mernik, M.: Exploration and exploitation in evolutionary algorithms: a survey. ACM Comput. Surv. (CSUR) 45(3), 1–33 (2013)CrossRef Črepinšek, M., Liu, S.H., Mernik, M.: Exploration and exploitation in evolutionary algorithms: a survey. ACM Comput. Surv. (CSUR) 45(3), 1–33 (2013)CrossRef
5.
Zurück zum Zitat Doerr, B., Sudholt, D., Witt, C.: When do evolutionary algorithms optimize separable functions in parallel? In: Proceedings FOGA XII, pp. 51–64 (2013) Doerr, B., Sudholt, D., Witt, C.: When do evolutionary algorithms optimize separable functions in parallel? In: Proceedings FOGA XII, pp. 51–64 (2013)
6.
Zurück zum Zitat El-Abd, M., Kamel, M.S.: Black-box optimization benchmarking for noiseless function testbed using an EDA and PSO hybrid. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2263–2268 (2009) El-Abd, M., Kamel, M.S.: Black-box optimization benchmarking for noiseless function testbed using an EDA and PSO hybrid. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2263–2268 (2009)
7.
Zurück zum Zitat Esmin, A.A.A., Lambert-Torres, G., Alvarenga, G.B.: Hybrid evolutionary algorithm based on PSO and GA mutation. In: 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS 2006), pp. 57. IEEE (2006) Esmin, A.A.A., Lambert-Torres, G., Alvarenga, G.B.: Hybrid evolutionary algorithm based on PSO and GA mutation. In: 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS 2006), pp. 57. IEEE (2006)
8.
Zurück zum Zitat Faris, H., Aljarah, I., Mirjalili, S., Castillo, P.A., Merelo-Guervós, J.J.: EvoloPy: an open-source nature-inspired optimization framework in Python. In: IJCCI (ECTA), pp. 171–177 (2016) Faris, H., Aljarah, I., Mirjalili, S., Castillo, P.A., Merelo-Guervós, J.J.: EvoloPy: an open-source nature-inspired optimization framework in Python. In: IJCCI (ECTA), pp. 171–177 (2016)
9.
Zurück zum Zitat Fortin, F.A., Rainville, F.M.D., Gardner, M.A., Parizeau, M., Gagné, C.: DEAP: evolutionary algorithms made easy. J. Mach. Learn. Res. 13, 2171–2175 (2012)MathSciNet Fortin, F.A., Rainville, F.M.D., Gardner, M.A., Parizeau, M., Gagné, C.: DEAP: evolutionary algorithms made easy. J. Mach. Learn. Res. 13, 2171–2175 (2012)MathSciNet
11.
Zurück zum Zitat García-Nieto, J., Alba, E., Apolloni, J.: Noiseless functions black-box optimization: evaluation of a hybrid particle swarm with differential operators. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2231–2238 (2009) García-Nieto, J., Alba, E., Apolloni, J.: Noiseless functions black-box optimization: evaluation of a hybrid particle swarm with differential operators. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2231–2238 (2009)
12.
Zurück zum Zitat García-Valdez, J.M., Merelo-Guervós, J.J.: A modern, event-based architecture for distributed evolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 233–234 (2018) García-Valdez, J.M., Merelo-Guervós, J.J.: A modern, event-based architecture for distributed evolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 233–234 (2018)
13.
Zurück zum Zitat García-Valdez, M., Merelo, J.: Benchmarking a pool-based execution with GA and PSO workers on the BBOB noiseless testbed. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1750–1755 (2017) García-Valdez, M., Merelo, J.: Benchmarking a pool-based execution with GA and PSO workers on the BBOB noiseless testbed. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1750–1755 (2017)
15.
Zurück zum Zitat Grimaldi, E.A., Grimaccia, F., Mussetta, M., Pirinoli, P., Zich, R.: Genetical swarm optimization: a new hybrid evolutionary algorithm for electromagnetic applications. In: 2005 18th International Conference on Applied Electromagnetics and Communications, pp. 1–4. IEEE (2005) Grimaldi, E.A., Grimaccia, F., Mussetta, M., Pirinoli, P., Zich, R.: Genetical swarm optimization: a new hybrid evolutionary algorithm for electromagnetic applications. In: 2005 18th International Conference on Applied Electromagnetics and Communications, pp. 1–4. IEEE (2005)
16.
Zurück zum Zitat Grosso, P.: Computer simulations of genetic adaptation: parallel subcomponent interaction in multilocus model. Ph.D. dissertation, University of Michigan (1985) Grosso, P.: Computer simulations of genetic adaptation: parallel subcomponent interaction in multilocus model. Ph.D. dissertation, University of Michigan (1985)
17.
Zurück zum Zitat Gulia, P., et al.: Hybrid swarm and GA based approach for software test case selection. Int. J. Electr. Comput. Eng. 9, 4898–4903 (2019). (2088–8708) Gulia, P., et al.: Hybrid swarm and GA based approach for software test case selection. Int. J. Electr. Comput. Eng. 9, 4898–4903 (2019). (2088–8708)
18.
Zurück zum Zitat Hansen, N.: Benchmarking a BI-population CMA-ES on the BBOB-2009 function testbed. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2389–2396 (2009) Hansen, N.: Benchmarking a BI-population CMA-ES on the BBOB-2009 function testbed. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2389–2396 (2009)
19.
Zurück zum Zitat Hansen, N., Auger, A., Mersmann, O., Tusar, T., Brockhoff, D.: COCO: a platform for comparing continuous optimizers in a black-box setting. arXiv preprint arXiv:1603.08785 (2016) Hansen, N., Auger, A., Mersmann, O., Tusar, T., Brockhoff, D.: COCO: a platform for comparing continuous optimizers in a black-box setting. arXiv preprint arXiv:​1603.​08785 (2016)
20.
Zurück zum Zitat Hansen, N., Auger, A., Ros, R., Finck, S., Pošík, P.: Comparing results of 31 algorithms from the black-box optimization benchmarking BBOB-2009. In: Proceedings of the 12th Annual Conference Companion on Genetic and Evolutionary Computation, pp. 1689–1696. ACM (2010) Hansen, N., Auger, A., Ros, R., Finck, S., Pošík, P.: Comparing results of 31 algorithms from the black-box optimization benchmarking BBOB-2009. In: Proceedings of the 12th Annual Conference Companion on Genetic and Evolutionary Computation, pp. 1689–1696. ACM (2010)
21.
Zurück zum Zitat Hansen, N., Finck, S., Ros, R., Auger, A.: Real-parameter black-box optimization benchmarking 2009: noiseless functions definitions. Ph.D. thesis, INRIA (2009) Hansen, N., Finck, S., Ros, R., Auger, A.: Real-parameter black-box optimization benchmarking 2009: noiseless functions definitions. Ph.D. thesis, INRIA (2009)
23.
Zurück zum Zitat Bengoetxea, E., Larrañaga, P., Bloch, I., Perchant, A.: Estimation of distribution algorithms: a new evolutionary computation approach for graph matching problems. In: Figueiredo, M., Zerubia, J., Jain, A.K. (eds.) EMMCVPR 2001. LNCS, vol. 2134, pp. 454–469. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-44745-8_30CrossRef Bengoetxea, E., Larrañaga, P., Bloch, I., Perchant, A.: Estimation of distribution algorithms: a new evolutionary computation approach for graph matching problems. In: Figueiredo, M., Zerubia, J., Jain, A.K. (eds.) EMMCVPR 2001. LNCS, vol. 2134, pp. 454–469. Springer, Heidelberg (2001). https://​doi.​org/​10.​1007/​3-540-44745-8_​30CrossRef
24.
Zurück zum Zitat Li, C., Nguyen, T.T., Yang, M., Yang, S., Zeng, S.: Multi-population methods in unconstrained continuous dynamic environments: the challenges. Inf. Sci. 296, 95–118 (2015)CrossRef Li, C., Nguyen, T.T., Yang, M., Yang, S., Zeng, S.: Multi-population methods in unconstrained continuous dynamic environments: the challenges. Inf. Sci. 296, 95–118 (2015)CrossRef
25.
Zurück zum Zitat Li, S., Wu, X., Tan, M.: Gene selection using hybrid particle swarm optimization and genetic algorithm. Soft. Comput. 12(11), 1039–1048 (2008)CrossRef Li, S., Wu, X., Tan, M.: Gene selection using hybrid particle swarm optimization and genetic algorithm. Soft. Comput. 12(11), 1039–1048 (2008)CrossRef
26.
Zurück zum Zitat Li, X., Ma, S., Wang, Y.: Multi-population based ensemble mutation method for single objective bilevel optimization problem. IEEE Access 4, 7262–7274 (2016)CrossRef Li, X., Ma, S., Wang, Y.: Multi-population based ensemble mutation method for single objective bilevel optimization problem. IEEE Access 4, 7262–7274 (2016)CrossRef
27.
Zurück zum Zitat Lien, L.C., Cheng, M.Y.: A hybrid swarm intelligence based particle-bee algorithm for construction site layout optimization. Expert Syst. Appl. 39(10), 9642–9650 (2012)CrossRef Lien, L.C., Cheng, M.Y.: A hybrid swarm intelligence based particle-bee algorithm for construction site layout optimization. Expert Syst. Appl. 39(10), 9642–9650 (2012)CrossRef
28.
Zurück zum Zitat Ma, H., Shen, S., Yu, M., Yang, Z., Fei, M., Zhou, H.: Multi-population techniques in nature inspired optimization algorithms: a comprehensive survey. Swarm Evol. Comput. 44, 365–387 (2019)CrossRef Ma, H., Shen, S., Yu, M., Yang, Z., Fei, M., Zhou, H.: Multi-population techniques in nature inspired optimization algorithms: a comprehensive survey. Swarm Evol. Comput. 44, 365–387 (2019)CrossRef
29.
Zurück zum Zitat Merelo Guervós, J.J., García-Valdez, J.M.: Introducing an event-based architecture for concurrent and distributed evolutionary algorithms. In: Auger, A., Fonseca, C.M., Lourenço, N., Machado, P., Paquete, L., Whitley, D. (eds.) PPSN 2018. LNCS, vol. 11101, pp. 399–410. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99253-2_32CrossRef Merelo Guervós, J.J., García-Valdez, J.M.: Introducing an event-based architecture for concurrent and distributed evolutionary algorithms. In: Auger, A., Fonseca, C.M., Lourenço, N., Machado, P., Paquete, L., Whitley, D. (eds.) PPSN 2018. LNCS, vol. 11101, pp. 399–410. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-319-99253-2_​32CrossRef
30.
Zurück zum Zitat Merelo-Guervós, J.J., Laredo, J.L.J., Castillo, P.A., Valdez, M.G., Rojas-Galeano, S.: Improving the algorithmic efficiency and performance of channel-based evolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 320–321 (2019) Merelo-Guervós, J.J., Laredo, J.L.J., Castillo, P.A., Valdez, M.G., Rojas-Galeano, S.: Improving the algorithmic efficiency and performance of channel-based evolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 320–321 (2019)
31.
Zurück zum Zitat Mühlenbein, H., Gorges-Schleuter, M., Krämer, O.: Evolution algorithms in combinatorial optimization. Parallel Comput. 7(1), 65–85 (1988)CrossRef Mühlenbein, H., Gorges-Schleuter, M., Krämer, O.: Evolution algorithms in combinatorial optimization. Parallel Comput. 7(1), 65–85 (1988)CrossRef
32.
Zurück zum Zitat Nicolau, M.: Application of a simple binary genetic algorithm to a noiseless testbed benchmark. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2473–2478 (2009) Nicolau, M.: Application of a simple binary genetic algorithm to a noiseless testbed benchmark. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2473–2478 (2009)
33.
Zurück zum Zitat Nseef, S.K., Abdullah, S., Turky, A., Kendall, G.: An adaptive multi-population artificial bee colony algorithm for dynamic optimisation problems. Knowl.-Based Syst. 104, 14–23 (2016)CrossRef Nseef, S.K., Abdullah, S., Turky, A., Kendall, G.: An adaptive multi-population artificial bee colony algorithm for dynamic optimisation problems. Knowl.-Based Syst. 104, 14–23 (2016)CrossRef
34.
Zurück zum Zitat Pandi, V.R., Panigrahi, B.K.: Dynamic economic load dispatch using hybrid swarm intelligence based harmony search algorithm. Expert Syst. Appl. 38(7), 8509–8514 (2011)CrossRef Pandi, V.R., Panigrahi, B.K.: Dynamic economic load dispatch using hybrid swarm intelligence based harmony search algorithm. Expert Syst. Appl. 38(7), 8509–8514 (2011)CrossRef
35.
Zurück zum Zitat Pošík, P.: BBOB-benchmarking two variants of the line-search algorithm. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2329–2336 (2009) Pošík, P.: BBOB-benchmarking two variants of the line-search algorithm. In: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers, pp. 2329–2336 (2009)
36.
Zurück zum Zitat Pošík, P., Baudiš, P.: Dimension selection in axis-parallel brent-step method for black-box optimization of separable continuous functions. In: Proceedings of the Companion Publication of the 2015 Annual Conference on Genetic and Evolutionary Computation, pp. 1151–1158 (2015) Pošík, P., Baudiš, P.: Dimension selection in axis-parallel brent-step method for black-box optimization of separable continuous functions. In: Proceedings of the Companion Publication of the 2015 Annual Conference on Genetic and Evolutionary Computation, pp. 1151–1158 (2015)
37.
Zurück zum Zitat Pošík, P., Klemš, V.: Benchmarking the differential evolution with adaptive encoding on noiseless functions. In: Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation, pp. 189–196 (2012) Pošík, P., Klemš, V.: Benchmarking the differential evolution with adaptive encoding on noiseless functions. In: Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation, pp. 189–196 (2012)
38.
Zurück zum Zitat Robinson, J., Sinton, S., Rahmat-Samii, Y.: Particle swarm, genetic algorithm, and their hybrids: optimization of a profiled corrugated horn antenna. In: IEEE Antennas and Propagation Society, AP-S International Symposium (Digest), vol. 1, pp. 314–317, February 2002. https://doi.org/10.1109/APS.2002.1016311 Robinson, J., Sinton, S., Rahmat-Samii, Y.: Particle swarm, genetic algorithm, and their hybrids: optimization of a profiled corrugated horn antenna. In: IEEE Antennas and Propagation Society, AP-S International Symposium (Digest), vol. 1, pp. 314–317, February 2002. https://​doi.​org/​10.​1109/​APS.​2002.​1016311
39.
Zurück zum Zitat Sangeeta, S.: Comprehensive analysis of hybrid nature-inspired algorithms for software reliability analysis. J. Stat. Manag. Syst. 23(6), 1037–1048 (2020)MathSciNet Sangeeta, S.: Comprehensive analysis of hybrid nature-inspired algorithms for software reliability analysis. J. Stat. Manag. Syst. 23(6), 1037–1048 (2020)MathSciNet
40.
Zurück zum Zitat Shi, X., Lu, Y., Zhou, C., Lee, H., Lin, W., Liang, Y.: Hybrid evolutionary algorithms based on PSO and GA. In: The 2003 Congress on Evolutionary Computation 2003. CEC 2003, vol. 4, pp. 2393–2399. IEEE (2003) Shi, X., Lu, Y., Zhou, C., Lee, H., Lin, W., Liang, Y.: Hybrid evolutionary algorithms based on PSO and GA. In: The 2003 Congress on Evolutionary Computation 2003. CEC 2003, vol. 4, pp. 2393–2399. IEEE (2003)
41.
Zurück zum Zitat Swarzberg, S., Seront, G., Bersini, H.: Step: the easiest way to optimize a function. In: Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence, pp. 519–524. IEEE (1994) Swarzberg, S., Seront, G., Bersini, H.: Step: the easiest way to optimize a function. In: Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence, pp. 519–524. IEEE (1994)
42.
Zurück zum Zitat Tanabe, R., Fukunaga, A.: Evaluation of a randomized parameter setting strategy for island-model evolutionary algorithms. In: 2013 IEEE Congress on Evolutionary Computation (CEC), pp. 1263–1270. IEEE (2013) Tanabe, R., Fukunaga, A.: Evaluation of a randomized parameter setting strategy for island-model evolutionary algorithms. In: 2013 IEEE Congress on Evolutionary Computation (CEC), pp. 1263–1270. IEEE (2013)
43.
Zurück zum Zitat Wu, G., Mallipeddi, R., Suganthan, P.N., Wang, R., Chen, H.: Differential evolution with multi-population based ensemble of mutation strategies. Inf. Sci. 329, 329–345 (2016)CrossRef Wu, G., Mallipeddi, R., Suganthan, P.N., Wang, R., Chen, H.: Differential evolution with multi-population based ensemble of mutation strategies. Inf. Sci. 329, 329–345 (2016)CrossRef
44.
Zurück zum Zitat Yang, X.S.: Nature-Inspired Optimization Algorithms. Elsevier, Amsterdam (2014)MATH Yang, X.S.: Nature-Inspired Optimization Algorithms. Elsevier, Amsterdam (2014)MATH
45.
Zurück zum Zitat Yuan, B., Gallagher, M.: On the importance of diversity maintenance in estimation of distribution algorithms. In: Proceedings of the 7th Annual Conference on Genetic and Evolutionary Computation, pp. 719–726 (2005) Yuan, B., Gallagher, M.: On the importance of diversity maintenance in estimation of distribution algorithms. In: Proceedings of the 7th Annual Conference on Genetic and Evolutionary Computation, pp. 719–726 (2005)
Metadaten
Titel
Event-Driven Multi-algorithm Optimization: Mixing Swarm and Evolutionary Strategies
verfasst von
Mario García-Valdez
Juan J. Merelo
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-72699-7_47

Premium Partner