Skip to main content
Erschienen in: Soft Computing 24/2019

05.03.2019 | Methodologies and Application

Distributed minimum spanning tree differential evolution for multimodal optimization problems

verfasst von: Zi-Jia Wang, Zhi-Hui Zhan, Jun Zhang

Erschienen in: Soft Computing | Ausgabe 24/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multimodal optimization problem (MMOP) requires to find optima as many as possible for a single problem. Recently, many niching techniques have been proposed to tackle MMOPs. However, most of the niching techniques are either sensitive to the niching parameters or causing a waste of fitness evaluations. In this paper, we proposed a novel niching technique based on minimum spanning tree (MST) and applied it into differential evolution (DE), termed as MSTDE, to solve MMOPs. In every generation, an MST is built based on the distance information among the individuals. After that, we cut the M largest weighted edges of the MST to form some subtrees, so-called subpopulations. The DE operators are executed within the subpopulations. Besides, a dynamic pruning ratio (DPR) strategy is proposed to determine M with an attempt to reduce its sensitivity, so as to enhance the niching performance. Meanwhile, the DPR strategy can achieve a good balance between diversity and convergence. Besides, taking the advantage of fast availability in time from virtual machines (VMs), a distributed model is applied in MSTDE, where different subpopulations run concurrently on distributed VMs. Experiments have been conducted on the CEC2013 multimodal benchmark functions to test the performance of MSTDE, and the experimental results show that MSTDE can outperform many existed multimodal optimization algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Agrawal S, Silakari S (2014) FRPSO: Fletcher–Reeves based particle swarm optimization for multimodal function optimization. Soft Comput 18(11):2227–2243CrossRef Agrawal S, Silakari S (2014) FRPSO: Fletcher–Reeves based particle swarm optimization for multimodal function optimization. Soft Comput 18(11):2227–2243CrossRef
Zurück zum Zitat Ahrari A, Deb K, Preuss M (2017) Multimodal optimization by covariance matrix self-adaptation evolution strategy with repelling subpopulations. Evol Comput 25(3):439–471CrossRef Ahrari A, Deb K, Preuss M (2017) Multimodal optimization by covariance matrix self-adaptation evolution strategy with repelling subpopulations. Evol Comput 25(3):439–471CrossRef
Zurück zum Zitat Arellano-Verdejo J, Alba E, Godoy-Calderon S (2016) Efficiently finding the optimum number of clusters in a dataset with a new hybrid differential evolution algorithm: DELA. Soft Comput 20(3):895–905CrossRef Arellano-Verdejo J, Alba E, Godoy-Calderon S (2016) Efficiently finding the optimum number of clusters in a dataset with a new hybrid differential evolution algorithm: DELA. Soft Comput 20(3):895–905CrossRef
Zurück zum Zitat Arora P, Bhargava S, Srivastava S, Hanmandlu M (2017) Multimodal biometric system based on information set theory and refined scores. Soft Comput 21(17):5133–5144CrossRef Arora P, Bhargava S, Srivastava S, Hanmandlu M (2017) Multimodal biometric system based on information set theory and refined scores. Soft Comput 21(17):5133–5144CrossRef
Zurück zum Zitat Biswas S, Kundu S, Das S (2014) An improved parent-centric mutation with normalized neighborhoods for inducing niching behavior in differential evolution. IEEE Trans Cybern 44(10):1726–1737CrossRef Biswas S, Kundu S, Das S (2014) An improved parent-centric mutation with normalized neighborhoods for inducing niching behavior in differential evolution. IEEE Trans Cybern 44(10):1726–1737CrossRef
Zurück zum Zitat Biswas S, Kundu S, Das S (2015) Inducing niching behavior in differential evolution through local information sharing. IEEE Trans Evol Comput 19(2):246–263CrossRef Biswas S, Kundu S, Das S (2015) Inducing niching behavior in differential evolution through local information sharing. IEEE Trans Evol Comput 19(2):246–263CrossRef
Zurück zum Zitat Chen CH, Yang SY (2013) A knowledge-based cooperative differential evolution for neural fuzzy inference systems. Soft Comput 17(5):883–895CrossRef Chen CH, Yang SY (2013) A knowledge-based cooperative differential evolution for neural fuzzy inference systems. Soft Comput 17(5):883–895CrossRef
Zurück zum Zitat Chen N, Chen WN, Gong YJ, Zhan ZH, Zhang J, Li Y, Tan YS (2015) An evolutionary algorithm with double-level archives for multiobjective optimization. IEEE Trans Cybern 45(9):1851–1863CrossRef Chen N, Chen WN, Gong YJ, Zhan ZH, Zhang J, Li Y, Tan YS (2015) An evolutionary algorithm with double-level archives for multiobjective optimization. IEEE Trans Cybern 45(9):1851–1863CrossRef
Zurück zum Zitat Cuevas E, González M (2013) An optimization algorithm for multimodal functions inspired by collective animal behavior. Soft Comput 17(3):489–502CrossRef Cuevas E, González M (2013) An optimization algorithm for multimodal functions inspired by collective animal behavior. Soft Comput 17(3):489–502CrossRef
Zurück zum Zitat Cuevas E, González M, Zaldívar D, Pérez-Cisneros M (2014) Multi-ellipses detection on images inspired by collective animal behavior. Neural Comput Appl 24(5):1019–1033CrossRef Cuevas E, González M, Zaldívar D, Pérez-Cisneros M (2014) Multi-ellipses detection on images inspired by collective animal behavior. Neural Comput Appl 24(5):1019–1033CrossRef
Zurück zum Zitat Datta D, Figueira JR (2011) Graph partitioning by multi-objective real-valued metaheuristics: a comparative study. Appl Soft Comput 11(5):3976–3987CrossRef Datta D, Figueira JR (2011) Graph partitioning by multi-objective real-valued metaheuristics: a comparative study. Appl Soft Comput 11(5):3976–3987CrossRef
Zurück zum Zitat Derrac J, Garcıa S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18CrossRef Derrac J, Garcıa S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18CrossRef
Zurück zum Zitat Dick G, Whigham PA (2011) Weighted local sharing and local clearing for multimodal optimization. Soft Comput 15(9):1707–1721CrossRef Dick G, Whigham PA (2011) Weighted local sharing and local clearing for multimodal optimization. Soft Comput 15(9):1707–1721CrossRef
Zurück zum Zitat Gao W, Yen GG, Liu S (2014) A cluster-based differential evolution with self-adaptive strategy for multimodal optimization. IEEE Trans Cybern 44(8):1314–1327CrossRef Gao W, Yen GG, Liu S (2014) A cluster-based differential evolution with self-adaptive strategy for multimodal optimization. IEEE Trans Cybern 44(8):1314–1327CrossRef
Zurück zum Zitat Goldberg DE, Richardson J (1987) Genetic algorithms with sharing for multimodal function optimization. In: Proceedings of the international conference on genetic algorithms, Cambridge, pp 41–49 Goldberg DE, Richardson J (1987) Genetic algorithms with sharing for multimodal function optimization. In: Proceedings of the international conference on genetic algorithms, Cambridge, pp 41–49
Zurück zum Zitat Hui S, Suganthan PN (2016) Ensemble and arithmetic recombination-based speciation differential evolution for multimodal optimization. IEEE Trans Cybern 46(1):64–74CrossRef Hui S, Suganthan PN (2016) Ensemble and arithmetic recombination-based speciation differential evolution for multimodal optimization. IEEE Trans Cybern 46(1):64–74CrossRef
Zurück zum Zitat Jeyakumar G, Velayutham CS (2014) Distributed heterogeneous mixing of differential and dynamic differential evolution variants for unconstrained global optimization. Soft Comput 18(10):1949–1965CrossRef Jeyakumar G, Velayutham CS (2014) Distributed heterogeneous mixing of differential and dynamic differential evolution variants for unconstrained global optimization. Soft Comput 18(10):1949–1965CrossRef
Zurück zum Zitat Li X (2005) Efficient differential evolution using speciation for multimodal function optimization. In: Proceeding of the conference on genetic and evolutionary computation, Washington, DC, pp 873–880 Li X (2005) Efficient differential evolution using speciation for multimodal function optimization. In: Proceeding of the conference on genetic and evolutionary computation, Washington, DC, pp 873–880
Zurück zum Zitat Li YL, Zhan ZH, Gong YJ, Chen WN, Zhang J, Li Y (2015) Differential evolution with an evolution path: a DEEP evolutionary algorithm. IEEE Trans Cybern 45(9):1798–1810CrossRef Li YL, Zhan ZH, Gong YJ, Chen WN, Zhang J, Li Y (2015) Differential evolution with an evolution path: a DEEP evolutionary algorithm. IEEE Trans Cybern 45(9):1798–1810CrossRef
Zurück zum Zitat Liu XF, Zhan ZH, Zhang J (2018a) Neural network for change direction prediction in dynamic optimization. IEEE Access 6:72649–72662CrossRef Liu XF, Zhan ZH, Zhang J (2018a) Neural network for change direction prediction in dynamic optimization. IEEE Access 6:72649–72662CrossRef
Zurück zum Zitat Preuss M (2010) Niching the CMA-ES via nearest-better clustering. In: Proceeding of the genetic and evolutionary computation, pp 1711–1718 Preuss M (2010) Niching the CMA-ES via nearest-better clustering. In: Proceeding of the genetic and evolutionary computation, pp 1711–1718
Zurück zum Zitat Preuss M (2012) Improved topological niching for real-valued global optimization. In: Proceeding of the European conference on the applications of evolutionary computation, pp 386–395 Preuss M (2012) Improved topological niching for real-valued global optimization. In: Proceeding of the European conference on the applications of evolutionary computation, pp 386–395
Zurück zum Zitat Qu BY, Suganthan PN, Liang JJ (2012) Differential evolution with neighborhood mutation for multimodal optimization. IEEE Trans Evol Comput 16(5):601–614CrossRef Qu BY, Suganthan PN, Liang JJ (2012) Differential evolution with neighborhood mutation for multimodal optimization. IEEE Trans Evol Comput 16(5):601–614CrossRef
Zurück zum Zitat Qu BY, Suganthan PN, Das S (2013) A distance-based locally informed particle swarm model for multimodal optimization. IEEE Trans Evol Comput 17(3):387–402CrossRef Qu BY, Suganthan PN, Das S (2013) A distance-based locally informed particle swarm model for multimodal optimization. IEEE Trans Evol Comput 17(3):387–402CrossRef
Zurück zum Zitat Rim C, Piao S, Li G, Pak U (2018) A niching chaos optimization algorithm for multimodal optimization. Soft Comput 22(2):621–633CrossRef Rim C, Piao S, Li G, Pak U (2018) A niching chaos optimization algorithm for multimodal optimization. Soft Comput 22(2):621–633CrossRef
Zurück zum Zitat Rönkkönen J, Li X, Kyrki V, Lampinen J (2011) A framework for generating tunable test functions for multimodal optimization. Soft Comput 15(9):1689–1706CrossRef Rönkkönen J, Li X, Kyrki V, Lampinen J (2011) A framework for generating tunable test functions for multimodal optimization. Soft Comput 15(9):1689–1706CrossRef
Zurück zum Zitat Sharifi-Noghabi H, Mashhadi HR, Shojaee K (2017) A novel mutation operator based on the union of fitness and design spaces information for differential evolution. Soft Comput 21(22):6555–6562CrossRef Sharifi-Noghabi H, Mashhadi HR, Shojaee K (2017) A novel mutation operator based on the union of fitness and design spaces information for differential evolution. Soft Comput 21(22):6555–6562CrossRef
Zurück zum Zitat Son NN, Anh HPH, Chau TD (2018) Adaptive neural model optimized by modified differential evolution for identifying 5-DOF robot manipulator dynamic system. Soft Comput 22(3):979–988CrossRef Son NN, Anh HPH, Chau TD (2018) Adaptive neural model optimized by modified differential evolution for identifying 5-DOF robot manipulator dynamic system. Soft Comput 22(3):979–988CrossRef
Zurück zum Zitat Thomsen R (2004) Multimodal optimization using crowding-based differential evolution. In: Proceeding of the IEEE congress on evolutionary computation, vol 2. Portland, pp 1382–1389 Thomsen R (2004) Multimodal optimization using crowding-based differential evolution. In: Proceeding of the IEEE congress on evolutionary computation, vol 2. Portland, pp 1382–1389
Zurück zum Zitat Ursem RK (1999) Multinational evolutionary algorithms. In: Proceeding of the IEEE congress on evolutionary computation, pp 1633–1640 Ursem RK (1999) Multinational evolutionary algorithms. In: Proceeding of the IEEE congress on evolutionary computation, pp 1633–1640
Zurück zum Zitat Wang Y, Li HX, Yen GG, Song W (2014) MOMMOP: multiobjective optimization for locating multiple optimal solutions of multimodal optimization problems. IEEE Trans Cybern 45(4):830–843CrossRef Wang Y, Li HX, Yen GG, Song W (2014) MOMMOP: multiobjective optimization for locating multiple optimal solutions of multimodal optimization problems. IEEE Trans Cybern 45(4):830–843CrossRef
Zurück zum Zitat Wang ZJ, Zhan ZH, Zhang J (2015) An improved method for comprehensive learning particle swarm optimization. In: Proceeding of the IEEE symposium series on computational intelligence, pp 218–225 Wang ZJ, Zhan ZH, Zhang J (2015) An improved method for comprehensive learning particle swarm optimization. In: Proceeding of the IEEE symposium series on computational intelligence, pp 218–225
Zurück zum Zitat Wang ZJ, Zhan ZH, Zhang J (2016a) Orthogonal learning particle swarm optimization with variable relocation for dynamic optimization. In: Proceeding of the IEEE congress on evolutionary computation, pp 594–600 Wang ZJ, Zhan ZH, Zhang J (2016a) Orthogonal learning particle swarm optimization with variable relocation for dynamic optimization. In: Proceeding of the IEEE congress on evolutionary computation, pp 594–600
Zurück zum Zitat Wang ZJ, Zhan ZH, Zhang J (2016b) Parallel multi-strategy evolutionary algorithm using message passing interface for many-objective optimization. In: Proceeding of the IEEE symposium series on computational intelligence, pp 1–8 Wang ZJ, Zhan ZH, Zhang J (2016b) Parallel multi-strategy evolutionary algorithm using message passing interface for many-objective optimization. In: Proceeding of the IEEE symposium series on computational intelligence, pp 1–8
Zurück zum Zitat Wang ZJ, Zhan ZH, Lin Y, Yu WJ, Yuan HQ, Gu TL, Kwong S, Zhang J (2018) Dual-strategy differential evolution with affinity propagation clustering for multimodal optimization problems. IEEE Trans Evol Comput 22(6):894–908CrossRef Wang ZJ, Zhan ZH, Lin Y, Yu WJ, Yuan HQ, Gu TL, Kwong S, Zhang J (2018) Dual-strategy differential evolution with affinity propagation clustering for multimodal optimization problems. IEEE Trans Evol Comput 22(6):894–908CrossRef
Zurück zum Zitat Weber M, Tirronen V, Neri F (2010) Scale factor inheritance mechanism in distributed differential evolution. Soft Comput 14(11):1187–1207CrossRef Weber M, Tirronen V, Neri F (2010) Scale factor inheritance mechanism in distributed differential evolution. Soft Comput 14(11):1187–1207CrossRef
Zurück zum Zitat Wong KC, Leung KS, Wong MH (2010) Protein structure prediction on a lattice model via multimodal optimization techniques. In: Proceedings conference on genetic and evolutionary computation, Portland, pp 155–162 Wong KC, Leung KS, Wong MH (2010) Protein structure prediction on a lattice model via multimodal optimization techniques. In: Proceedings conference on genetic and evolutionary computation, Portland, pp 155–162
Zurück zum Zitat Woo DK, Choi JH, Ali M, Jung HK (2011) A novel multimodal optimization algorithm applied to electromagnetic optimization. IEEE Trans Magn 47(6):1667–1673CrossRef Woo DK, Choi JH, Ali M, Jung HK (2011) A novel multimodal optimization algorithm applied to electromagnetic optimization. IEEE Trans Magn 47(6):1667–1673CrossRef
Zurück zum Zitat Yang Q, Chen WN, Li Y, Chen CLP, Hu XM, Zhang J (2017) Multimodal estimation of distribution algorithms. IEEE Trans Cybern 47(3):636–650CrossRef Yang Q, Chen WN, Li Y, Chen CLP, Hu XM, Zhang J (2017) Multimodal estimation of distribution algorithms. IEEE Trans Cybern 47(3):636–650CrossRef
Zurück zum Zitat Zhan ZH, Liu XF, Gong YJ, Zhang J, Chung HSH, Li Y (2015) Cloud computing resource scheduling and a survey of its evolutionary approaches. ACM Comput Surv 47(4):1–33 (Article 63) CrossRef Zhan ZH, Liu XF, Gong YJ, Zhang J, Chung HSH, Li Y (2015) Cloud computing resource scheduling and a survey of its evolutionary approaches. ACM Comput Surv 47(4):1–33 (Article 63) CrossRef
Zurück zum Zitat Zhan ZH, Liu X, Zhang H, Yu Z, Weng J, Li Y, Gu T, Zhang J (2017) Cloudde: a heterogeneous differential evolution algorithm and its distributed cloud version. IEEE Trans Parallel Distrib Syst 28(3):704–716CrossRef Zhan ZH, Liu X, Zhang H, Yu Z, Weng J, Li Y, Gu T, Zhang J (2017) Cloudde: a heterogeneous differential evolution algorithm and its distributed cloud version. IEEE Trans Parallel Distrib Syst 28(3):704–716CrossRef
Zurück zum Zitat Zhang X, Zhang X (2017) Improving differential evolution by differential vector archive and hybrid repair method for global optimization. Soft Comput 21(23):7107–7116CrossRef Zhang X, Zhang X (2017) Improving differential evolution by differential vector archive and hybrid repair method for global optimization. Soft Comput 21(23):7107–7116CrossRef
Zurück zum Zitat Zhang YH, Gong YJ, Zhang HX, Gu TL, Zhang J (2017) Toward fast niching evolutionary algorithms: a locality sensitive hashing-based approach. IEEE Trans Evol Comput 21(3):347–362 Zhang YH, Gong YJ, Zhang HX, Gu TL, Zhang J (2017) Toward fast niching evolutionary algorithms: a locality sensitive hashing-based approach. IEEE Trans Evol Comput 21(3):347–362
Metadaten
Titel
Distributed minimum spanning tree differential evolution for multimodal optimization problems
verfasst von
Zi-Jia Wang
Zhi-Hui Zhan
Jun Zhang
Publikationsdatum
05.03.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 24/2019
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-019-03875-x

Weitere Artikel der Ausgabe 24/2019

Soft Computing 24/2019 Zur Ausgabe

Premium Partner