Skip to main content
Top

2017 | OriginalPaper | Chapter

Experimental Study of Distributed Differential Evolution Based on Different Platforms

Authors : Lin Shi, Zhi-Hui Zhan, Zi-Jia Wang, Jun Zhang

Published in: Bio-inspired Computing: Theories and Applications

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the increasing complexity of real-world optimization problems, many challenges appear to evolutionary algorithms (EAs). When solving these time-consuming or high-complexity problems, although EAs can guarantee the high quality of solutions, the intolerable time costs will influence their availabilities drastically. Thus, many attempts have been made to overcome that problem. With the rapid development of the distributed computing paradigm and platforms, such as the Message Passing Interface (MPI) and Open Multi-Processing (OpenMP), distributed computing has become readily available and affordable for realizing more powerful EAs. In order to find out whether these platforms have any particular difficulties or preference, whether one of them would be more suitable for EAs, we analyze the performance of different distributed EAs (DEAs) based on different distributed computing platforms, using differential evolution (DE) as an example. Finally, we find out that both MPI and OpenMP have their own superiorities and they can improve the speedup obviously. However, MPI is more suitable for computationally expensive problems and can achieve higher speedup than OpenMP.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wang, Z.Y., Xing, H.L., Li, T.R., Yang, Y., Qu, R., Pan, Y.: A modified ant colony optimization algorithm for network coding resource minimization. IEEE Trans. Evol. Comput. 20(3), 325–342 (2016)CrossRef Wang, Z.Y., Xing, H.L., Li, T.R., Yang, Y., Qu, R., Pan, Y.: A modified ant colony optimization algorithm for network coding resource minimization. IEEE Trans. Evol. Comput. 20(3), 325–342 (2016)CrossRef
2.
go back to reference Yoon, Y., Kim, Y.H.: An efficient genetic algorithm for maximum coverage deployment in wireless sensor networks. IEEE Trans. Cybern. 43(5), 1473–1483 (2013)CrossRef Yoon, Y., Kim, Y.H.: An efficient genetic algorithm for maximum coverage deployment in wireless sensor networks. IEEE Trans. Cybern. 43(5), 1473–1483 (2013)CrossRef
3.
go back to reference Hu, X.M., Zhang, J., Chung, H.S.H., Li, Y., Liu, O.: SamACO: variable sampling ant colony optimization algorithm for continuous optimization. IEEE Trans. Cybern. 40(6), 1555–1566 (2010)CrossRef Hu, X.M., Zhang, J., Chung, H.S.H., Li, Y., Liu, O.: SamACO: variable sampling ant colony optimization algorithm for continuous optimization. IEEE Trans. Cybern. 40(6), 1555–1566 (2010)CrossRef
4.
go back to reference Zhan, Z.H., Liu, X.F., Zhang, H.X., Yu, Z.T., Weng, J., Li, Y., Gu, T.L., Zhang, J.: Cloudde: a heterogeneous differential evolution algorithm and its distributed cloud version. IEEE Trans. Parallel Distrib. Syst. 28(3), 704–716 (2017)CrossRef Zhan, Z.H., Liu, X.F., Zhang, H.X., Yu, Z.T., Weng, J., Li, Y., Gu, T.L., Zhang, J.: Cloudde: a heterogeneous differential evolution algorithm and its distributed cloud version. IEEE Trans. Parallel Distrib. Syst. 28(3), 704–716 (2017)CrossRef
5.
go back to reference Zhang, X.Y., Zhang, J., Gong, Y.J., Zhan, Z.H., Chen, W.N., Li, Y.: Kuhn-Munkres parallel genetic algorithm for the set cover problem and its application to large-scale wireless sensor networks. IEEE Trans. Evol. Comput. 20(5), 695–710 (2016)CrossRef Zhang, X.Y., Zhang, J., Gong, Y.J., Zhan, Z.H., Chen, W.N., Li, Y.: Kuhn-Munkres parallel genetic algorithm for the set cover problem and its application to large-scale wireless sensor networks. IEEE Trans. Evol. Comput. 20(5), 695–710 (2016)CrossRef
6.
go back to reference Roberge, V., Tarbouchi, M., Okou, F.: Strategies to accelerate harmonic minimization in multilevel inverters using a parallel genetic algorithm on graphical processing unit. IEEE Trans. Power Electron. 29(10), 5087–5090 (2014)CrossRef Roberge, V., Tarbouchi, M., Okou, F.: Strategies to accelerate harmonic minimization in multilevel inverters using a parallel genetic algorithm on graphical processing unit. IEEE Trans. Power Electron. 29(10), 5087–5090 (2014)CrossRef
7.
go back to reference Huang, H.C.: SoPC-based parallel ACO algorithm and its application to optimal motion controller design for intelligent omnidirectional mobile robots. IEEE Trans. Ind. Inform. 9(4), 1828–1835 (2013)CrossRef Huang, H.C.: SoPC-based parallel ACO algorithm and its application to optimal motion controller design for intelligent omnidirectional mobile robots. IEEE Trans. Ind. Inform. 9(4), 1828–1835 (2013)CrossRef
8.
go back to reference Huang, H.C.: A Taguchi-based heterogeneous parallel metaheuristic ACO-PSO and its FPGA realization to optimal polar-space locomotion control of four-wheeled redundant mobile robots. IEEE Trans. Ind. Inform. 11(4), 915–922 (2015)CrossRef Huang, H.C.: A Taguchi-based heterogeneous parallel metaheuristic ACO-PSO and its FPGA realization to optimal polar-space locomotion control of four-wheeled redundant mobile robots. IEEE Trans. Ind. Inform. 11(4), 915–922 (2015)CrossRef
9.
go back to reference Hossain, M.S., Moniruzzaman, M., Muhammad, G., Ghoneim, A., Alamri, A.: Big data-driven service composition using parallel clustered particle swarm optimization in mobile environment. IEEE Trans. Serv. Comput. 9(5), 806–817 (2016)CrossRef Hossain, M.S., Moniruzzaman, M., Muhammad, G., Ghoneim, A., Alamri, A.: Big data-driven service composition using parallel clustered particle swarm optimization in mobile environment. IEEE Trans. Serv. Comput. 9(5), 806–817 (2016)CrossRef
10.
go back to reference Wang, Z.J., Zhan, Z.H., Zhang, J.: An improved method for comprehensive learning particle swarm optimization. In: Proceedings of IEEE Symposium Series on Computational Intelligence, pp. 218–225 (2015) Wang, Z.J., Zhan, Z.H., Zhang, J.: An improved method for comprehensive learning particle swarm optimization. In: Proceedings of IEEE Symposium Series on Computational Intelligence, pp. 218–225 (2015)
11.
go back to reference Zhan, Z.H., Wang, Z.J., Lin, Y., Zhang, J.: Adaptive radius species-based particle swarm optimization for multimodal optimization problems. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 2043–2048 (2016) Zhan, Z.H., Wang, Z.J., Lin, Y., Zhang, J.: Adaptive radius species-based particle swarm optimization for multimodal optimization problems. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 2043–2048 (2016)
12.
go back to reference Wang, Z.J., Zhan, Z.H., Du, K.J., Yu, Z.W., Zhang, J.: Orthogonal learning particle swarm optimization with variable relocation for dynamic optimization. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 594–600 (2016) Wang, Z.J., Zhan, Z.H., Du, K.J., Yu, Z.W., Zhang, J.: Orthogonal learning particle swarm optimization with variable relocation for dynamic optimization. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 594–600 (2016)
13.
go back to reference Kusetogullari, H., Yavariabdi, A., Celik, T.: Unsupervised change detection in multitemporal multispectral satellite images using parallel particle swarm optimization. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8(5), 2151–2164 (2015)CrossRef Kusetogullari, H., Yavariabdi, A., Celik, T.: Unsupervised change detection in multitemporal multispectral satellite images using parallel particle swarm optimization. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8(5), 2151–2164 (2015)CrossRef
14.
go back to reference Weber, M., Neri, F., Tirronen, V.: Shuffle or update parallel differential evolution for large-scale optimization. Soft Comput. 15(11), 2089–2107 (2011)CrossRef Weber, M., Neri, F., Tirronen, V.: Shuffle or update parallel differential evolution for large-scale optimization. Soft Comput. 15(11), 2089–2107 (2011)CrossRef
15.
go back to reference Li, Y.L., Zhan, Z.H., Gong, Y.J., Chen, W.N., Zhang, J., Li, Y.: Differential evolution with an evolution path: a DEEP evolutionary algorithm. IEEE Trans. Cybern. 45(9), 1798–1810 (2015)CrossRef Li, Y.L., Zhan, Z.H., Gong, Y.J., Chen, W.N., Zhang, J., Li, Y.: Differential evolution with an evolution path: a DEEP evolutionary algorithm. IEEE Trans. Cybern. 45(9), 1798–1810 (2015)CrossRef
16.
go back to reference Chen, Z.H., Jiang, X.W., Li, J.B., Li, S.S., Wang, L.W.: PDECO: parallel differential evolution for clusters optimization. J. Comput. Chem. 34(12), 1046–1059 (2013)CrossRef Chen, Z.H., Jiang, X.W., Li, J.B., Li, S.S., Wang, L.W.: PDECO: parallel differential evolution for clusters optimization. J. Comput. Chem. 34(12), 1046–1059 (2013)CrossRef
17.
go back to reference Dubreuil, M., Gagn, C., Parizeau, M.: Analysis of a master-slave architecture for distributed evolutionary computations. IEEE Trans. Cybern. 36(1), 229–235 (2006)CrossRef Dubreuil, M., Gagn, C., Parizeau, M.: Analysis of a master-slave architecture for distributed evolutionary computations. IEEE Trans. Cybern. 36(1), 229–235 (2006)CrossRef
18.
go back to reference Wang, Z.J., Zhan, Z.H., Zhang, J.: Parallel multi-strategy evolutionary algorithm using message passing interface for many-objective optimization. In: Proceedings of IEEE Symposium Series on Computational Intelligence, pp. 1–8 (2016) Wang, Z.J., Zhan, Z.H., Zhang, J.: Parallel multi-strategy evolutionary algorithm using message passing interface for many-objective optimization. In: Proceedings of IEEE Symposium Series on Computational Intelligence, pp. 1–8 (2016)
19.
go back to reference Mendiburu, A., Lozano, J.A., Alonso, J.M.: Parallel implementation of EDAs based on probabilistic graphical models. IEEE Trans. Evol. Comput. 9(4), 406–423 (2005)CrossRef Mendiburu, A., Lozano, J.A., Alonso, J.M.: Parallel implementation of EDAs based on probabilistic graphical models. IEEE Trans. Evol. Comput. 9(4), 406–423 (2005)CrossRef
20.
go back to reference Weber, M., Neri, F., Tirronen, V.: A study on scale factor in distributed differential evolution. Inf. Sci. 181, 2488–2511 (2011)CrossRef Weber, M., Neri, F., Tirronen, V.: A study on scale factor in distributed differential evolution. Inf. Sci. 181, 2488–2511 (2011)CrossRef
21.
go back to reference Weber, M., Neri, F., Tirronen, V.: A study on scale factor/crossover interaction in distributed differential evolution. Artif. Intell. Rev. 39(3), 195–224 (2013)CrossRef Weber, M., Neri, F., Tirronen, V.: A study on scale factor/crossover interaction in distributed differential evolution. Artif. Intell. Rev. 39(3), 195–224 (2013)CrossRef
22.
go back to reference Alba, E., Dorronsoro, B.: The exploration/exploitation tradeoff in dynamic cellular genetic algorithms. IEEE Trans. Evol. Comput. 9(2), 126–142 (2005)CrossRef Alba, E., Dorronsoro, B.: The exploration/exploitation tradeoff in dynamic cellular genetic algorithms. IEEE Trans. Evol. Comput. 9(2), 126–142 (2005)CrossRef
23.
go back to reference Giacobini, M., Tomassini, M., Tettamanzi, A.G., Alba, E.: Selection intensity in cellular evolutionary algorithms for regular lattices. IEEE Trans. Evol. Comput. 9(5), 489–505 (2005)CrossRef Giacobini, M., Tomassini, M., Tettamanzi, A.G., Alba, E.: Selection intensity in cellular evolutionary algorithms for regular lattices. IEEE Trans. Evol. Comput. 9(5), 489–505 (2005)CrossRef
24.
go back to reference Ismail, M.A.: Parallel genetic algorithms (PGAs): master-slave paradigm approach using MPI. In: E-Tech, pp. 83–87 (2004) Ismail, M.A.: Parallel genetic algorithms (PGAs): master-slave paradigm approach using MPI. In: E-Tech, pp. 83–87 (2004)
25.
go back to reference Zhang, G.-W., Zhan, Z.-H., Du, K.-J., Lin, Y., Chen, W.-N., Li, J.-J., Zhang, J.: Parallel particle swarm optimization using message passing interface. In: Handa, H., Ishibuchi, H., Ong, Y.-S., Tan, K.C. (eds.) Proceedings of the 18th Asia Pacific Symposium on Intelligent and Evolutionary Systems, Volume 1. PALO, vol. 1, pp. 55–64. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-13359-1_5 Zhang, G.-W., Zhan, Z.-H., Du, K.-J., Lin, Y., Chen, W.-N., Li, J.-J., Zhang, J.: Parallel particle swarm optimization using message passing interface. In: Handa, H., Ishibuchi, H., Ong, Y.-S., Tan, K.C. (eds.) Proceedings of the 18th Asia Pacific Symposium on Intelligent and Evolutionary Systems, Volume 1. PALO, vol. 1, pp. 55–64. Springer, Cham (2015). https://​doi.​org/​10.​1007/​978-3-319-13359-1_​5
26.
go back to reference Herda, M.: Parallel genetic algorithm for capacitated p-median problem using OpenMP protocol. In: Proceedings of IEEE International Symposium on Computational Intelligence and Informatics, pp. 347–352 (2016) Herda, M.: Parallel genetic algorithm for capacitated p-median problem using OpenMP protocol. In: Proceedings of IEEE International Symposium on Computational Intelligence and Informatics, pp. 347–352 (2016)
27.
go back to reference Wang, D.Z., Wang, D.W., Yan, Y., Wang, H.F.: An adaptive version of parallel MPSO with OpenMP for uncapacitated facility location problem. In: Proceedings of IEEE Chinese Control and Decision Conference, pp. 2387–2391 (2008) Wang, D.Z., Wang, D.W., Yan, Y., Wang, H.F.: An adaptive version of parallel MPSO with OpenMP for uncapacitated facility location problem. In: Proceedings of IEEE Chinese Control and Decision Conference, pp. 2387–2391 (2008)
Metadata
Title
Experimental Study of Distributed Differential Evolution Based on Different Platforms
Authors
Lin Shi
Zhi-Hui Zhan
Zi-Jia Wang
Jun Zhang
Copyright Year
2017
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-7179-9_37

Premium Partner