Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 9/2022

02-04-2022 | Original Article

A dynamic multi-swarm cooperation particle swarm optimization with dimension mutation for complex optimization problem

Authors: Xu Yang, Hongru Li, Xia Yu

Published in: International Journal of Machine Learning and Cybernetics | Issue 9/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Particle swarm optimization (PSO) has been used to solve numerous real-world problems because of its strong optimization ability. However, PSO still has some shortcomings in solving complex optimization problems, such as premature convergence and poor balance between exploration and exploitation. To overcome these drawbacks of PSO, a dynamic multi-swarm cooperation PSO with dimension mutation (MSCPSO) is proposed in this paper. There are two contributions in MSCPSO, which are the adaptive sample selection strategy (ASS) and the adaptive dimension mutation strategy (ADM). Firstly, in ASS, particles in each sub-swarm are sorted into three states (elite, ordinary and inferior) according to their fitness. Three samples pool are used to save elite, ordinary and inferior particles. Particles in each sub-swarm can select their learning samples in their sample pools adaptively according to their fitness. Therefore, ASS can facilitate information interaction among the sub-swarms and increase the diversity of the population. Secondly, ADM generates the mutation positions for the whole population according to the information and knowledge acquired by particles during the evolution. In this case, ADM is used to enhance the exploitation ability of DMS-PSO without losing population diversity. Finally, two test suites (CEC2013 and CEC2017) and four practical engineering problems are used to verify the performance of MSCPSO. Experimental results verify that MSCPSO has a remarkable performance compared with 7 recent state-of-the-art PSO variants in most complex and multimodal conditions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Appendix
Available only for authorised users
Literature
1.
go back to reference Feng Z-K, Niu W-J, Zhang R, Wang S, Cheng C-T (2019) Operation rule derivation of hydropower reservoir by k-means clustering method and extreme learning machine based on particle swarm optimization. J Hydrol 576:229–238 Feng Z-K, Niu W-J, Zhang R, Wang S, Cheng C-T (2019) Operation rule derivation of hydropower reservoir by k-means clustering method and extreme learning machine based on particle swarm optimization. J Hydrol 576:229–238
2.
go back to reference Rana S, Jasola S, Kumar R (2012) A boundary restricted adaptive particle swarm optimization for data clustering. Int J Mach Learn Cybern 4(4):391–400 Rana S, Jasola S, Kumar R (2012) A boundary restricted adaptive particle swarm optimization for data clustering. Int J Mach Learn Cybern 4(4):391–400
3.
go back to reference Baghban A, Jalali A, Shafiee M, Ahmadi MH, Chau K-W (2018) Developing an ANFIS-based swarm concept model for estimating the relative viscosity of nanofluids. Eng Appl Comput Fluid Mech 13(1):26–39 Baghban A, Jalali A, Shafiee M, Ahmadi MH, Chau K-W (2018) Developing an ANFIS-based swarm concept model for estimating the relative viscosity of nanofluids. Eng Appl Comput Fluid Mech 13(1):26–39
4.
go back to reference Ehteram M, Salih SQ, Yaseen ZM (2020) Efficiency evaluation of reverse osmosis desalination plant using hybridized multilayer perceptron with particle swarm optimization. Environ Sci Pollut Res Int 27(13):15278–15291 Ehteram M, Salih SQ, Yaseen ZM (2020) Efficiency evaluation of reverse osmosis desalination plant using hybridized multilayer perceptron with particle swarm optimization. Environ Sci Pollut Res Int 27(13):15278–15291
5.
go back to reference Ali Ghorbani M, Kazempour R, Chau K-W, Shamshirband S, Taherei Ghazvinei P (2018) Forecasting pan evaporation with an integrated artificial neural network quantum-behaved particle swarm optimization model: a case study in Talesh, Northern Iran. Eng Appl Comput Fluid Mech 12(1):724–737 Ali Ghorbani M, Kazempour R, Chau K-W, Shamshirband S, Taherei Ghazvinei P (2018) Forecasting pan evaporation with an integrated artificial neural network quantum-behaved particle swarm optimization model: a case study in Talesh, Northern Iran. Eng Appl Comput Fluid Mech 12(1):724–737
6.
go back to reference Kennedy J, Eberhart R (1995) Particle swarm optimization. In Proceedings of ICNN'95 - International Conference on Neural Networks. Kennedy J, Eberhart R (1995) Particle swarm optimization. In Proceedings of ICNN'95 - International Conference on Neural Networks.
7.
go back to reference Javidi MM (2020) Feature selection schema based on game theory and biology migration algorithm for regression problems. Int J Mach Learn Cybern 12(2):303–342MathSciNet Javidi MM (2020) Feature selection schema based on game theory and biology migration algorithm for regression problems. Int J Mach Learn Cybern 12(2):303–342MathSciNet
8.
go back to reference Sánchez D, Melin P, Castillo O (2020) Comparison of particle swarm optimization variants with fuzzy dynamic parameter adaptation for modular granular neural networks for human recognition. J Intell Fuzzy Syst 38(3):3229–3252 Sánchez D, Melin P, Castillo O (2020) Comparison of particle swarm optimization variants with fuzzy dynamic parameter adaptation for modular granular neural networks for human recognition. J Intell Fuzzy Syst 38(3):3229–3252
9.
go back to reference Cheng C-T, Niu W-J, Feng Z-K, Shen J-J, Chau K-W (2015) Daily reservoir runoff forecasting method using artificial neural network based on quantum-behaved particle swarm optimization. Water 7(12):4232–4246 Cheng C-T, Niu W-J, Feng Z-K, Shen J-J, Chau K-W (2015) Daily reservoir runoff forecasting method using artificial neural network based on quantum-behaved particle swarm optimization. Water 7(12):4232–4246
10.
go back to reference Taormina R, Chau K-W (2015) ANN-based interval forecasting of streamflow discharges using the LUBE method and MOFIPS. Eng Appl Artif Intell 45:429–440 Taormina R, Chau K-W (2015) ANN-based interval forecasting of streamflow discharges using the LUBE method and MOFIPS. Eng Appl Artif Intell 45:429–440
11.
go back to reference Tanweer MR, Suresh S, Sundararajan N (2015) Self regulating particle swarm optimization algorithm. Inf Sci 294:182–202MathSciNetMATH Tanweer MR, Suresh S, Sundararajan N (2015) Self regulating particle swarm optimization algorithm. Inf Sci 294:182–202MathSciNetMATH
12.
go back to reference Liu W, Wang Z, Zeng N, Yuan Y, Alsaadi FE, Liu X (2020) A novel randomised particle swarm optimizer. Int J Mach Learn Cybern 12(2):529–540 Liu W, Wang Z, Zeng N, Yuan Y, Alsaadi FE, Liu X (2020) A novel randomised particle swarm optimizer. Int J Mach Learn Cybern 12(2):529–540
13.
go back to reference Liu H, Zhang X-W, Tu L-P (2020) A modified particle swarm optimization using adaptive strategy. Expert Syst Appl 152:113353 Liu H, Zhang X-W, Tu L-P (2020) A modified particle swarm optimization using adaptive strategy. Expert Syst Appl 152:113353
14.
go back to reference Chen K, Zhou F, Yin L, Wang S, Wang Y, Wan F (2018) A hybrid particle swarm optimizer with sine cosine acceleration coefficients. Inf Sci 422:218–241MathSciNet Chen K, Zhou F, Yin L, Wang S, Wang Y, Wan F (2018) A hybrid particle swarm optimizer with sine cosine acceleration coefficients. Inf Sci 422:218–241MathSciNet
15.
go back to reference Xia X, Xing Y, Wei B, Zhang Y, Li X, Deng X, Gui L (2019) A fitness-based multi-role particle swarm optimization. Swarm Evol Comput 44:349–364 Xia X, Xing Y, Wei B, Zhang Y, Li X, Deng X, Gui L (2019) A fitness-based multi-role particle swarm optimization. Swarm Evol Comput 44:349–364
16.
go back to reference Olivas F, Valdez F, Castillo O, Melin P (2014) Dynamic parameter adaptation in particle swarm optimization using interval type-2 fuzzy logic. Soft Comput 20(3):1057–1070 Olivas F, Valdez F, Castillo O, Melin P (2014) Dynamic parameter adaptation in particle swarm optimization using interval type-2 fuzzy logic. Soft Comput 20(3):1057–1070
17.
go back to reference Garg H (2016) A hybrid PSO-GA algorithm for constrained optimization problems. Appl Math Comput 274:292–305MathSciNetMATH Garg H (2016) A hybrid PSO-GA algorithm for constrained optimization problems. Appl Math Comput 274:292–305MathSciNetMATH
18.
go back to reference Cheng T, Chen M, Fleming PJ, Yang Z, Gan S (2017) A novel hybrid teaching learning based multi-objective particle swarm optimization. Neurocomputing 222:11–25 Cheng T, Chen M, Fleming PJ, Yang Z, Gan S (2017) A novel hybrid teaching learning based multi-objective particle swarm optimization. Neurocomputing 222:11–25
19.
go back to reference Pan X, Xue L, Lu Y, Sun N (2018) Hybrid particle swarm optimization with simulated annealing. Multimed Tools Appl 78(21):29921–29936 Pan X, Xue L, Lu Y, Sun N (2018) Hybrid particle swarm optimization with simulated annealing. Multimed Tools Appl 78(21):29921–29936
20.
go back to reference Lagunes ML, Castillo O, Valdez F, Soria J (2019) Multi-metaheuristic competitive model for optimization of fuzzy controllers. Algorithms 12:5MathSciNet Lagunes ML, Castillo O, Valdez F, Soria J (2019) Multi-metaheuristic competitive model for optimization of fuzzy controllers. Algorithms 12:5MathSciNet
21.
go back to reference Valdez F, Vazquez JC, Melin P, Castillo O (2017) Comparative study of the use of fuzzy logic in improving particle swarm optimization variants for mathematical functions using co-evolution. Appl Soft Comput 52:1070–1083 Valdez F, Vazquez JC, Melin P, Castillo O (2017) Comparative study of the use of fuzzy logic in improving particle swarm optimization variants for mathematical functions using co-evolution. Appl Soft Comput 52:1070–1083
22.
go back to reference Garg H (2019) A hybrid GSA-GA algorithm for constrained optimization problems. Inf Sci 478:499–523 Garg H (2019) A hybrid GSA-GA algorithm for constrained optimization problems. Inf Sci 478:499–523
23.
go back to reference Patwal RS, Narang N, Garg H (2018) A novel TVAC-PSO based mutation strategies algorithm for generation scheduling of pumped storage hydrothermal system incorporating solar units. Energy 142:822–837 Patwal RS, Narang N, Garg H (2018) A novel TVAC-PSO based mutation strategies algorithm for generation scheduling of pumped storage hydrothermal system incorporating solar units. Energy 142:822–837
24.
go back to reference Garg H (2015) A hybrid GA-GSA algorithm for optimizing the performance of an industrial system by utilizing uncertain data. In: Handbook of research on artificial intelligence techniques and algorithms, pp: 620–654 Garg H (2015) A hybrid GA-GSA algorithm for optimizing the performance of an industrial system by utilizing uncertain data. In: Handbook of research on artificial intelligence techniques and algorithms, pp: 620–654
25.
go back to reference Liang JJ, Suganthan PN (2006) Dynamic multi-swarm particle swarm optimizer with a novel constraint-handling mechanism. In Proceedings 2005 IEEE Swarm Intelligence Symposium. Liang JJ, Suganthan PN (2006) Dynamic multi-swarm particle swarm optimizer with a novel constraint-handling mechanism. In Proceedings 2005 IEEE Swarm Intelligence Symposium.
26.
go back to reference Lynn N, Suganthan PN (2015) Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation. Swarm Evol Comput 24:11–24 Lynn N, Suganthan PN (2015) Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation. Swarm Evol Comput 24:11–24
27.
go back to reference Wei B, Xia X, Yu F, Zhang Y, Xu X, Wu H, Gui L, He G (2020) Multiple adaptive strategies based particle swarm optimization algorithm. Swarm Evolut Comput 57:100731 Wei B, Xia X, Yu F, Zhang Y, Xu X, Wu H, Gui L, He G (2020) Multiple adaptive strategies based particle swarm optimization algorithm. Swarm Evolut Comput 57:100731
28.
go back to reference Xia X, Gui L, Zhan Z-H (2018) A multi-swarm particle swarm optimization algorithm based on dynamical topology and purposeful detecting. Appl Soft Comput 67:126–140 Xia X, Gui L, Zhan Z-H (2018) A multi-swarm particle swarm optimization algorithm based on dynamical topology and purposeful detecting. Appl Soft Comput 67:126–140
29.
go back to reference Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210 Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210
30.
go back to reference Lin A, Sun W, Yu H, Wu G, Tang H (2019) Global genetic learning particle swarm optimization with diversity enhancement by ring topology. Swarm Evol Comput 44:571–583 Lin A, Sun W, Yu H, Wu G, Tang H (2019) Global genetic learning particle swarm optimization with diversity enhancement by ring topology. Swarm Evol Comput 44:571–583
31.
go back to reference Lynn N, Suganthan PN (2017) Ensemble particle swarm optimizer. Appl Soft Comput 55:533–548 Lynn N, Suganthan PN (2017) Ensemble particle swarm optimizer. Appl Soft Comput 55:533–548
32.
go back to reference Gong YJ, Li JJ, Zhou Y, Li Y, Chung HS, Shi YH, Zhang J (2016) Genetic learning particle swarm optimization. IEEE Trans Cybern 46(10):2277–2290 Gong YJ, Li JJ, Zhou Y, Li Y, Chung HS, Shi YH, Zhang J (2016) Genetic learning particle swarm optimization. IEEE Trans Cybern 46(10):2277–2290
33.
go back to reference Liang JJ, Definitions P, Criteria E (2013) For the CEC, Special Session on Realparameter Optimization Technical report 201212, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China, 2013. Nanyang Technological University, Singapore Liang JJ, Definitions P, Criteria E (2013) For the CEC, Special Session on Realparameter Optimization Technical report 201212, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China, 2013. Nanyang Technological University, Singapore
34.
go back to reference Awad NH, Ali MZ, Suganthan PN, Liang JJ, Qu BY (2017) Problem definitions and evaluation criteria for the CEC 2017 special session and competition on single objective real-parameter numerical optimization, pp. 1–34. Awad NH, Ali MZ, Suganthan PN, Liang JJ, Qu BY (2017) Problem definitions and evaluation criteria for the CEC 2017 special session and competition on single objective real-parameter numerical optimization, pp. 1–34.
35.
go back to reference Abderazek H, Yildiz AR, Sait SM (2019) Mechanical engineering design optimisation using novel adaptive differential evolution algorithm. Int J Vehicle Design 80:285–329 Abderazek H, Yildiz AR, Sait SM (2019) Mechanical engineering design optimisation using novel adaptive differential evolution algorithm. Int J Vehicle Design 80:285–329
36.
go back to reference Yıldız AR, Özkaya H, Yıldız M, Bureerat S, Yıldız BS, Sait SM (2020) The equilibrium optimization algorithm and the response surface-based metamodel for optimal structural design of vehicle components. Mater Test 62(5):492–496 Yıldız AR, Özkaya H, Yıldız M, Bureerat S, Yıldız BS, Sait SM (2020) The equilibrium optimization algorithm and the response surface-based metamodel for optimal structural design of vehicle components. Mater Test 62(5):492–496
37.
go back to reference Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67 Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67
38.
go back to reference Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47 Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47
39.
go back to reference Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248MATH Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248MATH
40.
go back to reference Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61 Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61
41.
go back to reference Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris H, Mirjalili SM (2017) Salp Swarm Algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191 Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris H, Mirjalili SM (2017) Salp Swarm Algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191
44.
go back to reference D’Angelo G, Palmieri F (2021) GGA: A modified genetic algorithm with gradient-based local search for solving constrained optimization problems. Inf Sci 547:136–162MathSciNetMATH D’Angelo G, Palmieri F (2021) GGA: A modified genetic algorithm with gradient-based local search for solving constrained optimization problems. Inf Sci 547:136–162MathSciNetMATH
45.
go back to reference Xue Y, Jiang J, Zhao B, Ma T (2017) A self-adaptive artificial bee colony algorithm based on global best for global optimization. Soft Comput 22(9):2935–2952 Xue Y, Jiang J, Zhao B, Ma T (2017) A self-adaptive artificial bee colony algorithm based on global best for global optimization. Soft Comput 22(9):2935–2952
46.
go back to reference Gandomi AH, Yang X-S, Alavi AH (2011) Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng Comput 29(1):17–35 Gandomi AH, Yang X-S, Alavi AH (2011) Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng Comput 29(1):17–35
47.
go back to reference Yildiz BS, Pholdee N, Bureerat S, Yildiz AR, Sait SM (2021) Robust design of a robot gripper mechanism using new hybrid grasshopper optimization algorithm. Expert Syst 38:3 Yildiz BS, Pholdee N, Bureerat S, Yildiz AR, Sait SM (2021) Robust design of a robot gripper mechanism using new hybrid grasshopper optimization algorithm. Expert Syst 38:3
48.
go back to reference Yıldız AR, Erdaş MU (2021) A new Hybrid Taguchi-salp swarm optimization algorithm for the robust design of real-world engineering problems. Mater Test 63(2):157–162 Yıldız AR, Erdaş MU (2021) A new Hybrid Taguchi-salp swarm optimization algorithm for the robust design of real-world engineering problems. Mater Test 63(2):157–162
49.
go back to reference Karen İ, Yildiz AR, Kaya N, Öztürk N, Öztürk F (2006) Hybrid approach for genetic algorithm and Taguchi’s method based design optimization in the automotive industry. Int J Prod Res 44(22):4897–4914MATH Karen İ, Yildiz AR, Kaya N, Öztürk N, Öztürk F (2006) Hybrid approach for genetic algorithm and Taguchi’s method based design optimization in the automotive industry. Int J Prod Res 44(22):4897–4914MATH
Metadata
Title
A dynamic multi-swarm cooperation particle swarm optimization with dimension mutation for complex optimization problem
Authors
Xu Yang
Hongru Li
Xia Yu
Publication date
02-04-2022
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 9/2022
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-022-01545-3

Other articles of this Issue 9/2022

International Journal of Machine Learning and Cybernetics 9/2022 Go to the issue