Skip to main content
Top
Published in: Neural Computing and Applications 10/2019

09-04-2018 | Original Article

An adaptive parallel particle swarm optimization for numerical optimization problems

Authors: Xinsheng Lai, Yuren Zhou

Published in: Neural Computing and Applications | Issue 10/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The parallelization of particle swarm optimization (PSO) is an efficient way to improve the performance of PSO. The multiple population parallelization is one way to parallelize PSO, in which three parameters need to be manually set in advance. They are migration interval, migration rate, and migration direction, which decide when, how many and from which subpopulation to which subpopulation particles will be migrated, respectively. However, there are two shortcomings concerning manually setting these three parameters in advance. One is that good particles cannot be migrated in time since particles can only be migrated every a given interval and in a given direction in parallel PSO. The other is that a large number of unnecessary migrations will take place since a given rate of particles in each subpopulation will be migrated every a given interval in a given direction. Both may be bad for parallel PSO to find high-quality solutions as quickly as possible, and this will result in a huge communication cost. Inspired by the phenomenon of osmosis, this paper presents a multiple population parallel version of PSO based on osmosis. It can adaptively decide when, how many, and from which subpopulation to which subpopulation particles will be migrated. Its usefulness, especially for high-dimensional functions, is demonstrated by numerical experiments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, pp 1942–1948 Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, pp 1942–1948
2.
go back to reference Sivanandam SN, Deepa SN (2008) Introduction to genetic algorithms. Springer, BerlinMATH Sivanandam SN, Deepa SN (2008) Introduction to genetic algorithms. Springer, BerlinMATH
3.
go back to reference McMullen PR, Tarasewich P (2003) Using ant techniques to solve the assembly line balancing problem. IIE Trans 35(7):605–617CrossRef McMullen PR, Tarasewich P (2003) Using ant techniques to solve the assembly line balancing problem. IIE Trans 35(7):605–617CrossRef
4.
go back to reference Xiang Y, Zhou Y, Liu H (2015) An elitism based multi-objective artificial bee colony algorithm. Eur J Oper Res 245(1):168–193CrossRef Xiang Y, Zhou Y, Liu H (2015) An elitism based multi-objective artificial bee colony algorithm. Eur J Oper Res 245(1):168–193CrossRef
5.
go back to reference Ali ES, Abd Elazim SM, Abdelaziz AY (2016) Ant lion optimization algorithm for renewable distributed generations. Energy 116:445–458CrossRef Ali ES, Abd Elazim SM, Abdelaziz AY (2016) Ant lion optimization algorithm for renewable distributed generations. Energy 116:445–458CrossRef
6.
go back to reference Ali ES, Abd Elazim SM, Abdelaziz AY (2016) Improved harmony algorithm and power loss index for optimal locations and sizing of capacitors in radial distribution systems. Int J Electr Power Energy Syst 80:252–263CrossRef Ali ES, Abd Elazim SM, Abdelaziz AY (2016) Improved harmony algorithm and power loss index for optimal locations and sizing of capacitors in radial distribution systems. Int J Electr Power Energy Syst 80:252–263CrossRef
7.
go back to reference Li H (2014) A teaching quality evaluation model based on a wavelet neural network improved by particle swarm optimization. Cybern Inf Technol 14(3):110–120 Li H (2014) A teaching quality evaluation model based on a wavelet neural network improved by particle swarm optimization. Cybern Inf Technol 14(3):110–120
8.
go back to reference Jordehi AR (2014) Particle swarm optimisation for dynamic optimisation problems: a review. Neural Comput Appl 25(7–8):1507–1516CrossRef Jordehi AR (2014) Particle swarm optimisation for dynamic optimisation problems: a review. Neural Comput Appl 25(7–8):1507–1516CrossRef
9.
go back to reference Karahan H (2012) Determining rainfall-intensity-duration-frequency relationship using particle swarm optimization. KSCE J Civil Eng 16(4):667–675CrossRef Karahan H (2012) Determining rainfall-intensity-duration-frequency relationship using particle swarm optimization. KSCE J Civil Eng 16(4):667–675CrossRef
10.
go back to reference Ouyang A, Li K, Truong TK, Sallam A, Sha HM (2014) Hybrid particle swarm optimization for parameter estimation of Muskingum model. Neural Comput Appl 25(7–8):1785–1799CrossRef Ouyang A, Li K, Truong TK, Sallam A, Sha HM (2014) Hybrid particle swarm optimization for parameter estimation of Muskingum model. Neural Comput Appl 25(7–8):1785–1799CrossRef
11.
go back to reference Pant M, Thangaraj R, Abraham A (2009) Particle swarm optimization: performance tuning and empirical analysis. In: Abraham A, Hassanien A-E, Siarry P, Engelbrecht A (eds) Foundations of computational intelligence, vol 3. Springer, Berlin Heidelberg, pp 101–128 Pant M, Thangaraj R, Abraham A (2009) Particle swarm optimization: performance tuning and empirical analysis. In: Abraham A, Hassanien A-E, Siarry P, Engelbrecht A (eds) Foundations of computational intelligence, vol 3. Springer, Berlin Heidelberg, pp 101–128
12.
go back to reference Niu B, Zhu Y, He X, Wu H (2007) MCPSO: a multi-swarm cooperative particle swarm optimizer. Appl Math Comput 185(2):1050–1062MATH Niu B, Zhu Y, He X, Wu H (2007) MCPSO: a multi-swarm cooperative particle swarm optimizer. Appl Math Comput 185(2):1050–1062MATH
13.
go back to reference Deep K, Arya M, Barak S (2010) A new multi-swarm particle swarm optimization and its application to Lennard-Jones problem. INFOCOMP 9(3):52–60 Deep K, Arya M, Barak S (2010) A new multi-swarm particle swarm optimization and its application to Lennard-Jones problem. INFOCOMP 9(3):52–60
14.
go back to reference Schutte JF, Reinbolt JA, Fregly BJ, Haftka RT, George AD (2004) Parallel global optimization with the particle swarm algorithm. J Numer Methods Eng 61(13):2296–2315CrossRef Schutte JF, Reinbolt JA, Fregly BJ, Haftka RT, George AD (2004) Parallel global optimization with the particle swarm algorithm. J Numer Methods Eng 61(13):2296–2315CrossRef
15.
go back to reference Koh BI, George AD, Haftka RT, Fregly BJ (2006) Parallel asynchronous particle swarm optimization. Int J Numer Methods Eng 67(4):578–595CrossRef Koh BI, George AD, Haftka RT, Fregly BJ (2006) Parallel asynchronous particle swarm optimization. Int J Numer Methods Eng 67(4):578–595CrossRef
16.
go back to reference Fan S, Chang J (2009) A parallel particle swarm optimization algorithm for multi-objective optimization problems. Eng Optim 41(7):673–697MathSciNetCrossRef Fan S, Chang J (2009) A parallel particle swarm optimization algorithm for multi-objective optimization problems. Eng Optim 41(7):673–697MathSciNetCrossRef
17.
go back to reference Shao B, Liu J, Huang Z, Li R (2011) A parallel particle swarm optimization algorithm for reference stations distribution. J Softw 6(7):1281–1288CrossRef Shao B, Liu J, Huang Z, Li R (2011) A parallel particle swarm optimization algorithm for reference stations distribution. J Softw 6(7):1281–1288CrossRef
18.
go back to reference Kamal A, Mahroos M, Sayed A, Nassar A (2012) Parallel particle swarm optimization for global multiple sequence alignment. Inf Technol J 11(8):998–1006CrossRef Kamal A, Mahroos M, Sayed A, Nassar A (2012) Parallel particle swarm optimization for global multiple sequence alignment. Inf Technol J 11(8):998–1006CrossRef
19.
go back to reference Moraes AOS, Mitre JF, Lage PLC, Secchi AR (2015) A robust parallel algorithm of the particle swarm optimization method for large dimensional engineering problems. Appl Math Model 39(14):4223–4241MathSciNetCrossRef Moraes AOS, Mitre JF, Lage PLC, Secchi AR (2015) A robust parallel algorithm of the particle swarm optimization method for large dimensional engineering problems. Appl Math Model 39(14):4223–4241MathSciNetCrossRef
20.
go back to reference Gülcü S, Kodaz H (2015) A novel parallel multi-swarm algorithm based on comprehensive learning particle swarm optimization. Eng Appl Artif Intell 45:33–45CrossRef Gülcü S, Kodaz H (2015) A novel parallel multi-swarm algorithm based on comprehensive learning particle swarm optimization. Eng Appl Artif Intell 45:33–45CrossRef
21.
go back to reference Suzuki M (2016) Adaptive parallel particle swarm optimization algorithm based on dynamic exchange of control parameters. Am J Oper Res 6(5):401–413 Suzuki M (2016) Adaptive parallel particle swarm optimization algorithm based on dynamic exchange of control parameters. Am J Oper Res 6(5):401–413
22.
go back to reference Wu Q, Xiong F, Wang F, Xiong Y (2016) Parallel particle swarm optimization on a graphics processing unit with application to trajectory optimization. Eng Optim 48(10):1679–1692MathSciNetCrossRef Wu Q, Xiong F, Wang F, Xiong Y (2016) Parallel particle swarm optimization on a graphics processing unit with application to trajectory optimization. Eng Optim 48(10):1679–1692MathSciNetCrossRef
23.
go back to reference Cao J, Cui H, Shi H, Jiao L (2016) Big data: a parallel particle swarm optimization-back-propagation neural network algorithm based on mapreduce. Plos One 11(6):e0157551CrossRef Cao J, Cui H, Shi H, Jiao L (2016) Big data: a parallel particle swarm optimization-back-propagation neural network algorithm based on mapreduce. Plos One 11(6):e0157551CrossRef
24.
go back to reference Alba E, Tomassini M (2002) Parallelism and evolutionary algorithms. IEEE Trans Evol Comput 6(5):443–462CrossRef Alba E, Tomassini M (2002) Parallelism and evolutionary algorithms. IEEE Trans Evol Comput 6(5):443–462CrossRef
25.
go back to reference Waintraub M, Schirru R, Pereira CMNA (2009) Multiprocessor modeling of parallel particle swarm optimization applied to nuclear engineering problems. Prog Nuclear Energy 51(6–7):680–688CrossRef Waintraub M, Schirru R, Pereira CMNA (2009) Multiprocessor modeling of parallel particle swarm optimization applied to nuclear engineering problems. Prog Nuclear Energy 51(6–7):680–688CrossRef
26.
go back to reference Chang JF, Chu SC, Roddick JF, Pan JS (2005) A parallel particle swarm optimization algorithm with communication strategies. J Inf Sci Eng 21(4):809–818 Chang JF, Chu SC, Roddick JF, Pan JS (2005) A parallel particle swarm optimization algorithm with communication strategies. J Inf Sci Eng 21(4):809–818
27.
go back to reference Yao X, Liu Y (1996) Fast evolutionary programming. In: Proceedings of the fifth annual congress on evolutionary computation, pp 451–460 Yao X, Liu Y (1996) Fast evolutionary programming. In: Proceedings of the fifth annual congress on evolutionary computation, pp 451–460
28.
go back to reference Zhao X, Gao X-S (2007) Binary affinity genetic algorithm. J Heuristics 13(2):133–150CrossRef Zhao X, Gao X-S (2007) Binary affinity genetic algorithm. J Heuristics 13(2):133–150CrossRef
29.
go back to reference Vesterstrom J, Thomsen R (2004) A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. In: Proceedings of congress on evolutionary programming, pp 1980–1987 Vesterstrom J, Thomsen R (2004) A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. In: Proceedings of congress on evolutionary programming, pp 1980–1987
30.
go back to reference Shi Y, Eberhart R (1998) A modified particle swarm optimization. In: Proceedings of IEEE international conference on evolutionary computation, pp 69–73 Shi Y, Eberhart R (1998) A modified particle swarm optimization. In: Proceedings of IEEE international conference on evolutionary computation, pp 69–73
31.
go back to reference Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82CrossRef Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82CrossRef
32.
go back to reference Bratton D, Kennedy J (2007) Defining a standard for particle swarm optimization. In: Proceedings of the 2007 IEEE swarm intelligence symposium, pp 120–127 Bratton D, Kennedy J (2007) Defining a standard for particle swarm optimization. In: Proceedings of the 2007 IEEE swarm intelligence symposium, pp 120–127
33.
go back to reference Karaboga D, Akay B (2009) A comparative study of artificial bee colony algorithm. Appl Math Comput 214(1):108–132MathSciNetMATH Karaboga D, Akay B (2009) A comparative study of artificial bee colony algorithm. Appl Math Comput 214(1):108–132MathSciNetMATH
Metadata
Title
An adaptive parallel particle swarm optimization for numerical optimization problems
Authors
Xinsheng Lai
Yuren Zhou
Publication date
09-04-2018
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 10/2019
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-3454-9

Other articles of this Issue 10/2019

Neural Computing and Applications 10/2019 Go to the issue

Premium Partner