Skip to main content
Top
Published in: Soft Computing 11/2017

26-12-2015 | Methodologies and Application

Conceptual and numerical comparisons of swarm intelligence optimization algorithms

Authors: Haiping Ma, Sengang Ye, Dan Simon, Minrui Fei

Published in: Soft Computing | Issue 11/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Swarm intelligence (SI) optimization algorithms are fast and robust global optimization methods, and have attracted significant attention due to their ability to solve complex optimization problems. The underlying idea behind all SI algorithms is similar, and various SI algorithms differ only in their details. In this paper we discuss the algorithmic equivalence of particle swarm optimization (PSO) and various other newer SI algorithms, including the shuffled frog leaping algorithm (SFLA), the group search optimizer (GSO), the firefly algorithm (FA), artificial bee colony algorithm (ABC) and the gravitational search algorithm (GSA). We find that the original versions of SFLA, GSO, FA, ABC, and GSA, are all algorithmically identical to PSO under certain conditions. We discuss their diverse biological motivations and algorithmic details as typically implemented, and show how their differences enhance the diversity of SI research and application. Then we numerically compare SFLA, GSO, FA, ABC, and GSA, with basic and advanced versions on some continuous benchmark functions and combinatorial knapsack problems. Empirical results show that an advanced version of ABC performs best on the continuous benchmark functions, and advanced versions of SFLA and GSA perform best on the combinatorial knapsack problems. We conclude that although these SI algorithms are conceptually equivalent, their implementation details result in notably different performance levels.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abulkalamazad M, Rocha A, Fernandes E (2014) Improved binary artificial fish swarm algorithm for the 0–1 multidimensional knapsack problems. Swarm Evolut Comput 14:66–75CrossRef Abulkalamazad M, Rocha A, Fernandes E (2014) Improved binary artificial fish swarm algorithm for the 0–1 multidimensional knapsack problems. Swarm Evolut Comput 14:66–75CrossRef
go back to reference Bahriye A, Dervis K (2012) A modified artificial bee colony algorithm for real-parameter optimization. Inf Sci 192:120–142CrossRefMATH Bahriye A, Dervis K (2012) A modified artificial bee colony algorithm for real-parameter optimization. Inf Sci 192:120–142CrossRefMATH
go back to reference Bhattacharjee K, Sarmah SP (2014) Shuffled frog leaping algorithm and its application to 0/1 knapsack problem. Appl Soft Comput 19:252–263CrossRef Bhattacharjee K, Sarmah SP (2014) Shuffled frog leaping algorithm and its application to 0/1 knapsack problem. Appl Soft Comput 19:252–263CrossRef
go back to reference Chen D, Wang J, Zou F, Hou W, Zhao C (2012) An improved group search optimizer with operation of quantum-behaved swarm and its application. Appl Soft Comput 12:712–725CrossRef Chen D, Wang J, Zou F, Hou W, Zhao C (2012) An improved group search optimizer with operation of quantum-behaved swarm and its application. Appl Soft Comput 12:712–725CrossRef
go back to reference Civicioglu P, Besdok E (2013) A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms. Artif Intell Rev 39:315–345CrossRef Civicioglu P, Besdok E (2013) A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms. Artif Intell Rev 39:315–345CrossRef
go back to reference Clerc M, Kennedy J (2002) The particle swarm-explosion, stability and convergence in a multidimensional complex space. IEEE Trans Evolut Comput 6(3):58–73CrossRef Clerc M, Kennedy J (2002) The particle swarm-explosion, stability and convergence in a multidimensional complex space. IEEE Trans Evolut Comput 6(3):58–73CrossRef
go back to reference Cobos C, Muñoz-Collazos H, Urbano-Muñoz R, Mendoza M, León E, Herrera-Viedma E (2014) Clustering of web search results based on the cuckoo search algorithm and balanced Bayesian information criterion. Inf Sci 281:248–264CrossRef Cobos C, Muñoz-Collazos H, Urbano-Muñoz R, Mendoza M, León E, Herrera-Viedma E (2014) Clustering of web search results based on the cuckoo search algorithm and balanced Bayesian information criterion. Inf Sci 281:248–264CrossRef
go back to reference Davarynejad M, Berg J, Rezaei J (2014) Evaluating center-seeking and initialization bias: the case of particle swarm and gravitational search algorithms. Inf Sci 278:802–821MathSciNetCrossRef Davarynejad M, Berg J, Rezaei J (2014) Evaluating center-seeking and initialization bias: the case of particle swarm and gravitational search algorithms. Inf Sci 278:802–821MathSciNetCrossRef
go back to reference Derrac J, Garcia S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evolut Comput 1:3–18CrossRef Derrac J, Garcia S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evolut Comput 1:3–18CrossRef
go back to reference Dervis K, Bahriye B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Glob Optim 39:459–471MathSciNetCrossRefMATH Dervis K, Bahriye B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Glob Optim 39:459–471MathSciNetCrossRefMATH
go back to reference Dervis K, Beyza G, Celal O, Nurhan K (2014) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42:21–57CrossRef Dervis K, Beyza G, Celal O, Nurhan K (2014) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42:21–57CrossRef
go back to reference Dorigo M, Gambardella LM (1997) Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans Evolut Comput 1(3):53–66CrossRef Dorigo M, Gambardella LM (1997) Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans Evolut Comput 1(3):53–66CrossRef
go back to reference Dowlatshahi MB, Nezamabadi-pour H, Mashinchi M (2014) A discrete gravitational search algorithm for solving combinatorial optimization problems. Inf Sci 258:94–107MathSciNetCrossRefMATH Dowlatshahi MB, Nezamabadi-pour H, Mashinchi M (2014) A discrete gravitational search algorithm for solving combinatorial optimization problems. Inf Sci 258:94–107MathSciNetCrossRefMATH
go back to reference Elbeltagi E, Hegazy T, Grierson D (2005) Comparison among five evolutionary-based optimization algorithms. Adv Eng Inform 19:43–53CrossRef Elbeltagi E, Hegazy T, Grierson D (2005) Comparison among five evolutionary-based optimization algorithms. Adv Eng Inform 19:43–53CrossRef
go back to reference Emad E, Tarek H, Donald G (2007) A modifed shuffled frog-leaping optimization algorithm: applications to project management. Struct Infrastruct Eng 3(1):53–60CrossRef Emad E, Tarek H, Donald G (2007) A modifed shuffled frog-leaping optimization algorithm: applications to project management. Struct Infrastruct Eng 3(1):53–60CrossRef
go back to reference Eusuff M, Lansey KE (2003) Optimization of water distribution network design using the shuffled frog leaping algorithm. J Water Res Pl-ASCE 129:210–225CrossRef Eusuff M, Lansey KE (2003) Optimization of water distribution network design using the shuffled frog leaping algorithm. J Water Res Pl-ASCE 129:210–225CrossRef
go back to reference Fister I, Jr Fister, Yang X, Brest J (2013) A comprehensive review of firefly algorithms. Swarm Evolut Comput 13:34–46CrossRef Fister I, Jr Fister, Yang X, Brest J (2013) A comprehensive review of firefly algorithms. Swarm Evolut Comput 13:34–46CrossRef
go back to reference Gao S, Vairappan C, Wang Y, Cao Q, Tang Z (2014) Gravitational search algorithm combined with chaos for unconstrained numerical optimization. Appl Math Comput 231:48–62MathSciNetCrossRef Gao S, Vairappan C, Wang Y, Cao Q, Tang Z (2014) Gravitational search algorithm combined with chaos for unconstrained numerical optimization. Appl Math Comput 231:48–62MathSciNetCrossRef
go back to reference Hasançebi O, Carbas S (2014) Bat inspired algorithm for discrete size optimization of steel frames. Adv Eng Softw 67:173–185CrossRef Hasançebi O, Carbas S (2014) Bat inspired algorithm for discrete size optimization of steel frames. Adv Eng Softw 67:173–185CrossRef
go back to reference He S, Wu Q, Saunders J (2006) A novel group search optimizer inspired by animal behavioral ecology. In: Proceedings of the IEEE international conference on evolutionary computation, pp 1272–1278 He S, Wu Q, Saunders J (2006) A novel group search optimizer inspired by animal behavioral ecology. In: Proceedings of the IEEE international conference on evolutionary computation, pp 1272–1278
go back to reference Jiang S, Wang Y, Ji Z (2014) Convergence analysis and performance of an improved gravitational search algorithm. Appl Soft Comput 24:363–384CrossRef Jiang S, Wang Y, Ji Z (2014) Convergence analysis and performance of an improved gravitational search algorithm. Appl Soft Comput 24:363–384CrossRef
go back to reference Karaboga D (2005) An idea based on honey bee swarm for numerical optimization. Technical report, Computer Engineering Department, Erciyes University Karaboga D (2005) An idea based on honey bee swarm for numerical optimization. Technical report, Computer Engineering Department, Erciyes University
go back to reference Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Glob Optim 39:459–471MathSciNetCrossRefMATH Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Glob Optim 39:459–471MathSciNetCrossRefMATH
go back to reference Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, pp 1942–1948 Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, pp 1942–1948
go back to reference Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, CambridgeMATH Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, CambridgeMATH
go back to reference Krishnanand KN, Ghose D (2009) Glowworm swarm optimization for simultaneous capture of multiple local optima of multimodal functions. Swarm Intell 3:87–124CrossRef Krishnanand KN, Ghose D (2009) Glowworm swarm optimization for simultaneous capture of multiple local optima of multimodal functions. Swarm Intell 3:87–124CrossRef
go back to reference Liao T, Stuetzle T (2013) Benchmark results for a simple hybrid algorithm on the CEC 2013 benchmark set for real parameter optimization. In: Proceedings of IEEE congress on evolutionary computation, pp 1938–1944 Liao T, Stuetzle T (2013) Benchmark results for a simple hybrid algorithm on the CEC 2013 benchmark set for real parameter optimization. In: Proceedings of IEEE congress on evolutionary computation, pp 1938–1944
go back to reference Parpinelli R, Lopes H (2011) New inspirations in swarm intelligence: a survey. Int J Bio-Inspired Comput 3:1–16CrossRef Parpinelli R, Lopes H (2011) New inspirations in swarm intelligence: a survey. Int J Bio-Inspired Comput 3:1–16CrossRef
go back to reference Parpinelli R, Teodoro F, Lopes H (2012) A comparison of swarm intelligence algorithms for structural engineering optimization. Int J Numer Methods Eng 19:666–684CrossRefMATH Parpinelli R, Teodoro F, Lopes H (2012) A comparison of swarm intelligence algorithms for structural engineering optimization. Int J Numer Methods Eng 19:666–684CrossRefMATH
go back to reference Rahimi-Vahed A, Mirzaei A (2008) Solving a bi-criteria permutation flow-shop problem using shuffled frog-leaping algorithm. Soft Comput 12:435–452CrossRefMATH Rahimi-Vahed A, Mirzaei A (2008) Solving a bi-criteria permutation flow-shop problem using shuffled frog-leaping algorithm. Soft Comput 12:435–452CrossRefMATH
go back to reference Rao RV, Savsani VJ, Vakharia DP (2011) Teaching-learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput-Aided Des 43:303–315CrossRef Rao RV, Savsani VJ, Vakharia DP (2011) Teaching-learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput-Aided Des 43:303–315CrossRef
go back to reference Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179:2232–2248CrossRefMATH Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179:2232–2248CrossRefMATH
go back to reference Rashedi E, Nezamabadi-pour H, Saryazdi S (2011) Filter modeling using gravitational search algorithm. Eng Appl Artif Intell 24:117–122CrossRefMATH Rashedi E, Nezamabadi-pour H, Saryazdi S (2011) Filter modeling using gravitational search algorithm. Eng Appl Artif Intell 24:117–122CrossRefMATH
go back to reference Reeves C, Rowe J (2003) Genetic algorithms: principles and perspectives. Kluwer Academic Publishers, BostonCrossRefMATH Reeves C, Rowe J (2003) Genetic algorithms: principles and perspectives. Kluwer Academic Publishers, BostonCrossRefMATH
go back to reference Sarkheyli A, Zain AM, Sharif S (2015) The role of basic, modified and hybrid shuffled frog leaping algorithm on optimization problems: a review. Soft Comput 19:2011–2038CrossRef Sarkheyli A, Zain AM, Sharif S (2015) The role of basic, modified and hybrid shuffled frog leaping algorithm on optimization problems: a review. Soft Comput 19:2011–2038CrossRef
go back to reference Schwefel HP (1995) Evolution and optimum seeking. Wiley Press, New Jersey Schwefel HP (1995) Evolution and optimum seeking. Wiley Press, New Jersey
go back to reference Simon D (2011) A dynamic system model of biogeography-based optimization. Appl Soft Comput 11:5652–5661CrossRef Simon D (2011) A dynamic system model of biogeography-based optimization. Appl Soft Comput 11:5652–5661CrossRef
go back to reference Simon D (2013) Evolutionary optimization algorithms. Wiley, New Jersey Simon D (2013) Evolutionary optimization algorithms. Wiley, New Jersey
go back to reference Shen H, Zhu Y, Niu B, Wu Q (2009) An improved group search optimizer for mechanical design optimization problems. Prog Nat Sci 19:91–97CrossRef Shen H, Zhu Y, Niu B, Wu Q (2009) An improved group search optimizer for mechanical design optimization problems. Prog Nat Sci 19:91–97CrossRef
go back to reference Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. Lect Notes Comput Sci 1447:591–600CrossRef Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. Lect Notes Comput Sci 1447:591–600CrossRef
go back to reference Suzuki J (1995) A Markov chain analysis on simple genetic algorithms. IEEE Trans Syst Man Cybern Part B 25:655–659CrossRef Suzuki J (1995) A Markov chain analysis on simple genetic algorithms. IEEE Trans Syst Man Cybern Part B 25:655–659CrossRef
go back to reference Tan Y, Zhu Y (2010) Fireworks algorithm for optimization. Lect Notes Comput Sci 6145:355–364CrossRef Tan Y, Zhu Y (2010) Fireworks algorithm for optimization. Lect Notes Comput Sci 6145:355–364CrossRef
go back to reference Wang L, Fang C (2011) An effective shuffled frog-leaping algorithm for multi-mode resource-constrained project scheduling problem. Inf Sci 181:4804–4822MathSciNetCrossRefMATH Wang L, Fang C (2011) An effective shuffled frog-leaping algorithm for multi-mode resource-constrained project scheduling problem. Inf Sci 181:4804–4822MathSciNetCrossRefMATH
go back to reference Wang L, Zhong X, Liu M (2012) A novel group search optimizer for multi-objective optimization. Expert Syst Appl 39:2939–2946CrossRef Wang L, Zhong X, Liu M (2012) A novel group search optimizer for multi-objective optimization. Expert Syst Appl 39:2939–2946CrossRef
go back to reference Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evolut Comput 1:67–82CrossRef Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evolut Comput 1:67–82CrossRef
go back to reference Yang X (2011) Review of meta-heuristics and generalized evolutionary walk algorithm. Int J Bio-Inspired Comput 3:77–84CrossRef Yang X (2011) Review of meta-heuristics and generalized evolutionary walk algorithm. Int J Bio-Inspired Comput 3:77–84CrossRef
go back to reference Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evolut Comput 3(1):82–102 Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evolut Comput 3(1):82–102
go back to reference Yu S, Zhu S, Ma Y, Mao D (2015) A variable step size firefly algorithm for numerical optimization. Appl Math Comput 263:214–220MathSciNetCrossRef Yu S, Zhu S, Ma Y, Mao D (2015) A variable step size firefly algorithm for numerical optimization. Appl Math Comput 263:214–220MathSciNetCrossRef
go back to reference Zang H, Zhang S, Hapeshi K (2010) A review of nature-inspired algorithms. J Bionic Eng 7(Supplement):S232–S237CrossRef Zang H, Zhang S, Hapeshi K (2010) A review of nature-inspired algorithms. J Bionic Eng 7(Supplement):S232–S237CrossRef
go back to reference Zare K, Haque M, Davoodi E (2012) Solving non-convex economic dispatch problem with valve point effects using modified group search optimizer method. Electr Power Syst Res 84:83–89CrossRef Zare K, Haque M, Davoodi E (2012) Solving non-convex economic dispatch problem with valve point effects using modified group search optimizer method. Electr Power Syst Res 84:83–89CrossRef
go back to reference Zheng X, Lu D, Chen Z (2014) A self-adaptive group search optimizer with elitist strategy. In: Proceedings of 2014 IEEE congress on evolutionary computation, pp 2033–2039 Zheng X, Lu D, Chen Z (2014) A self-adaptive group search optimizer with elitist strategy. In: Proceedings of 2014 IEEE congress on evolutionary computation, pp 2033–2039
Metadata
Title
Conceptual and numerical comparisons of swarm intelligence optimization algorithms
Authors
Haiping Ma
Sengang Ye
Dan Simon
Minrui Fei
Publication date
26-12-2015
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 11/2017
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-015-1993-x

Other articles of this Issue 11/2017

Soft Computing 11/2017 Go to the issue

Premium Partner