Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 6/2019

24-03-2018 | Original Article

A collaboration-based particle swarm optimizer for global optimization problems

Authors: Leilei Cao, Lihong Xu, Erik D. Goodman

Published in: International Journal of Machine Learning and Cybernetics | Issue 6/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper introduces a collaboration-based particle swarm optimizer (PSO) by incorporating three new strategies: a global learning strategy, a probability of learning, and a “worst replacement” swarm update rule. Instead of learning from the personal historical best position and the global (or local) best position which was used by the classical PSO, a target particle learns from another randomly chosen particle and the global best one in the swarm. Instead of accepting a new velocity directly, the velocity updates according to a learning probability, according to which the velocity of the target particle in each dimension updates via learning from other particles or simply inherits its previous velocity component. Since each particle has the same chance to be selected as a leader, the worst particle might influence the whole swarm’s performance. Therefore, the worst particle in the swarm in each update is moved to a new better position generated from another particle. The proposed algorithm is shown to be statistically significantly better than six other state-of-the-art PSO variants on 20 typical benchmark functions with three different dimensionalities.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Eberhart RC, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the Sixth International Symposium on Micro Machine and Human Science, vol 1, pp 39–43 Eberhart RC, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the Sixth International Symposium on Micro Machine and Human Science, vol 1, pp 39–43
2.
go back to reference Li X (2003) A non-dominated sorting particle swarm optimizer for multi-objective optimization. In: Proceedings of genetic and evolutionary computation conference, lecture notes in computer science. Springer, Berlin, vol 2723, pp 37–48 Li X (2003) A non-dominated sorting particle swarm optimizer for multi-objective optimization. In: Proceedings of genetic and evolutionary computation conference, lecture notes in computer science. Springer, Berlin, vol 2723, pp 37–48
3.
go back to reference Chunkai Z, Yu L, Huihe S (2000) A new evolved artificial neural network and its application. In: Proceedings of the 3rd world congress on intelligent control and automation, IEEE, vol 2, pp 1065–1068 Chunkai Z, Yu L, Huihe S (2000) A new evolved artificial neural network and its application. In: Proceedings of the 3rd world congress on intelligent control and automation, IEEE, vol 2, pp 1065–1068
4.
go back to reference Verma R, Mehra R (2016) PSO algorithm based adaptive median filter for noise removal in image processing application. Int J Adv Comput Sci Appl 1(7):92–98 Verma R, Mehra R (2016) PSO algorithm based adaptive median filter for noise removal in image processing application. Int J Adv Comput Sci Appl 1(7):92–98
5.
go back to reference Rana S, Jasola S, Kumar R (2013) A boundary restricted adaptive particle swarm optimization for data clustering. Int J Mach Learn Cybern 4(4):391–400CrossRef Rana S, Jasola S, Kumar R (2013) A boundary restricted adaptive particle swarm optimization for data clustering. Int J Mach Learn Cybern 4(4):391–400CrossRef
6.
go back to reference Subasi A (2013) Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders. Comput Biol Med 43(5):576–586CrossRef Subasi A (2013) Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders. Comput Biol Med 43(5):576–586CrossRef
7.
go back to reference Lin CM, Li MC, Ting AB, Lin MH (2011) A robust self-learning PID control system design for nonlinear systems using a particle swarm optimization algorithm. Int J Mach Learn Cybern 2(4):225–234CrossRef Lin CM, Li MC, Ting AB, Lin MH (2011) A robust self-learning PID control system design for nonlinear systems using a particle swarm optimization algorithm. Int J Mach Learn Cybern 2(4):225–234CrossRef
8.
go back to reference Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of the 2002 congress on evolutionary computation, IEEE, vol 2, pp 1671–1676 Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of the 2002 congress on evolutionary computation, IEEE, vol 2, pp 1671–1676
9.
go back to reference Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. In: Proceedings of the 1999 congress on evolutionary computation. IEEE, vol 3, pp 1931–1938 Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. In: Proceedings of the 1999 congress on evolutionary computation. IEEE, vol 3, pp 1931–1938
10.
go back to reference Zhan ZH, Zhang J, Li Y et al (2009) Adaptive particle swarm optimization. IEEE Trans Syst Man Part B (Cybern) 39(6):1362–1381CrossRef Zhan ZH, Zhang J, Li Y et al (2009) Adaptive particle swarm optimization. IEEE Trans Syst Man Part B (Cybern) 39(6):1362–1381CrossRef
11.
go back to reference Xu G (2013) An adaptive parameter tuning of particle swarm optimization algorithm. Appl Math Comput 219(9):4560–4569MathSciNetMATH Xu G (2013) An adaptive parameter tuning of particle swarm optimization algorithm. Appl Math Comput 219(9):4560–4569MathSciNetMATH
12.
go back to reference Li C, Yang S, Nguyen TT, Part B (2012) A self-learning particle swarm optimizer for global optimization problems. IEEE Trans Syst Man Part B (Cybern) 42(3):627–646CrossRef Li C, Yang S, Nguyen TT, Part B (2012) A self-learning particle swarm optimizer for global optimization problems. IEEE Trans Syst Man Part B (Cybern) 42(3):627–646CrossRef
13.
go back to reference Liang JJ, Qin AK, Suganthan PN et al (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295CrossRef Liang JJ, Qin AK, Suganthan PN et al (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295CrossRef
14.
15.
go back to reference Li X (2010) Niching without niching parameters: particle swarm optimization using a ring topology. IEEE Trans Evol Comput 14(1):150–169CrossRef Li X (2010) Niching without niching parameters: particle swarm optimization using a ring topology. IEEE Trans Evol Comput 14(1):150–169CrossRef
16.
go back to reference Parrott D, Li X (2006) Locating and tracking multiple dynamic optima by a particle swarm model using speciation. IEEE Trans Evol Comput 10(4):440–458CrossRef Parrott D, Li X (2006) Locating and tracking multiple dynamic optima by a particle swarm model using speciation. IEEE Trans Evol Comput 10(4):440–458CrossRef
17.
go back to reference Yang S, Li C (2010) A clustering particle swarm optimizer for locating and tracking multiple optima in dynamic environments. IEEE Trans Evol Comput 14(6):959–974CrossRef Yang S, Li C (2010) A clustering particle swarm optimizer for locating and tracking multiple optima in dynamic environments. IEEE Trans Evol Comput 14(6):959–974CrossRef
18.
go back to reference Chen W, Zhang J, Lin Y et al (2013) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evol Comput 17(2):241–258CrossRef Chen W, Zhang J, Lin Y et al (2013) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evol Comput 17(2):241–258CrossRef
19.
go back to reference Liang JJ, Suganthan PN (2005) Dynamic multi-swarm particle swarm optimizer with local search. In: Proceedings of the 2005 IEEE congress on evolutionary computation, IEEE, vol 1, pp 522–528 Liang JJ, Suganthan PN (2005) Dynamic multi-swarm particle swarm optimizer with local search. In: Proceedings of the 2005 IEEE congress on evolutionary computation, IEEE, vol 1, pp 522–528
20.
go back to reference Li Y, Zhan Z, Lin S et al (2015) Competitive and cooperative particle swarm optimization with information sharing mechanism for global optimization problems. Inf Sci 293:370–382CrossRef Li Y, Zhan Z, Lin S et al (2015) Competitive and cooperative particle swarm optimization with information sharing mechanism for global optimization problems. Inf Sci 293:370–382CrossRef
21.
go back to reference Nasir M, Das S, Maity D et al (2012) A dynamic neighborhood learning based particle swarm optimizer for global numerical optimization. Inf Sci 209:16–36MathSciNetCrossRef Nasir M, Das S, Maity D et al (2012) A dynamic neighborhood learning based particle swarm optimizer for global numerical optimization. Inf Sci 209:16–36MathSciNetCrossRef
22.
go back to reference Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optimiz 11(4):341–359MathSciNetCrossRefMATH Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optimiz 11(4):341–359MathSciNetCrossRefMATH
23.
go back to reference He Y, Xie H, Wong TL, Wang X (2018) A novel binary artificial bee colony algorithm for the set-union knapsack problem. Future Gener Comput Syst 78:77–86CrossRef He Y, Xie H, Wong TL, Wang X (2018) A novel binary artificial bee colony algorithm for the set-union knapsack problem. Future Gener Comput Syst 78:77–86CrossRef
24.
go back to reference Li X, Yang G (2016) Artificial bee colony algorithm with memory. Appl Soft Comput 41:362–372CrossRef Li X, Yang G (2016) Artificial bee colony algorithm with memory. Appl Soft Comput 41:362–372CrossRef
25.
go back to reference Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210CrossRef Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210CrossRef
26.
go back to reference Eberhart RC, Shi Y (2001) Particle swarm optimization: development, applications and resources. In: Proceedings of the 2001 IEEE congress on evolutionary computation, IEEE, vol 1, pp 81–86 Eberhart RC, Shi Y (2001) Particle swarm optimization: development, applications and resources. In: Proceedings of the 2001 IEEE congress on evolutionary computation, IEEE, vol 1, pp 81–86
27.
go back to reference Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31CrossRef Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15(1):4–31CrossRef
28.
go back to reference Zhu H, He Y, Wang X (2017) Discrete differential evolutions for the discounted {0–1} knapsack problem. Int J Bio-Inspir Comput 10(4):219–238CrossRef Zhu H, He Y, Wang X (2017) Discrete differential evolutions for the discounted {0–1} knapsack problem. Int J Bio-Inspir Comput 10(4):219–238CrossRef
29.
go back to reference Dong C, Ng WWY, Wang X et al (2014) An improved differential evolution and its application to determining feature weights in similarity-based clustering. Neurocomputing 146:95–103CrossRef Dong C, Ng WWY, Wang X et al (2014) An improved differential evolution and its application to determining feature weights in similarity-based clustering. Neurocomputing 146:95–103CrossRef
30.
go back to reference Das S, Konar A, Chakraborty UK (2005) Improving particle swarm optimization with differentially perturbed velocity. In: Proceedings of the 7th annual conference on genetic and evolutionary computation. ACM, pp 177–184 Das S, Konar A, Chakraborty UK (2005) Improving particle swarm optimization with differentially perturbed velocity. In: Proceedings of the 7th annual conference on genetic and evolutionary computation. ACM, pp 177–184
31.
go back to reference Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: Proceedings of 1998 IEEE world congress on computational intelligence, IEEE, pp 69–73 Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: Proceedings of 1998 IEEE world congress on computational intelligence, IEEE, pp 69–73
32.
go back to reference Clerc M, Kennedy J (2002) The particle swarm-explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73CrossRef Clerc M, Kennedy J (2002) The particle swarm-explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73CrossRef
33.
go back to reference Shi Y, Eberhart RC (1999) Empirical study of particle swarm optimization. In: Proceedings of the 1999 congress on evolutionary computation, IEEE, vol 3, pp 1945–1950 Shi Y, Eberhart RC (1999) Empirical study of particle swarm optimization. In: Proceedings of the 1999 congress on evolutionary computation, IEEE, vol 3, pp 1945–1950
34.
go back to reference Ratnaweera A, Halgamuge SK, Watson HC (2004) Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255CrossRef Ratnaweera A, Halgamuge SK, Watson HC (2004) Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255CrossRef
35.
go back to reference Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization algorithm with adaptive inertia weight. Appl Soft Comput 11(4):3658–3670CrossRef Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization algorithm with adaptive inertia weight. Appl Soft Comput 11(4):3658–3670CrossRef
36.
go back to reference Janson S, Middendorf M (2005) A hierarchical particle swarm optimizer and its adaptive variant., IEEE Trans Syst Man Part B (Cybernet) 35(6):1272–1282CrossRef Janson S, Middendorf M (2005) A hierarchical particle swarm optimizer and its adaptive variant., IEEE Trans Syst Man Part B (Cybernet) 35(6):1272–1282CrossRef
37.
go back to reference Parsopoulos KE, Vrahatis MN (2004) UPSO: a unified particle swarm optimization scheme. Lecture Ser Comput Comput Sci Proc Int Conf Comput Methods Sci Eng 1(5):868–873 Parsopoulos KE, Vrahatis MN (2004) UPSO: a unified particle swarm optimization scheme. Lecture Ser Comput Comput Sci Proc Int Conf Comput Methods Sci Eng 1(5):868–873
38.
go back to reference Hu M, Wu T, Weir JD (2012) An intelligent augmentation of particle swarm optimization with multiple adaptive methods. Inf Sci 213:68–83CrossRef Hu M, Wu T, Weir JD (2012) An intelligent augmentation of particle swarm optimization with multiple adaptive methods. Inf Sci 213:68–83CrossRef
39.
go back to reference Hu M, Wu T, Weir JD (2013) An adaptive particle swarm optimization with multiple adaptive methods. IEEE Trans Evol Comput 17(5):705–720CrossRef Hu M, Wu T, Weir JD (2013) An adaptive particle swarm optimization with multiple adaptive methods. IEEE Trans Evol Comput 17(5):705–720CrossRef
40.
41.
go back to reference Kao YT, Zahara E (2008) A hybrid genetic algorithm and particle swarm optimization for multimodal functions. Appl Soft Comput 8(2):849–857CrossRef Kao YT, Zahara E (2008) A hybrid genetic algorithm and particle swarm optimization for multimodal functions. Appl Soft Comput 8(2):849–857CrossRef
42.
go back to reference Qu B, Liang JJ, Suganthan PN (2012) Niching particle swarm optimization with local search for multi-modal optimization. Inf Sci 197:131–143CrossRef Qu B, Liang JJ, Suganthan PN (2012) Niching particle swarm optimization with local search for multi-modal optimization. Inf Sci 197:131–143CrossRef
43.
go back to reference Qu B, Suganthan PN, Das S (2013) A distance-based locally informed particle swarm model for multimodal optimization. IEEE Trans Evol Comput 17(3):387–402CrossRef Qu B, Suganthan PN, Das S (2013) A distance-based locally informed particle swarm model for multimodal optimization. IEEE Trans Evol Comput 17(3):387–402CrossRef
44.
go back to reference Liang X, Li W, Zhang Y et al (2015) An adaptive particle swarm optimization method based on clustering. Soft Comput 19(2):431–448CrossRef Liang X, Li W, Zhang Y et al (2015) An adaptive particle swarm optimization method based on clustering. Soft Comput 19(2):431–448CrossRef
45.
go back to reference Van den Bergh F, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239CrossRef Van den Bergh F, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239CrossRef
46.
go back to reference Li X, Yao X (2012) Cooperatively coevolving particle swarms for large scale optimization. IEEE Trans Evol Comput 16(2):210–224CrossRef Li X, Yao X (2012) Cooperatively coevolving particle swarms for large scale optimization. IEEE Trans Evol Comput 16(2):210–224CrossRef
47.
go back to reference Wang H, Sun H, Li C et al (2013) Diversity enhanced particle swarm optimization with neighborhood search. Inf Sci 223:119–135MathSciNetCrossRef Wang H, Sun H, Li C et al (2013) Diversity enhanced particle swarm optimization with neighborhood search. Inf Sci 223:119–135MathSciNetCrossRef
48.
go back to reference Suganthan PN, Hansen N, Liang JJ et al (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization, Nanyang Technological University and KanGAL Report, p 2005005 Suganthan PN, Hansen N, Liang JJ et al (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization, Nanyang Technological University and KanGAL Report, p 2005005
49.
go back to reference Jin Y, Branke J (2005) Evolutionary optimization in uncertain environments-a survey. IEEE Trans Evol Comput 9(3):303–317CrossRef Jin Y, Branke J (2005) Evolutionary optimization in uncertain environments-a survey. IEEE Trans Evol Comput 9(3):303–317CrossRef
Metadata
Title
A collaboration-based particle swarm optimizer for global optimization problems
Authors
Leilei Cao
Lihong Xu
Erik D. Goodman
Publication date
24-03-2018
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 6/2019
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-018-0810-0

Other articles of this Issue 6/2019

International Journal of Machine Learning and Cybernetics 6/2019 Go to the issue