Skip to main content
Erschienen in: Swarm Intelligence 2-3/2015

01.09.2015

Particle swarm variants: standardized convergence analysis

verfasst von: Christopher W. Cleghorn, Andries P. Engelbrecht

Erschienen in: Swarm Intelligence | Ausgabe 2-3/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents an objective function specially designed for the convergence analysis of a number of particle swarm optimization (PSO) variants. It was found that using a specially designed objective function for convergence analysis is both a simple and valid method for performing assumption free convergence analysis. It was also found that the canonical particle swarm’s topology did not have an impact on the parameter region needed to ensure convergence. The parameter region needed to ensure convergent particle behavior was empirically obtained for the fully informed PSO, the bare bones PSO, and the standard PSO 2011 algorithm. In the case of the bare bones PSO and the standard PSO 2011, the region needed to ensure convergent particle behavior differs from previous theoretical work. The difference in the obtained regions in the bare bones PSO is a direct result of the previous theoretical work relying on simplifying assumptions, specifically the stagnation assumption. A number of possible causes for the discrepancy in the obtained convergent region for the standard PSO 2011 are given.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Blackwell, T. (2012). A study of collapse in bare bones particle swarm optimization. IEEE Transactions on Evolutionary Computation, 16(3), 354–372.CrossRef Blackwell, T. (2012). A study of collapse in bare bones particle swarm optimization. IEEE Transactions on Evolutionary Computation, 16(3), 354–372.CrossRef
Zurück zum Zitat Bonyadi, M., & Michalewicz, Z. (2014). SPSO2011-analysis of stability, local convergence, and rotation sensitivity. In Proceedings of the genetic and evolutionary computation conference (pp. 9–15). New York, NY: ACM Press. Bonyadi, M., & Michalewicz, Z. (2014). SPSO2011-analysis of stability, local convergence, and rotation sensitivity. In Proceedings of the genetic and evolutionary computation conference (pp. 9–15). New York, NY: ACM Press.
Zurück zum Zitat Campana, E. F., Fasano, G., & Pinto, A. (2010). Dynamic analysis for the selection of parameters and initial population, in particle swarm optimization. Journal of Global Optimization, 48(3), 347–397. Campana, E. F., Fasano, G., & Pinto, A. (2010). Dynamic analysis for the selection of parameters and initial population, in particle swarm optimization. Journal of Global Optimization, 48(3), 347–397.
Zurück zum Zitat Cleghorn, C., & Engelbrecht, A. (2014a). A generalized theoretical deterministic particle swarm model. Swarm Intelligence, 8(1), 35–59.CrossRef Cleghorn, C., & Engelbrecht, A. (2014a). A generalized theoretical deterministic particle swarm model. Swarm Intelligence, 8(1), 35–59.CrossRef
Zurück zum Zitat Cleghorn, C., & Engelbrecht, A. (2014b). Particle swarm convergence: An empirical investigation. In Proceedings of the congress on evolutionary computation (pp. 2524–2530). Piscataway, NJ: IEEE Press. Cleghorn, C., & Engelbrecht, A. (2014b). Particle swarm convergence: An empirical investigation. In Proceedings of the congress on evolutionary computation (pp. 2524–2530). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Clerc, M., & Kennedy, J. (2002). The particle swarm-explosion, stability, and convergence in a multidimensional complex space. IEEE Transactions on Evolutionary Computation, 6(1), 58–73.CrossRef Clerc, M., & Kennedy, J. (2002). The particle swarm-explosion, stability, and convergence in a multidimensional complex space. IEEE Transactions on Evolutionary Computation, 6(1), 58–73.CrossRef
Zurück zum Zitat Engelbrecht, A. (2007). Computational intelligence (2nd ed.). Wiltshire: Wiley.CrossRef Engelbrecht, A. (2007). Computational intelligence (2nd ed.). Wiltshire: Wiley.CrossRef
Zurück zum Zitat Engelbrecht, A. (2013a). Particle swarm optimization: Global best or local best. In Proceedings of the 1st BRICS countries congress on computational intelligence (pp. 124–135). Piscataway, NJ: IEEE Press. Engelbrecht, A. (2013a). Particle swarm optimization: Global best or local best. In Proceedings of the 1st BRICS countries congress on computational intelligence (pp. 124–135). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Engelbrecht, A. (2013b). Roaming behavior of unconstrained particles. In Proceedings of the 1st BRICS countries congress on computational intelligence (pp. 104–111). Piscataway, NJ: IEEE Press. Engelbrecht, A. (2013b). Roaming behavior of unconstrained particles. In Proceedings of the 1st BRICS countries congress on computational intelligence (pp. 104–111). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Gazi, V. (2012). Stochastic stability analysis of the particle dynamics in the PSO algorithm. In Proceedings of the IEEE international symposium on intelligent control (pp. 708–713).Piscataway: IEEE Press. Gazi, V. (2012). Stochastic stability analysis of the particle dynamics in the PSO algorithm. In Proceedings of the IEEE international symposium on intelligent control (pp. 708–713).Piscataway: IEEE Press.
Zurück zum Zitat Jiang, M., Luo, Y., & Yang, S. (2007). Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm. Information Processing Letters, 102(1), 8–16.MathSciNetCrossRefMATH Jiang, M., Luo, Y., & Yang, S. (2007). Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm. Information Processing Letters, 102(1), 8–16.MathSciNetCrossRefMATH
Zurück zum Zitat Kadirkamanathan, V., Selvarajah, K., & Fleming, P. (2006). Stability analysis of the particle dynamics in particle swarm optimizer. IEEE Transactions on Evolutionary Computation, 10(3), 245–255.CrossRef Kadirkamanathan, V., Selvarajah, K., & Fleming, P. (2006). Stability analysis of the particle dynamics in particle swarm optimizer. IEEE Transactions on Evolutionary Computation, 10(3), 245–255.CrossRef
Zurück zum Zitat Kendall, M., & Ord, J. (1990). Time series (3rd ed.). London: Edward Arnold.MATH Kendall, M., & Ord, J. (1990). Time series (3rd ed.). London: Edward Arnold.MATH
Zurück zum Zitat Kennedy, J. (1999). Small worlds and mega-minds: Effects of neighborhood topology on particle swarm performance. In Proceedings of the IEEE congress on evolutionary computation (Vol. 3, pp. 1931–1938). Piscataway, NJ: IEEE Press. Kennedy, J. (1999). Small worlds and mega-minds: Effects of neighborhood topology on particle swarm performance. In Proceedings of the IEEE congress on evolutionary computation (Vol. 3, pp. 1931–1938). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Kennedy, J. (2003). Bare bones particle swarms. In Proceedings of the IEEE swarm intelligence symposium (pp. 80–87). Piscataway, NJ: IEEE Press. Kennedy, J. (2003). Bare bones particle swarms. In Proceedings of the IEEE swarm intelligence symposium (pp. 80–87). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. In Proceedings of the IEEE international joint conference on neural networks (pp. 1942–1948). Piscataway, NJ: IEEE Press. Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. In Proceedings of the IEEE international joint conference on neural networks (pp. 1942–1948). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Kennedy, J., & Mendes, R. (2002). Population structure and particle performance. In Proceedings of the IEEE congress on evolutionary computation (pp. 1671–1676). Piscataway, NJ: IEEE Press. Kennedy, J., & Mendes, R. (2002). Population structure and particle performance. In Proceedings of the IEEE congress on evolutionary computation (pp. 1671–1676). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Kennedy, J., & Mendes, R. (2003). Neighborhood topologies in fully-informed and best-of-neighborhood particle swarms. In Proceedings of the IEEE international workshop on soft computing in industrial applications (pp. 45–50). Piscataway, NJ: IEEE Press. Kennedy, J., & Mendes, R. (2003). Neighborhood topologies in fully-informed and best-of-neighborhood particle swarms. In Proceedings of the IEEE international workshop on soft computing in industrial applications (pp. 45–50). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Kisacanin, B., & Agarwal, G. (2001). Linear control systems: With solved problems and Matlab examples. New York, NY: Springer.CrossRef Kisacanin, B., & Agarwal, G. (2001). Linear control systems: With solved problems and Matlab examples. New York, NY: Springer.CrossRef
Zurück zum Zitat Liang, J., Qu, B., & Suganthan, P. (2013). Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. Technical Report 201311, Computational Intelligence Laboratory, Zhengzhou University and Nanyang Technological University. Liang, J., Qu, B., & Suganthan, P. (2013). Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. Technical Report 201311, Computational Intelligence Laboratory, Zhengzhou University and Nanyang Technological University.
Zurück zum Zitat Mirinda, V., Keko, H., & Duque, A. (2008). Stochastic star communication topology in evolutionary particle swarms (EPSO). International Journal of Computational Intelligence Research, 4(2), 105–116.MathSciNet Mirinda, V., Keko, H., & Duque, A. (2008). Stochastic star communication topology in evolutionary particle swarms (EPSO). International Journal of Computational Intelligence Research, 4(2), 105–116.MathSciNet
Zurück zum Zitat Montes de Oca, M., & Stützle, T. (2008). Convergence behavior of the fully informed particle swarm optimization algorithm. In Proceedings of the genetic and evolutionary computation conference (pp. 71–78). New York, NY: ACM Press. Montes de Oca, M., & Stützle, T. (2008). Convergence behavior of the fully informed particle swarm optimization algorithm. In Proceedings of the genetic and evolutionary computation conference (pp. 71–78). New York, NY: ACM Press.
Zurück zum Zitat Ozcan, E., & Mohan, C. (1998). Analysis of a simple particle swarm optimization system. Intelligent Engineering Systems through Artificial Neural Networks, 8, 253–258. Ozcan, E., & Mohan, C. (1998). Analysis of a simple particle swarm optimization system. Intelligent Engineering Systems through Artificial Neural Networks, 8, 253–258.
Zurück zum Zitat Ozcan, E., & Mohan, C. (1999). Particle swarm optimization: Surfing the waves. In Proceedings of the IEEE congress on evolutionary computation (Vol. 3, pp. 1939–1944). Piscataway, NJ: IEEE Press. Ozcan, E., & Mohan, C. (1999). Particle swarm optimization: Surfing the waves. In Proceedings of the IEEE congress on evolutionary computation (Vol. 3, pp. 1939–1944). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Poli, R. (2007). On the moments of the sampling distribution of particles swarm optimisers. In Proceedings of the genetic and evolutionary computation conference (pp. 2907–141). New York, NY: ACM Press. Poli, R. (2007). On the moments of the sampling distribution of particles swarm optimisers. In Proceedings of the genetic and evolutionary computation conference (pp. 2907–141). New York, NY: ACM Press.
Zurück zum Zitat Poli, R. (2008). Analysis of the publications on the applications of particle swarm optimisation. Journal of Artificial Evolution and Applications, 2008, 1–10. Poli, R. (2008). Analysis of the publications on the applications of particle swarm optimisation. Journal of Artificial Evolution and Applications, 2008, 1–10.
Zurück zum Zitat Poli, R. (2009). Mean and variance of the sampling distribution of particle swarm optimizers during stagnation. IEEE Transactions on Evolutionary Computation, 13(4), 712–721.CrossRef Poli, R. (2009). Mean and variance of the sampling distribution of particle swarm optimizers during stagnation. IEEE Transactions on Evolutionary Computation, 13(4), 712–721.CrossRef
Zurück zum Zitat Poli, R., & Broomhead, D. (2007). Exact analysis of the sampling distribution for the canonical particle swarm optimiser and its convergence during stagnation. In Proceedings of the genetic and evolutionary computation conference (pp. 134–141). New York, NY: ACM Press. Poli, R., & Broomhead, D. (2007). Exact analysis of the sampling distribution for the canonical particle swarm optimiser and its convergence during stagnation. In Proceedings of the genetic and evolutionary computation conference (pp. 134–141). New York, NY: ACM Press.
Zurück zum Zitat Shi, Y., & Eberhart, R. (1998). A modified particle swarm optimizer. In Proceedings of the IEEE congress on evolutionary computation (pp. 69–73). Piscataway, NJ: IEEE Press. Shi, Y., & Eberhart, R. (1998). A modified particle swarm optimizer. In Proceedings of the IEEE congress on evolutionary computation (pp. 69–73). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Trelea, I. (2003). The particle swarm optimization algorithm: Convergence analysis and parameter selection. Information Processing Letters, 85(6), 317–325.MathSciNetCrossRefMATH Trelea, I. (2003). The particle swarm optimization algorithm: Convergence analysis and parameter selection. Information Processing Letters, 85(6), 317–325.MathSciNetCrossRefMATH
Zurück zum Zitat Van den Bergh, F. (2002). An analysis of particle swarm optimizers. Ph.D. Thesis, Department of Computer Science, University of Pretoria, Pretoria, South Africa. Van den Bergh, F. (2002). An analysis of particle swarm optimizers. Ph.D. Thesis, Department of Computer Science, University of Pretoria, Pretoria, South Africa.
Zurück zum Zitat Van den Bergh, F., & Engelbrecht, A. (2006). A study of particle swarm optimization particle trajectories. Information Sciences, 176(8), 937–971.MathSciNetCrossRef Van den Bergh, F., & Engelbrecht, A. (2006). A study of particle swarm optimization particle trajectories. Information Sciences, 176(8), 937–971.MathSciNetCrossRef
Zurück zum Zitat Zambrano-Bigiarini, M., & Clerc, M. (2013). Standard particle swarm optimisation 2011 at CEC-2013: A baseline for future PSO improvements. In Proceedings of the IEEE congress on evolutionary computation (pp. 2337–2344). Piscataway, NJ: IEEE Press. Zambrano-Bigiarini, M., & Clerc, M. (2013). Standard particle swarm optimisation 2011 at CEC-2013: A baseline for future PSO improvements. In Proceedings of the IEEE congress on evolutionary computation (pp. 2337–2344). Piscataway, NJ: IEEE Press.
Zurück zum Zitat Zheng, Y., Ma, L., Zhang, L., & Qian, J. (2003). On the convergence analysis and parameter selection in particle swarm optimization. In Proceedings of the international conference on machine learning and cybernetics (Vol. 3, pp. 1802–1907). Piscataway, NJ: IEEE Press. Zheng, Y., Ma, L., Zhang, L., & Qian, J. (2003). On the convergence analysis and parameter selection in particle swarm optimization. In Proceedings of the international conference on machine learning and cybernetics (Vol. 3, pp. 1802–1907). Piscataway, NJ: IEEE Press.
Metadaten
Titel
Particle swarm variants: standardized convergence analysis
verfasst von
Christopher W. Cleghorn
Andries P. Engelbrecht
Publikationsdatum
01.09.2015
Verlag
Springer US
Erschienen in
Swarm Intelligence / Ausgabe 2-3/2015
Print ISSN: 1935-3812
Elektronische ISSN: 1935-3820
DOI
https://doi.org/10.1007/s11721-015-0109-7

Weitere Artikel der Ausgabe 2-3/2015

Swarm Intelligence 2-3/2015 Zur Ausgabe

Premium Partner