Skip to main content

2019 | OriginalPaper | Buchkapitel

12. A Probabilistic Finite State Machine Design of Particle Swarm Optimization

verfasst von : Abdellatif El Afia, Malek Sarhani, Oussama Aoun

Erschienen in: Bioinspired Heuristics for Optimization

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nowadays, control is the main concern with emergent behaviours of multi-agent systems and state machine reasoning. This paper focuses on the restriction of this general issue to swarm intelligence approaches designed for solving complex optimization problems. Indeed, we propose a probabilistic finite state machine for controlling particles behaviour of the particle swarm optimization algorithm. That is, our multi-agent approach consists of assigning different roles to each particle based on its probabilistic finite state machine control which is used to address this issue. We performed evaluations on ten benchmark functions to test our control scheme for particles. Experimental results show that our proposed scheme gives a distinguishable out-performance on a number of state of the art of PSO variants.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aoun, O., Sarhani, M., & El Afia, A. (2017). Particle swarm optimisation with population size and acceleration coefficients adaptation using hidden markov model state classification. In International Journal of Metaheuristics Aoun, O., Sarhani, M., & El Afia, A. (2017). Particle swarm optimisation with population size and acceleration coefficients adaptation using hidden markov model state classification. In International Journal of Metaheuristics
2.
Zurück zum Zitat Aoun, O., Sarhani, M., & El Afia, A. (2016). Investigation of hidden markov model for the tuning of metaheuristics in airline scheduling problems. IFAC-PapersOnLine, 49(3), 347–352.CrossRef Aoun, O., Sarhani, M., & El Afia, A. (2016). Investigation of hidden markov model for the tuning of metaheuristics in airline scheduling problems. IFAC-PapersOnLine, 49(3), 347–352.CrossRef
3.
Zurück zum Zitat Aoun, O., Sarhani, M., & El Afia, A. (2017). Hidden markov model classifier for the adaptive particle swarm optimization. In Talbi, E.-G., Yalaoui F., Amodeo, L. (Eds.), Recent developments of metaheuristics, Chap. 1. Berlin: Springer. Aoun, O., Sarhani, M., & El Afia, A. (2017). Hidden markov model classifier for the adaptive particle swarm optimization. In Talbi, E.-G., Yalaoui F., Amodeo, L. (Eds.), Recent developments of metaheuristics, Chap. 1. Berlin: Springer.
4.
Zurück zum Zitat Aydin, M. E. (2012). Coordinating metaheuristic agents with swarm intelligence. Journal of Intelligent Manufacturing, 23(4), 991–999.CrossRef Aydin, M. E. (2012). Coordinating metaheuristic agents with swarm intelligence. Journal of Intelligent Manufacturing, 23(4), 991–999.CrossRef
5.
Zurück zum Zitat Baum, L. E., Petrie, T., Soules, G., & Weiss, N. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of markov chains. The Annals of Mathematical Statistics, 164–171. Baum, L. E., Petrie, T., Soules, G., & Weiss, N. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of markov chains. The Annals of Mathematical Statistics, 164–171.
6.
Zurück zum Zitat Bengfort, B., Kim, P. Y., Harrison, K., & Reggia, J. A. (2014). Evolutionary design of self-organizing particle systems for collective problem solving. 2014 IEEE symposium on swarm intelligence (SIS) (pp. 1–8). New York: IEEE. Bengfort, B., Kim, P. Y., Harrison, K., & Reggia, J. A. (2014). Evolutionary design of self-organizing particle systems for collective problem solving. 2014 IEEE symposium on swarm intelligence (SIS) (pp. 1–8). New York: IEEE.
7.
Zurück zum Zitat Beni, G. (2004). From swarm intelligence to swarm robotics. Swarm robotics (pp. 1–9). Berlin: Springer. Beni, G. (2004). From swarm intelligence to swarm robotics. Swarm robotics (pp. 1–9). Berlin: Springer.
8.
Zurück zum Zitat Blackwell, T., Branke, J. et al. (2004). Multi-swarm optimization in dynamic environments. In EvoWorkshops (Vol. 3005, pp. 489–500). Berlin: Springer. 2004. Blackwell, T., Branke, J. et al. (2004). Multi-swarm optimization in dynamic environments. In EvoWorkshops (Vol. 3005, pp. 489–500). Berlin: Springer. 2004.
9.
Zurück zum Zitat Bouzbita, S., El Afia, A., & Faizi, R. (2016). A novel based hidden markov model approach for controlling the acs-tsp evaporation parameter. 2016 5th international conference on multimedia computing and systems (ICMCS) (pp. 633–638). New York: IEEE.CrossRef Bouzbita, S., El Afia, A., & Faizi, R. (2016). A novel based hidden markov model approach for controlling the acs-tsp evaporation parameter. 2016 5th international conference on multimedia computing and systems (ICMCS) (pp. 633–638). New York: IEEE.CrossRef
10.
Zurück zum Zitat Bouzbita, S., El Afia, A., Faizi, R., & Zbakh, M. (2016). Dynamic adaptation of the acs-tsp local pheromone decay parameter based on the hidden markov model. 2016 2nd international conference on cloud computing technologies and applications (CloudTech) (pp. 344–349). New York: IEEE.CrossRef Bouzbita, S., El Afia, A., Faizi, R., & Zbakh, M. (2016). Dynamic adaptation of the acs-tsp local pheromone decay parameter based on the hidden markov model. 2016 2nd international conference on cloud computing technologies and applications (CloudTech) (pp. 344–349). New York: IEEE.CrossRef
11.
Zurück zum Zitat Brambilla, M., Ferrante, E., Birattari, M., & Dorigo, M. (2013). Swarm robotics: a review from the swarm engineering perspective. Swarm Intelligence, 7(1), 1–41.CrossRef Brambilla, M., Ferrante, E., Birattari, M., & Dorigo, M. (2013). Swarm robotics: a review from the swarm engineering perspective. Swarm Intelligence, 7(1), 1–41.CrossRef
12.
Zurück zum Zitat Cappé, O. (2011). Online em algorithm for hidden markov models. Journal of Computational and Graphical Statistics, 20(3), Cappé, O. (2011). Online em algorithm for hidden markov models. Journal of Computational and Graphical Statistics, 20(3),
13.
Zurück zum Zitat De Oca, M. A. M., Stützle, T., Van den Enden, K., & Dorigo, M. (2011). Incremental social learning in particle swarms. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 41(2), 368–384.CrossRef De Oca, M. A. M., Stützle, T., Van den Enden, K., & Dorigo, M. (2011). Incremental social learning in particle swarms. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 41(2), 368–384.CrossRef
14.
Zurück zum Zitat Monett Diaz, D. (2005). Agent-Based Configuration of (Metaheuristic) Algorithms. PhD thesis, Humboldt University of Berlin. Monett Diaz, D. (2005). Agent-Based Configuration of (Metaheuristic) Algorithms. PhD thesis, Humboldt University of Berlin.
15.
Zurück zum Zitat Dorigo, M., & Gambardella, L. M. (1997). Ant colony system: A cooperative learning approach to the traveling salesman problem. IEEE Transactions on Evolutionary Computation, 1(1), 53–66.CrossRef Dorigo, M., & Gambardella, L. M. (1997). Ant colony system: A cooperative learning approach to the traveling salesman problem. IEEE Transactions on Evolutionary Computation, 1(1), 53–66.CrossRef
16.
Zurück zum Zitat Dupont, P., Denis, F., & Esposito, Y. (2005). Links between probabilistic automata and hidden markov models: Probability distributions, learning models and induction algorithms. Pattern Recognition, 38(9), 1349–1371.CrossRef Dupont, P., Denis, F., & Esposito, Y. (2005). Links between probabilistic automata and hidden markov models: Probability distributions, learning models and induction algorithms. Pattern Recognition, 38(9), 1349–1371.CrossRef
17.
Zurück zum Zitat El Afia, A., Sarhani, M., & Aoun, O. (2017). Hidden markov model control of inertia weight adaptation for particle swarm optimization. In IFAC2017 World Congress, Toulouse, France. El Afia, A., Sarhani, M., & Aoun, O. (2017). Hidden markov model control of inertia weight adaptation for particle swarm optimization. In IFAC2017 World Congress, Toulouse, France.
18.
Zurück zum Zitat El-Maleh., A. H., Sheikh, A. T., & Sait, S. M. (2013). Binary particle swarm optimization (BPSO) based state assignment for area minimization of sequential circuits. Applied Soft Computing, 13(12), 4832–4840. El-Maleh., A. H., Sheikh, A. T., & Sait, S. M. (2013). Binary particle swarm optimization (BPSO) based state assignment for area minimization of sequential circuits. Applied Soft Computing, 13(12), 4832–4840.
19.
Zurück zum Zitat Elliott, R. J., Aggoun, L., & Moore, J. B. (2008). Hidden Markov models: estimation and control (Vol. 29). Berlin: Springer Science & Business Media.MATH Elliott, R. J., Aggoun, L., & Moore, J. B. (2008). Hidden Markov models: estimation and control (Vol. 29). Berlin: Springer Science & Business Media.MATH
20.
Zurück zum Zitat Jiang, W., Zhang, Y., & Wang, R. (2014). Comparative study on several pso algorithms. In Control and Decision Conference (2014 CCDC), The 26th Chinese (pp. 1117–1119). Jiang, W., Zhang, Y., & Wang, R. (2014). Comparative study on several pso algorithms. In Control and Decision Conference (2014 CCDC), The 26th Chinese (pp. 1117–1119).
21.
Zurück zum Zitat Jianxiu, H., & Jianchao, Z. (2007). A two-order particle swarm optimization model [j]. Journal of Computer Research and Development, 11, 004. Jianxiu, H., & Jianchao, Z. (2007). A two-order particle swarm optimization model [j]. Journal of Computer Research and Development, 11, 004.
22.
Zurück zum Zitat Kennedy, J., & Eberhart, R. C. (1995). Particle swarm optimization. In Proceedings of IEEE international conference neural networks (pp. 1942–1948). New York: IEEE. Kennedy, J., & Eberhart, R. C. (1995). Particle swarm optimization. In Proceedings of IEEE international conference neural networks (pp. 1942–1948). New York: IEEE.
23.
Zurück zum Zitat Knig, L., Mostaghim, S., & Schmeck, H. (2009). Decentralized evolution of robotic behavior using finite state machines. International Journal of Intelligent Computing and Cybernetics, 2(4), 695–723.MathSciNetCrossRef Knig, L., Mostaghim, S., & Schmeck, H. (2009). Decentralized evolution of robotic behavior using finite state machines. International Journal of Intelligent Computing and Cybernetics, 2(4), 695–723.MathSciNetCrossRef
24.
Zurück zum Zitat Lalaoui, M., El Afia, A., & Chiheb, R. (2016). Hidden markov model for a self-learning of simulated annealing cooling law. In 2016 5th international conference on multimedia computing and systems (ICMCS) (pp. 558–563. New York: IEEE. Lalaoui, M., El Afia, A., & Chiheb, R. (2016). Hidden markov model for a self-learning of simulated annealing cooling law. In 2016 5th international conference on multimedia computing and systems (ICMCS) (pp. 558–563. New York: IEEE.
25.
Zurück zum Zitat LaTorre, A., Muelas, S., & Peña, J.-M. (2015). A comprehensive comparison of large scale global optimizers. Information Sciences, 316, 517–549.CrossRef LaTorre, A., Muelas, S., & Peña, J.-M. (2015). A comprehensive comparison of large scale global optimizers. Information Sciences, 316, 517–549.CrossRef
26.
Zurück zum Zitat Li, C., Yang, S., & Nguyen, T. T. (2012). A self-learning particle swarm optimizer for global optimization problems. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 42(3), 627–646.CrossRef Li, C., Yang, S., & Nguyen, T. T. (2012). A self-learning particle swarm optimizer for global optimization problems. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 42(3), 627–646.CrossRef
27.
Zurück zum Zitat Liang, J. J., Qin, A. K., Suganthan, P. N., & Baskar, S. (2006). Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Transactions on Evolutionary Computation, 10(3), 281–295.CrossRef Liang, J. J., Qin, A. K., Suganthan, P. N., & Baskar, S. (2006). Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Transactions on Evolutionary Computation, 10(3), 281–295.CrossRef
28.
Zurück zum Zitat Li-li, L. I. U., & Xing-bao, G. A. O. (2012). An adaptive simulation of bacterial foraging algorithm. Basic Sciences Journal of Textile Universities, 4, 022. Li-li, L. I. U., & Xing-bao, G. A. O. (2012). An adaptive simulation of bacterial foraging algorithm. Basic Sciences Journal of Textile Universities, 4, 022.
29.
Zurück zum Zitat Mirjalili, S., Lewis, A., & Sadiq, A. S. (2014). Autonomous particles groups for particle swarm optimization. Arabian Journal for Science and Engineering, 39(6), 4683–4697.CrossRef Mirjalili, S., Lewis, A., & Sadiq, A. S. (2014). Autonomous particles groups for particle swarm optimization. Arabian Journal for Science and Engineering, 39(6), 4683–4697.CrossRef
30.
Zurück zum Zitat Rabiner, L. (1989). A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2), 257–286. Rabiner, L. (1989). A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2), 257–286.
31.
Zurück zum Zitat Risler, M. (2010). Behavior control for single and multiple autonomous agents based on hierarchical finite state machines. PhD thesis, tuprints. Risler, M. (2010). Behavior control for single and multiple autonomous agents based on hierarchical finite state machines. PhD thesis, tuprints.
32.
Zurück zum Zitat Sarhani, M.,& El Afia, A. (2015). Facing the feature selection problem with a binary pso-gsa approach. In The XI metaheuristics international conference (MIC), Agadir, Morocco. Sarhani, M.,& El Afia, A. (2015). Facing the feature selection problem with a binary pso-gsa approach. In The XI metaheuristics international conference (MIC), Agadir, Morocco.
33.
Zurück zum Zitat Shi, Y., Liu, H., Gao, L., & Zhang, G. (2011). Cellular particle swarm optimization. Inf. Sci., 181(20), 4460–4493.MathSciNetCrossRef Shi, Y., Liu, H., Gao, L., & Zhang, G. (2011). Cellular particle swarm optimization. Inf. Sci., 181(20), 4460–4493.MathSciNetCrossRef
34.
Zurück zum Zitat Soysal, O., & Şahin, E. (2006). A macroscopic model for self-organized aggregation in swarm robotic systems. In Swarm robotics (pp. 27–42. Berlin: Springer. Soysal, O., & Şahin, E. (2006). A macroscopic model for self-organized aggregation in swarm robotic systems. In Swarm robotics (pp. 27–42. Berlin: Springer.
35.
Zurück zum Zitat van den Bergh, F., & Engelbrecht, A. (2004). A cooperative approach to particle swarm optimization. IEEE Transactions on Evolutionary Computation, 8(3), 225–239.CrossRef van den Bergh, F., & Engelbrecht, A. (2004). A cooperative approach to particle swarm optimization. IEEE Transactions on Evolutionary Computation, 8(3), 225–239.CrossRef
36.
Zurück zum Zitat Veček, N., Črepinšek, M., & Mernik, M. (2017). On the influence of the number of algorithms, problems, and independent runs in the comparison of evolutionary algorithms. Applied Soft Computing, 54, 23–45.CrossRef Veček, N., Črepinšek, M., & Mernik, M. (2017). On the influence of the number of algorithms, problems, and independent runs in the comparison of evolutionary algorithms. Applied Soft Computing, 54, 23–45.CrossRef
37.
Zurück zum Zitat Vidal, E., Thollard, F., De La Higuera, C., Casacuberta, F., & Carrasco, R. C. (2005). Probabilistic finite-state machines-part ii. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(7), 1026–1039.CrossRef Vidal, E., Thollard, F., De La Higuera, C., Casacuberta, F., & Carrasco, R. C. (2005). Probabilistic finite-state machines-part ii. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(7), 1026–1039.CrossRef
38.
Zurück zum Zitat Wang, S., Chen, M., Huang, D., Guo, X., & Wang, C. (2014). Dream effected particle swarm optimization algorithm. Wang, S., Chen, M., Huang, D., Guo, X., & Wang, C. (2014). Dream effected particle swarm optimization algorithm.
39.
Zurück zum Zitat Wu, Z. (2014). Optimization of distribution route selection based on particle swarm algorithm. International Journal of Simulation Modelling (IJSIMM), 13(2), Wu, Z. (2014). Optimization of distribution route selection based on particle swarm algorithm. International Journal of Simulation Modelling (IJSIMM), 13(2),
40.
Zurück zum Zitat Yang, S., & Li, C. (2010). A clustering particle swarm optimizer for locating and tracking multiple optima in dynamic environments. IEEE Transactions on Evolutionary Computation. Yang, S., & Li, C. (2010). A clustering particle swarm optimizer for locating and tracking multiple optima in dynamic environments. IEEE Transactions on Evolutionary Computation.
41.
Zurück zum Zitat Zhan, Z.-H., Zhang, J., Li, Y., & Chung, H. S.-H. (2009). Adaptive particle swarm optimization. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 39(6), 1362–1381.CrossRef Zhan, Z.-H., Zhang, J., Li, Y., & Chung, H. S.-H. (2009). Adaptive particle swarm optimization. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 39(6), 1362–1381.CrossRef
Metadaten
Titel
A Probabilistic Finite State Machine Design of Particle Swarm Optimization
verfasst von
Abdellatif El Afia
Malek Sarhani
Oussama Aoun
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-319-95104-1_12