Skip to main content
Top
Published in: Progress in Artificial Intelligence 4/2019

26-04-2019 | Regular Paper

Adaptive cooperation of multi-swarm particle swarm optimizer-based hidden Markov model

Authors: Abdellatif El Afia, Oussama Aoun, Salvador Garcia

Published in: Progress in Artificial Intelligence | Issue 4/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The classical PSO algorithm can be affected with premature convergence when it comes to more complex optimization problems; the resolution easily can be trapped into local optima. The primary concern is to accelerate the convergence speed and to prevent the local optima solutions. To defeat these weaknesses and to enhance the overall performances, a new technique is offered building a dynamic multi-swarm design with cooperative rules based on a machine-learning design, namely the hidden Markov classification model. In this approach, a new design with multiple processes implemented inside the PSO that are the control of parameters adaptively with the improvement in the topological structure by setting a multi-swarm layer. Another process of information exchange between swarms is also considered. According to an HMM classification, the entire swarm will be then divided into dynamic cooperating sub-swarms. The size of each sub-swarm is going to be also adjusted at each iteration to suit the search stage. All sub-swarms share information between each other in order to ensure the best exploration of the search space and most effective exploitation. Adaptiveness of both acceleration coefficient and inertia weight strategies is customized with the account of the multi-swarm dynamic evolution and the history of achievements. The approach is simulated and compared by experimental tests to the best-known state of the art.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aoun, O., El Afia, A., Garcia, S.: Self inertia weight adaptation for the particle swarm optimization. In: Proceedings of the International Conference on Learning and Optimization Algorithms: Theory and Applications, p. 8. ACM (2018) Aoun, O., El Afia, A., Garcia, S.: Self inertia weight adaptation for the particle swarm optimization. In: Proceedings of the International Conference on Learning and Optimization Algorithms: Theory and Applications, p. 8. ACM (2018)
2.
go back to reference Aoun, O., Sarhani, M., El Afia, A.: Hidden markov model classifier for the adaptive particle swarm optimization. In: The XI Metaheuristics International Conference (MIC), Agadir, Morocco, 7–10 (2015) Aoun, O., Sarhani, M., El Afia, A.: Hidden markov model classifier for the adaptive particle swarm optimization. In: The XI Metaheuristics International Conference (MIC), Agadir, Morocco, 7–10 (2015)
3.
go back to reference Aoun, O. Sarhani, M., El Afia, A.: Investigation of hidden Markov model for the tuning of metaheuristics in airline scheduling problems. IFAC-PapersOnLine. In: 14th IFAC Symposium on Control in Transportation Systems CTS 2016, vol. 49, issue 3, pp. 347–352 (2016) Aoun, O. Sarhani, M., El Afia, A.: Investigation of hidden Markov model for the tuning of metaheuristics in airline scheduling problems. IFAC-PapersOnLine. In: 14th IFAC Symposium on Control in Transportation Systems CTS 2016, vol. 49, issue 3, pp. 347–352 (2016)
4.
go back to reference Aoun, O., Sarhani,M., El Afia, A.: Hidden Markov model classifier for the adaptive particle swarm optimization. In: Recent Developments in Metaheuristics, pp. 1–15. Springer (2018) Aoun, O., Sarhani,M., El Afia, A.: Hidden Markov model classifier for the adaptive particle swarm optimization. In: Recent Developments in Metaheuristics, pp. 1–15. Springer (2018)
5.
go back to reference Aoun, O., El Afia, A., Sarhani, M.: Hidden Markov model control of inertia weight adaptation for particle swarm optimization. IFAC-PapersOnLine 50(1), 9997–10002 (2017)CrossRef Aoun, O., El Afia, A., Sarhani, M.: Hidden Markov model control of inertia weight adaptation for particle swarm optimization. IFAC-PapersOnLine 50(1), 9997–10002 (2017)CrossRef
6.
go back to reference Aoun, O., Sarhani, M., El Afia, A.: Particle swarm optimisation with population size and acceleration coefficients adaptation using hidden Markov model state classification. Int. J. Metaheuristics 7(1), 1–29 (2018)CrossRef Aoun, O., Sarhani, M., El Afia, A.: Particle swarm optimisation with population size and acceleration coefficients adaptation using hidden Markov model state classification. Int. J. Metaheuristics 7(1), 1–29 (2018)CrossRef
7.
go back to reference Aydin, M.: Coordinating metaheuristic agents with swarm intelligence. J. Intell. Manuf. 23(4), 991–999 (2012)CrossRef Aydin, M.: Coordinating metaheuristic agents with swarm intelligence. J. Intell. Manuf. 23(4), 991–999 (2012)CrossRef
8.
go back to reference Blackwell, T., Branke, J., et al.: Multi-swarm optimization in dynamic environments. In: EvoWorkshops, vol. 3005, pp. 489–500. Springer (2004) Blackwell, T., Branke, J., et al.: Multi-swarm optimization in dynamic environments. In: EvoWorkshops, vol. 3005, pp. 489–500. Springer (2004)
9.
go back to reference Cheung, N.J., Ding, X.-M., Shen, H.-B.: Optifel: a convergent heterogeneous particle swarm optimization algorithm for takagi–sugeno fuzzy modeling. IEEE Trans. Fuzzy Syst. 22(4), 919–933 (2014)CrossRef Cheung, N.J., Ding, X.-M., Shen, H.-B.: Optifel: a convergent heterogeneous particle swarm optimization algorithm for takagi–sugeno fuzzy modeling. IEEE Trans. Fuzzy Syst. 22(4), 919–933 (2014)CrossRef
10.
go back to reference Chou, C.-W., Lin, J.-H., Yang, C.-H., Tsai, H.-L., Ou, Y.-H.: Constructing a markov chain on particle swarm optimizer. In: 2012 Third International Conference on Innovations in Bio-Inspired Computing and Applications (IBICA), pp. 13–18. IEEE (2012) Chou, C.-W., Lin, J.-H., Yang, C.-H., Tsai, H.-L., Ou, Y.-H.: Constructing a markov chain on particle swarm optimizer. In: 2012 Third International Conference on Innovations in Bio-Inspired Computing and Applications (IBICA), pp. 13–18. IEEE (2012)
11.
go back to reference Chou, C.-W., Lin, J.-H., Jeng, R.: Markov chain and adaptive parameter selection on particle swarm optimizer. Int. J. Soft Comput. 4(2), 1 (2013)CrossRef Chou, C.-W., Lin, J.-H., Jeng, R.: Markov chain and adaptive parameter selection on particle swarm optimizer. Int. J. Soft Comput. 4(2), 1 (2013)CrossRef
12.
go back to reference Dorigo, M., Gambardella, L.M.: Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans. Evolut. Comput. 1(1), 53–66 (1997)CrossRef Dorigo, M., Gambardella, L.M.: Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans. Evolut. Comput. 1(1), 53–66 (1997)CrossRef
13.
go back to reference Dupont, P., Denis, F., Esposito, Y.: Links between probabilistic automata and hidden Markov models: probability distributions, learning models and induction algorithms. Pattern Recogn. 38(9), 1349–1371 (2005)CrossRef Dupont, P., Denis, F., Esposito, Y.: Links between probabilistic automata and hidden Markov models: probability distributions, learning models and induction algorithms. Pattern Recogn. 38(9), 1349–1371 (2005)CrossRef
14.
go back to reference Durand, N., Alliot, J.-M.: Genetic crossover operator for partially separable functions. In: GP 1998, 3rd Annual Conference on Genetic Programming, (1998) Durand, N., Alliot, J.-M.: Genetic crossover operator for partially separable functions. In: GP 1998, 3rd Annual Conference on Genetic Programming, (1998)
15.
go back to reference El Afia, A., Sarhani, M., Aoun, O.: A probabilistic finite state machine design of particle swarm optimization. In: Bioinspired Heuristics for Optimization, pp. 185–201. Springer (2019) El Afia, A., Sarhani, M., Aoun, O.: A probabilistic finite state machine design of particle swarm optimization. In: Bioinspired Heuristics for Optimization, pp. 185–201. Springer (2019)
16.
go back to reference Engelbrecht, A.P.: Heterogeneous particle swarm optimization. In: International Conference on Swarm Intelligence, pp. 191–202. Springer (2010) Engelbrecht, A.P.: Heterogeneous particle swarm optimization. In: International Conference on Swarm Intelligence, pp. 191–202. Springer (2010)
17.
go back to reference Jiang, W., Zhang, Y., Wang, R.: Comparative study on several pso algorithms. In: Control and Decision Conference (2014 CCDC), The 26th Chinese, pp. 1117–1119 (2014) Jiang, W., Zhang, Y., Wang, R.: Comparative study on several pso algorithms. In: Control and Decision Conference (2014 CCDC), The 26th Chinese, pp. 1117–1119 (2014)
18.
go back to reference Jianxiu, H., Jianchao, Z.: A two-order particle swarm optimization model. J. Comput. Res. Dev. 11, 004 (2007) Jianxiu, H., Jianchao, Z.: A two-order particle swarm optimization model. J. Comput. Res. Dev. 11, 004 (2007)
19.
go back to reference Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings of IEEE International Conference Neural Networks, IEEE, pp. 1942–8 (1995) Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings of IEEE International Conference Neural Networks, IEEE, pp. 1942–8 (1995)
20.
go back to reference Li, J., Xiao, X.: Multi-swarm and multi-best particle swarm optimization algorithm. In: 7th World Congress on Intelligent Control and Automation. WCICA 2008, pp. 6281–6286. IEEE (2008) Li, J., Xiao, X.: Multi-swarm and multi-best particle swarm optimization algorithm. In: 7th World Congress on Intelligent Control and Automation. WCICA 2008, pp. 6281–6286. IEEE (2008)
21.
go back to reference Li, C., Yang, S., Nguyen, T.T.: A self-learning particle swarm optimizer for global optimization problems. IEEE Trans. Syst. Man Cybern. Part B Cybern. 42(3), 627–646 (2012)CrossRef Li, C., Yang, S., Nguyen, T.T.: A self-learning particle swarm optimizer for global optimization problems. IEEE Trans. Syst. Man Cybern. Part B Cybern. 42(3), 627–646 (2012)CrossRef
22.
go back to reference Liang, J.J., Qin, A.K., Suganthan, P.N., Baskar, S.: Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans. Evolut. Comput. 10(3), 281–295 (2006)CrossRef Liang, J.J., Qin, A.K., Suganthan, P.N., Baskar, S.: Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans. Evolut. Comput. 10(3), 281–295 (2006)CrossRef
23.
go back to reference Li-li, L.I.U., Xing-bao, G.A.O.: An adaptive simulation of bacterial foraging algorithm. Basic Sci. J. Text. Univ. 4, 022 (2012) Li-li, L.I.U., Xing-bao, G.A.O.: An adaptive simulation of bacterial foraging algorithm. Basic Sci. J. Text. Univ. 4, 022 (2012)
24.
go back to reference Liu, Yu., Qin, Z., Shi, Z., Jiang, L.: Center particle swarm optimization. Neurocomputing 70(4–6), 672–679 (2007)CrossRef Liu, Yu., Qin, Z., Shi, Z., Jiang, L.: Center particle swarm optimization. Neurocomputing 70(4–6), 672–679 (2007)CrossRef
25.
go back to reference Mirjalili, S., Lewis, A., Safa Sadiq, A.: Autonomous particles groups for particle swarm optimization. Arab. J. Sci. Eng. 39(6), 4683–4697 (2014)CrossRef Mirjalili, S., Lewis, A., Safa Sadiq, A.: Autonomous particles groups for particle swarm optimization. Arab. J. Sci. Eng. 39(6), 4683–4697 (2014)CrossRef
26.
go back to reference Monett Diaz D. Agent-based configuration of (metaheuristic) algorithms. PhD thesis, Humboldt University of Berlin (2005) Monett Diaz D. Agent-based configuration of (metaheuristic) algorithms. PhD thesis, Humboldt University of Berlin (2005)
27.
go back to reference Montes De Oca, M.A., Stützle, T., Van den Enden, K., Dorigo, M.: Incremental social learning in particle swarms. IEEE Trans. Syst. Man Cybern. Part B Cybern. 41(2), 368–384 (2011)CrossRef Montes De Oca, M.A., Stützle, T., Van den Enden, K., Dorigo, M.: Incremental social learning in particle swarms. IEEE Trans. Syst. Man Cybern. Part B Cybern. 41(2), 368–384 (2011)CrossRef
28.
go back to reference Niu, B., Zhu, Y., He, X., Henry, W.: Mcpso: a multi-swarm cooperative particle swarm optimizer. Appl. Math. Comput. 185(2), 1050–1062 (2007)MATH Niu, B., Zhu, Y., He, X., Henry, W.: Mcpso: a multi-swarm cooperative particle swarm optimizer. Appl. Math. Comput. 185(2), 1050–1062 (2007)MATH
29.
go back to reference Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)CrossRef Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)CrossRef
30.
go back to reference Schaeffer, J., Lu, P., Szafron, D., Lake, R.: A re-examination of brute-force search. In: Proceedings of the AAAI Fall Symposium on Games: Planning and Learning, pp. 51–58 (1993) Schaeffer, J., Lu, P., Szafron, D., Lake, R.: A re-examination of brute-force search. In: Proceedings of the AAAI Fall Symposium on Games: Planning and Learning, pp. 51–58 (1993)
31.
go back to reference Stützle, T., López-Ibáñez, M.: Automated design of metaheuristic algorithms. In: Handbook of metaheuristics, pp. 541–579. Springer (2019) Stützle, T., López-Ibáñez, M.: Automated design of metaheuristic algorithms. In: Handbook of metaheuristics, pp. 541–579. Springer (2019)
32.
go back to reference Sun, J., Lai, C.-H., Wu, X.-J.: Particle Swarm Optimisation: Classical and Quantum Perspectives. CRC Press, Boca Raton (2016)CrossRef Sun, J., Lai, C.-H., Wu, X.-J.: Particle Swarm Optimisation: Classical and Quantum Perspectives. CRC Press, Boca Raton (2016)CrossRef
33.
go back to reference van den Bergh, F., Engelbrecht, A.: A cooperative approach to particle swarm optimization. IEEE Trans. Evol. Comput. 8(3), 225–239 (2004)CrossRef van den Bergh, F., Engelbrecht, A.: A cooperative approach to particle swarm optimization. IEEE Trans. Evol. Comput. 8(3), 225–239 (2004)CrossRef
34.
go back to reference Wang, S., Chen, M., Huang, D., Guo, X., Wang, C.: Dream effected particle swarm optimization algorithm. J. Inf. Comput. Sci. 11(15), 5631 (2014)CrossRef Wang, S., Chen, M., Huang, D., Guo, X., Wang, C.: Dream effected particle swarm optimization algorithm. J. Inf. Comput. Sci. 11(15), 5631 (2014)CrossRef
35.
go back to reference Wu, Z.: Optimization of distribution route selection based on particle swarm algorithm. Int. J. Simul. Model 13(2), 230–243 (2014)CrossRef Wu, Z.: Optimization of distribution route selection based on particle swarm algorithm. Int. J. Simul. Model 13(2), 230–243 (2014)CrossRef
36.
go back to reference Yang, S., Li, C.: A clustering particle swarm optimizer for locating and tracking multiple optima in dynamic environments. IEEE Trans. Evolut. Comput. 14, 959–974 (2010)CrossRef Yang, S., Li, C.: A clustering particle swarm optimizer for locating and tracking multiple optima in dynamic environments. IEEE Trans. Evolut. Comput. 14, 959–974 (2010)CrossRef
37.
go back to reference Zhan, Z.-H., Zhang, J., Li, Y., Chung, H.S.-H.: Adaptive particle swarm optimization. IEEE Trans. Syst. Man Cybern. Part B Cybern. 39(6), 1362–1381 (2009)CrossRef Zhan, Z.-H., Zhang, J., Li, Y., Chung, H.S.-H.: Adaptive particle swarm optimization. IEEE Trans. Syst. Man Cybern. Part B Cybern. 39(6), 1362–1381 (2009)CrossRef
38.
go back to reference Zhang, J., Ding, X.: A multi-swarm self-adaptive and cooperative particle swarm optimization. Eng. Appl. Artif. Intell. 24(6), 958–967 (2011)CrossRef Zhang, J., Ding, X.: A multi-swarm self-adaptive and cooperative particle swarm optimization. Eng. Appl. Artif. Intell. 24(6), 958–967 (2011)CrossRef
Metadata
Title
Adaptive cooperation of multi-swarm particle swarm optimizer-based hidden Markov model
Authors
Abdellatif El Afia
Oussama Aoun
Salvador Garcia
Publication date
26-04-2019
Publisher
Springer Berlin Heidelberg
Published in
Progress in Artificial Intelligence / Issue 4/2019
Print ISSN: 2192-6352
Electronic ISSN: 2192-6360
DOI
https://doi.org/10.1007/s13748-019-00183-1

Other articles of this Issue 4/2019

Progress in Artificial Intelligence 4/2019 Go to the issue

Premium Partner