Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 8/2022

01-10-2021 | Research Article-Computer Engineering and Computer Science

An Improved Multi-objective Particle Swarm Optimization with Mutual Information Feedback Model and Its Application

Authors: Yuan Chen, Debao Chen, Yu Deng, Feng Zou, Ying Zheng, Minglan Fu, Chun Wang

Published in: Arabian Journal for Science and Engineering | Issue 8/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-objective optimization problems have been widely studied in the evolutionary computation domain, and many algorithms with evolutionary computation have been successfully adopted to solve multi-objective optimization problems. The information feedback model is an effective method to generate new individuals by combining previous and current information. It has been successfully used to improve the performance of particle swarm optimization to solve single-objective optimization problems. However, the current information feedback model has at least two drawbacks. First, the function evaluation number is increased for all individuals should be evaluated twice in a generation. Second, the model cannot directly be used to solve the multi-objective optimization problems because the update coefficient of the feedback model is difficult to determine for many objectives. To solve these problems, an information feedback model based on mutual information is developed to directly solve the multi-objective optimization problems. The model can be easily combined with any optimization algorithm. The model was used in particle swarm optimization to form a new multi-objective particle swarm optimization in this study. In this method, the external archive of multi-objective particle swarm optimization was built by non-dominated sorting method, the basic operator of multi-objective particle swarm optimization and the information feedback model based on mutual information were used to update individuals with different characters. The convergence and diversity of the population were better balanced. The effectiveness of the method was tested on non-constrained, constrained, and real-world problems. The results of the method were compared to those of some state-of-the-art multi-objective optimization problems. The comparisons indicate that the proposed algorithm is challenging in terms of the generational distance and spacing of solutions in multi-objective optimization problems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Miglierina, E.; Molho, E.; Recchioni, M.C.: Box-constrained multi-objective optimization : a gradient-like method without “a priori” scalarization. Eur. J. Oper. Res. 8(3), 662–682 (2008)MathSciNetCrossRef Miglierina, E.; Molho, E.; Recchioni, M.C.: Box-constrained multi-objective optimization : a gradient-like method without “a priori” scalarization. Eur. J. Oper. Res. 8(3), 662–682 (2008)MathSciNetCrossRef
2.
go back to reference Ehrgott, M.: Multicriteria Optimization, 2nd edn. Springer, Berlin (2005)MATH Ehrgott, M.: Multicriteria Optimization, 2nd edn. Springer, Berlin (2005)MATH
3.
go back to reference Coello, C.A.C.: Evolutionary multi-objective optimization: a historical view of the field. IEEE Comput. Comput. Intell. M. 1(1), 28–36 (2006)CrossRef Coello, C.A.C.: Evolutionary multi-objective optimization: a historical view of the field. IEEE Comput. Comput. Intell. M. 1(1), 28–36 (2006)CrossRef
4.
go back to reference Srinivas, N.; Deb, K.: Multi-objective optimization using nondominated sorting in genetic algorithms. Evol. Comput. 2(3), 221–248 (1994)CrossRef Srinivas, N.; Deb, K.: Multi-objective optimization using nondominated sorting in genetic algorithms. Evol. Comput. 2(3), 221–248 (1994)CrossRef
5.
go back to reference Deb, K.; Pratab, A.; Agrawal, S.; Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evo. Comput. 6(2), 182–197 (2000)CrossRef Deb, K.; Pratab, A.; Agrawal, S.; Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evo. Comput. 6(2), 182–197 (2000)CrossRef
6.
go back to reference Coello, C.A.C.; Salazar Lechuga, M.: MOPSO: a proposal for multiple objective particle swarm optimization, in: Congress on Evolutionary Computation (CEC’2002), vol. 1, IEEE Service Center, Piscataway, New Jersey, 2002, pp. 1051-1056 Coello, C.A.C.; Salazar Lechuga, M.: MOPSO: a proposal for multiple objective particle swarm optimization, in: Congress on Evolutionary Computation (CEC’2002), vol. 1, IEEE Service Center, Piscataway, New Jersey, 2002, pp. 1051-1056
7.
go back to reference Xue, F.; Sanderson, A.C.; Graves, R.J.: Pareto-based multi-objective differential evolution. In: Proceedings of the Congress on Evolutionary Computation 2003 (CEC’2003), 2, 862–869 (2003) Xue, F.; Sanderson, A.C.; Graves, R.J.: Pareto-based multi-objective differential evolution. In: Proceedings of the Congress on Evolutionary Computation 2003 (CEC’2003), 2, 862–869 (2003)
8.
go back to reference Raquel, C.R.; Naval, P.C.: An effective use of crowding distance in multiobjective particle swarm optimization, In: Proceedings of the Conference on Genetic and evolutionary computation, New York, USA, 2005: 257–264 Raquel, C.R.; Naval, P.C.: An effective use of crowding distance in multiobjective particle swarm optimization, In: Proceedings of the Conference on Genetic and evolutionary computation, New York, USA, 2005: 257–264
9.
go back to reference Zhu, G.P.; Kwong, S.: Gbest-guided artificial bee colony algorithm for numerical function optimization. Appl. Math. Comput. 217, 3166–3173 (2010)MathSciNetMATH Zhu, G.P.; Kwong, S.: Gbest-guided artificial bee colony algorithm for numerical function optimization. Appl. Math. Comput. 217, 3166–3173 (2010)MathSciNetMATH
10.
go back to reference Chen, D.B.; Zou, F.; Lu, R.Q.; Wang, P.: Learning backtracking search optimisation algorithm and its application. Inform. Sci. 376, 71–94 (2017)CrossRef Chen, D.B.; Zou, F.; Lu, R.Q.; Wang, P.: Learning backtracking search optimisation algorithm and its application. Inform. Sci. 376, 71–94 (2017)CrossRef
11.
go back to reference Neri, F.; Tirronen, V.: Recent advances in differential evolution: a survey and experimental analysis. Artif. Intell. Rev. 33, 61–106 (2010)CrossRef Neri, F.; Tirronen, V.: Recent advances in differential evolution: a survey and experimental analysis. Artif. Intell. Rev. 33, 61–106 (2010)CrossRef
12.
go back to reference Gao, W.F.; Liu, S.Y.; Huang, L.L.: A novel artificial bee colony algorithm based on modified search equation and orthogonal learning. IEEE Trans. Cybern. 43, 1011–1024 (2013)CrossRef Gao, W.F.; Liu, S.Y.; Huang, L.L.: A novel artificial bee colony algorithm based on modified search equation and orthogonal learning. IEEE Trans. Cybern. 43, 1011–1024 (2013)CrossRef
13.
go back to reference Li, C,; Yang, S.; Nguyen, T.T.: A self-learning particle swarm optimizer for global optimization problems, IEEE Trans. Sys. Man Cy. Part B, 42(3) (2012) 627–646 Li, C,; Yang, S.; Nguyen, T.T.: A self-learning particle swarm optimizer for global optimization problems, IEEE Trans. Sys. Man Cy. Part B, 42(3) (2012) 627–646
14.
go back to reference Wang, G.G.; Tian, Y.: Improving Metaheuristic Algorithms With Information Feedback Models. IEEE Trans. Cy. 99, 1–14 (2017) Wang, G.G.; Tian, Y.: Improving Metaheuristic Algorithms With Information Feedback Models. IEEE Trans. Cy. 99, 1–14 (2017)
15.
go back to reference Zhang, Y.; Wang, G.G.; Li, K.Q., et al.: Enhancing MOEA/D with Information Feedback Models for Large-Scale Many-Objective Optimization. Inform. Sci. 522, 1–16 (2020)MathSciNetCrossRef Zhang, Y.; Wang, G.G.; Li, K.Q., et al.: Enhancing MOEA/D with Information Feedback Models for Large-Scale Many-Objective Optimization. Inform. Sci. 522, 1–16 (2020)MathSciNetCrossRef
16.
go back to reference He, X.G.; Guan, H.; Qin, J.: A hybrid wavelet neural network model with mutual information and particle swarm optimization for forecasting monthly rainfall. J. Hydrol. 527(17), 88–100 (2015)CrossRef He, X.G.; Guan, H.; Qin, J.: A hybrid wavelet neural network model with mutual information and particle swarm optimization for forecasting monthly rainfall. J. Hydrol. 527(17), 88–100 (2015)CrossRef
17.
go back to reference Song, X.F.; Zhang, Y.; Gong, D.W.; Sun, X.Y.: Feature selection using bare-bones particle swarm optimization with mutual information. Pattern Recognit. 112, 107804 (2021)CrossRef Song, X.F.; Zhang, Y.; Gong, D.W.; Sun, X.Y.: Feature selection using bare-bones particle swarm optimization with mutual information. Pattern Recognit. 112, 107804 (2021)CrossRef
18.
go back to reference Wang, Z.; Li, M.; Li, J.: A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure. Inf. Sci. 307, 73–88 (2015)MathSciNetCrossRef Wang, Z.; Li, M.; Li, J.: A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure. Inf. Sci. 307, 73–88 (2015)MathSciNetCrossRef
19.
go back to reference Han, M.; Ren, W.: Global mutual information-based feature selection approach using single-objective and multi-objective optimization. Neurocomputing 168, 47–54 (2015)CrossRef Han, M.; Ren, W.: Global mutual information-based feature selection approach using single-objective and multi-objective optimization. Neurocomputing 168, 47–54 (2015)CrossRef
20.
go back to reference Coello, C.A.C.; Pulido, G.T.; Lechuga, M.S.: Handling multiple objectives with particle swarm optimization. IEEE Trans. Evol. Comput. 8(3), 256–279 (2004)CrossRef Coello, C.A.C.; Pulido, G.T.; Lechuga, M.S.: Handling multiple objectives with particle swarm optimization. IEEE Trans. Evol. Comput. 8(3), 256–279 (2004)CrossRef
21.
go back to reference Veldhuizen, D.A.V.; Lamont, G.B.: Evolutionary Computation and Convergence to a Pareto Front, In: Koza, J.R. (ed.), Late Breaking Papers at the Genetic Programming 1998 Conference, Stanford University, California, July 1998. 221–228 (1998) Veldhuizen, D.A.V.; Lamont, G.B.: Evolutionary Computation and Convergence to a Pareto Front, In: Koza, J.R. (ed.), Late Breaking Papers at the Genetic Programming 1998 Conference, Stanford University, California, July 1998. 221–228 (1998)
22.
go back to reference Schott, J.R.: Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization, Master's thesis, Department of Aeronautics and Astronautics, Massachusetts Institute of Technology, Cambridge, Massachusetts, (1995) Schott, J.R.: Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization, Master's thesis, Department of Aeronautics and Astronautics, Massachusetts Institute of Technology, Cambridge, Massachusetts, (1995)
23.
go back to reference Chen, D.B.; Zou, F.; Wang, J.T.: A multi-objective endocrine PSO algorithm and application. Appl. Soft Comput. 11, 4508–4520 (2011)CrossRef Chen, D.B.; Zou, F.; Wang, J.T.: A multi-objective endocrine PSO algorithm and application. Appl. Soft Comput. 11, 4508–4520 (2011)CrossRef
24.
go back to reference Zhang, Q.F.; Zhou, A.M.; Jin, Y.C.: RM-MEDA: a regularity model-based multi-objective estimation of distribution algorithm. IEEE Trans. Evol. Comput. 12(1), 182–197 (2008) Zhang, Q.F.; Zhou, A.M.; Jin, Y.C.: RM-MEDA: a regularity model-based multi-objective estimation of distribution algorithm. IEEE Trans. Evol. Comput. 12(1), 182–197 (2008)
26.
go back to reference Mirjalili, S.: Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems. Neural Comput. Appl. 27(4), 1053–1073 (2016)MathSciNetCrossRef Mirjalili, S.: Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems. Neural Comput. Appl. 27(4), 1053–1073 (2016)MathSciNetCrossRef
27.
go back to reference Zhang, Q.; Zhou, A.; Zhao, S.; Suganthan, P. N.; Liu, W., Tiwari, S.: Multiobjective optimization Test Instances for the CEC 2009 SpecialSession and Competition. Tech. Rep. CES-487, (2007) Zhang, Q.; Zhou, A.; Zhao, S.; Suganthan, P. N.; Liu, W., Tiwari, S.: Multiobjective optimization Test Instances for the CEC 2009 SpecialSession and Competition. Tech. Rep. CES-487, (2007)
28.
go back to reference Yang, Y.K.; Liu, J.C.; Tan, S.B.: A constrained multi-objective evolutionary algorithm based on decomposition and dynamic constraint-handling mechanism. Appl. Soft Comput. 89, 106–104 (2020)CrossRef Yang, Y.K.; Liu, J.C.; Tan, S.B.: A constrained multi-objective evolutionary algorithm based on decomposition and dynamic constraint-handling mechanism. Appl. Soft Comput. 89, 106–104 (2020)CrossRef
29.
go back to reference Pallli, N.; Azram, S.; McCluskey, P., et al.: An interactive multistage ε-inequality constraint method for multiple objectives decision making. ASME J. Mech. Design 120(4), 678–686 (1999)CrossRef Pallli, N.; Azram, S.; McCluskey, P., et al.: An interactive multistage ε-inequality constraint method for multiple objectives decision making. ASME J. Mech. Design 120(4), 678–686 (1999)CrossRef
30.
go back to reference Yang, B.S.; Yeun, Y.S.; Ruy, W.S.: Managing approximation models in multi-objective optimization. Struct. Multidiscip. O. 24, 141–156 (2002)CrossRef Yang, B.S.; Yeun, Y.S.; Ruy, W.S.: Managing approximation models in multi-objective optimization. Struct. Multidiscip. O. 24, 141–156 (2002)CrossRef
Metadata
Title
An Improved Multi-objective Particle Swarm Optimization with Mutual Information Feedback Model and Its Application
Authors
Yuan Chen
Debao Chen
Yu Deng
Feng Zou
Ying Zheng
Minglan Fu
Chun Wang
Publication date
01-10-2021
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 8/2022
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-06178-2

Other articles of this Issue 8/2022

Arabian Journal for Science and Engineering 8/2022 Go to the issue

RESEARCH ARTICLE-COMPUTER ENGINEERING AND COMPUTER SCIENCE

Upgrading the Quality of Power Using TVSS Device and PFC Converter Fed SBLDC Motor

Premium Partners