Top

Structural and Multidisciplinary Optimization

Published in:

01-04-2024 | Research

A Kriging-assisted multi-stage evolutionary algorithm for expensive many-objective optimization problems

Authors: Qinghua Gu, Xueqing Wang, Dan Wang, Di Liu

Published in: Structural and Multidisciplinary Optimization | Issue 4/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

For expensive problems, as the number of objectives and the number of decision variables increase, the number of non-dominated solutions in the population increases dramatically, and the population does not have enough convergence pressure to converge to the true pareto frontier. A Kriging-assisted Multi-stage Evolutionary Algorithm (K-MSEA) is proposed to enhance the exploratory capacity of populations in expensive many-objective optimization problems. A multi-stage strategy is used in K-MSEA. Mating selection and environmental selection of populations are divided into three stages based on convergence and diversity indices. Targeted selection of individuals should be conducted at each stage of population development. The population independently chooses the appropriate stage in accordance with the current demands of convergence and diversity. Differential evolutionary algorithm is used to improve the search ability of the population. To guide the population in the correct direction, K-MSEA employs an elite retention strategy in environmental selection. The population utilizes individual renewal, where underperforming parents are replaced by better-performing offspring. The surrogate model is then updated with the uncertainty information supplied by the Kriging model. Finally, K-MSEA is benchmarked against five other algorithms in experiments on two benchmark problems and two realistic expensive problems. Mathematical analysis demonstrates that K-MSEA is more competitive than others.

previous article A novel multi-fidelity cokriging model assisted by multiple non-hierarchical low-fidelity datasets

next article A cutting plane approach to maximization of fundamental frequency in truss topology optimization

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Cai X, Gao L, Li X (2020) Efficient generalized surrogate-assisted evolutionary algorithm for high-dimensional expensive problems. IEEE Trans Evol Comput 24:365–379. https://doi.org/10.1109/TEVC.2019.2919762CrossRef

Cheng R, Jin Y, Olhofer M, Sendhoff B (2016) A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 20:773–791. https://doi.org/10.1109/TEVC.2016.2519378CrossRef

Cheng R, Li M, Tian Y, Zhang X, Yang S, Jin Y, Yao X (2017) A benchmark test suite for evolutionary many-objective optimization. Complex Intell Syst 3:67–81. https://doi.org/10.1007/s40747-017-0039-7CrossRef

Chugh T, Jin Y, Miettinen K et al (2018) A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization. IEEE Trans Evol Comput 22:129–142. https://doi.org/10.1109/TEVC.2016.2622301CrossRef

Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273–297. https://doi.org/10.1007/BF00994018CrossRef

Deb K, Pratap A, Agarwal S, Meyarivan T (2002a) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6:182–197. https://doi.org/10.1109/4235.996017CrossRef

Deb K, Gupta S, Daum D, Branke J, Mall AK, Padmanabhan D (2009) Reliability-based optimization using evolutionary algorithms. IEEE Trans Evol Comput 13:1054–1074. https://doi.org/10.1109/TEVC.2009.2014361CrossRef

Deb K, Thiele L, Laumanns M, Zitzler E (2002b) Scalable multi-objective optimization test problems. In: Proceedings of the 2002 Congress on Evolutionary Computation. CEC’02 (Cat. No.02TH8600). vol 1, pp 825–830

Díaz-Manríquez A, Toscano G, Barron-Zambrano JH, Tello-Leal E (2016) A review of surrogate assisted multiobjective evolutionary algorithms. Comput Intell Neurosci 2016:1–14. https://doi.org/10.1155/2016/9420460CrossRef

Dong J, Gong W, Ming F, Wang L (2022) A two-stage evolutionary algorithm based on three indicators for constrained multi-objective optimization. Expert Syst Appl 195:116499. https://doi.org/10.1016/j.eswa.2022.116499CrossRef

Fay MP, Proschan MA (2010) Wilcoxon-Mann-Whitney or t-test? On assumptions for hypothesis tests and multiple interpretations of decision rules. Stat Surv 4:1–39. https://doi.org/10.1214/09-SS051MathSciNetCrossRefPubMedPubMedCentral

Gu Q, Zhou Y, Li X, Ruan S (2021) A surrogate-assisted radial space division evolutionary algorithm for expensive many-objective optimization problems. Appl Soft Comput 111:107703. https://doi.org/10.1016/j.asoc.2021.107703CrossRef

Guo D, Jin Y, Ding J, Chai T (2019) Heterogeneous ensemble-based infill criterion for evolutionary multiobjective optimization of expensive problems. IEEE Trans Cybern 49:1012–1025. https://doi.org/10.1109/TCYB.2018.2794503CrossRefPubMed

Guo D, Chai T, Ding J, Jin Y (2016) Small data driven evolutionary multi-objective optimization of fused magnesium furnaces. In: 2016 IEEE Symposium Series on Computational Intelligence (SSCI). pp 1–8

Hao H, Zhou A, Qian H, Zhang H (2022) Expensive Multiobjective optimization by relation learning and prediction. IEEE Trans Evol Comput 26:1157–1170. https://doi.org/10.1109/TEVC.2022.3152582CrossRef

He C, Tian Y, Jin Y, Zhang X, Pan L (2017) A radial space division based evolutionary algorithm for many-objective optimization. Appl Soft Comput 61:603–621. https://doi.org/10.1016/j.asoc.2017.08.024CrossRef

Hoffman P, Grinstein G, Marx K, Grosse I, Stanley E (1997) DNA visual and analytic data mining. In: Proceedings. Visualization ’97 (Cat. No. 97CB36155). pp 437–441

Jeong S, Murayama M, Yamamoto K (2005) Efficient optimization design method using Kriging model. J Aircr 42:413–420. https://doi.org/10.2514/1.6386

Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol Comput 1:61–70. https://doi.org/10.1016/j.swevo.2011.05.001CrossRef

Jin Y, Sendhoff B (2009) A systems approach to evolutionary multiobjective structural optimization and beyond. IEEE Comput Intell Mag 4:62–76. https://doi.org/10.1109/MCI.2009.933094CrossRef

Li F, Cai X, Gao L, Shen W (2021) A surrogate-assisted multiswarm optimization algorithm for high-dimensional computationally expensive problems. IEEE Trans Cybern 51:1390–1402. https://doi.org/10.1109/TCYB.2020.2967553CrossRefPubMed

Liu Q, Cheng R, Jin Y et al (2022) Reference vector-assisted adaptive model management for surrogate-assisted many-objective optimization. IEEE Trans Syst Man Cybern Syst 52:7760–7773. https://doi.org/10.1109/TSMC.2022.3163129CrossRef

Lluvia O-E, Manuel EGV, Chen Lu et al (2018) Industrial application of surrogate models to optimize crude oil distillation units. Chem Eng Trans 69:289–294. https://doi.org/10.3303/CET1869049CrossRef

Pan L, He C, Tian Y et al (2019) A classification-based surrogate-assisted evolutionary algorithm for expensive many-objective optimization. IEEE Trans Evol Comput 23:74–88. https://doi.org/10.1109/TEVC.2018.2802784CrossRef

Park J, Sandberg IW (1991) Universal approximation using Radial-Basis-Function Networks. Neural Comput 3:246–257. https://doi.org/10.1162/neco.1991.3.2.246

Pike DJ (1988) Empirical model-building and response surfaces. J R Stat Soc Ser A Stat Soc 151:223–224. https://doi.org/10.2307/2982196CrossRef

Qin S, Sun C, Liu Q, Jin Y (2023) A performance indicator-based infill criterion for expensive multi-/many-objective optimization. IEEE Trans Evol Comput 27:1085–1099. https://doi.org/10.1109/TEVC.2023.3237605CrossRef

Ren Z, Sun C, Tan Y et al (2021) A bi-stage surrogate-assisted hybrid algorithm for expensive optimization problems. Complex Intell Syst 7:1391–1405. https://doi.org/10.1007/s40747-021-00277-1CrossRef

Song Z, Wang H, He C, Jin Y (2021) A Kriging-assisted two-archive evolutionary algorithm for expensive many-objective optimization. IEEE Trans Evol Comput 25:1013–1027. https://doi.org/10.1109/TEVC.2021.3073648CrossRef

Storn R, Price K (1997) Differential evolution – A simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359. https://doi.org/10.1023/A:1008202821328MathSciNetCrossRef

Sun Y, Yen GG, Yi Z (2019) IGD indicator-based evolutionary algorithm for many-objective optimization problems. IEEE Trans Evol Comput 23:173–187. https://doi.org/10.1109/TEVC.2018.2791283CrossRef

Tian Y, Cheng R, Zhang X, Jin Y (2017) PlatEMO: a MATLAB platform for evolutionary multi-objective optimization [Educational Forum]. IEEE Comput Intell Mag 12:73–87. https://doi.org/10.1109/MCI.2017.2742868CrossRef

Tian Y, Cheng R, Zhang X et al (2018) An indicator-based multiobjective evolutionary algorithm with reference point adaptation for better versatility. IEEE Trans Evol Comput 22:609–622. https://doi.org/10.1109/TEVC.2017.2749619CrossRef

Tian Y, He C, Cheng R, Zhang X (2021) A multistage evolutionary algorithm for better diversity preservation in multiobjective optimization. IEEE Trans Syst Man Cybern Syst 51:5880–5894. https://doi.org/10.1109/TSMC.2019.2956288CrossRef

Tian Y, Hu J, He C et al (2023) A pairwise comparison based surrogate-assisted evolutionary algorithm for expensive multi-objective optimization. Swarm Evol Comput 80:101323. https://doi.org/10.1016/j.swevo.2023.101323CrossRef

Walker DJ, RichardM E, Fieldsend JE (2013) Visualizing mutually nondominating solution sets in many-objective optimization. IEEE Trans Evol Comput 17:165–184. https://doi.org/10.1109/TEVC.2012.2225064CrossRef

Wang Y, Yin D-Q, Yang S, Sun G (2019) Global and local surrogate-assisted differential evolution for expensive constrained optimization problems with inequality constraints. IEEE Trans Cybern 49:1642–1656. https://doi.org/10.1109/TCYB.2018.2809430CrossRefPubMed

Wang X, Jin Y, Schmitt S, Olhofer M (2020) An adaptive Bayesian approach to surrogate-assisted evolutionary multi-objective optimization. Inf Sci 519:317–331. https://doi.org/10.1016/j.ins.2020.01.048MathSciNetCrossRef

While L, Hingston P, Barone L, Huband S (2006) A faster algorithm for calculating hypervolume. IEEE Trans Evol Comput 10:29–38. https://doi.org/10.1109/TEVC.2005.851275CrossRef

Xu Y, Zhang H, Zeng X, Nojima Y (2022) An adaptive convergence enhanced evolutionary algorithm for many-objective optimization problems. Swarm Evol Comput 75:101180. https://doi.org/10.1016/j.swevo.2022.101180CrossRef

Zhang Q, Liu W, Tsang E, Virginas B (2010) Expensive multiobjective optimization by MOEA/D with Gaussian process model. IEEE Trans Evol Comput 14(3):456–474. https://doi.org/10.1109/TEVC.2009.2033671CrossRef

Zhao Y, Zhao J, Zeng J, Tan Y (2022) A two-stage infill strategy and surrogate-ensemble assisted expensive many-objective optimization. Complex Intell Syst 8:5047–5063. https://doi.org/10.1007/s40747-022-00751-4CrossRef

Zhou A, Jin Y, Zhang Q, Sendhoff B, Tsang E (2006) Combining Model-based and Genetics-based Offspring Generation for Multi-objective Optimization Using a Convergence Criterion. In: 2006 IEEE International Conference on Evolutionary Computation. pp 892–899

Title: A Kriging-assisted multi-stage evolutionary algorithm for expensive many-objective optimization problems
Authors: Qinghua Gu
Xueqing Wang
Dan Wang
Di Liu
Publication date: 01-04-2024
Publisher: Springer Berlin Heidelberg
Published in: Structural and Multidisciplinary Optimization / Issue 4/2024
Print ISSN: 1615-147X
Electronic ISSN: 1615-1488
DOI: https://doi.org/10.1007/s00158-024-03748-4

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 4/2024

A crashworthiness optimization method of subway underframe structures based on the differential evolution of the weighted graph representation

Form-finding of frame-supported non-minimal tensile membrane structures for anisotropic prestress using physics-informed neural networks

Inverse design of periodic microstructures with targeted nonlinear mechanical behaviour

A constrained Bayesian Optimization framework for structural vibrations with local nonlinearities

Integrated topology and size optimization for frame structures considering displacement, stress, and stability constraints

Topography optimisation using a reduced-dimensional model for transient conjugate heat transfer between fluid channels and solid plates with volumetric heat source

Premium Partners