Skip to main content
Top

20-08-2019 | Original Article

A two-stage adaptive multi-fidelity surrogate model-assisted multi-objective genetic algorithm for computationally expensive problems

Authors: Qi Zhou, Jinhong Wu, Tao Xue, Peng Jin

Published in: Engineering with Computers | Issue 1/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Surrogate model-assisted multi-objective genetic algorithms (MOGA) show great potential in solving engineering design problems since they can save computational cost by reducing the calls of expensive simulations. In this paper, a two-stage adaptive multi-fidelity surrogate (MFS) model-assisted MOGA (AMFS-MOGA) is developed to further relieve their computational burden. In the warm-up stage, a preliminary Pareto frontier is obtained relying only on the data from the low-fidelity (LF) model. In the second stage, an initial MFS model is constructed based on the data from both LF and high-fidelity (HF) models at the samples, which are selected from the preliminary Pareto set according to the crowding distance in the objective space. Then the fitness values of individuals are evaluated using the MFS model, which is adaptively updated according to two developed strategies, an individual-based updating strategy and a generation-based updating strategy. The former considers the prediction uncertainty from the MFS model, while the latter takes the discrete degree of the population into consideration. The effectiveness and merits of the proposed AMFS-MOGA approach are illustrated using three benchmark tests and the design optimization of a stiffened cylindrical shell. The comparisons between the proposed AMFS-MOGA approach and some existing approaches considering the quality of the obtained Pareto frontiers and computational efficiency are made. The results show that the proposed AMFS-MOGA method can obtain Pareto frontiers comparable to that obtained by the MOGA with HF model, while significantly reducing the number of evaluations of the expensive HF model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kitayama S, Srirat J, Arakawa M, Yamazaki K (2013) Sequential approximate multi-objective optimization using radial basis function network. Struct Multidiscip Optim 48:501–515MathSciNet Kitayama S, Srirat J, Arakawa M, Yamazaki K (2013) Sequential approximate multi-objective optimization using radial basis function network. Struct Multidiscip Optim 48:501–515MathSciNet
2.
go back to reference Jiang C, Qiu H, Yang Z, Chen L, Gao L, Li P (2019) A general failure-pursuing sampling framework for surrogate-based reliability analysis. Reliab Eng Syst Saf 183:47–59 Jiang C, Qiu H, Yang Z, Chen L, Gao L, Li P (2019) A general failure-pursuing sampling framework for surrogate-based reliability analysis. Reliab Eng Syst Saf 183:47–59
3.
go back to reference Liu B, Koziel S, Zhang Q (2016) A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems. J Comput Sci 12:28–37MathSciNet Liu B, Koziel S, Zhang Q (2016) A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems. J Comput Sci 12:28–37MathSciNet
4.
go back to reference Roshanian J, Bataleblu AA, Ebrahimi M (2018) A novel evolution control strategy for surrogate-assisted design optimization. Struct Multidiscip Optim 58:1255–1273 Roshanian J, Bataleblu AA, Ebrahimi M (2018) A novel evolution control strategy for surrogate-assisted design optimization. Struct Multidiscip Optim 58:1255–1273
5.
go back to reference Peng L, Liu L, Long T, Yang W (2014) An efficient truss structure optimization framework based on CAD/CAE integration and sequential radial basis function metamodel. Struct Multidiscip Optim 50:329–346 Peng L, Liu L, Long T, Yang W (2014) An efficient truss structure optimization framework based on CAD/CAE integration and sequential radial basis function metamodel. Struct Multidiscip Optim 50:329–346
6.
go back to reference Ray T, Smith W (2006) A surrogate assisted parallel multiobjective evolutionary algorithm for robust engineering design. Eng Optim 38:997–1011 Ray T, Smith W (2006) A surrogate assisted parallel multiobjective evolutionary algorithm for robust engineering design. Eng Optim 38:997–1011
7.
go back to reference Jin Y (2003) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9:3–12 Jin Y (2003) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9:3–12
8.
go back to reference Li G, Li M, Azarm S, Rambo J, Joshi Y (2007) Optimizing thermal design of data center cabinets with a new multi-objective genetic algorithm. Distrib Parallel Databases 21:167–192 Li G, Li M, Azarm S, Rambo J, Joshi Y (2007) Optimizing thermal design of data center cabinets with a new multi-objective genetic algorithm. Distrib Parallel Databases 21:167–192
9.
go back to reference Wang H, Jin Y, Jansen JO (2016) Data-driven surrogate-assisted multiobjective evolutionary optimization of a trauma system. IEEE Trans Evol Comput 20:939–952 Wang H, Jin Y, Jansen JO (2016) Data-driven surrogate-assisted multiobjective evolutionary optimization of a trauma system. IEEE Trans Evol Comput 20:939–952
10.
go back to reference Habib A, Singh HK, Ray T (2017) A multiple surrogate assisted evolutionary algorithm for optimization involving iterative solvers. Eng Optim 50:1625–1644 Habib A, Singh HK, Ray T (2017) A multiple surrogate assisted evolutionary algorithm for optimization involving iterative solvers. Eng Optim 50:1625–1644
11.
go back to reference Pan L, He C, Tian Y, Wang H, Zhang X, Jin Y (2018) A classification based surrogate-assisted evolutionary algorithm for expensive many-objective optimization. IEEE Trans Evolut Comput 23:74–88 Pan L, He C, Tian Y, Wang H, Zhang X, Jin Y (2018) A classification based surrogate-assisted evolutionary algorithm for expensive many-objective optimization. IEEE Trans Evolut Comput 23:74–88
12.
go back to reference Jin Y, Wang H, Chugh T, Guo D, Miettinen K (2018) Data-driven evolutionary optimization: an overview and case studies. IEEE Trans Evolut Comput 23:442–458 Jin Y, Wang H, Chugh T, Guo D, Miettinen K (2018) Data-driven evolutionary optimization: an overview and case studies. IEEE Trans Evolut Comput 23:442–458
13.
go back to reference Sun C, Jin Y, Cheng R, Ding J, Zeng J (2017) Surrogate-assisted cooperative swarm optimization of high-dimensional expensive problems. IEEE Trans Evol Comput 21:644–660 Sun C, Jin Y, Cheng R, Ding J, Zeng J (2017) Surrogate-assisted cooperative swarm optimization of high-dimensional expensive problems. IEEE Trans Evol Comput 21:644–660
14.
go back to reference Dong H, Li C, Song B, Wang P (2018) Multi-surrogate-based differential evolution with multi-start exploration (MDEME) for computationally expensive optimization. Adv Eng Softw 123:62–76 Dong H, Li C, Song B, Wang P (2018) Multi-surrogate-based differential evolution with multi-start exploration (MDEME) for computationally expensive optimization. Adv Eng Softw 123:62–76
15.
go back to reference Wang H, Jin Y, Sun C, Doherty J (2019) Offline Data-driven evolutionary optimization using selective surrogate ensembles. IEEE Trans Evolut Comput 23:203–216 Wang H, Jin Y, Sun C, Doherty J (2019) Offline Data-driven evolutionary optimization using selective surrogate ensembles. IEEE Trans Evolut Comput 23:203–216
16.
go back to reference Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evolut Comput 1:61–70 Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evolut Comput 1:61–70
17.
go back to reference Li M (2011) An improved kriging-assisted multi-objective genetic algorithm. J Mech Des 133:071008 Li M (2011) An improved kriging-assisted multi-objective genetic algorithm. J Mech Des 133:071008
18.
go back to reference Tian J, Tan Y, Zeng J, Sun C, Jin Y (2018) Multi-objective infill criterion driven gaussian process assisted particle swarm optimization of high-dimensional expensive problems. IEEE Trans Evolut Comput 23:459–472 Tian J, Tan Y, Zeng J, Sun C, Jin Y (2018) Multi-objective infill criterion driven gaussian process assisted particle swarm optimization of high-dimensional expensive problems. IEEE Trans Evolut Comput 23:459–472
19.
go back to reference Wang H, Jin Y, Sun C, Doherty J (2018) Offline data-driven evolutionary optimization using selective surrogate ensembles. IEEE Trans Evolut Comput 23:203–216 Wang H, Jin Y, Sun C, Doherty J (2018) Offline data-driven evolutionary optimization using selective surrogate ensembles. IEEE Trans Evolut Comput 23:203–216
20.
go back to reference Yu H, Tan Y, Sun C, Zeng J (2019) A generation-based optimal restart strategy for surrogate-assisted social learning particle swarm optimization. Knowl Based Syst 163:14–25 Yu H, Tan Y, Sun C, Zeng J (2019) A generation-based optimal restart strategy for surrogate-assisted social learning particle swarm optimization. Knowl Based Syst 163:14–25
21.
go back to reference Li K, Yu Y, He J, Lin Y (2018) An integrated beam-plate structure multi-level optimal design framework based on bi-directional evolutionary structural optimization and surrogate model. Adv Eng Softw 115:230–247 Li K, Yu Y, He J, Lin Y (2018) An integrated beam-plate structure multi-level optimal design framework based on bi-directional evolutionary structural optimization and surrogate model. Adv Eng Softw 115:230–247
22.
go back to reference Chugh T, Sindhya K, Hakanen J, Miettinen K (2017) A survey on handling computationally expensive multiobjective optimization problems with evolutionary algorithms. Soft Comput 23:3137–3166 Chugh T, Sindhya K, Hakanen J, Miettinen K (2017) A survey on handling computationally expensive multiobjective optimization problems with evolutionary algorithms. Soft Comput 23:3137–3166
23.
go back to reference Yu H, Tan Y, Zeng J, Sun C, Jin Y (2018) Surrogate-assisted hierarchical particle swarm optimization. Inf Sci 454:59–72MathSciNet Yu H, Tan Y, Zeng J, Sun C, Jin Y (2018) Surrogate-assisted hierarchical particle swarm optimization. Inf Sci 454:59–72MathSciNet
24.
go back to reference Dong H, Song B, Wang P, Dong Z (2018) Hybrid surrogate-based optimization using space reduction (HSOSR) for expensive black-box functions. Appl Soft Comput 64:641–655 Dong H, Song B, Wang P, Dong Z (2018) Hybrid surrogate-based optimization using space reduction (HSOSR) for expensive black-box functions. Appl Soft Comput 64:641–655
25.
go back to reference Song X, Lv L, Li J, Sun W, Zhang J (2018) An advanced and robust ensemble surrogate model: extended adaptive hybrid functions. J Mech Des 140:041402 Song X, Lv L, Li J, Sun W, Zhang J (2018) An advanced and robust ensemble surrogate model: extended adaptive hybrid functions. J Mech Des 140:041402
26.
go back to reference Li E, Wang H (2016) An alternative adaptive differential evolutionary algorithm assisted by expected improvement criterion and cut-HDMR expansion and its application in time-based sheet forming design. Adv Eng Softw 97:96–107 Li E, Wang H (2016) An alternative adaptive differential evolutionary algorithm assisted by expected improvement criterion and cut-HDMR expansion and its application in time-based sheet forming design. Adv Eng Softw 97:96–107
27.
go back to reference Zhang K-S, Han Z-H, Gao Z-J, Wang Y (2019) Constraint aggregation for large number of constraints in wing surrogate-based optimization. Struct Multidiscip Optim 59:421–438MathSciNet Zhang K-S, Han Z-H, Gao Z-J, Wang Y (2019) Constraint aggregation for large number of constraints in wing surrogate-based optimization. Struct Multidiscip Optim 59:421–438MathSciNet
29.
go back to reference Lin Y, He J, Li K (2018) Hull form design optimization of twin-skeg fishing vessel for minimum resistance based on surrogate model. Adv Eng Softw 123:38–50 Lin Y, He J, Li K (2018) Hull form design optimization of twin-skeg fishing vessel for minimum resistance based on surrogate model. Adv Eng Softw 123:38–50
31.
go back to reference Toal DJJ (2015) A study into the potential of GPUs for the efficient construction and evaluation of Kriging models. Eng Comput 32:377–404 Toal DJJ (2015) A study into the potential of GPUs for the efficient construction and evaluation of Kriging models. Eng Comput 32:377–404
32.
go back to reference Bouhlel MA, Martins JRRA (2018) Gradient-enhanced kriging for high-dimensional problems. Eng Comput 35:157–173 Bouhlel MA, Martins JRRA (2018) Gradient-enhanced kriging for high-dimensional problems. Eng Comput 35:157–173
33.
go back to reference Guo Z, Song L, Park C, Li J, Haftka RT (2018) Analysis of dataset selection for multi-fidelity surrogates for a turbine problem. Struct Multidiscip Optim 57:2127–2142 Guo Z, Song L, Park C, Li J, Haftka RT (2018) Analysis of dataset selection for multi-fidelity surrogates for a turbine problem. Struct Multidiscip Optim 57:2127–2142
34.
go back to reference Park C, Haftka RT, Kim NH (2017) Remarks on multi-fidelity surrogates. Struct Multidiscip Optim 55:1029–1050MathSciNet Park C, Haftka RT, Kim NH (2017) Remarks on multi-fidelity surrogates. Struct Multidiscip Optim 55:1029–1050MathSciNet
35.
go back to reference Cai X, Qiu H, Gao L, Shao X (2017) Metamodeling for high dimensional design problems by multi-fidelity simulations. Struct Multidiscip Optim 56:151–166MathSciNet Cai X, Qiu H, Gao L, Shao X (2017) Metamodeling for high dimensional design problems by multi-fidelity simulations. Struct Multidiscip Optim 56:151–166MathSciNet
36.
go back to reference Han Z, Zimmerman R, Görtz S (2012) Alternative cokriging method for variable-fidelity surrogate modeling. AIAA J 50:1205–1210 Han Z, Zimmerman R, Görtz S (2012) Alternative cokriging method for variable-fidelity surrogate modeling. AIAA J 50:1205–1210
37.
go back to reference Liu H, Ong Y-S, Cai J, Wang Y (2018) Cope with diverse data structures in multi-fidelity modeling: a Gaussian process method. Eng Appl Artif Intell 67:211–225 Liu H, Ong Y-S, Cai J, Wang Y (2018) Cope with diverse data structures in multi-fidelity modeling: a Gaussian process method. Eng Appl Artif Intell 67:211–225
38.
go back to reference Xiao M, Zhang G, Breitkopf P, Villon P, Zhang W (2018) Extended co-kriging interpolation method based on multi-fidelity data. Appl Math Comput 323:120–131MATH Xiao M, Zhang G, Breitkopf P, Villon P, Zhang W (2018) Extended co-kriging interpolation method based on multi-fidelity data. Appl Math Comput 323:120–131MATH
39.
go back to reference Song X, Lv L, Sun W, Zhang J (2019) A radial basis function-based multi-fidelity surrogate model: exploring correlation between high-fidelity and low-fidelity models. Struct Multidiscip Optim 60:965–981 Song X, Lv L, Sun W, Zhang J (2019) A radial basis function-based multi-fidelity surrogate model: exploring correlation between high-fidelity and low-fidelity models. Struct Multidiscip Optim 60:965–981
40.
go back to reference Park C, Haftka RT, Kim NH (2018) Low-fidelity scale factor improves Bayesian multi-fidelity prediction by reducing bumpiness of discrepancy function. Struct Multidiscip Optim 58:399–414 Park C, Haftka RT, Kim NH (2018) Low-fidelity scale factor improves Bayesian multi-fidelity prediction by reducing bumpiness of discrepancy function. Struct Multidiscip Optim 58:399–414
41.
go back to reference Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87:1–13MathSciNetMATH Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87:1–13MathSciNetMATH
42.
go back to reference Zhou Q, Wang Y, Choi S-K, Jiang P, Shao X, Hu J et al (2018) A robust optimization approach based on multi-fidelity metamodel. Struct Multidiscip Optim 57:775–797 Zhou Q, Wang Y, Choi S-K, Jiang P, Shao X, Hu J et al (2018) A robust optimization approach based on multi-fidelity metamodel. Struct Multidiscip Optim 57:775–797
43.
go back to reference Nguyen N-V, Choi S-M, Kim W-S, Lee J-W, Kim S, Neufeld D et al (2013) Multidisciplinary unmanned combat air vehicle system design using multi-fidelity model. Aerosp Sci Technol 26:200–210 Nguyen N-V, Choi S-M, Kim W-S, Lee J-W, Kim S, Neufeld D et al (2013) Multidisciplinary unmanned combat air vehicle system design using multi-fidelity model. Aerosp Sci Technol 26:200–210
44.
go back to reference Shu L, Jiang P, Zhou Q, Shao X, Hu J, Meng X (2018) An on-line variable fidelity metamodel assisted multi-objective genetic algorithm for engineering design optimization. Appl Soft Comput 66:438–448 Shu L, Jiang P, Zhou Q, Shao X, Hu J, Meng X (2018) An on-line variable fidelity metamodel assisted multi-objective genetic algorithm for engineering design optimization. Appl Soft Comput 66:438–448
45.
go back to reference Liu Y, Collette M (2014) Improving surrogate-assisted variable fidelity multi-objective optimization using a clustering algorithm. Appl Soft Comput 24:482–493 Liu Y, Collette M (2014) Improving surrogate-assisted variable fidelity multi-objective optimization using a clustering algorithm. Appl Soft Comput 24:482–493
46.
go back to reference Zhou Q, Wang Y, Choi S-K, Jiang P (2017) An on-line multi-fidelity metamodel assisted multi-objective genetic algorithm. In: ASME 2017 international design engineering technical conferences and computers and information in engineering conference, Cleveland Zhou Q, Wang Y, Choi S-K, Jiang P (2017) An on-line multi-fidelity metamodel assisted multi-objective genetic algorithm. In: ASME 2017 international design engineering technical conferences and computers and information in engineering conference, Cleveland
47.
go back to reference Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. Evolut Comput IEEE Trans 6:182–197 Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. Evolut Comput IEEE Trans 6:182–197
48.
go back to reference Zhou Q, Yang Y, Jiang P, Shao X, Cao L, Hu J et al (2017) A multi-fidelity information fusion metamodeling assisted laser beam welding process parameter optimization approach. Adv Eng Softw 110:85–97 Zhou Q, Yang Y, Jiang P, Shao X, Cao L, Hu J et al (2017) A multi-fidelity information fusion metamodeling assisted laser beam welding process parameter optimization approach. Adv Eng Softw 110:85–97
49.
go back to reference Zadeh PM, Toropov VV, Wood AS (2009) Metamodel-based collaborative optimization framework. Struct Multidiscip Optim 38:103–115 Zadeh PM, Toropov VV, Wood AS (2009) Metamodel-based collaborative optimization framework. Struct Multidiscip Optim 38:103–115
50.
go back to reference Zhou Q, Wang Y, Choi SK, Jiang P, Shao X, Hu J (2017) A sequential multi-fidelity metamodeling approach for data regression. Knowl Based Syst 134:199–212 Zhou Q, Wang Y, Choi SK, Jiang P, Shao X, Hu J (2017) A sequential multi-fidelity metamodeling approach for data regression. Knowl Based Syst 134:199–212
51.
go back to reference Zhou Q, Shao X, Jiang P, Gao Z, Wang C, Shu L (2016) An active learning metamodeling approach by sequentially exploiting difference information from variable-fidelity models. Adv Eng Inform 30:283–297 Zhou Q, Shao X, Jiang P, Gao Z, Wang C, Shu L (2016) An active learning metamodeling approach by sequentially exploiting difference information from variable-fidelity models. Adv Eng Inform 30:283–297
52.
go back to reference Li M, Li G, Azarm S (2008) A kriging metamodel assisted multi-objective genetic algorithm for design optimization. J Mech Des 130:031401 Li M, Li G, Azarm S (2008) A kriging metamodel assisted multi-objective genetic algorithm for design optimization. J Mech Des 130:031401
53.
go back to reference Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, Chichester, U.K.MATH Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, Chichester, U.K.MATH
54.
go back to reference Wu J, Azarm S (2001) Metrics for quality assessment of a multiobjective design optimization solution set. J Mech Des 123:18–25 Wu J, Azarm S (2001) Metrics for quality assessment of a multiobjective design optimization solution set. J Mech Des 123:18–25
55.
go back to reference Cheng S, Zhou J, Li M (2015) A new hybrid algorithm for multi-objective robust optimization with interval uncertainty. J Mech Des 137:021401 Cheng S, Zhou J, Li M (2015) A new hybrid algorithm for multi-objective robust optimization with interval uncertainty. J Mech Des 137:021401
56.
go back to reference Zhu J, Wang Y-J, Collette M (2014) A multi-objective variable-fidelity optimization method for genetic algorithms. Eng Optim 46:521–542MathSciNet Zhu J, Wang Y-J, Collette M (2014) A multi-objective variable-fidelity optimization method for genetic algorithms. Eng Optim 46:521–542MathSciNet
Metadata
Title
A two-stage adaptive multi-fidelity surrogate model-assisted multi-objective genetic algorithm for computationally expensive problems
Authors
Qi Zhou
Jinhong Wu
Tao Xue
Peng Jin
Publication date
20-08-2019
Publisher
Springer London
Published in
Engineering with Computers / Issue 1/2021
Print ISSN: 0177-0667
Electronic ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-019-00844-8