Skip to main content
Top
Published in: Structural and Multidisciplinary Optimization 5/2015

01-05-2015 | Research Paper

Performance study of multi-fidelity gradient enhanced kriging

Authors: Selvakumar Ulaganathan, Ivo Couckuyt, Francesco Ferranti, Eric Laermans, Tom Dhaene

Published in: Structural and Multidisciplinary Optimization | Issue 5/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-fidelity surrogate modelling offers an efficient way to approximate computationally expensive simulations. In particular, Kriging-based surrogate models are popular for approximating deterministic data. In this work, the performance of Kriging is investigated when multi-fidelity gradient data is introduced along with multi-fidelity function data to approximate computationally expensive black-box simulations. To achieve this, the recursive CoKriging formulation is extended by incorporating multi-fidelity gradient information. This approach, denoted by Gradient-Enhanced recursive CoKriging (GECoK), is initially applied to two analytical problems. As expected, results from the analytical benchmark problems show that additional gradient information of different fidelities can significantly improve the accuracy of the Kriging model. Moreover, GECoK provides a better approximation even when the gradient information is only partially available. Further comparison between CoKriging, Gradient Enhanced Kriging, denoted by GEK, and GECoK highlights various advantages of employing single and multi-fidelity gradient data. Finally, GECoK is further applied to two real-life examples.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
www.​eesof.​com, Agilent Technologies EEsof EDA, Santa Rosa, CA.
 
2
www.​cst.​com, CST Computer Simulation Technology AG, Darmstadt, Germany.
 
Literature
go back to reference Bandler JW, Biernacki RM, Chen SH, Grobelny PA, Hemmers RH (1994) Space mapping technique for electromagnetic optimization. IEEE Trans Microw Theory Tech 12:2536–2544CrossRef Bandler JW, Biernacki RM, Chen SH, Grobelny PA, Hemmers RH (1994) Space mapping technique for electromagnetic optimization. IEEE Trans Microw Theory Tech 12:2536–2544CrossRef
go back to reference Brezillon J, Dwight R (2005) Discrete adjoint of the Navier-stokes Equations for aerodynamic shape optimization. In: Evolutionary and deterministic methods for design, optimisation and control with applications to industrial and societal problems (EUROGEN). Munich, Germany, p 2005 Brezillon J, Dwight R (2005) Discrete adjoint of the Navier-stokes Equations for aerodynamic shape optimization. In: Evolutionary and deterministic methods for design, optimisation and control with applications to industrial and societal problems (EUROGEN). Munich, Germany, p 2005
go back to reference Chemmangat K, Ferranti F, Knockaert L, Dhaene T (2011) Parametric macromodeling for sensitivity responses from tabulated data. IEEE Microw Wirel Components Lett 21(8):397–399CrossRef Chemmangat K, Ferranti F, Knockaert L, Dhaene T (2011) Parametric macromodeling for sensitivity responses from tabulated data. IEEE Microw Wirel Components Lett 21(8):397–399CrossRef
go back to reference Chung HS, Alonso JJ (2002) Using gradients to construct Cokriging approximation models for high-dimensional design optimization problems. In: Problems, 40th AIAA aerospace sciences meeting and exhibit, AIAA. Reno, NV, pp 2002–0317 Chung HS, Alonso JJ (2002) Using gradients to construct Cokriging approximation models for high-dimensional design optimization problems. In: Problems, 40th AIAA aerospace sciences meeting and exhibit, AIAA. Reno, NV, pp 2002–0317
go back to reference Couckuyt I, Declercq F, Dhaene T, Rogier H, Knockaert L (2010) Surrogate-based infill optimization applied to electromagnetic problems. Int J RF Microw Comput-Aided Eng 20(5):492–501CrossRef Couckuyt I, Declercq F, Dhaene T, Rogier H, Knockaert L (2010) Surrogate-based infill optimization applied to electromagnetic problems. Int J RF Microw Comput-Aided Eng 20(5):492–501CrossRef
go back to reference Courrier N, Boucard PA, Soulier B (2014) The use of partially converged simulations in building surrogate models. Adv Eng Softw 67(0):186–197CrossRef Courrier N, Boucard PA, Soulier B (2014) The use of partially converged simulations in building surrogate models. Adv Eng Softw 67(0):186–197CrossRef
go back to reference Craig PS, Goldstein M, Seheult AH, Smith JA (1998) Constructing partial prior specifications for models of complex physical systems. J R Stat Soc Ser D : (Stat) 47(1):37–53CrossRef Craig PS, Goldstein M, Seheult AH, Smith JA (1998) Constructing partial prior specifications for models of complex physical systems. J R Stat Soc Ser D : (Stat) 47(1):37–53CrossRef
go back to reference Cumming JA, Goldstein M (2009) Small sample Bayesian designs for complex high-dimensional models based on information gained using fast approximations. Technometrics 51(4):377–388MathSciNetCrossRef Cumming JA, Goldstein M (2009) Small sample Bayesian designs for complex high-dimensional models based on information gained using fast approximations. Technometrics 51(4):377–388MathSciNetCrossRef
go back to reference Davis GJ, Morris MD (1997) Six factors which affect the condition number of matrices associated with kriging. Math Geol 29(5):669–683CrossRef Davis GJ, Morris MD (1997) Six factors which affect the condition number of matrices associated with kriging. Math Geol 29(5):669–683CrossRef
go back to reference Degroote J, Hojjat M, Stavropoulou E, Wüchner R, Bletzinger KU (2013) Partitioned solution of an unsteady adjoint for strongly coupled fluid-structure interactions and application to parameter identification of a one-dimensional problem. Struct Multidiscip Optim 47(1):77–94MATHMathSciNetCrossRef Degroote J, Hojjat M, Stavropoulou E, Wüchner R, Bletzinger KU (2013) Partitioned solution of an unsteady adjoint for strongly coupled fluid-structure interactions and application to parameter identification of a one-dimensional problem. Struct Multidiscip Optim 47(1):77–94MATHMathSciNetCrossRef
go back to reference Dwight RP, Han ZH (2009) Efficient uncertainty quantification using gradient-enhanced kriging. In: 11th AIAA on-deterministic approaches conference. Palm Springs, California Dwight RP, Han ZH (2009) Efficient uncertainty quantification using gradient-enhanced kriging. In: 11th AIAA on-deterministic approaches conference. Palm Springs, California
go back to reference Forrester AI, Bressloff NW, Keane AJ (2006) Optimization using surrogate models and partially converged computational fluid dynamics simulations. Proc R Soc A : Math Phys Eng Sci Med 462(2071):2177–2204MATHCrossRef Forrester AI, Bressloff NW, Keane AJ (2006) Optimization using surrogate models and partially converged computational fluid dynamics simulations. Proc R Soc A : Math Phys Eng Sci Med 462(2071):2177–2204MATHCrossRef
go back to reference Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. Proc R Soc 463:3251–3269MATHCrossRef Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. Proc R Soc 463:3251–3269MATHCrossRef
go back to reference Forrester AI, Sóbester A, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide, 1st edn. Wiley, New YorkCrossRef Forrester AI, Sóbester A, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide, 1st edn. Wiley, New YorkCrossRef
go back to reference Goldstein M, Wooff DA (2007) Bayes linear statistics: theory & methods bayes linear statistics. Wiley, New YorkCrossRef Goldstein M, Wooff DA (2007) Bayes linear statistics: theory & methods bayes linear statistics. Wiley, New YorkCrossRef
go back to reference Higdon D, Kennedy M, Cavendish J, Cafeo J, Ryne RD (2004) Combining field data and computer simulations for calibration and prediction. SIAM J Sci Comput 26(2):448–466MATHMathSciNetCrossRef Higdon D, Kennedy M, Cavendish J, Cafeo J, Ryne RD (2004) Combining field data and computer simulations for calibration and prediction. SIAM J Sci Comput 26(2):448–466MATHMathSciNetCrossRef
go back to reference Huang D, Allen T, Notz W, Miller R (2006) Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidiscip Optim 32(5):369–382CrossRef Huang D, Allen T, Notz W, Miller R (2006) Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidiscip Optim 32(5):369–382CrossRef
go back to reference Jin R, Chen W, Simpson TW (2000) Comparative studies of metamodeling techniques under multiple modeling criteria. Struct Multidiscip Optim 23:1–13CrossRef Jin R, Chen W, Simpson TW (2000) Comparative studies of metamodeling techniques under multiple modeling criteria. Struct Multidiscip Optim 23:1–13CrossRef
go back to reference Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1):1–13MATHMathSciNetCrossRef Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1):1–13MATHMathSciNetCrossRef
go back to reference Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with kriging and cokriging. AIAA 46(2):498–507CrossRef Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with kriging and cokriging. AIAA 46(2):498–507CrossRef
go back to reference Laurenceau J, Meaux M, Montagnac M, Sagaut P (2010) Comparison of gradient-based and gradient-enhanced response-surface-based optimizers. Am Inst Aeronaut Astronaut J 48(5):981–994CrossRef Laurenceau J, Meaux M, Montagnac M, Sagaut P (2010) Comparison of gradient-based and gradient-enhanced response-surface-based optimizers. Am Inst Aeronaut Astronaut J 48(5):981–994CrossRef
go back to reference Laurent L, Boucard P A, Soulier B (2013) Generation of a cokriging metamodel using a multiparametric strategy. Comput Mech 51(2):151–169MATHMathSciNetCrossRef Laurent L, Boucard P A, Soulier B (2013) Generation of a cokriging metamodel using a multiparametric strategy. Comput Mech 51(2):151–169MATHMathSciNetCrossRef
go back to reference Leary SJ, Bhaskar A, Keane AJ (2004) A derivative based surrogate model for approximating and optimizing the output of an expensive computer simulation. J Glob Optim 30(1):39–58MATHMathSciNetCrossRef Leary SJ, Bhaskar A, Keane AJ (2004) A derivative based surrogate model for approximating and optimizing the output of an expensive computer simulation. J Glob Optim 30(1):39–58MATHMathSciNetCrossRef
go back to reference Liu W (2003) Development of gradient-enhanced kriging approximations for multidisciplinary design optimisation. PhD thesis, University of Notre Dame, Notre Dame, Indiana Liu W (2003) Development of gradient-enhanced kriging approximations for multidisciplinary design optimisation. PhD thesis, University of Notre Dame, Notre Dame, Indiana
go back to reference March A, Willcox K, Wang Q (2010) Gradient-based multifidelity optimisation for aircraft design using bayesian model calibration. In: 2nd aircraft structural design conference. Royal Aeronautical Society, London, p 1720 March A, Willcox K, Wang Q (2010) Gradient-based multifidelity optimisation for aircraft design using bayesian model calibration. In: 2nd aircraft structural design conference. Royal Aeronautical Society, London, p 1720
go back to reference Morris MD, Mitchell TJ, Ylvisaker D (1993) Bayesian design and analysis of computer experiments: use of gradients in surface prediction. Technometrics 35(3):243–255MATHMathSciNetCrossRef Morris MD, Mitchell TJ, Ylvisaker D (1993) Bayesian design and analysis of computer experiments: use of gradients in surface prediction. Technometrics 35(3):243–255MATHMathSciNetCrossRef
go back to reference Näther W, Šimák J (2003) Effective observation of random processes using derivatives. Metrika 58:71–84MATHMathSciNet Näther W, Šimák J (2003) Effective observation of random processes using derivatives. Metrika 58:71–84MATHMathSciNet
go back to reference Qian PZG, Wu CFJ (2008) Bayesian hierarchical modeling for integrating low-accuracy and high-accuracy experiments. Technometrics 50(2):192–204MathSciNetCrossRef Qian PZG, Wu CFJ (2008) Bayesian hierarchical modeling for integrating low-accuracy and high-accuracy experiments. Technometrics 50(2):192–204MathSciNetCrossRef
go back to reference Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. The MIT Press. MA, USA Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. The MIT Press. MA, USA
go back to reference Schneider R (2012) FEINS: finite element solver for shape optimization with adjoint equations. In: Progress in industrial mathematics at ECMI 2010 conference, pp 573–580 Schneider R (2012) FEINS: finite element solver for shape optimization with adjoint equations. In: Progress in industrial mathematics at ECMI 2010 conference, pp 573–580
go back to reference Simpson T, Poplinski J, Koch PN, Allen J (2001) Metamodels for computer-based engineering design: Survey and recommendations. Engineering with Computers 17(2):129–150MATHCrossRef Simpson T, Poplinski J, Koch PN, Allen J (2001) Metamodels for computer-based engineering design: Survey and recommendations. Engineering with Computers 17(2):129–150MATHCrossRef
go back to reference Toal DJ, Forrester AI, Bressloff NW, Keane AJ, Holden C (2009) An adjoint for likelihood maximization. Proc R Soc A 8(465):3267–3287MathSciNetCrossRef Toal DJ, Forrester AI, Bressloff NW, Keane AJ, Holden C (2009) An adjoint for likelihood maximization. Proc R Soc A 8(465):3267–3287MathSciNetCrossRef
go back to reference Šimák J (2002) On experimental designs for derivative random fields. PhD thesis. TU Bergakademie Freiberg. Freiberg, Germany Šimák J (2002) On experimental designs for derivative random fields. PhD thesis. TU Bergakademie Freiberg. Freiberg, Germany
go back to reference Wang GG, Shan S (2006) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129(4):370–380CrossRef Wang GG, Shan S (2006) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129(4):370–380CrossRef
go back to reference Yu W, Bandler J (2006) Optimization of spiral inductor on silicon using space mapping. In: IEEE MTT-S international microwave symposium digest, pp 1085–1088 Yu W, Bandler J (2006) Optimization of spiral inductor on silicon using space mapping. In: IEEE MTT-S international microwave symposium digest, pp 1085–1088
go back to reference Zimmermann R (2013) On the maximum likelihood training of gradient-enhanced spatial gaussian processes. SIAM J Sci Comput 35(6):A2554—A2574MATHCrossRef Zimmermann R (2013) On the maximum likelihood training of gradient-enhanced spatial gaussian processes. SIAM J Sci Comput 35(6):A2554—A2574MATHCrossRef
Metadata
Title
Performance study of multi-fidelity gradient enhanced kriging
Authors
Selvakumar Ulaganathan
Ivo Couckuyt
Francesco Ferranti
Eric Laermans
Tom Dhaene
Publication date
01-05-2015
Publisher
Springer Berlin Heidelberg
Published in
Structural and Multidisciplinary Optimization / Issue 5/2015
Print ISSN: 1615-147X
Electronic ISSN: 1615-1488
DOI
https://doi.org/10.1007/s00158-014-1192-x

Other articles of this Issue 5/2015

Structural and Multidisciplinary Optimization 5/2015 Go to the issue

Premium Partners