Skip to main content
Erschienen in: Structural and Multidisciplinary Optimization 5/2015

01.05.2015 | Research Paper

Performance study of multi-fidelity gradient enhanced kriging

verfasst von: Selvakumar Ulaganathan, Ivo Couckuyt, Francesco Ferranti, Eric Laermans, Tom Dhaene

Erschienen in: Structural and Multidisciplinary Optimization | Ausgabe 5/2015

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-fidelity surrogate modelling offers an efficient way to approximate computationally expensive simulations. In particular, Kriging-based surrogate models are popular for approximating deterministic data. In this work, the performance of Kriging is investigated when multi-fidelity gradient data is introduced along with multi-fidelity function data to approximate computationally expensive black-box simulations. To achieve this, the recursive CoKriging formulation is extended by incorporating multi-fidelity gradient information. This approach, denoted by Gradient-Enhanced recursive CoKriging (GECoK), is initially applied to two analytical problems. As expected, results from the analytical benchmark problems show that additional gradient information of different fidelities can significantly improve the accuracy of the Kriging model. Moreover, GECoK provides a better approximation even when the gradient information is only partially available. Further comparison between CoKriging, Gradient Enhanced Kriging, denoted by GEK, and GECoK highlights various advantages of employing single and multi-fidelity gradient data. Finally, GECoK is further applied to two real-life examples.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
www.​eesof.​com, Agilent Technologies EEsof EDA, Santa Rosa, CA.
 
2
www.​cst.​com, CST Computer Simulation Technology AG, Darmstadt, Germany.
 
Literatur
Zurück zum Zitat Bandler JW, Biernacki RM, Chen SH, Grobelny PA, Hemmers RH (1994) Space mapping technique for electromagnetic optimization. IEEE Trans Microw Theory Tech 12:2536–2544CrossRef Bandler JW, Biernacki RM, Chen SH, Grobelny PA, Hemmers RH (1994) Space mapping technique for electromagnetic optimization. IEEE Trans Microw Theory Tech 12:2536–2544CrossRef
Zurück zum Zitat Brezillon J, Dwight R (2005) Discrete adjoint of the Navier-stokes Equations for aerodynamic shape optimization. In: Evolutionary and deterministic methods for design, optimisation and control with applications to industrial and societal problems (EUROGEN). Munich, Germany, p 2005 Brezillon J, Dwight R (2005) Discrete adjoint of the Navier-stokes Equations for aerodynamic shape optimization. In: Evolutionary and deterministic methods for design, optimisation and control with applications to industrial and societal problems (EUROGEN). Munich, Germany, p 2005
Zurück zum Zitat Chemmangat K, Ferranti F, Knockaert L, Dhaene T (2011) Parametric macromodeling for sensitivity responses from tabulated data. IEEE Microw Wirel Components Lett 21(8):397–399CrossRef Chemmangat K, Ferranti F, Knockaert L, Dhaene T (2011) Parametric macromodeling for sensitivity responses from tabulated data. IEEE Microw Wirel Components Lett 21(8):397–399CrossRef
Zurück zum Zitat Chung HS, Alonso JJ (2002) Using gradients to construct Cokriging approximation models for high-dimensional design optimization problems. In: Problems, 40th AIAA aerospace sciences meeting and exhibit, AIAA. Reno, NV, pp 2002–0317 Chung HS, Alonso JJ (2002) Using gradients to construct Cokriging approximation models for high-dimensional design optimization problems. In: Problems, 40th AIAA aerospace sciences meeting and exhibit, AIAA. Reno, NV, pp 2002–0317
Zurück zum Zitat Couckuyt I, Declercq F, Dhaene T, Rogier H, Knockaert L (2010) Surrogate-based infill optimization applied to electromagnetic problems. Int J RF Microw Comput-Aided Eng 20(5):492–501CrossRef Couckuyt I, Declercq F, Dhaene T, Rogier H, Knockaert L (2010) Surrogate-based infill optimization applied to electromagnetic problems. Int J RF Microw Comput-Aided Eng 20(5):492–501CrossRef
Zurück zum Zitat Courrier N, Boucard PA, Soulier B (2014) The use of partially converged simulations in building surrogate models. Adv Eng Softw 67(0):186–197CrossRef Courrier N, Boucard PA, Soulier B (2014) The use of partially converged simulations in building surrogate models. Adv Eng Softw 67(0):186–197CrossRef
Zurück zum Zitat Craig PS, Goldstein M, Seheult AH, Smith JA (1998) Constructing partial prior specifications for models of complex physical systems. J R Stat Soc Ser D : (Stat) 47(1):37–53CrossRef Craig PS, Goldstein M, Seheult AH, Smith JA (1998) Constructing partial prior specifications for models of complex physical systems. J R Stat Soc Ser D : (Stat) 47(1):37–53CrossRef
Zurück zum Zitat Cumming JA, Goldstein M (2009) Small sample Bayesian designs for complex high-dimensional models based on information gained using fast approximations. Technometrics 51(4):377–388MathSciNetCrossRef Cumming JA, Goldstein M (2009) Small sample Bayesian designs for complex high-dimensional models based on information gained using fast approximations. Technometrics 51(4):377–388MathSciNetCrossRef
Zurück zum Zitat Davis GJ, Morris MD (1997) Six factors which affect the condition number of matrices associated with kriging. Math Geol 29(5):669–683CrossRef Davis GJ, Morris MD (1997) Six factors which affect the condition number of matrices associated with kriging. Math Geol 29(5):669–683CrossRef
Zurück zum Zitat Degroote J, Hojjat M, Stavropoulou E, Wüchner R, Bletzinger KU (2013) Partitioned solution of an unsteady adjoint for strongly coupled fluid-structure interactions and application to parameter identification of a one-dimensional problem. Struct Multidiscip Optim 47(1):77–94MATHMathSciNetCrossRef Degroote J, Hojjat M, Stavropoulou E, Wüchner R, Bletzinger KU (2013) Partitioned solution of an unsteady adjoint for strongly coupled fluid-structure interactions and application to parameter identification of a one-dimensional problem. Struct Multidiscip Optim 47(1):77–94MATHMathSciNetCrossRef
Zurück zum Zitat Dwight RP, Han ZH (2009) Efficient uncertainty quantification using gradient-enhanced kriging. In: 11th AIAA on-deterministic approaches conference. Palm Springs, California Dwight RP, Han ZH (2009) Efficient uncertainty quantification using gradient-enhanced kriging. In: 11th AIAA on-deterministic approaches conference. Palm Springs, California
Zurück zum Zitat Forrester AI, Bressloff NW, Keane AJ (2006) Optimization using surrogate models and partially converged computational fluid dynamics simulations. Proc R Soc A : Math Phys Eng Sci Med 462(2071):2177–2204MATHCrossRef Forrester AI, Bressloff NW, Keane AJ (2006) Optimization using surrogate models and partially converged computational fluid dynamics simulations. Proc R Soc A : Math Phys Eng Sci Med 462(2071):2177–2204MATHCrossRef
Zurück zum Zitat Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. Proc R Soc 463:3251–3269MATHCrossRef Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. Proc R Soc 463:3251–3269MATHCrossRef
Zurück zum Zitat Forrester AI, Sóbester A, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide, 1st edn. Wiley, New YorkCrossRef Forrester AI, Sóbester A, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide, 1st edn. Wiley, New YorkCrossRef
Zurück zum Zitat Goldstein M, Wooff DA (2007) Bayes linear statistics: theory & methods bayes linear statistics. Wiley, New YorkCrossRef Goldstein M, Wooff DA (2007) Bayes linear statistics: theory & methods bayes linear statistics. Wiley, New YorkCrossRef
Zurück zum Zitat Higdon D, Kennedy M, Cavendish J, Cafeo J, Ryne RD (2004) Combining field data and computer simulations for calibration and prediction. SIAM J Sci Comput 26(2):448–466MATHMathSciNetCrossRef Higdon D, Kennedy M, Cavendish J, Cafeo J, Ryne RD (2004) Combining field data and computer simulations for calibration and prediction. SIAM J Sci Comput 26(2):448–466MATHMathSciNetCrossRef
Zurück zum Zitat Huang D, Allen T, Notz W, Miller R (2006) Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidiscip Optim 32(5):369–382CrossRef Huang D, Allen T, Notz W, Miller R (2006) Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidiscip Optim 32(5):369–382CrossRef
Zurück zum Zitat Jin R, Chen W, Simpson TW (2000) Comparative studies of metamodeling techniques under multiple modeling criteria. Struct Multidiscip Optim 23:1–13CrossRef Jin R, Chen W, Simpson TW (2000) Comparative studies of metamodeling techniques under multiple modeling criteria. Struct Multidiscip Optim 23:1–13CrossRef
Zurück zum Zitat Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1):1–13MATHMathSciNetCrossRef Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1):1–13MATHMathSciNetCrossRef
Zurück zum Zitat Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with kriging and cokriging. AIAA 46(2):498–507CrossRef Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with kriging and cokriging. AIAA 46(2):498–507CrossRef
Zurück zum Zitat Laurenceau J, Meaux M, Montagnac M, Sagaut P (2010) Comparison of gradient-based and gradient-enhanced response-surface-based optimizers. Am Inst Aeronaut Astronaut J 48(5):981–994CrossRef Laurenceau J, Meaux M, Montagnac M, Sagaut P (2010) Comparison of gradient-based and gradient-enhanced response-surface-based optimizers. Am Inst Aeronaut Astronaut J 48(5):981–994CrossRef
Zurück zum Zitat Laurent L, Boucard P A, Soulier B (2013) Generation of a cokriging metamodel using a multiparametric strategy. Comput Mech 51(2):151–169MATHMathSciNetCrossRef Laurent L, Boucard P A, Soulier B (2013) Generation of a cokriging metamodel using a multiparametric strategy. Comput Mech 51(2):151–169MATHMathSciNetCrossRef
Zurück zum Zitat Leary SJ, Bhaskar A, Keane AJ (2004) A derivative based surrogate model for approximating and optimizing the output of an expensive computer simulation. J Glob Optim 30(1):39–58MATHMathSciNetCrossRef Leary SJ, Bhaskar A, Keane AJ (2004) A derivative based surrogate model for approximating and optimizing the output of an expensive computer simulation. J Glob Optim 30(1):39–58MATHMathSciNetCrossRef
Zurück zum Zitat Liu W (2003) Development of gradient-enhanced kriging approximations for multidisciplinary design optimisation. PhD thesis, University of Notre Dame, Notre Dame, Indiana Liu W (2003) Development of gradient-enhanced kriging approximations for multidisciplinary design optimisation. PhD thesis, University of Notre Dame, Notre Dame, Indiana
Zurück zum Zitat March A, Willcox K, Wang Q (2010) Gradient-based multifidelity optimisation for aircraft design using bayesian model calibration. In: 2nd aircraft structural design conference. Royal Aeronautical Society, London, p 1720 March A, Willcox K, Wang Q (2010) Gradient-based multifidelity optimisation for aircraft design using bayesian model calibration. In: 2nd aircraft structural design conference. Royal Aeronautical Society, London, p 1720
Zurück zum Zitat Morris MD, Mitchell TJ, Ylvisaker D (1993) Bayesian design and analysis of computer experiments: use of gradients in surface prediction. Technometrics 35(3):243–255MATHMathSciNetCrossRef Morris MD, Mitchell TJ, Ylvisaker D (1993) Bayesian design and analysis of computer experiments: use of gradients in surface prediction. Technometrics 35(3):243–255MATHMathSciNetCrossRef
Zurück zum Zitat Näther W, Šimák J (2003) Effective observation of random processes using derivatives. Metrika 58:71–84MATHMathSciNet Näther W, Šimák J (2003) Effective observation of random processes using derivatives. Metrika 58:71–84MATHMathSciNet
Zurück zum Zitat Qian PZG, Wu CFJ (2008) Bayesian hierarchical modeling for integrating low-accuracy and high-accuracy experiments. Technometrics 50(2):192–204MathSciNetCrossRef Qian PZG, Wu CFJ (2008) Bayesian hierarchical modeling for integrating low-accuracy and high-accuracy experiments. Technometrics 50(2):192–204MathSciNetCrossRef
Zurück zum Zitat Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. The MIT Press. MA, USA Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. The MIT Press. MA, USA
Zurück zum Zitat Schneider R (2012) FEINS: finite element solver for shape optimization with adjoint equations. In: Progress in industrial mathematics at ECMI 2010 conference, pp 573–580 Schneider R (2012) FEINS: finite element solver for shape optimization with adjoint equations. In: Progress in industrial mathematics at ECMI 2010 conference, pp 573–580
Zurück zum Zitat Simpson T, Poplinski J, Koch PN, Allen J (2001) Metamodels for computer-based engineering design: Survey and recommendations. Engineering with Computers 17(2):129–150MATHCrossRef Simpson T, Poplinski J, Koch PN, Allen J (2001) Metamodels for computer-based engineering design: Survey and recommendations. Engineering with Computers 17(2):129–150MATHCrossRef
Zurück zum Zitat Stein ML (1999) Interpolation of spatial data: some theory for kriging. Springer, New YorkMATHCrossRef Stein ML (1999) Interpolation of spatial data: some theory for kriging. Springer, New YorkMATHCrossRef
Zurück zum Zitat Toal DJ, Forrester AI, Bressloff NW, Keane AJ, Holden C (2009) An adjoint for likelihood maximization. Proc R Soc A 8(465):3267–3287MathSciNetCrossRef Toal DJ, Forrester AI, Bressloff NW, Keane AJ, Holden C (2009) An adjoint for likelihood maximization. Proc R Soc A 8(465):3267–3287MathSciNetCrossRef
Zurück zum Zitat Šimák J (2002) On experimental designs for derivative random fields. PhD thesis. TU Bergakademie Freiberg. Freiberg, Germany Šimák J (2002) On experimental designs for derivative random fields. PhD thesis. TU Bergakademie Freiberg. Freiberg, Germany
Zurück zum Zitat Wang GG, Shan S (2006) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129(4):370–380CrossRef Wang GG, Shan S (2006) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129(4):370–380CrossRef
Zurück zum Zitat Yu W, Bandler J (2006) Optimization of spiral inductor on silicon using space mapping. In: IEEE MTT-S international microwave symposium digest, pp 1085–1088 Yu W, Bandler J (2006) Optimization of spiral inductor on silicon using space mapping. In: IEEE MTT-S international microwave symposium digest, pp 1085–1088
Zurück zum Zitat Zimmermann R (2013) On the maximum likelihood training of gradient-enhanced spatial gaussian processes. SIAM J Sci Comput 35(6):A2554—A2574MATHCrossRef Zimmermann R (2013) On the maximum likelihood training of gradient-enhanced spatial gaussian processes. SIAM J Sci Comput 35(6):A2554—A2574MATHCrossRef
Metadaten
Titel
Performance study of multi-fidelity gradient enhanced kriging
verfasst von
Selvakumar Ulaganathan
Ivo Couckuyt
Francesco Ferranti
Eric Laermans
Tom Dhaene
Publikationsdatum
01.05.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Structural and Multidisciplinary Optimization / Ausgabe 5/2015
Print ISSN: 1615-147X
Elektronische ISSN: 1615-1488
DOI
https://doi.org/10.1007/s00158-014-1192-x

Weitere Artikel der Ausgabe 5/2015

Structural and Multidisciplinary Optimization 5/2015 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.