Skip to main content
Erschienen in: Engineering with Computers 1/2016

01.01.2016 | Original Article

Performance study of gradient-enhanced Kriging

verfasst von: Selvakumar Ulaganathan, Ivo Couckuyt, Tom Dhaene, Joris Degroote, Eric Laermans

Erschienen in: Engineering with Computers | Ausgabe 1/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The use of surrogate models for approximating computationally expensive simulations has been on the rise for the last two decades. Kriging-based surrogate models are popular for approximating deterministic computer models. In this work, the performance of Kriging is investigated when gradient information is introduced for the approximation of computationally expensive black-box simulations. This approach, known as gradient-enhanced Kriging, is applied to various benchmark functions of varying dimensionality (2D-20D). As expected, results from the benchmark problems show that additional gradient information can significantly enhance the accuracy of Kriging. Gradient-enhanced Kriging provides a better approximation even when gradient information is only partially available. Further comparison between gradient-enhanced Kriging and an alternative formulation of gradient-enhanced Kriging, called indirect gradient-enhanced Kriging, highlights various advantages of directly employing gradient information, such as improved surrogate model accuracy, better conditioning of the correlation matrix, etc. Finally, gradient-enhanced Kriging is used to model 6- and 10-variable fluid–structure interaction problems from bio-mechanics to identify the arterial wall’s stiffness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
MATLAB, The MathWorks, Inc., Natick, MA, USA.
 
3
This fact may not be completely true in high dimensional problems where partial set of gradients for a set of high-valued hyper-parameters is required to provide accurate GEK models (Table 8). Again, the size of the set of high-valued hyper-parameters, which is greater than \(5\) in this case, depends on the complexity of the function to be modelled.
 
Literatur
1.
Zurück zum Zitat Brezillon J, Dwight R (2005) Discrete adjoint of the Navier–Stokes equations for aerodynamic shape optimization. In: Evolutionary and deterministic methods for design, optimisation and control with applications to industrial and societal problems (EUROGEN 2005). Munich, Germany Brezillon J, Dwight R (2005) Discrete adjoint of the Navier–Stokes equations for aerodynamic shape optimization. In: Evolutionary and deterministic methods for design, optimisation and control with applications to industrial and societal problems (EUROGEN 2005). Munich, Germany
2.
Zurück zum Zitat Chung HS, Alonso JJ (2002) Using gradients to construct cokriging approximation models for high-dimensional design optimization problems. Problems., G 40th AIAA Aerospace Sciences Meeting and Exhibit, AIAAReno, NV, pp. 2002–0317 Chung HS, Alonso JJ (2002) Using gradients to construct cokriging approximation models for high-dimensional design optimization problems. Problems., G 40th AIAA Aerospace Sciences Meeting and Exhibit, AIAAReno, NV, pp. 2002–0317
3.
Zurück zum Zitat Couckuyt I, Dhaene T, Demeester P (2014) ooDACE toolbox: a flexible object-oriented kriging implementation. J Mach Learn Res 15:3183–3186MATH Couckuyt I, Dhaene T, Demeester P (2014) ooDACE toolbox: a flexible object-oriented kriging implementation. J Mach Learn Res 15:3183–3186MATH
4.
Zurück zum Zitat Degroote J, Bathe KJ, Vierendeels J (2009) Performance of a new partitioned procedure versus a monolithic procedure in fluid–structure interaction. Comput Struct 87(11–12):793–801CrossRef Degroote J, Bathe KJ, Vierendeels J (2009) Performance of a new partitioned procedure versus a monolithic procedure in fluid–structure interaction. Comput Struct 87(11–12):793–801CrossRef
5.
Zurück zum Zitat Degroote J, Hojjat M, Stavropoulou E, Wüchner R, Bletzinger KU (2013) Partitioned solution of an unsteady adjoint for strongly coupled fluid–structure interactions and application to parameter identification of a one-dimensional problem. Struct Multidiscip Optim 47(1):77–94MATHMathSciNetCrossRef Degroote J, Hojjat M, Stavropoulou E, Wüchner R, Bletzinger KU (2013) Partitioned solution of an unsteady adjoint for strongly coupled fluid–structure interactions and application to parameter identification of a one-dimensional problem. Struct Multidiscip Optim 47(1):77–94MATHMathSciNetCrossRef
6.
Zurück zum Zitat Dwight RP, Han ZH (2009) Efficient uncertainty quantification using gradient-enhanced kriging. In: 11th AIAA Non-Deterministic Approaches Conference. Palm Springs, California, USA Dwight RP, Han ZH (2009) Efficient uncertainty quantification using gradient-enhanced kriging. In: 11th AIAA Non-Deterministic Approaches Conference. Palm Springs, California, USA
7.
Zurück zum Zitat Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. Proc R Soc 463:3251–3269MATHCrossRef Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. Proc R Soc 463:3251–3269MATHCrossRef
8.
Zurück zum Zitat Forrester AI, Sóbester A, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide, 1 edn. Wiley, New York (2008) Forrester AI, Sóbester A, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide, 1 edn. Wiley, New York (2008)
9.
Zurück zum Zitat Ginsbourger D (2009) Multiples métamodéles pour l’approximation et l’optimisation de fonctions numériques multivariables. Ph.D. thesis, École des Mines de Saint-Étienne Ginsbourger D (2009) Multiples métamodéles pour l’approximation et l’optimisation de fonctions numériques multivariables. Ph.D. thesis, École des Mines de Saint-Étienne
10.
Zurück zum Zitat Ginsbourger D, Dupuis D, Badea A, Carraro L, Roustant O (2009) A note on the choice and the estimation of kriging models for the analysis of deterministic computer experiments. Appl Stoch Models Bus Ind 25(2):115–131. Special issue: Computer experiments versus physical experiments Ginsbourger D, Dupuis D, Badea A, Carraro L, Roustant O (2009) A note on the choice and the estimation of kriging models for the analysis of deterministic computer experiments. Appl Stoch Models Bus Ind 25(2):115–131. Special issue: Computer experiments versus physical experiments
11.
Zurück zum Zitat Ginsbourger D, Helbert C, Carraro L (2008) Discrete mixtures of kernels for kriging-based optimization. Qual Reliabil Eng Int 24(6):681–691CrossRef Ginsbourger D, Helbert C, Carraro L (2008) Discrete mixtures of kernels for kriging-based optimization. Qual Reliabil Eng Int 24(6):681–691CrossRef
12.
Zurück zum Zitat Griewank A (2000) Evaluating derivatives: principles and techniques of algorithmic differentiation. No. 19 in Frontiers in Appl Math SIAM, Philadelphia, PA (2000) Griewank A (2000) Evaluating derivatives: principles and techniques of algorithmic differentiation. No. 19 in Frontiers in Appl Math SIAM, Philadelphia, PA (2000)
13.
Zurück zum Zitat Husslage B, Rennen G, van Dam E, den Hertog D (2011) Space-filling latin hypercube designs for computer experiments. Optim Eng 12(4):611–630MATHCrossRef Husslage B, Rennen G, van Dam E, den Hertog D (2011) Space-filling latin hypercube designs for computer experiments. Optim Eng 12(4):611–630MATHCrossRef
14.
Zurück zum Zitat Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1):1–13MATHMathSciNetCrossRef Kennedy MC, O’Hagan A (2000) Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1):1–13MATHMathSciNetCrossRef
15.
Zurück zum Zitat Killeya MRH (2004) Thinking inside the box: using derivatives to improve Bayesian black box emulation of computer simulators with application to compart mental models. Ph.D. thesis, Durham theses, Durham University, England Killeya MRH (2004) Thinking inside the box: using derivatives to improve Bayesian black box emulation of computer simulators with application to compart mental models. Ph.D. thesis, Durham theses, Durham University, England
17.
Zurück zum Zitat Laurenceau J, Meaux M, Montagnac M, Sagaut P (2010) Comparison of gradient-based and gradient-enhanced response-surface-based optimizers. Am Inst Aeronaut Astronaut J 48(5):981–994CrossRef Laurenceau J, Meaux M, Montagnac M, Sagaut P (2010) Comparison of gradient-based and gradient-enhanced response-surface-based optimizers. Am Inst Aeronaut Astronaut J 48(5):981–994CrossRef
18.
Zurück zum Zitat Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with kriging and cokriging. AIAA 46(2):498–507CrossRef Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with kriging and cokriging. AIAA 46(2):498–507CrossRef
19.
Zurück zum Zitat Laurent S, Cockcroft J, Van Bortel L, Boutouyrie P, Giannattasio C, Hayoz D, Pannier B, Vlachopoulos C, Wilkinson I, Struijker-Boudier H (2006) Expert consensus document on arterial stiffness: methodological issues and clinical applications. Eur Heart J 27(21):2588–2605CrossRef Laurent S, Cockcroft J, Van Bortel L, Boutouyrie P, Giannattasio C, Hayoz D, Pannier B, Vlachopoulos C, Wilkinson I, Struijker-Boudier H (2006) Expert consensus document on arterial stiffness: methodological issues and clinical applications. Eur Heart J 27(21):2588–2605CrossRef
20.
Zurück zum Zitat Liu W (2003) Development of gradient-enhanced kriging approximations for multidisciplinary design optimisation. Ph.D. thesis, University of Notre Dame, Notre Dame, Indiana Liu W (2003) Development of gradient-enhanced kriging approximations for multidisciplinary design optimisation. Ph.D. thesis, University of Notre Dame, Notre Dame, Indiana
21.
Zurück zum Zitat Lockwood BA, Anitescu M (2010) Gradient-enhanced universal kriging for uncertainty propagation. Preprint ANL/MCS-P1808-1110 Lockwood BA, Anitescu M (2010) Gradient-enhanced universal kriging for uncertainty propagation. Preprint ANL/MCS-P1808-1110
22.
Zurück zum Zitat Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA 40(10):2053–2060CrossRef Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA 40(10):2053–2060CrossRef
23.
Zurück zum Zitat Morris MD, Mitchell TJ, Ylvisaker D (1993) Bayesian design and analysis of computer experiments: use of gradients in surface prediction. Technometrics 35(3):243–255MATHMathSciNetCrossRef Morris MD, Mitchell TJ, Ylvisaker D (1993) Bayesian design and analysis of computer experiments: use of gradients in surface prediction. Technometrics 35(3):243–255MATHMathSciNetCrossRef
24.
Zurück zum Zitat Näther W, Šimák J (2003) Effective observation of random processes using derivatives. Metrika Springer 58:71–84MATH Näther W, Šimák J (2003) Effective observation of random processes using derivatives. Metrika Springer 58:71–84MATH
25.
Zurück zum Zitat Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. The MIT Press, CambridgeMATH Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. The MIT Press, CambridgeMATH
26.
27.
28.
Zurück zum Zitat Schneider R (2012) Feins: Finite element solver for shape optimization with adjoint equations. In: Progress in industrial mathematics at ECMI 2010 Conference, pp. 573–580 Schneider R (2012) Feins: Finite element solver for shape optimization with adjoint equations. In: Progress in industrial mathematics at ECMI 2010 Conference, pp. 573–580
29.
Zurück zum Zitat Shao W, Deng H, Ma Y, Wei Z (2012) Extended Gaussian kriging for computer experiments in engineering design. Eng Comput 28(2):161–178CrossRef Shao W, Deng H, Ma Y, Wei Z (2012) Extended Gaussian kriging for computer experiments in engineering design. Eng Comput 28(2):161–178CrossRef
36.
Zurück zum Zitat Šimák J (2002) On experimental designs for derivative random fields. Ph.D. thesis, TU Bergakademie Freiberg, Freiberg, Germany Šimák J (2002) On experimental designs for derivative random fields. Ph.D. thesis, TU Bergakademie Freiberg, Freiberg, Germany
30.
Zurück zum Zitat Simpson T, Poplinski J, Koch PN, Allen J (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17(2):129–150MATHCrossRef Simpson T, Poplinski J, Koch PN, Allen J (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17(2):129–150MATHCrossRef
31.
Zurück zum Zitat Stein ML (1999) Interpolation of spatial data: some theory for Kriging. Springer, New YorkMATHCrossRef Stein ML (1999) Interpolation of spatial data: some theory for Kriging. Springer, New YorkMATHCrossRef
32.
Zurück zum Zitat Stephenson G (2010) Using derivative information in the statistical analysis of computer models. Ph.D. thesis, University of Southampton, Southampton, UK Stephenson G (2010) Using derivative information in the statistical analysis of computer models. Ph.D. thesis, University of Southampton, Southampton, UK
33.
Zurück zum Zitat Toal DJ, Forrester AI, Bressloff NW, Keane AJ, Holden C (2009) An adjoint for likelihood maximization. Proc R Soc A 8 465(2111):3267–3287 (2009) Toal DJ, Forrester AI, Bressloff NW, Keane AJ, Holden C (2009) An adjoint for likelihood maximization. Proc R Soc A 8 465(2111):3267–3287 (2009)
34.
Zurück zum Zitat Ulaganathan S, Couckuyt I, Ferranti F, Laermans E, Dhaene T (2014) Performance study of multi-fidelity gradient enhanced Kriging. Struct Multidiscip Optim. doi:10.1007/s00158-014-1192-x Ulaganathan S, Couckuyt I, Ferranti F, Laermans E, Dhaene T (2014) Performance study of multi-fidelity gradient enhanced Kriging. Struct Multidiscip Optim. doi:10.​1007/​s00158-014-1192-x
35.
Zurück zum Zitat Vignon-Clementel I, Figueroa C, Jansen K, Taylor C (2010) Outflow boundary conditions for 3D simulations of non-periodic blood flow and pressure fields in deformable arteries. Comput Methods Biomech Biomed Eng 13(5):625–640CrossRef Vignon-Clementel I, Figueroa C, Jansen K, Taylor C (2010) Outflow boundary conditions for 3D simulations of non-periodic blood flow and pressure fields in deformable arteries. Comput Methods Biomech Biomed Eng 13(5):625–640CrossRef
37.
Zurück zum Zitat Wang GG, Shan S (2006) Review of metamodeling techniques in support of engineering design optimization. J Mech Design 129(4):370–380CrossRef Wang GG, Shan S (2006) Review of metamodeling techniques in support of engineering design optimization. J Mech Design 129(4):370–380CrossRef
38.
Zurück zum Zitat Yamazaki W, Rumpfkeil MP, Mavriplis DJ (2010) Design optimization utilizing Gradient/Hessian enhanced surrogate model. In: 28th AIAA Applied Aerodynamics Conference, AIAA paper 2010–4363. Chicago, Illinois, USA Yamazaki W, Rumpfkeil MP, Mavriplis DJ (2010) Design optimization utilizing Gradient/Hessian enhanced surrogate model. In: 28th AIAA Applied Aerodynamics Conference, AIAA paper 2010–4363. Chicago, Illinois, USA
39.
Zurück zum Zitat Ying X, JunHua X, WeiHua Z, YuLin Z (2009) Gradient-based kriging approximate model and its application research to optimization design. Sci China Technol Sci 52(4):1117–1124MATHCrossRef Ying X, JunHua X, WeiHua Z, YuLin Z (2009) Gradient-based kriging approximate model and its application research to optimization design. Sci China Technol Sci 52(4):1117–1124MATHCrossRef
40.
Zurück zum Zitat Zhao D, Xue D (2011) A multi-surrogate approximation method for metamodeling. Eng Comput 27(2):139–153CrossRef Zhao D, Xue D (2011) A multi-surrogate approximation method for metamodeling. Eng Comput 27(2):139–153CrossRef
Metadaten
Titel
Performance study of gradient-enhanced Kriging
verfasst von
Selvakumar Ulaganathan
Ivo Couckuyt
Tom Dhaene
Joris Degroote
Eric Laermans
Publikationsdatum
01.01.2016
Verlag
Springer London
Erschienen in
Engineering with Computers / Ausgabe 1/2016
Print ISSN: 0177-0667
Elektronische ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-015-0397-y

Weitere Artikel der Ausgabe 1/2016

Engineering with Computers 1/2016 Zur Ausgabe