Skip to main content
Erschienen in: Engineering with Computers 3/2016

01.07.2016 | Original Article

A study into the potential of GPUs for the efficient construction and evaluation of Kriging models

verfasst von: David J. J. Toal

Erschienen in: Engineering with Computers | Ausgabe 3/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The surrogate modelling technique known as Kriging, and its various derivatives, requires an optimization process to effectively determine the model’s defining parameters. This optimization typically involves the maximisation of a likelihood function which requires the construction and inversion of a correlation matrix dependent on the selected modelling parameters. The construction of such models in high dimensions and with a large numbers of sample points can, therefore, be considerably expensive. Similarly, once such a model has been constructed the evaluation of the predictor, error and other related design and model improvement criteria can also be costly. The following paper investigates the potential for graphical processing units to be used to accelerate the evaluation of the Kriging likelihood, predictor and error functions. Five different Kriging formulations are considered including, ordinary, universal, non-stationary, gradient-enhanced and multi-fidelity Kriging. Other key contributions include the derivation of the adjoint of the likelihood function for a fully and partially gradient-enhanced Kriging model as well as the presentation of novel schemes to accelerate the likelihood optimization via a mixture of single and double precision calculations and by automatically selecting the best hardware to perform the evaluations on.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Akbariyeh A, Carrigan T, Dennis B, Chan W, Wang B, Lawrence K (2012) Application of gpu-based computing to large scale finite element analysis of three-dimensional structures. In: Proceedings of the 8th international conference on engineering computational technology Akbariyeh A, Carrigan T, Dennis B, Chan W, Wang B, Lawrence K (2012) Application of gpu-based computing to large scale finite element analysis of three-dimensional structures. In: Proceedings of the 8th international conference on engineering computational technology
2.
Zurück zum Zitat Angelikopoulos P, Papadimitriou C (2012) Bayesian uncertainty quantification and propagation in molecular dynamics simulations. In: ECCOMAS 2012—European congress on computational methods in applied sciences and engineering Angelikopoulos P, Papadimitriou C (2012) Bayesian uncertainty quantification and propagation in molecular dynamics simulations. In: ECCOMAS 2012—European congress on computational methods in applied sciences and engineering
5.
Zurück zum Zitat Brooks C, Forrester A, Keane A, Shahpar S (2011) Multi-fidelity design optimisation of a transonic compressor rotor. In: 9th European turbomachinery conference. Istanbul Brooks C, Forrester A, Keane A, Shahpar S (2011) Multi-fidelity design optimisation of a transonic compressor rotor. In: 9th European turbomachinery conference. Istanbul
9.
Zurück zum Zitat Cressie N (1993) Statistics for spatial data, probability and mathematical statistics. Wiley, New York Cressie N (1993) Statistics for spatial data, probability and mathematical statistics. Wiley, New York
11.
Zurück zum Zitat Demir I, Westermann R (2013) Progressive high-quality response surfaces for visually guided sensitivity analysis. Comput Graph Forum 32(3):2130. doi:10.1111/cgf.12089 Demir I, Westermann R (2013) Progressive high-quality response surfaces for visually guided sensitivity analysis. Comput Graph Forum 32(3):2130. doi:10.​1111/​cgf.​12089
12.
Zurück zum Zitat Dwight R, Han Z (2009) Efficient uncertainty quantification using gradient-enhanced kriging. In: 50th AIAA/ASME/ASCE/AHS/ASC Structures, structural dynamics, and materials conference. doi: Y10.2514/6.2009-2276 Dwight R, Han Z (2009) Efficient uncertainty quantification using gradient-enhanced kriging. In: 50th AIAA/ASME/ASCE/AHS/ASC Structures, structural dynamics, and materials conference. doi: Y10.2514/6.2009-2276
16.
Zurück zum Zitat Forrester A, Keane A, Bressloff N (2006) Design and analysis of “noisy” computer experiments. AIAA Journal 44(10):2331–2339CrossRef Forrester A, Keane A, Bressloff N (2006) Design and analysis of “noisy” computer experiments. AIAA Journal 44(10):2331–2339CrossRef
17.
Zurück zum Zitat Forrester A, Sóbester A, Keane A (2008) Engineering design via surrogate modelling. Wiley, LondonCrossRefMATH Forrester A, Sóbester A, Keane A (2008) Engineering design via surrogate modelling. Wiley, LondonCrossRefMATH
18.
Zurück zum Zitat Fuentes M (2001) A high frequency Kriging approach for non-stationary environmental processes. Environmetrics 12:469–483CrossRef Fuentes M (2001) A high frequency Kriging approach for non-stationary environmental processes. Environmetrics 12:469–483CrossRef
19.
Zurück zum Zitat Gibbs M (1997) Bayesian Gaussian processes for regression and classficiation. Ph.D. Dissertation, University of Cambridge Gibbs M (1997) Bayesian Gaussian processes for regression and classficiation. Ph.D. Dissertation, University of Cambridge
21.
Zurück zum Zitat Giles M, Pierce N (2000) An introduction to the adjoint approach to design. Flow Turbul Combust 65(3–4):393–415CrossRefMATH Giles M, Pierce N (2000) An introduction to the adjoint approach to design. Flow Turbul Combust 65(3–4):393–415CrossRefMATH
22.
Zurück zum Zitat Griewank A (2000) Evaluating derivatives: principles and techniques of algorithmic differentiation. SIAM, Philadelphia Griewank A (2000) Evaluating derivatives: principles and techniques of algorithmic differentiation. SIAM, Philadelphia
23.
Zurück zum Zitat Haas T (1990) Lognormal and moving window methods of estimating acid deposition. J Am Stat Assoc 85(412):950–963CrossRef Haas T (1990) Lognormal and moving window methods of estimating acid deposition. J Am Stat Assoc 85(412):950–963CrossRef
30.
Zurück zum Zitat Keane A (2006) Statistical improvement criteria for use in mulitobjective design optimization. AIAA J 44(4):879–891CrossRef Keane A (2006) Statistical improvement criteria for use in mulitobjective design optimization. AIAA J 44(4):879–891CrossRef
32.
Zurück zum Zitat Krige D (1951) A statistical approach to some basic mine valuation problems on the witwatersrand. J Chem Metallurigical Min Eng Soc S Afr 52(6):119–139. doi:10.2307/3006914 Krige D (1951) A statistical approach to some basic mine valuation problems on the witwatersrand. J Chem Metallurigical Min Eng Soc S Afr 52(6):119–139. doi:10.​2307/​3006914
33.
Zurück zum Zitat Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with Kriging and cokriging. AIAA J 46(2):498–507. doi:10.2514/1.32308 CrossRef Laurenceau J, Sagaut P (2008) Building efficient response surfaces of aerodynamic functions with Kriging and cokriging. AIAA J 46(2):498–507. doi:10.​2514/​1.​32308 CrossRef
34.
Zurück zum Zitat Leary S, Bhaskar A, Keane A (2004) Global approximation and optimisation using adjoint computational fluid dynamics codes. AIAA J 42(3):631–641CrossRef Leary S, Bhaskar A, Keane A (2004) Global approximation and optimisation using adjoint computational fluid dynamics codes. AIAA J 42(3):631–641CrossRef
35.
Zurück zum Zitat Leithead W, Zhang Y (2007) \(O(N^2)\)-operation approximation of covariance matrix inverse in gaussian process regression based on quasi-newton BFGS method. Commun Stat Simul Comput 36(2):367–380MathSciNetCrossRefMATH Leithead W, Zhang Y (2007) \(O(N^2)\)-operation approximation of covariance matrix inverse in gaussian process regression based on quasi-newton BFGS method. Commun Stat Simul Comput 36(2):367–380MathSciNetCrossRefMATH
36.
Zurück zum Zitat Li Q, Salman R, Kecman V (2010) An intelligent system for accelerating parallel SVM classification problems on large datasets using GPU. In: Proceedings of the 2010 10th international conference on intelligent systems design and applications, pp 1131–1135. doi:10.1109/ISDA.2010.5687033 Li Q, Salman R, Kecman V (2010) An intelligent system for accelerating parallel SVM classification problems on large datasets using GPU. In: Proceedings of the 2010 10th international conference on intelligent systems design and applications, pp 1131–1135. doi:10.​1109/​ISDA.​2010.​5687033
37.
Zurück zum Zitat Liao Q, Wang J, Webster Y, Watson I (2009) Gpu accelerated support vector machines for mining high-throughput screening data. J Chem Inf Model 49(12):2718–2725CrossRef Liao Q, Wang J, Webster Y, Watson I (2009) Gpu accelerated support vector machines for mining high-throughput screening data. J Chem Inf Model 49(12):2718–2725CrossRef
38.
Zurück zum Zitat Lophaven S, Nielsen H, Søndergaard J (2002) Dace: A matlab Kriging toolbox, imm-tr-2002-12. Tech. rep., Informatics and Mathematical Modelling, Technical University of Denmark Lophaven S, Nielsen H, Søndergaard J (2002) Dace: A matlab Kriging toolbox, imm-tr-2002-12. Tech. rep., Informatics and Mathematical Modelling, Technical University of Denmark
39.
40.
Zurück zum Zitat Mishra V, Suresh K (2011) GPU-friendly preconditioners for efficient 3-d finite element analysis of thin structures. In: Proceedings of the ASME 2011 international design engineering technical conferences and computers and information in engineering conference Mishra V, Suresh K (2011) GPU-friendly preconditioners for efficient 3-d finite element analysis of thin structures. In: Proceedings of the ASME 2011 international design engineering technical conferences and computers and information in engineering conference
41.
Zurück zum Zitat Paciorek C, Schervish M (2004) Nonstationary covariance functions for Gaussian process regression. Adv Neural Inf Process Syst 16:273–280 Paciorek C, Schervish M (2004) Nonstationary covariance functions for Gaussian process regression. Adv Neural Inf Process Syst 16:273–280
42.
Zurück zum Zitat Pintore A, Holmes C (2004) Spatially adaptive non-stationary covariance functions via spatially adaptive spectra. Technical Report, University of Oxford, U.K Pintore A, Holmes C (2004) Spatially adaptive non-stationary covariance functions via spatially adaptive spectra. Technical Report, University of Oxford, U.K
43.
Zurück zum Zitat Gutiérrez de Ravé E, Jiménez-Hornero F, Ariza-Villaverde A, Gómez-Lpez J (2014) Using general-purpose computing on graphics processing units (GPGPU) to accelerate the ordinary Kriging algorithm. Comput Geosci 64:1–6. doi:10.1016/j.cageo.2012.11.013 Gutiérrez de Ravé E, Jiménez-Hornero F, Ariza-Villaverde A, Gómez-Lpez J (2014) Using general-purpose computing on graphics processing units (GPGPU) to accelerate the ordinary Kriging algorithm. Comput Geosci 64:1–6. doi:10.​1016/​j.​cageo.​2012.​11.​013
47.
Zurück zum Zitat Sampson P, Guttorp P (1992) Nonparametric estimation of nonstationary spatial covariance structure. J Am Stat Assoc 87(417):108–119CrossRef Sampson P, Guttorp P (1992) Nonparametric estimation of nonstationary spatial covariance structure. J Am Stat Assoc 87(417):108–119CrossRef
48.
Zurück zum Zitat Sankaran R, Grout R (2012) Accelerating the computation of detailed chemical reaction kinetics for simulating combustion of complex fuels. In: 50th AIAA aerospace sciences meeting including the new horizons forum and aerospace exposition. doi:Y10.2514/6.2012-720 Sankaran R, Grout R (2012) Accelerating the computation of detailed chemical reaction kinetics for simulating combustion of complex fuels. In: 50th AIAA aerospace sciences meeting including the new horizons forum and aerospace exposition. doi:Y10.2514/6.2012-720
49.
51.
56.
Zurück zum Zitat Viana F, Simpson T, Balabanov V, Toropov V (2014) Metamodeling in multidisciplinary design optimization: how far have we come. AIAA J. doi:10.2514/1.J052375 Viana F, Simpson T, Balabanov V, Toropov V (2014) Metamodeling in multidisciplinary design optimization: how far have we come. AIAA J. doi:10.​2514/​1.​J052375
57.
Zurück zum Zitat Voutchkov I, Keane A, Fox R (2006) Robust structural design of a simplified jet engine model using multiobjective optimization. In: 11th AIAA/ISSMO Multidisciplinary analysis and optimization conference. Portsmouth Voutchkov I, Keane A, Fox R (2006) Robust structural design of a simplified jet engine model using multiobjective optimization. In: 11th AIAA/ISSMO Multidisciplinary analysis and optimization conference. Portsmouth
58.
Zurück zum Zitat Wachowiak M, Lambe Foster AE (2012) GPU-based asynchronous global optimization with particle swarm. In: High performance computing symposium 2012 Wachowiak M, Lambe Foster AE (2012) GPU-based asynchronous global optimization with particle swarm. In: High performance computing symposium 2012
60.
Zurück zum Zitat Xiong Y, Chen W, Apley D, Ding X (2007) A non-stationary covariance-based Kriging method for metamodelling in engineering design. Int J Numer Methods Eng 71(6):733–756CrossRefMATH Xiong Y, Chen W, Apley D, Ding X (2007) A non-stationary covariance-based Kriging method for metamodelling in engineering design. Int J Numer Methods Eng 71(6):733–756CrossRefMATH
61.
Zurück zum Zitat Zbierski M (2011) A simulated annealing algorithm for GPU clusters. In: 9th International conference on parallel processing and applied mathematics Zbierski M (2011) A simulated annealing algorithm for GPU clusters. In: 9th International conference on parallel processing and applied mathematics
63.
Zurück zum Zitat Zhang Y, Leithead W (2005) Exploiting hessian matrix and trust-region algorithm in hyperparameters estimation of Gaussian process. Appl Math Comput 171(2):1264–1281MathSciNetMATH Zhang Y, Leithead W (2005) Exploiting hessian matrix and trust-region algorithm in hyperparameters estimation of Gaussian process. Appl Math Comput 171(2):1264–1281MathSciNetMATH
64.
Zurück zum Zitat Zhongwen L, Hongzhi L, Zhengping Y, Xincai W (2005) Self-organizing maps computing on graphic process unit. In: Proceedings—13th European symposium on artificial neural networks Zhongwen L, Hongzhi L, Zhengping Y, Xincai W (2005) Self-organizing maps computing on graphic process unit. In: Proceedings—13th European symposium on artificial neural networks
Metadaten
Titel
A study into the potential of GPUs for the efficient construction and evaluation of Kriging models
verfasst von
David J. J. Toal
Publikationsdatum
01.07.2016
Verlag
Springer London
Erschienen in
Engineering with Computers / Ausgabe 3/2016
Print ISSN: 0177-0667
Elektronische ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-015-0421-2

Weitere Artikel der Ausgabe 3/2016

Engineering with Computers 3/2016 Zur Ausgabe

Neuer Inhalt