Skip to main content
Top
Published in: Structural and Multidisciplinary Optimization 1/2017

30-01-2017 | RESEARCH PAPER

Metamodeling for high dimensional design problems by multi-fidelity simulations

Authors: Xiwen Cai, Haobo Qiu, Liang Gao, Xinyu Shao

Published in: Structural and Multidisciplinary Optimization | Issue 1/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-fidelity metamodeling provides an efficient way to approximate expensive black-box problems by utilizing the samples of multiple fidelities. While it still faces the challenge of “curse-of-dimensionality” when used in approximating high dimensional problems. On the other hand, the high dimensional model representation (HDMR) method, as an efficient tool to tackle high dimensional problems, can only handle single-fidelity samples in approximation. Therefore, a hybrid metamodel which combines Cut-HDMR with Co-kriging and kriging is proposed to improve the metamodeling efficiency for high dimensional problems. The developed HDMR, termed as MF-HDMR, can efficiently use multi-fidelity samples to approximate black-box problems by using a two stage metamodeling strategy. It can naturally explore and exploit the linearity/nonlinearity and correlations among variables of underlying problems, which are unknown or computationally expensive. Besides, to further improve the efficiency of MF-HDMR, an extended maximin distance sequential sampling method is proposed to add new sample points of different fidelities in the metamodeling process. Moreover, a mathematical function is used to illustrate the modeling theory and procedures of MF-HDMR. In order to validate the proposed method, it is tested by several numerical benchmark problems and successfully applied in the optimal design of a long cylinder pressure vessel. Moreover, an overall comparison between the proposed method and several other metamodeling methods has been made. Results show that the proposed method is very efficient in approximating high dimensional problems by using multi-fidelity samples, thus making it particularly suitable for high dimensional engineering design problems involving computationally expensive simulations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Cai X, Qiu H, Gao L, Yang P, Shao X (2016) An enhanced RBF-HDMR integrated with an adaptive sampling method for approximating high dimensional problems in engineering design. Struct Multidiscip Optim 53(6):1209–1229CrossRef Cai X, Qiu H, Gao L, Yang P, Shao X (2016) An enhanced RBF-HDMR integrated with an adaptive sampling method for approximating high dimensional problems in engineering design. Struct Multidiscip Optim 53(6):1209–1229CrossRef
go back to reference Chen Z (1993) Fitting multivariate regression functions by interaction spline models. J R Stat Soc SerB (Methodol) 473–491 Chen Z (1993) Fitting multivariate regression functions by interaction spline models. J R Stat Soc SerB (Methodol) 473–491
go back to reference Cleveland WS, Devlin SJ (1988) Locally weighted regression: an approach to regression analysis by local fitting. J Am Stat Assoc 83(403):596–610CrossRefMATH Cleveland WS, Devlin SJ (1988) Locally weighted regression: an approach to regression analysis by local fitting. J Am Stat Assoc 83(403):596–610CrossRefMATH
go back to reference Drucker H, Burges CJ, Kaufman L, Smola A, Vapnik V (1997) Support vector regression machines. Adv Neural Inf Proces Syst 9:155–161 Drucker H, Burges CJ, Kaufman L, Smola A, Vapnik V (1997) Support vector regression machines. Adv Neural Inf Proces Syst 9:155–161
go back to reference Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. In Proceedings of the royal society of london a: mathematical, physical and engineering sciences. R Soc 463(2088):3251–3269MathSciNetCrossRefMATH Forrester AI, Sóbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. In Proceedings of the royal society of london a: mathematical, physical and engineering sciences. R Soc 463(2088):3251–3269MathSciNetCrossRefMATH
go back to reference Friedman JH (1991) Multivariate adaptive regression splines. Ann stat 1–67 Friedman JH (1991) Multivariate adaptive regression splines. Ann stat 1–67
go back to reference Gano SE, Renaud JE, Sanders B (2005) Hybrid variable fidelity optimization by using a kriging-based scaling function. AIAA J 43(11):2422–2433CrossRef Gano SE, Renaud JE, Sanders B (2005) Hybrid variable fidelity optimization by using a kriging-based scaling function. AIAA J 43(11):2422–2433CrossRef
go back to reference Han ZH, Görtz S, Zimmermann R (2013) Improving variable-fidelity surrogate modeling via gradient-enhanced kriging and a generalized hybrid bridge function. Aerosp Sci Technol 25(1):177–189CrossRef Han ZH, Görtz S, Zimmermann R (2013) Improving variable-fidelity surrogate modeling via gradient-enhanced kriging and a generalized hybrid bridge function. Aerosp Sci Technol 25(1):177–189CrossRef
go back to reference Huang D, Allen TT, Notz WI, Miller RA (2006) Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidiscip Optim 32(5):369–382CrossRef Huang D, Allen TT, Notz WI, Miller RA (2006) Sequential kriging optimization using multiple-fidelity evaluations. Struct Multidiscip Optim 32(5):369–382CrossRef
go back to reference Huang Z, Qiu H, Zhao M, Cai X, Gao L (2015) An adaptive SVR-HDMR model for approximating high dimensional problems. Eng Comput 32(3):643–667CrossRef Huang Z, Qiu H, Zhao M, Cai X, Gao L (2015) An adaptive SVR-HDMR model for approximating high dimensional problems. Eng Comput 32(3):643–667CrossRef
go back to reference Jin R, Chen W, Simpson TW (2001) Comparative studies of metamodelling techniques under multiple modelling criteria. Struct Multidiscip Optim 23(1):1–13CrossRef Jin R, Chen W, Simpson TW (2001) Comparative studies of metamodelling techniques under multiple modelling criteria. Struct Multidiscip Optim 23(1):1–13CrossRef
go back to reference Jin R, Chen W, Sudjianto A (2002) On sequential sampling for global metamodeling in engineering design. In ASME 2002 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Am Soc Mech Eng 539–548 Jin R, Chen W, Sudjianto A (2002) On sequential sampling for global metamodeling in engineering design. In ASME 2002 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Am Soc Mech Eng 539–548
go back to reference Jones DR, Perttunen CD, Stuckman BE (1993) Lipschitzian optimization without the Lipschitz constant. J Optim Theory Appl 79(1):157–181 Jones DR, Perttunen CD, Stuckman BE (1993) Lipschitzian optimization without the Lipschitz constant. J Optim Theory Appl 79(1):157–181
go back to reference Kim HS, Koc M, Ni J (2007) A hybrid multi-fidelity approach to the optimal design of warm forming processes using a knowledge-based artificial neural network. Int J Mach Tools Manuf 47(2):211–222CrossRef Kim HS, Koc M, Ni J (2007) A hybrid multi-fidelity approach to the optimal design of warm forming processes using a knowledge-based artificial neural network. Int J Mach Tools Manuf 47(2):211–222CrossRef
go back to reference Kim BS, Lee YB, Choi DH (2009) Comparison study on the accuracy of metamodeling technique for non-convex functions. J Mech Sci Technol 23(4):1175–1181CrossRef Kim BS, Lee YB, Choi DH (2009) Comparison study on the accuracy of metamodeling technique for non-convex functions. J Mech Sci Technol 23(4):1175–1181CrossRef
go back to reference Leary SJ, Bhaskar A, Keane AJ (2003) A knowledge-based approach to response surface modelling in multifidelity optimization. J Glob Optim 26(3):297–319MathSciNetCrossRefMATH Leary SJ, Bhaskar A, Keane AJ (2003) A knowledge-based approach to response surface modelling in multifidelity optimization. J Glob Optim 26(3):297–319MathSciNetCrossRefMATH
go back to reference Li E, Wang H (2016) An alternative adaptive differential evolutionary Algorithm assisted by Expected Improvement criterion and cut-HDMR expansion and its application in time-based sheet forming design. Adv Eng Soft 97:96–107 Li E, Wang H (2016) An alternative adaptive differential evolutionary Algorithm assisted by Expected Improvement criterion and cut-HDMR expansion and its application in time-based sheet forming design. Adv Eng Soft 97:96–107
go back to reference Li G, Wang SW, Rabitz H (2002) Practical approaches to construct RS-HDMR component functions. J Phys Chem A 106(37):8721–8733 Li G, Wang SW, Rabitz H (2002) Practical approaches to construct RS-HDMR component functions. J Phys Chem A 106(37):8721–8733
go back to reference Lophaven S, Nielsen H, Sondergaard J (2002) AMatlab Kriging Toolbox. Technical University of Denmark, Kongens Lyngby, Technical Report No. IMM-TR-2002-12 Lophaven S, Nielsen H, Sondergaard J (2002) AMatlab Kriging Toolbox. Technical University of Denmark, Kongens Lyngby, Technical Report No. IMM-TR-2002-12
go back to reference Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060 Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060
go back to reference Mullur AA, Messac A (2005) Extended radial basis functions: more flexible and effective metamodeling. AIAA J 43(6):1306–1315CrossRef Mullur AA, Messac A (2005) Extended radial basis functions: more flexible and effective metamodeling. AIAA J 43(6):1306–1315CrossRef
go back to reference Orr MJ (1995) Local smoothing of radial basis function networks. In International Symposium on Artificial Neural Networks Orr MJ (1995) Local smoothing of radial basis function networks. In International Symposium on Artificial Neural Networks
go back to reference Rabitz H, Aliş ÖF, Shorter J, Shim K (1999) Efficient input—output model representations. Comput Phys Commun 117(1):11–20 Rabitz H, Aliş ÖF, Shorter J, Shim K (1999) Efficient input—output model representations. Comput Phys Commun 117(1):11–20
go back to reference Rajnarayan D, Haas A, Kroo I (2008) A multi-fidelity gradient-free optimization method and application to aerodynamic design. In 12th AIAA/ISSMO multidisciplinary analysis and optimization conference, Victoria, British Columbia AIAA 6020 Rajnarayan D, Haas A, Kroo I (2008) A multi-fidelity gradient-free optimization method and application to aerodynamic design. In 12th AIAA/ISSMO multidisciplinary analysis and optimization conference, Victoria, British Columbia AIAA 6020
go back to reference Rao B, Chowdhury R (2008) Probabilistic analysis using high dimensional model representation and fast Fourier transform. Int J Comput Methods Eng Sci Mech 9(6):342–357CrossRefMATH Rao B, Chowdhury R (2008) Probabilistic analysis using high dimensional model representation and fast Fourier transform. Int J Comput Methods Eng Sci Mech 9(6):342–357CrossRefMATH
go back to reference Shan S, Wang GG (2009) Development of adaptive RBF-HDMR model for approximating high dimensional problems, ASME Shan S, Wang GG (2009) Development of adaptive RBF-HDMR model for approximating high dimensional problems, ASME
go back to reference Shan S, Wang GG (2010) Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions. Struct Multidiscip Optim 41(2):219–241MathSciNetCrossRefMATH Shan S, Wang GG (2010) Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions. Struct Multidiscip Optim 41(2):219–241MathSciNetCrossRefMATH
go back to reference Shan S, Wang GG (2011) Turning Black-Box Functions Into White Functions. J Mech Des 133(3):031003CrossRef Shan S, Wang GG (2011) Turning Black-Box Functions Into White Functions. J Mech Des 133(3):031003CrossRef
go back to reference Simpson TW, Poplinski JD, Koch PN, Allen JK (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17(2):129–150CrossRefMATH Simpson TW, Poplinski JD, Koch PN, Allen JK (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17(2):129–150CrossRefMATH
go back to reference Simpson TW, Toropov V, Balabanov V, Viana FA (2008) Design and analysis of computer experiments in multidisciplinary design optimization: a review of how far we have come or not. 12th AIAA/ISSMO Mult Anal Opt Conf 5(10):10–12 Simpson TW, Toropov V, Balabanov V, Viana FA (2008) Design and analysis of computer experiments in multidisciplinary design optimization: a review of how far we have come or not. 12th AIAA/ISSMO Mult Anal Opt Conf 5(10):10–12
go back to reference Sobol I (2003) Theorems and examples on high dimensional model representation. Reliabil En Syst Safety 79(2):187–193MathSciNetCrossRef Sobol I (2003) Theorems and examples on high dimensional model representation. Reliabil En Syst Safety 79(2):187–193MathSciNetCrossRef
go back to reference Sun G, Li G, Zhou S, Xu W, Yang X, Li Q (2011) Multi-fidelity optimization for sheet metal forming process. Struct Multidiscip Optim 44(1):111–124CrossRef Sun G, Li G, Zhou S, Xu W, Yang X, Li Q (2011) Multi-fidelity optimization for sheet metal forming process. Struct Multidiscip Optim 44(1):111–124CrossRef
go back to reference Tang L, Wang H, Li G (2013) Advanced high strength steel springback optimization by projection-based heuristic global search algorithm. Mater Des 43:426–437CrossRef Tang L, Wang H, Li G (2013) Advanced high strength steel springback optimization by projection-based heuristic global search algorithm. Mater Des 43:426–437CrossRef
go back to reference Tyan M, Nguyen NV, Lee JW (2015) Improving variable-fidelity modelling by exploring global design space and radial basis function networks for aero foil design. Eng Optim 47(7):885–908CrossRef Tyan M, Nguyen NV, Lee JW (2015) Improving variable-fidelity modelling by exploring global design space and radial basis function networks for aero foil design. Eng Optim 47(7):885–908CrossRef
go back to reference Ulaganathan S, Couckuyt I, Ferranti F, Laermans E, Dhaene T (2015) Performance study of multi-fidelity gradient enhanced kriging. Struct Multidiscip Optim 51(5):1017–1033CrossRef Ulaganathan S, Couckuyt I, Ferranti F, Laermans E, Dhaene T (2015) Performance study of multi-fidelity gradient enhanced kriging. Struct Multidiscip Optim 51(5):1017–1033CrossRef
go back to reference Viana FA, Venter G, Balabanov V (2010) An algorithm for fast optimal Latin hypercube design of experiments. Int J Numer Methods Eng 82(2):135–156MathSciNetMATH Viana FA, Venter G, Balabanov V (2010) An algorithm for fast optimal Latin hypercube design of experiments. Int J Numer Methods Eng 82(2):135–156MathSciNetMATH
go back to reference Viana FA, Simpson TW, Balabanov V, Toropov V (2014) Special Section on Multidisciplinary Design Optimization: Metamodeling in Multidisciplinary Design Optimization: How Far Have We Really Come?.AIAA. Journal 52(4):670–690 Viana FA, Simpson TW, Balabanov V, Toropov V (2014) Special Section on Multidisciplinary Design Optimization: Metamodeling in Multidisciplinary Design Optimization: How Far Have We Really Come?.AIAA. Journal 52(4):670–690
go back to reference Wang H, Tang L, Li GY (2011) Adaptive MLS-HDMR metamodeling techniques for high dimensional problems. Expert Syst Appl 38(11):14117–14126 Wang H, Tang L, Li GY (2011) Adaptive MLS-HDMR metamodeling techniques for high dimensional problems. Expert Syst Appl 38(11):14117–14126
go back to reference Xu J, Zhang S, Huang E, Chen CH, Lee LH, Celik N (2015) Mo2tos: Multi-fidelity optimization with ordinal transformation and optimal sampling. Asia-Pacif J Operat Res 1650017 Xu J, Zhang S, Huang E, Chen CH, Lee LH, Celik N (2015) Mo2tos: Multi-fidelity optimization with ordinal transformation and optimal sampling. Asia-Pacif J Operat Res 1650017
go back to reference Zhao D, Xue D (2010) A comparative study of metamodeling methods considering sample quality merits. Struct Multidiscip Optim 42(6):923–938CrossRef Zhao D, Xue D (2010) A comparative study of metamodeling methods considering sample quality merits. Struct Multidiscip Optim 42(6):923–938CrossRef
go back to reference Zheng J, Shao X, Gao L, Jiang P, Li Z (2013) A hybrid variable-fidelity global approximation modelling method combining tuned radial basis function base and kriging correction. J Eng Des 24(8):604–622CrossRef Zheng J, Shao X, Gao L, Jiang P, Li Z (2013) A hybrid variable-fidelity global approximation modelling method combining tuned radial basis function base and kriging correction. J Eng Des 24(8):604–622CrossRef
go back to reference Zheng J, Shao X, Gao L, Jiang P, Qiu H (2015) Difference mapping method using least square support vector regression for variable-fidelity metamodelling. Eng Optim 47(6):719–736CrossRef Zheng J, Shao X, Gao L, Jiang P, Qiu H (2015) Difference mapping method using least square support vector regression for variable-fidelity metamodelling. Eng Optim 47(6):719–736CrossRef
go back to reference Ziehn T, Tomlin AS (2008) A global sensitivity study of sulfur chemistry in a premixed methane flame model using HDMR. In J Chem Kinet 40(11):742–753CrossRef Ziehn T, Tomlin AS (2008) A global sensitivity study of sulfur chemistry in a premixed methane flame model using HDMR. In J Chem Kinet 40(11):742–753CrossRef
Metadata
Title
Metamodeling for high dimensional design problems by multi-fidelity simulations
Authors
Xiwen Cai
Haobo Qiu
Liang Gao
Xinyu Shao
Publication date
30-01-2017
Publisher
Springer Berlin Heidelberg
Published in
Structural and Multidisciplinary Optimization / Issue 1/2017
Print ISSN: 1615-147X
Electronic ISSN: 1615-1488
DOI
https://doi.org/10.1007/s00158-017-1655-y

Other articles of this Issue 1/2017

Structural and Multidisciplinary Optimization 1/2017 Go to the issue

Premium Partners