Skip to main content

2015 | OriginalPaper | Buchkapitel

Adaptive Switching of Variable-Fidelity Models in Population-Based Optimization

verfasst von : Ali Mehmani, Souma Chowdhury, Weiyang Tong, Achille Messac

Erschienen in: Engineering and Applied Sciences Optimization

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This article presents a novel model management technique to be implemented in population-based heuristic optimization. This technique adaptively selects different computational models (both physics-based models and surrogate models) to be used during optimization, with the overall objective to result in optimal designs with high fidelity function estimates at a reasonable computational expense. For example, in optimizing an aircraft wing to obtain maximum lift-to-drag ratio, one can use low fidelity models such as given by the vortex lattice method, or a high fidelity finite volume model, or a surrogate model that substitutes the high-fidelity model. The information from these models with different levels of fidelity is integrated into the heuristic optimization process using the new adaptive model switching (AMS) technique. The model switching technique replaces the current model with the next higher fidelity model, when a stochastic switching criterion is met at a given iteration during the optimization process. The switching criterion is based on whether the uncertainty associated with the current model output dominates the latest improvement of the relative fitness function, where both the model output uncertainty and the function improvement (across the population) are expressed as probability distributions. For practical implementation, a measure of critical probability is used to regulate the degree of error that will be allowed, i.e., the fraction of instances where the improvement will be allowed to be lower than the model error, without having to change the model. In the absence of this critical probability, model management might become too conservative, leading to premature model-switching and thus higher computing expense. The proposed AMS-based optimization is applied to two design problems through Particle Swarm Optimization, which are: (i) Airfoil design, and (ii) Cantilever composite beam design. The application case studies of AMS illustrated: (i) the computational advantage of this method over purely high fidelity model-based optimization, and (ii) the accuracy advantage of this method over purely low fidelity model-based optimization.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hutchison MG, Unger ER, Mason WH, Grossman B, Haftka RT (1994) Variable-complexity aerodynamic optimization of a high-speed civil transport wing. J Aircr 31(1):110–116CrossRef Hutchison MG, Unger ER, Mason WH, Grossman B, Haftka RT (1994) Variable-complexity aerodynamic optimization of a high-speed civil transport wing. J Aircr 31(1):110–116CrossRef
2.
Zurück zum Zitat Jeong S, Murayama M, Yamamoto K (2005) Efficient optimization design method using kriging model. J Aircr 42(2):413–420CrossRef Jeong S, Murayama M, Yamamoto K (2005) Efficient optimization design method using kriging model. J Aircr 42(2):413–420CrossRef
3.
Zurück zum Zitat Oktem H, Erzurumlu T, Kurtaran H (2005) Application of response surface methodology in the optimization of cutting conditions for surface roughness. J Mater Proces Technol 170(1):11–16CrossRef Oktem H, Erzurumlu T, Kurtaran H (2005) Application of response surface methodology in the optimization of cutting conditions for surface roughness. J Mater Proces Technol 170(1):11–16CrossRef
4.
Zurück zum Zitat Simpson T, Booker A, Ghosh D, Giunta A, Koch P, Yang RJ (2004) Approximation methods in multidisciplinary analysis and optimization: a panel discussion. Struct Multidiscip Optim 27(5):302–313CrossRef Simpson T, Booker A, Ghosh D, Giunta A, Koch P, Yang RJ (2004) Approximation methods in multidisciplinary analysis and optimization: a panel discussion. Struct Multidiscip Optim 27(5):302–313CrossRef
5.
Zurück zum Zitat Simpson T, Toropov V, Balabanov V, Viana F (2008) Design and analysis of computer experiments in multidisciplinary design optimization: a review of how far we have come or not. In: 12th AIAA/ISSMO multidisciplinary analysis and optimization conference, Victoria, Canada Simpson T, Toropov V, Balabanov V, Viana F (2008) Design and analysis of computer experiments in multidisciplinary design optimization: a review of how far we have come or not. In: 12th AIAA/ISSMO multidisciplinary analysis and optimization conference, Victoria, Canada
6.
Zurück zum Zitat Wang G, Shan S (2007) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129(4):370–381CrossRefMathSciNet Wang G, Shan S (2007) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129(4):370–381CrossRefMathSciNet
7.
Zurück zum Zitat Jin R, Chen W, Simpson TW (2000) Comparative studies of metamodeling techniques under multiple modeling criteria. AIAA (4801) Jin R, Chen W, Simpson TW (2000) Comparative studies of metamodeling techniques under multiple modeling criteria. AIAA (4801)
8.
Zurück zum Zitat Forrester A, Keane A (2009) Recent advances in surrogate-based optimization. Prog Aerosp Sci 45(1–3):50–79CrossRef Forrester A, Keane A (2009) Recent advances in surrogate-based optimization. Prog Aerosp Sci 45(1–3):50–79CrossRef
9.
Zurück zum Zitat Simpson T, Korte J, Mauery T, Mistree F (2001) Kriging models for global approximation in simulation-based multidisciplinary design optimization. AIAA J 39(12):2233–2241CrossRef Simpson T, Korte J, Mauery T, Mistree F (2001) Kriging models for global approximation in simulation-based multidisciplinary design optimization. AIAA J 39(12):2233–2241CrossRef
10.
Zurück zum Zitat Choi K, Young B, Yang R (2001) Moving least square method for reliability-based design optimization. In: 4th world congress of structural and multidisciplinary optimization, Dalian, China, pp 4–8 Choi K, Young B, Yang R (2001) Moving least square method for reliability-based design optimization. In: 4th world congress of structural and multidisciplinary optimization, Dalian, China, pp 4–8
11.
Zurück zum Zitat Toropov VV, Schramm U, Sahai A, Jones RD, Zeguer T (2005) Design optimization and stochastic analysis based on the moving least squares method. In: 6th world congresses of structural and multidisciplinary optimization, Rio de Janeiro Toropov VV, Schramm U, Sahai A, Jones RD, Zeguer T (2005) Design optimization and stochastic analysis based on the moving least squares method. In: 6th world congresses of structural and multidisciplinary optimization, Rio de Janeiro
12.
Zurück zum Zitat Hardy RL (1971) Multiquadric equations of topography and other irregular surfaces. J Geophys Res 76:1905–1915CrossRef Hardy RL (1971) Multiquadric equations of topography and other irregular surfaces. J Geophys Res 76:1905–1915CrossRef
13.
Zurück zum Zitat Clarke SM, Griebsch JH, Simpson TW (2005) Analysis of support vector regression for approximation of complex engineering analyses. J Mech Des 127(6): 1077–1087 Clarke SM, Griebsch JH, Simpson TW (2005) Analysis of support vector regression for approximation of complex engineering analyses. J Mech Des 127(6): 1077–1087
14.
Zurück zum Zitat Yegnanarayana B (2004) Artificial neural networks. PHI Learning Pvt, Ltd, New Delhi Yegnanarayana B (2004) Artificial neural networks. PHI Learning Pvt, Ltd, New Delhi
15.
Zurück zum Zitat Zhang J, Chowdhury S, Messac A (2012) An adaptive hybrid surrogate model. Struct Multidiscip Optim 46(2):223–238CrossRef Zhang J, Chowdhury S, Messac A (2012) An adaptive hybrid surrogate model. Struct Multidiscip Optim 46(2):223–238CrossRef
16.
Zurück zum Zitat Mehmani A, Chowdhury S, Messac A (2014) A novel approach to simultaneous selection of surrogate models, constitutive kernels, and hyper-parameter values. In: 55th AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics and materials conference. National Harbor, MD, USA Mehmani A, Chowdhury S, Messac A (2014) A novel approach to simultaneous selection of surrogate models, constitutive kernels, and hyper-parameter values. In: 55th AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics and materials conference. National Harbor, MD, USA
17.
Zurück zum Zitat Zhang J, Chowdhury S, Mehmani A, Messac A (2014) Characterizing uncertainty attributable to surrogate models. J Mech Des 136(3):031004 Zhang J, Chowdhury S, Mehmani A, Messac A (2014) Characterizing uncertainty attributable to surrogate models. J Mech Des 136(3):031004
18.
Zurück zum Zitat Barthelemy JF, Haftka R (1993) Approximation concepts for optimum structural design (in a review). Struct Optim 5(3):129–144CrossRef Barthelemy JF, Haftka R (1993) Approximation concepts for optimum structural design (in a review). Struct Optim 5(3):129–144CrossRef
19.
Zurück zum Zitat Haftka RT (1991) Combining global and local approximations. AIAA J 29(9):1523–1525CrossRef Haftka RT (1991) Combining global and local approximations. AIAA J 29(9):1523–1525CrossRef
20.
Zurück zum Zitat Keane A, Nair P (2005) Computational approaches for aerospace design: the pursuit of excellence. Wiley, Chichester Keane A, Nair P (2005) Computational approaches for aerospace design: the pursuit of excellence. Wiley, Chichester
21.
Zurück zum Zitat Zadeh PM, Mehmani A (2010) Multidisciplinary design optimization using variable fidelity modeling: application to a wing based on high fidelity models. In: Third international conference on multidisciplinary design optimziation, Paris, France Zadeh PM, Mehmani A (2010) Multidisciplinary design optimization using variable fidelity modeling: application to a wing based on high fidelity models. In: Third international conference on multidisciplinary design optimziation, Paris, France
22.
Zurück zum Zitat Zadeh PM, Toropov VV, Wood AS (2009) Metamodel-based collaborative optimization framework. Struct Multidiscip Optim 38(2):103–115CrossRef Zadeh PM, Toropov VV, Wood AS (2009) Metamodel-based collaborative optimization framework. Struct Multidiscip Optim 38(2):103–115CrossRef
23.
Zurück zum Zitat Alexandrov NM, Lewis RM, Gumbert C, Green L, Newman P (1999) Optimization with variable-fidelity models applied to wing design. Technical report, ICASE, Institute for Computer Applications in Science and Engineering. NASA Langley Research Center, Hampton, Virginia Alexandrov NM, Lewis RM, Gumbert C, Green L, Newman P (1999) Optimization with variable-fidelity models applied to wing design. Technical report, ICASE, Institute for Computer Applications in Science and Engineering. NASA Langley Research Center, Hampton, Virginia
24.
Zurück zum Zitat Booker AJ, Dennis JE, Frank PD, Serafini DB, Torczon V, Trosset MW (1999) A rigorous framework for optimization of expensive functions by surrogates. Struct Optim 17(1):1–13CrossRef Booker AJ, Dennis JE, Frank PD, Serafini DB, Torczon V, Trosset MW (1999) A rigorous framework for optimization of expensive functions by surrogates. Struct Optim 17(1):1–13CrossRef
25.
26.
Zurück zum Zitat Robinson TD, Eldred MS, Willcox KE, Haimes R (2008) Surrogate-based optimization using multifidelity models with variable parameterization and corrected space mapping. AIAA J 46(11):2814–2822CrossRef Robinson TD, Eldred MS, Willcox KE, Haimes R (2008) Surrogate-based optimization using multifidelity models with variable parameterization and corrected space mapping. AIAA J 46(11):2814–2822CrossRef
27.
Zurück zum Zitat Rodriguez JF, Perez VM, Padmanabhan D, Renaud JE (2001) Sequential approximate optimization using variable fidelity response surface approximations. Struct Multidiscip Optim 22(1):24–34CrossRef Rodriguez JF, Perez VM, Padmanabhan D, Renaud JE (2001) Sequential approximate optimization using variable fidelity response surface approximations. Struct Multidiscip Optim 22(1):24–34CrossRef
28.
Zurück zum Zitat Alexandrov NM, Dennis JE, Lewis RM, Torczon V (1998) A trust-region framework for managing the use of approximation models in optimization. Struct Optim 15(1):16–23CrossRef Alexandrov NM, Dennis JE, Lewis RM, Torczon V (1998) A trust-region framework for managing the use of approximation models in optimization. Struct Optim 15(1):16–23CrossRef
29.
Zurück zum Zitat Toropov VV, Alvarez LF (1998) Development of mars-multipoint approximation method based on the response surface fitting. AIAA J 98: 4769 Toropov VV, Alvarez LF (1998) Development of mars-multipoint approximation method based on the response surface fitting. AIAA J 98: 4769
30.
Zurück zum Zitat Forrester A, Sobester A, Keane A (2008) Engineering design via surrogate modelling: a practical guide. Wiley, Chichester Forrester A, Sobester A, Keane A (2008) Engineering design via surrogate modelling: a practical guide. Wiley, Chichester
31.
Zurück zum Zitat Sugiyama M (2006) Active learning in approximately linear regression based on conditional expectation of generalization error. J Mach Learn Res 7:141–166MATHMathSciNet Sugiyama M (2006) Active learning in approximately linear regression based on conditional expectation of generalization error. J Mach Learn Res 7:141–166MATHMathSciNet
32.
Zurück zum Zitat Trosset MW, Torczon V (1997) Numerical optimization using computer experiments. Technicl report, DTIC Document Trosset MW, Torczon V (1997) Numerical optimization using computer experiments. Technicl report, DTIC Document
33.
Zurück zum Zitat Bichon BJ, Eldred MS, Mahadevan S, McFarland JM (2013) Efficient global surrogate modeling for reliability-based design optimization. J Mech Des 135(1):011, 009 Bichon BJ, Eldred MS, Mahadevan S, McFarland JM (2013) Efficient global surrogate modeling for reliability-based design optimization. J Mech Des 135(1):011, 009
34.
Zurück zum Zitat Duan Q, Sorooshian S, Gupta V (1992) Effective and efficient global optimization for conceptual rainfall-runoff models. Water Resour Res 28(4):1015–1031CrossRef Duan Q, Sorooshian S, Gupta V (1992) Effective and efficient global optimization for conceptual rainfall-runoff models. Water Resour Res 28(4):1015–1031CrossRef
35.
Zurück zum Zitat Jones D, Schonlau M, Welch W (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492CrossRefMATHMathSciNet Jones D, Schonlau M, Welch W (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492CrossRefMATHMathSciNet
36.
Zurück zum Zitat Kleijnen JP, Beers WV, Nieuwenhuyse IV (2012) Expected improvement in efficient global optimization through bootstrapped kriging. J Glob Optim 54(1):59–73CrossRefMATH Kleijnen JP, Beers WV, Nieuwenhuyse IV (2012) Expected improvement in efficient global optimization through bootstrapped kriging. J Glob Optim 54(1):59–73CrossRefMATH
37.
Zurück zum Zitat Jin Y, Olhofer M, Sendhoff B (2002) A framework for evolutionary optimization with approximate fitness functions. IEEE Trans Evolut Comput 6(5):481–494CrossRef Jin Y, Olhofer M, Sendhoff B (2002) A framework for evolutionary optimization with approximate fitness functions. IEEE Trans Evolut Comput 6(5):481–494CrossRef
38.
Zurück zum Zitat Graning L, Jin Y, Sendhoff B (2007) Individual-based management of meta-models for evolutionary optimization with application to three-dimensional blade optimization. In: Evolutionary computation in dynamic and uncertain environments, pp 225–250 Graning L, Jin Y, Sendhoff B (2007) Individual-based management of meta-models for evolutionary optimization with application to three-dimensional blade optimization. In: Evolutionary computation in dynamic and uncertain environments, pp 225–250
39.
Zurück zum Zitat Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9(1):3–12CrossRef Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9(1):3–12CrossRef
40.
Zurück zum Zitat Ulmer H, Streichert F, Zell A (2004) Evolution strategies with controlled model assistance. In: Evolutionary computation, 2004, IEEE congress on CEC2004, vol 2, pp 1569–1576 Ulmer H, Streichert F, Zell A (2004) Evolution strategies with controlled model assistance. In: Evolutionary computation, 2004, IEEE congress on CEC2004, vol 2, pp 1569–1576
41.
Zurück zum Zitat Jin Y, Sendhoff B (2004) Reducing fitness evaluations using clustering techniques and neural network ensembles. In: Genetic and evolutionary computation, GECCO 2004, pp 688–699 Jin Y, Sendhoff B (2004) Reducing fitness evaluations using clustering techniques and neural network ensembles. In: Genetic and evolutionary computation, GECCO 2004, pp 688–699
42.
Zurück zum Zitat Chowdhury S, Tong W, Messac A, Zhang J (2013) A mixed-discrete particle swarm optimization algorithm with explicit diversity-preservation. Struct Multidiscip Optim 47(3):367–388CrossRefMATHMathSciNet Chowdhury S, Tong W, Messac A, Zhang J (2013) A mixed-discrete particle swarm optimization algorithm with explicit diversity-preservation. Struct Multidiscip Optim 47(3):367–388CrossRefMATHMathSciNet
43.
Zurück zum Zitat Epanechnikov V (1969) Non-parametric estimation of a multivariate probability density. Theory Probab Appl 14:153–158CrossRef Epanechnikov V (1969) Non-parametric estimation of a multivariate probability density. Theory Probab Appl 14:153–158CrossRef
44.
Zurück zum Zitat Duong T, Hazelton M (2003) Plug-in bandwidth matrices for bivariate kernel density estimation. Nonparametric Stat 15(1):17–30CrossRefMATHMathSciNet Duong T, Hazelton M (2003) Plug-in bandwidth matrices for bivariate kernel density estimation. Nonparametric Stat 15(1):17–30CrossRefMATHMathSciNet
45.
Zurück zum Zitat Mehmani A, Chowdhury S, Messac A (2015) Predictive quantification of surrogate model fidelity based on modal variations with sample density. Struct Multidiscip Optim (Accepted) Mehmani A, Chowdhury S, Messac A (2015) Predictive quantification of surrogate model fidelity based on modal variations with sample density. Struct Multidiscip Optim (Accepted)
46.
Zurück zum Zitat Mehmani A, Chowdhury S, Zhang J, Tong W, Messac A (2013) Quantifying regional error in surrogates by modeling its relationship with sample density. In: 54th AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics and materials conference, Boston, MA, USA Mehmani A, Chowdhury S, Zhang J, Tong W, Messac A (2013) Quantifying regional error in surrogates by modeling its relationship with sample density. In: 54th AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics and materials conference, Boston, MA, USA
47.
Zurück zum Zitat Chowdhury S, Mehmani A, Messac A (2014) Concurrent surrogate model selection (cosmos) based on predictive estimation of model fidelity. In: ASME 2014 international design engineering technical conferences (IDETC), Buffalo, NY Chowdhury S, Mehmani A, Messac A (2014) Concurrent surrogate model selection (cosmos) based on predictive estimation of model fidelity. In: ASME 2014 international design engineering technical conferences (IDETC), Buffalo, NY
48.
Zurück zum Zitat Kennedy J, Eberhart RC (1995) Particle swarmoptimization. In: IEEE international conference on neural networks, vol 6, pp 1942–1948 Kennedy J, Eberhart RC (1995) Particle swarmoptimization. In: IEEE international conference on neural networks, vol 6, pp 1942–1948
49.
Zurück zum Zitat Coelho F, Breitkopf P, Knopf-Lenoir C (2008) Model reduction for multidisciplinary optimization: application to a 2d wing. Struct Multidiscip Optim 37(1):29–48CrossRef Coelho F, Breitkopf P, Knopf-Lenoir C (2008) Model reduction for multidisciplinary optimization: application to a 2d wing. Struct Multidiscip Optim 37(1):29–48CrossRef
Metadaten
Titel
Adaptive Switching of Variable-Fidelity Models in Population-Based Optimization
verfasst von
Ali Mehmani
Souma Chowdhury
Weiyang Tong
Achille Messac
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-18320-6_10

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.