Skip to main content
Top
Published in: Optimization and Engineering 1/2021

16-07-2020 | Research Article

Efficient global optimization method via clustering/classification methods and exploration strategy

Authors: Naohiko Ban, Wataru Yamazaki

Published in: Optimization and Engineering | Issue 1/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The objective of this research is to efficiently solve complicated high dimensional optimization problems by using machine learning technologies. Recently, major optimization targets have been changed to more complicated ones such as discontinuous and high dimensional optimization problems. It is necessary to solve the high-dimensional optimization problems to obtain an innovate design from topology design optimizations that have enormous numbers of design variables in order to express various topologies/shapes. In this research, therefore, an efficient global optimization method via clustering/classification methods and exploration strategy (EGOCCS) is developed to efficiently solve the high dimensional optimization problems without using probabilistic values as standard deviation, that are generally given/utilized in Gaussian process, and to reduce the construction cost of response surface models. Two optimization problems are solved to verify the usefulness of the developed method of EGOCCS. First optimization is executed to demonstrate the validity of the EGOCCS in 2, 10, 40, 80 and 160-dimensional analytic function problems that are also solved by the Bayesian optimization for comparison purposes. It is confirmed that the EGOCCS with radial basis function interpolation approach can obtain the best solutions in many analytic function problems with larger numbers of design variables. Second optimization is executed to examine the effect of the EGOCCS in high dimensional aerodynamic shape optimization problems for a two-dimensional biconvex airfoil that are also solved by a genetic algorithm for comparison purposes. It is confirmed that the EGOCCS can be efficiently used in the high dimensional aerodynamic shape optimization problems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Ban N, Yamazaki W (2019) Development of efficient global optimization method for discontinuous optimization problems with infeasible region via classification method. J Adv Mech Des Syst Manuf 13(1):p.JAMDSM0017 Ban N, Yamazaki W (2019) Development of efficient global optimization method for discontinuous optimization problems with infeasible region via classification method. J Adv Mech Des Syst Manuf 13(1):p.JAMDSM0017
go back to reference Ban N, Yamazaki W, Kusunose K (2016) A fundamental design optimization of innovative supersonic transport configuration and its design knowledge extraction. Trans Jpn Soc Aeronaut Space Sci 59(6):340–348CrossRef Ban N, Yamazaki W, Kusunose K (2016) A fundamental design optimization of innovative supersonic transport configuration and its design knowledge extraction. Trans Jpn Soc Aeronaut Space Sci 59(6):340–348CrossRef
go back to reference Ban N, Yamazaki W, Kusunose K (2018) Low-boom/low-drag design optimization of innovative supersonic transport configuration. J Aircr 55(3):1071–1081CrossRef Ban N, Yamazaki W, Kusunose K (2018) Low-boom/low-drag design optimization of innovative supersonic transport configuration. J Aircr 55(3):1071–1081CrossRef
go back to reference Bouhlel MA, Bartoli N, Otsmane A, Morlier J (2016) Improving kriging surrogates of high-dimensional design models by partial least squares dimension reduction. Struct Multidiscip Optim 53(5):935–952MathSciNetCrossRef Bouhlel MA, Bartoli N, Otsmane A, Morlier J (2016) Improving kriging surrogates of high-dimensional design models by partial least squares dimension reduction. Struct Multidiscip Optim 53(5):935–952MathSciNetCrossRef
go back to reference Chapman DR (1951) Airfoil profiles for minimum pressure drag at supersonic velocities—general analysis with application to linearized supersonic flow. NACA TN 2264 Chapman DR (1951) Airfoil profiles for minimum pressure drag at supersonic velocities—general analysis with application to linearized supersonic flow. NACA TN 2264
go back to reference Corinna C, Vladimir V (1995) Support-vector networks. Mach Learn 20:273–297MATH Corinna C, Vladimir V (1995) Support-vector networks. Mach Learn 20:273–297MATH
go back to reference Crina G, Ajith A (2009) A novel global optimization technique for high dimensional functions. Int J Intell Syst 24:421–440CrossRef Crina G, Ajith A (2009) A novel global optimization technique for high dimensional functions. Int J Intell Syst 24:421–440CrossRef
go back to reference Deb K, Deb D (2014) Analysing mutation schemes for real-parameter genetic algorithms. Int J Artif Intell Soft Comput 4(1):1–28CrossRef Deb K, Deb D (2014) Analysing mutation schemes for real-parameter genetic algorithms. Int J Artif Intell Soft Comput 4(1):1–28CrossRef
go back to reference Eshleman L, Schaffer JD (1993) Real-coded genetic algorithms and interval-schemata. Found Genet Algorithms 2:187–202 Eshleman L, Schaffer JD (1993) Real-coded genetic algorithms and interval-schemata. Found Genet Algorithms 2:187–202
go back to reference Ester M, Kriegel HP, Sander J, Xu X (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the 2nd international conference on knowledge discovery and data mining, Portland, OR, AAAI Press, pp 226–231 Ester M, Kriegel HP, Sander J, Xu X (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the 2nd international conference on knowledge discovery and data mining, Portland, OR, AAAI Press, pp 226–231
go back to reference Forrester AI, Sobester A, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide. Wiley, HobokenCrossRef Forrester AI, Sobester A, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide. Wiley, HobokenCrossRef
go back to reference Fujii D, Suzuki K, Ohtsubo H (2000) Topology optimization of structures using the voxel finite element method. Trans Jpn Soc Comput Eng Sci 2:87–94 Fujii D, Suzuki K, Ohtsubo H (2000) Topology optimization of structures using the voxel finite element method. Trans Jpn Soc Comput Eng Sci 2:87–94
go back to reference Han ZH, Görtz S (2012) Hierarchical kriging model for variable-fidelity surrogate modeling. AIAA J 50(9):1885–1896CrossRef Han ZH, Görtz S (2012) Hierarchical kriging model for variable-fidelity surrogate modeling. AIAA J 50(9):1885–1896CrossRef
go back to reference Han ZH, Zhang Y, Song CX, Zhang KS (2017) Weighted gradient-enhanced kriging for high-dimensional surrogate modeling and design optimization. AIAA J 55(12):4330–4346CrossRef Han ZH, Zhang Y, Song CX, Zhang KS (2017) Weighted gradient-enhanced kriging for high-dimensional surrogate modeling and design optimization. AIAA J 55(12):4330–4346CrossRef
go back to reference Hestenes MR, Stiefel E (1952) Methods of conjugate gradients for solving linear systems. J Res Natl Bureau Stand 49(6):409–436MathSciNetCrossRef Hestenes MR, Stiefel E (1952) Methods of conjugate gradients for solving linear systems. J Res Natl Bureau Stand 49(6):409–436MathSciNetCrossRef
go back to reference Igarashi K (2008) Technological overview of the next generation Shinkansen high-speed train Series N700. Jpn Soc Mech Eng, No, pp 07–66 Igarashi K (2008) Technological overview of the next generation Shinkansen high-speed train Series N700. Jpn Soc Mech Eng, No, pp 07–66
go back to reference Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13:455–492MathSciNetCrossRef Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13:455–492MathSciNetCrossRef
go back to reference Julien V, Emmanuel V, Eric W (2009) An informational approach to the global optimization of expensive-to-evaluate functions. J Glob Optim 44(4):509–534MathSciNetCrossRef Julien V, Emmanuel V, Eric W (2009) An informational approach to the global optimization of expensive-to-evaluate functions. J Glob Optim 44(4):509–534MathSciNetCrossRef
go back to reference Klunker EB, Harder K (1952) Comparison of supersonic minimum-drag airfoils determined by linear and nonlinear theory. National Advisory Committee for Aeronautics Technical Note (NACA TN) 2623, Washington Klunker EB, Harder K (1952) Comparison of supersonic minimum-drag airfoils determined by linear and nonlinear theory. National Advisory Committee for Aeronautics Technical Note (NACA TN) 2623, Washington
go back to reference Lars K, Alastair T, Gerrit R (2002) Application of topology, sizing and shape optimization methods to optimal design of aircraft components. Airbus UK Ltd, Altair Engineering Ltd Lars K, Alastair T, Gerrit R (2002) Application of topology, sizing and shape optimization methods to optimal design of aircraft components. Airbus UK Ltd, Altair Engineering Ltd
go back to reference Liu B, Zhang Q, Gielen GGE (2014) A Gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems. IEEE Trans Evol Comput 18(2):180–192CrossRef Liu B, Zhang Q, Gielen GGE (2014) A Gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems. IEEE Trans Evol Comput 18(2):180–192CrossRef
go back to reference Ma Z, Chen H, Zhou C (2008) A study of point moving adaptivity in gridless method. Comput Methods Appl Mech Eng 197(21–24):1926–1937MathSciNetCrossRef Ma Z, Chen H, Zhou C (2008) A study of point moving adaptivity in gridless method. Comput Methods Appl Mech Eng 197(21–24):1926–1937MathSciNetCrossRef
go back to reference Mohamed AB, Joaquim RRAM (2019) Gradient-enhanced kriging for high-dimensional problems. Eng Comput 35:157–173CrossRef Mohamed AB, Joaquim RRAM (2019) Gradient-enhanced kriging for high-dimensional problems. Eng Comput 35:157–173CrossRef
go back to reference Payot AD, Rendall T, Allen CB (2017) Mixing and refinement of design variables for geometry and topology optimization in aerodynamics. In: 35th AIAA Applied Aerodynamics Conference, AIAA 2017-3577, American Institute of Aeronautics and Astronautics, Reston, Virginia Payot AD, Rendall T, Allen CB (2017) Mixing and refinement of design variables for geometry and topology optimization in aerodynamics. In: 35th AIAA Applied Aerodynamics Conference, AIAA 2017-3577, American Institute of Aeronautics and Astronautics, Reston, Virginia
go back to reference Press WH, Teukolsky SA, Vetterling WT, Flannery BP (2007) Radial basis function interpolation. In: Numerical recipes: the art of scientific computing, 3 edn Press WH, Teukolsky SA, Vetterling WT, Flannery BP (2007) Radial basis function interpolation. In: Numerical recipes: the art of scientific computing, 3 edn
go back to reference Rahib HA, Mustafa T (2015) Optimization of high-dimensional functions through hypercube evaluation. Comput Intell Neurosci 967320:2015 Rahib HA, Mustafa T (2015) Optimization of high-dimensional functions through hypercube evaluation. Comput Intell Neurosci 967320:2015
go back to reference Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. MIT Press, CambridgeMATH Rasmussen CE, Williams CKI (2006) Gaussian processes for machine learning. MIT Press, CambridgeMATH
go back to reference Rumpfkeil MP, Yamazaki W, Mavriplis DJ (2011) Countering the curse of dimensionality using higher-order derivatives. In: SIAM conference on computational science and engineering, Reno, Nevada Rumpfkeil MP, Yamazaki W, Mavriplis DJ (2011) Countering the curse of dimensionality using higher-order derivatives. In: SIAM conference on computational science and engineering, Reno, Nevada
go back to reference Shepard D (1968) A two-dimensional interpolation function for irregularly-spaced data. In: Proceedings of the 1968 ACM National Conference, pp 517–524 Shepard D (1968) A two-dimensional interpolation function for irregularly-spaced data. In: Proceedings of the 1968 ACM National Conference, pp 517–524
go back to reference Suga Y, Yamazaki W (2015) Aerodynamic uncertainty quantification of supersonic biplane airfoil via polynomial chaos approach. AIAA Paper 2015-1815 Suga Y, Yamazaki W (2015) Aerodynamic uncertainty quantification of supersonic biplane airfoil via polynomial chaos approach. AIAA Paper 2015-1815
go back to reference Sugimoto J, Yonemoto K, Fujikawa T (2019) A surrogate-assisted dynamically distributed genetic algorithm for multi-objective design optimization. APISAT 2019:2056–2065 Sugimoto J, Yonemoto K, Fujikawa T (2019) A surrogate-assisted dynamically distributed genetic algorithm for multi-objective design optimization. APISAT 2019:2056–2065
go back to reference Takenaka K, Hatanaka K, Yamazaki W, Nakahashi K (2008) Multidisciplinary design exploration for a Winglet. J Aircr 45(5):1601–1611CrossRef Takenaka K, Hatanaka K, Yamazaki W, Nakahashi K (2008) Multidisciplinary design exploration for a Winglet. J Aircr 45(5):1601–1611CrossRef
go back to reference Volodymyr M, Adria PB, Mehdi M, Alex G, Timothy PL, Tim H, David S, Koray K (2016) Asynchronous methods for deep reinforcement learning. In: Proceedings of the 33rd international conference on machine learning, pp 1928–1937 Volodymyr M, Adria PB, Mehdi M, Alex G, Timothy PL, Tim H, David S, Koray K (2016) Asynchronous methods for deep reinforcement learning. In: Proceedings of the 33rd international conference on machine learning, pp 1928–1937
go back to reference Williams CKI, Carl ER (1996) Gaussian Processes for Regression. Adv Neural Inf Process Syst 8:514–520 Williams CKI, Carl ER (1996) Gaussian Processes for Regression. Adv Neural Inf Process Syst 8:514–520
go back to reference Yamazaki W, Mavriplis DJ (2013) Derivative-enhanced variable fidelity surrogate modeling for aerodynamic functions. AIAA J 51(1):126–137CrossRef Yamazaki W, Mavriplis DJ (2013) Derivative-enhanced variable fidelity surrogate modeling for aerodynamic functions. AIAA J 51(1):126–137CrossRef
go back to reference Ziyu W, Masrour Z, Frank H, David M, Nando F (2013) Bayesian Optimization in high dimensions via random embeddings. In: Proceedings of IJCAI’13 Ziyu W, Masrour Z, Frank H, David M, Nando F (2013) Bayesian Optimization in high dimensions via random embeddings. In: Proceedings of IJCAI’13
Metadata
Title
Efficient global optimization method via clustering/classification methods and exploration strategy
Authors
Naohiko Ban
Wataru Yamazaki
Publication date
16-07-2020
Publisher
Springer US
Published in
Optimization and Engineering / Issue 1/2021
Print ISSN: 1389-4420
Electronic ISSN: 1573-2924
DOI
https://doi.org/10.1007/s11081-020-09529-4

Other articles of this Issue 1/2021

Optimization and Engineering 1/2021 Go to the issue

Premium Partners