Skip to main content
Top
Published in: Structural and Multidisciplinary Optimization 1/2017

14-02-2017 | RESEARCH PAPER

A multi-point sampling method based on kriging for global optimization

Authors: Xiwen Cai, Haobo Qiu, Liang Gao, Peng Yang, Xinyu Shao

Published in: Structural and Multidisciplinary Optimization | Issue 1/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In general, sampling strategy plays a very important role in metamodel based design optimization, especially when computationally expensive simulations are involved in the optimization process. The research on new optimization methods with less sampling points and higher convergence speed receives great attention in recent years. In this paper, a multi-point sampling method based on kriging (MPSK) is proposed for improving the efficiency of global optimization. The sampling strategy of this method is based on a probabilistic distribution function converted from the expected improvement (EI) function. It can intelligently draw appropriate new samples in an area with certain probability according to corresponding EI values. Besides, three strategies are also proposed to speed up the sequential sampling process and the corresponding convergence criterions are put forward to stop the searching process reasonably. In order to validate the efficiency of this method, it is tested by several numerical benchmark problems and applied in two engineering design optimization problems. Moreover, an overall comparison between the proposed method and several other typical global optimization methods has been made. Results show that the higher global optimization efficiency of this method makes it particularly suitable for design optimization problems involving computationally expensive simulations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Arora JS (1989) Introduction to optimum design. McGraw-Hill, New York Arora JS (1989) Introduction to optimum design. McGraw-Hill, New York
go back to reference Chaudhuri A, Haftka RT (2014) Efficient global optimization with adaptive target setting. AIAA J 52(7):1573–1578CrossRef Chaudhuri A, Haftka RT (2014) Efficient global optimization with adaptive target setting. AIAA J 52(7):1573–1578CrossRef
go back to reference Cheng G, Wang GG (2012) Trust region based MPS method for global optimization of high dimensional design problems. In: 20th AIAA/ASME/AHS Adaptive Structures Conference, April 23-26 (pp. 1–8) Cheng G, Wang GG (2012) Trust region based MPS method for global optimization of high dimensional design problems. In: 20th AIAA/ASME/AHS Adaptive Structures Conference, April 23-26 (pp. 1–8)
go back to reference Coello CAC (2000) Use of a self-adaptive penalty approach for engineering optimization problems. Comput Ind 41(2):113–127CrossRef Coello CAC (2000) Use of a self-adaptive penalty approach for engineering optimization problems. Comput Ind 41(2):113–127CrossRef
go back to reference SKF Company (1990) SKF Bearing General catalogue SKF Company (1990) SKF Bearing General catalogue
go back to reference Desautels T, Krause A, Burdick JW (2014) Parallelizing exploration-exploitation tradeoffs in Gaussian process bandit optimization. J Mach Learn Res 15(1):3873–3923MathSciNetMATH Desautels T, Krause A, Burdick JW (2014) Parallelizing exploration-exploitation tradeoffs in Gaussian process bandit optimization. J Mach Learn Res 15(1):3873–3923MathSciNetMATH
go back to reference Duan X, Wang GG, Kang X, Niu Q, Naterer G, Peng Q (2009) Performance study of mode-pursuing sampling method. Eng Optim 41(1):1–21CrossRef Duan X, Wang GG, Kang X, Niu Q, Naterer G, Peng Q (2009) Performance study of mode-pursuing sampling method. Eng Optim 41(1):1–21CrossRef
go back to reference Finkel DE (2003) DIRECT optimization algorithm user guide. Center for Research in Scientific Computation, North Carolina State University, 2 Finkel DE (2003) DIRECT optimization algorithm user guide. Center for Research in Scientific Computation, North Carolina State University, 2
go back to reference Fu JC, Wang L (2002) A random-discretization based Monte Carlo sampling method and its applications. Methodol Comput Appl Probab 4(1):5–25MathSciNetCrossRefMATH Fu JC, Wang L (2002) A random-discretization based Monte Carlo sampling method and its applications. Methodol Comput Appl Probab 4(1):5–25MathSciNetCrossRefMATH
go back to reference Ginsbourger D, Le Riche R, Carraro L (2010) Kriging is well-suited to parallelize optimization. In: Computational Intelligence in Expensive Optimization Problems (pp. 131–162). Springer Berlin Heidelberg Ginsbourger D, Le Riche R, Carraro L (2010) Kriging is well-suited to parallelize optimization. In: Computational Intelligence in Expensive Optimization Problems (pp. 131–162). Springer Berlin Heidelberg
go back to reference Gu J, Li GY, Dong Z (2012) Hybrid and adaptive meta-model-based global optimization. Eng Optim 44(1):87–104CrossRef Gu J, Li GY, Dong Z (2012) Hybrid and adaptive meta-model-based global optimization. Eng Optim 44(1):87–104CrossRef
go back to reference Henkenjohann N, Kunert J (2007) An efficient sequential optimization approach based on the multivariate expected improvement criterion. Qual Eng 19(4):267–280CrossRef Henkenjohann N, Kunert J (2007) An efficient sequential optimization approach based on the multivariate expected improvement criterion. Qual Eng 19(4):267–280CrossRef
go back to reference Hernot X, Sartor M, Guillot J (2000) Calculation of the stiffness matrix of angular contact ball bearings by using the analytical approach. J Mech Des 122(1):83–90CrossRef Hernot X, Sartor M, Guillot J (2000) Calculation of the stiffness matrix of angular contact ball bearings by using the analytical approach. J Mech Des 122(1):83–90CrossRef
go back to reference Holmström K (2008) An adaptive radial basis algorithm (ARBF) for expensive black-box global optimization. J Glob Optim 41(3):447–464MathSciNetCrossRefMATH Holmström K (2008) An adaptive radial basis algorithm (ARBF) for expensive black-box global optimization. J Glob Optim 41(3):447–464MathSciNetCrossRefMATH
go back to reference Howard CQ, Pan JQ (1997) Hansen C H. Power transmission from a vibrating body to a circular cylindrical shell through active elastic isolators[J]. J Acoust Soc Am 101:1479–1491CrossRef Howard CQ, Pan JQ (1997) Hansen C H. Power transmission from a vibrating body to a circular cylindrical shell through active elastic isolators[J]. J Acoust Soc Am 101:1479–1491CrossRef
go back to reference Janusevskis J, Le Riche R, Ginsbourger D, Girdziusas R (2012) Expected improvements for the asynchronous parallel global optimization of expensive functions: potentials and challenges. In: Learning and Intelligent Optimization (pp. 413–418). Springer Berlin Heidelberg Janusevskis J, Le Riche R, Ginsbourger D, Girdziusas R (2012) Expected improvements for the asynchronous parallel global optimization of expensive functions: potentials and challenges. In: Learning and Intelligent Optimization (pp. 413–418). Springer Berlin Heidelberg
go back to reference Jie H, Wu Y, Ding J (2015) An adaptive metamodel-based global optimization algorithm for black-box type problems. Eng Optim 47(11):1459–1480 Jie H, Wu Y, Ding J (2015) An adaptive metamodel-based global optimization algorithm for black-box type problems. Eng Optim 47(11):1459–1480
go back to reference Kitayama S, Arakawa M, Yamazaki K (2011) Sequential approximate optimization using radial basis function network for engineering optimization. Optim Eng 12(4):535–557CrossRefMATH Kitayama S, Arakawa M, Yamazaki K (2011) Sequential approximate optimization using radial basis function network for engineering optimization. Optim Eng 12(4):535–557CrossRefMATH
go back to reference Kleijnen JP, van Beers W, Van Nieuwenhuyse I (2012) Expected improvement in efficient global optimization through bootstrapped kriging. J Glob Optim 54(1):59–73MathSciNetCrossRefMATH Kleijnen JP, van Beers W, Van Nieuwenhuyse I (2012) Expected improvement in efficient global optimization through bootstrapped kriging. J Glob Optim 54(1):59–73MathSciNetCrossRefMATH
go back to reference Lophaven S, Nielsen H, Sondergaard J (2002) Amatlab Kriging Toolbox. Technical University of Denmark, Kongens Lyngby, Technical Report No. IMM-TR-2002-12 Lophaven S, Nielsen H, Sondergaard J (2002) Amatlab Kriging Toolbox. Technical University of Denmark, Kongens Lyngby, Technical Report No. IMM-TR-2002-12
go back to reference Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579MathSciNetMATH Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579MathSciNetMATH
go back to reference Picheny V, Wagner T, Ginsbourger D (2013) A benchmark of kriging-based infill criteria for noisy optimization. Struct Multidiscip Optim 48(3):607–626CrossRef Picheny V, Wagner T, Ginsbourger D (2013) A benchmark of kriging-based infill criteria for noisy optimization. Struct Multidiscip Optim 48(3):607–626CrossRef
go back to reference Ray T, Saini P (2001) Engineering design optimization using a swarm with an intelligent information sharing among individuals. Eng Optim 33(6):735–748CrossRef Ray T, Saini P (2001) Engineering design optimization using a swarm with an intelligent information sharing among individuals. Eng Optim 33(6):735–748CrossRef
go back to reference Regis RG, Shoemaker CA (2007) Improved strategies for radial basis function methods for global optimization. J Glob Optim 37(1):113–135MathSciNetCrossRefMATH Regis RG, Shoemaker CA (2007) Improved strategies for radial basis function methods for global optimization. J Glob Optim 37(1):113–135MathSciNetCrossRefMATH
go back to reference Sasena MJ, Papalambros P, Goovaerts P (2002) Exploration of metamodeling sampling criteria for constrained global optimization. Eng Optim 34(3):263–278CrossRef Sasena MJ, Papalambros P, Goovaerts P (2002) Exploration of metamodeling sampling criteria for constrained global optimization. Eng Optim 34(3):263–278CrossRef
go back to reference Simpson TW, Booker AJ, Ghosh D et al (2004) Approximation methods in multidisciplinary analysis and optimization: a panel discussion [J]. Struct Multidiscip Optim 27(5):302–313CrossRef Simpson TW, Booker AJ, Ghosh D et al (2004) Approximation methods in multidisciplinary analysis and optimization: a panel discussion [J]. Struct Multidiscip Optim 27(5):302–313CrossRef
go back to reference Viana FA, Haftka RT (2010) Surrogate-based optimization with parallel simulations using the probability of improvement. In: 13th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference (pp. 13–15). USA: Fort Worth Viana FA, Haftka RT (2010) Surrogate-based optimization with parallel simulations using the probability of improvement. In: 13th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference (pp. 13–15). USA: Fort Worth
go back to reference Viana FA, Haftka RT, Watson LT (2013) Efficient global optimization algorithm assisted by multiple surrogate techniques. J Glob Optim 56(2):669–689CrossRefMATH Viana FA, Haftka RT, Watson LT (2013) Efficient global optimization algorithm assisted by multiple surrogate techniques. J Glob Optim 56(2):669–689CrossRefMATH
go back to reference Wang GG, Shan S (2007) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129(4):370–380CrossRef Wang GG, Shan S (2007) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129(4):370–380CrossRef
go back to reference Wang L, Shan S, Wang GG (2004) Mode-pursuing sampling method for global optimization on expensive black-box functions. Eng Optim 36(4):419–438CrossRef Wang L, Shan S, Wang GG (2004) Mode-pursuing sampling method for global optimization on expensive black-box functions. Eng Optim 36(4):419–438CrossRef
go back to reference Wang H, Shan S, Wang GG, Li G (2011) Integrating least square support vector regression and mode pursuing sampling optimization for crashworthiness design. J Mech Des 133(4):041002CrossRef Wang H, Shan S, Wang GG, Li G (2011) Integrating least square support vector regression and mode pursuing sampling optimization for crashworthiness design. J Mech Des 133(4):041002CrossRef
go back to reference Wang D, Wu Z, Fei Y, Zhang W (2014) Structural design employing a sequential approximation optimization approach. Comput Struct 134:75–87CrossRef Wang D, Wu Z, Fei Y, Zhang W (2014) Structural design employing a sequential approximation optimization approach. Comput Struct 134:75–87CrossRef
go back to reference Xiong YP, Xing JT, Price WG (2003) A general linear mathematical model of power flow analysis and control for integrated structure–control systems. J Sound Vib 267(2):301–334MathSciNetCrossRefMATH Xiong YP, Xing JT, Price WG (2003) A general linear mathematical model of power flow analysis and control for integrated structure–control systems. J Sound Vib 267(2):301–334MathSciNetCrossRefMATH
go back to reference Zhang Y, Deng YM, Sun BS (2009) Injection molding warpage optimization based on a mode-pursuing sampling method. Polym-Plast Technol Eng 48(7):767–774CrossRef Zhang Y, Deng YM, Sun BS (2009) Injection molding warpage optimization based on a mode-pursuing sampling method. Polym-Plast Technol Eng 48(7):767–774CrossRef
Metadata
Title
A multi-point sampling method based on kriging for global optimization
Authors
Xiwen Cai
Haobo Qiu
Liang Gao
Peng Yang
Xinyu Shao
Publication date
14-02-2017
Publisher
Springer Berlin Heidelberg
Published in
Structural and Multidisciplinary Optimization / Issue 1/2017
Print ISSN: 1615-147X
Electronic ISSN: 1615-1488
DOI
https://doi.org/10.1007/s00158-017-1648-x

Other articles of this Issue 1/2017

Structural and Multidisciplinary Optimization 1/2017 Go to the issue

Premium Partners