Skip to main content
Top

2016 | OriginalPaper | Chapter

3. Fundamentals of Numerical Optimization

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Although the main focus of the book is on surrogate-assisted optimization using physics-based low-fidelity models and response correction techniques, we provide—for the sake of making the material self-contained—some basic information about conventional optimization algorithms. In this book, we refer to conventional (or direct) methods as those that handle the expensive simulation model directly in the optimization scheme (as opposed to surrogate-based approaches where most of the operations are carried out using a fast surrogate). In this chapter, we provide an outline and a brief overview of conventional optimization techniques, including gradient-based and derivative-free methods, as well as metaheuristics.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Back, T., Fogel, D.B., Michalewicz Z. (eds). (2000) Evolutionary computation 1: basic algorithms and operators. Taylor & Francis Group. Back, T., Fogel, D.B., Michalewicz Z. (eds). (2000) Evolutionary computation 1: basic algorithms and operators. Taylor & Francis Group.
go back to reference Chakraborty, U., (2008) Advances in Differential Evolution. Studies in Computational Intelligence, Springer. Chakraborty, U., (2008) Advances in Differential Evolution. Studies in Computational Intelligence, Springer.
go back to reference Clerc, M., and Kennedy, J., (2002) The particle swarm – explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evolutionary Computation, 6, 58–73.CrossRef Clerc, M., and Kennedy, J., (2002) The particle swarm – explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evolutionary Computation, 6, 58–73.CrossRef
go back to reference Conn, A.R., Scheinberg, K., Vicente, L.N. (2009) Introduction to Derivative-Free Optimization. MPS-SIAM Series on Optimization.CrossRefMATH Conn, A.R., Scheinberg, K., Vicente, L.N. (2009) Introduction to Derivative-Free Optimization. MPS-SIAM Series on Optimization.CrossRefMATH
go back to reference Conn, A.R., Gould, N.I.M., Toint, P.L. (2000) Trust Region Methods. MPS-SIAM Series on Optimization.CrossRefMATH Conn, A.R., Gould, N.I.M., Toint, P.L. (2000) Trust Region Methods. MPS-SIAM Series on Optimization.CrossRefMATH
go back to reference Couckuyt, I., (2013) Forward and inverse surrogate modeling of computationally expensive problems. PhD Thesis, Ghent University. Couckuyt, I., (2013) Forward and inverse surrogate modeling of computationally expensive problems. PhD Thesis, Ghent University.
go back to reference Dorigo, M., and Stutzle, T., (2004) Ant colony optimization. MIT Press, Cambridge.MATH Dorigo, M., and Stutzle, T., (2004) Ant colony optimization. MIT Press, Cambridge.MATH
go back to reference Geem, Z.W., Kim, J.H., and Loganathan, G.V., (2001) A new heuristic optimization algorithm: harmony search. Simulation, 76, 60–68.CrossRef Geem, Z.W., Kim, J.H., and Loganathan, G.V., (2001) A new heuristic optimization algorithm: harmony search. Simulation, 76, 60–68.CrossRef
go back to reference Goldberg, D.E., (1989) Genetic algorithms in search, optimization & machine learning. Pearson Education. Goldberg, D.E., (1989) Genetic algorithms in search, optimization & machine learning. Pearson Education.
go back to reference Jameson, A., (1988). Aerodynamic design via control theory. Journal of Scientific Computing, 3, 233–260.CrossRefMATH Jameson, A., (1988). Aerodynamic design via control theory. Journal of Scientific Computing, 3, 233–260.CrossRefMATH
go back to reference Jin, Y. (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm and Evolutionary Computation, 1, pp. 61–70.CrossRef Jin, Y. (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm and Evolutionary Computation, 1, pp. 61–70.CrossRef
go back to reference Jones, D., Schonlau, M., Welch, W. (1998) Efficient global optimization of expensive black-box functions. Journal of Global Optimization. 13, pp. 455–492.MathSciNetCrossRefMATH Jones, D., Schonlau, M., Welch, W. (1998) Efficient global optimization of expensive black-box functions. Journal of Global Optimization. 13, pp. 455–492.MathSciNetCrossRefMATH
go back to reference Kennedy, J., Eberhart, R.C., Shi, Y. (2001) Swarm intelligence. Academic Press. Kennedy, J., Eberhart, R.C., Shi, Y. (2001) Swarm intelligence. Academic Press.
go back to reference Kuhn, H.W., Tucker, A.W. (1951). Nonlinear programming, in (J. Neyman, Ed.) Proc. Berkeley Symp. Mathematical Statistics Probability, Berkeley: University of California Press, 481–492. Kuhn, H.W., Tucker, A.W. (1951). Nonlinear programming, in (J. Neyman, Ed.) Proc. Berkeley Symp. Mathematical Statistics Probability, Berkeley: University of California Press, 481–492.
go back to reference Kolda, T.G., Lewis, R.M., Torczon, V. (2003). Optimization by direct search: new perspectives on some classical and modern methods. SIAM Rev., 45, pp. 385−482.MathSciNetCrossRefMATH Kolda, T.G., Lewis, R.M., Torczon, V. (2003). Optimization by direct search: new perspectives on some classical and modern methods. SIAM Rev., 45, pp. 385−482.MathSciNetCrossRefMATH
go back to reference Koziel, S., and Leifsson, L. (2013b) Multi-level Airfoil Shape Optimization with Automated Low-fidelity Model Selection. Int. Conf. Comp. Science, Barcelona, Spain, June 5–7. Koziel, S., and Leifsson, L. (2013b) Multi-level Airfoil Shape Optimization with Automated Low-fidelity Model Selection. Int. Conf. Comp. Science, Barcelona, Spain, June 5–7.
go back to reference Koziel, S., and Leifsson, L. (2013c) Surrogate-Based Aerodynamic Shape Optimization by Variable-Resolution Models. AIAA Journal, vol. 51, no. 1, pp. 94–106.CrossRef Koziel, S., and Leifsson, L. (2013c) Surrogate-Based Aerodynamic Shape Optimization by Variable-Resolution Models. AIAA Journal, vol. 51, no. 1, pp. 94–106.CrossRef
go back to reference Nelder, J.A., Mead, R. (1965). A simplex method for function minimization, Computer J., 7, 308–313. Nelder, J.A., Mead, R. (1965). A simplex method for function minimization, Computer J., 7, 308–313.
go back to reference Nielsen, H.B., (1999) Damping parameter in Marquardt‘s method. IMM DTU. Report IMM-REP-1999-05. Nielsen, H.B., (1999) Damping parameter in Marquardt‘s method. IMM DTU. Report IMM-REP-1999-05.
go back to reference Nocedal, J., Wright, S.J. (2000) Numerical Optimization, Springer Series in Operations Research, Springer. Nocedal, J., Wright, S.J. (2000) Numerical Optimization, Springer Series in Operations Research, Springer.
go back to reference Price K., Storn R. and Lampinen J., (2005). Differential Evolution: A Practical Approach to Global Optimization, Springer. Price K., Storn R. and Lampinen J., (2005). Differential Evolution: A Practical Approach to Global Optimization, Springer.
go back to reference Queipo, N.V., Haftka, R.T., Shyy, W., Goel, T., Vaidynathan, R., Tucker, P.K. (2005) Surrogate-based analysis and optimization. Progress in Aerospace Sciences, 41, pp. 1–28.CrossRef Queipo, N.V., Haftka, R.T., Shyy, W., Goel, T., Vaidynathan, R., Tucker, P.K. (2005) Surrogate-based analysis and optimization. Progress in Aerospace Sciences, 41, pp. 1–28.CrossRef
go back to reference Storn R., Price, K. (1997) Differential evolution − a simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11, pp. 341–359.MathSciNetCrossRefMATH Storn R., Price, K. (1997) Differential evolution − a simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11, pp. 341–359.MathSciNetCrossRefMATH
go back to reference Yang, X.S., (2005) Engineering optimization via nature-inspired virtual bee algorithms. IWINAC 2005, Lecture Notes in Computer Science, 3562, 317–323.CrossRef Yang, X.S., (2005) Engineering optimization via nature-inspired virtual bee algorithms. IWINAC 2005, Lecture Notes in Computer Science, 3562, 317–323.CrossRef
go back to reference Yang, X.S., (2008) Nature-inspired metaheuristic algorithms. Luniver Press. Yang, X.S., (2008) Nature-inspired metaheuristic algorithms. Luniver Press.
go back to reference Yang, X.S. (2010) Engineering optimization: an introduction with metaheuristic applications. Wiley. Yang, X.S. (2010) Engineering optimization: an introduction with metaheuristic applications. Wiley.
Metadata
Title
Fundamentals of Numerical Optimization
Authors
Slawomir Koziel
Leifur Leifsson
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-30115-0_3

Premium Partners