Skip to main content
Top
Published in: Evolutionary Intelligence 6/2023

21-12-2019 | Special Issue

Reducing the number of function evaluations in derivative-free algorithm for bound constrained optimization

Authors: Shanxue Yang, Zuqiao Yang, Yiping Fu, Hongwei Liu

Published in: Evolutionary Intelligence | Issue 6/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we present a derivative-free algorithm based on modified minimal positive base for bound constrained optimization problems. Compared with the derivative-free algorithms based on the maximal 2n positive base, the algorithms based on the minimal \(n+1\) positive base only need at most \(n+1\) function evaluations at every iteration, where n is the number of variables. Therefore, we can reduce the number of function evaluations from 2n to \(n+1\) at each iteration. But the minimal positive base can cause undesirable large angles between some positive base directions and large unexplored feasible domain. In order to overcome this defect, we propose a modified set of feasible directions based on the minimal positive base and the technique of search direction rotation to investigate the unexplored domain at the next iteration. Accordingly, convergence to stationary points is proved. Moreover, the numerical experiments show that the method based on modified minimal positive base can reduce the number of function evaluations and is beneficial in a derivative-free context.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Fermi E, Metropolis N (1952) Numerical solution of a minimum problem. Los Alamos Unclassified Report LA-1492, Los Alamos National Laboratory, Los Alamos Fermi E, Metropolis N (1952) Numerical solution of a minimum problem. Los Alamos Unclassified Report LA-1492, Los Alamos National Laboratory, Los Alamos
3.
go back to reference Box G (1957) Evolutionary operation: a method for increasing industrial productivity. Appl Stat 6(2):81–101CrossRef Box G (1957) Evolutionary operation: a method for increasing industrial productivity. Appl Stat 6(2):81–101CrossRef
4.
go back to reference Hooke R, Jeeves T (1961) Direct search solution of numerical and statistical problems. J Assoc Comput Mach 8(2):212–229CrossRefMATH Hooke R, Jeeves T (1961) Direct search solution of numerical and statistical problems. J Assoc Comput Mach 8(2):212–229CrossRefMATH
8.
go back to reference Lewis R, Torczon V (1996) Rank ordering and positive bases in pattern search algorithms. Technical Report 96-71, Institute for Computer Applications in Science and Engineering, NASA Langley Research Center, USA Lewis R, Torczon V (1996) Rank ordering and positive bases in pattern search algorithms. Technical Report 96-71, Institute for Computer Applications in Science and Engineering, NASA Langley Research Center, USA
9.
10.
go back to reference Liuzzi G, Lucidi S, Sciandrone M (2006) A derivative-free algorithm for linearly constrained finite minimax problems. SIAM J Optim 16(4):1054–1075MathSciNetCrossRefMATH Liuzzi G, Lucidi S, Sciandrone M (2006) A derivative-free algorithm for linearly constrained finite minimax problems. SIAM J Optim 16(4):1054–1075MathSciNetCrossRefMATH
11.
go back to reference Liuzzi G, Lucidi S, Sciandrone M (2010) Sequential penalty derivative-free methods for nonlinear constrained optimization. SIAM J Optim 20(5):2614–2635MathSciNetCrossRefMATH Liuzzi G, Lucidi S, Sciandrone M (2010) Sequential penalty derivative-free methods for nonlinear constrained optimization. SIAM J Optim 20(5):2614–2635MathSciNetCrossRefMATH
12.
go back to reference Liuzzi G, Lucidi S, Rinaldi F (2012) Derivative-free methods for bound constrained mixed-integer optimization. Comput Optim Appl 53(2):505–526MathSciNetCrossRefMATH Liuzzi G, Lucidi S, Rinaldi F (2012) Derivative-free methods for bound constrained mixed-integer optimization. Comput Optim Appl 53(2):505–526MathSciNetCrossRefMATH
13.
go back to reference Liuzzi G, Lucidi S, Rinaldi F (2014) Derivative-free methods for mixed-integer constrained optimization problems. J Optim Theory Appl 164(3):933–965MathSciNetCrossRefMATH Liuzzi G, Lucidi S, Rinaldi F (2014) Derivative-free methods for mixed-integer constrained optimization problems. J Optim Theory Appl 164(3):933–965MathSciNetCrossRefMATH
14.
go back to reference Vicente L (2013) Worst case complexity of direct search. EURO J Comput Optim 1(1):143–153CrossRefMATH Vicente L (2013) Worst case complexity of direct search. EURO J Comput Optim 1(1):143–153CrossRefMATH
15.
16.
go back to reference Cocchi G, Liuzzi G, Papini A et al (2018) An implicit filtering algorithm for derivative-free multiobjective optimization with box constraints. Comput Optim Appl 69(2):267–296MathSciNetCrossRefMATH Cocchi G, Liuzzi G, Papini A et al (2018) An implicit filtering algorithm for derivative-free multiobjective optimization with box constraints. Comput Optim Appl 69(2):267–296MathSciNetCrossRefMATH
18.
19.
go back to reference Abramson MA, Audet C, Dennis JE Jr (2009) OrthoMADS: a deterministic MADS instance with orthogonal directions. SIAM J Optim 20(2):948–966MathSciNetCrossRefMATH Abramson MA, Audet C, Dennis JE Jr (2009) OrthoMADS: a deterministic MADS instance with orthogonal directions. SIAM J Optim 20(2):948–966MathSciNetCrossRefMATH
20.
go back to reference Ianni A, Audet C, Digabel SL, Tribes C (2014) Reducing the number of function evaluations in mesh adaptive direct search algorithms. SIAM J Optim 24(2):621–642MathSciNetCrossRefMATH Ianni A, Audet C, Digabel SL, Tribes C (2014) Reducing the number of function evaluations in mesh adaptive direct search algorithms. SIAM J Optim 24(2):621–642MathSciNetCrossRefMATH
21.
go back to reference Liuzzi G, Risi A (2012) A decomposition algorithm for unconstrained optimization problems with partial derivative information. Optim Lett 6(3):437–450MathSciNetCrossRefMATH Liuzzi G, Risi A (2012) A decomposition algorithm for unconstrained optimization problems with partial derivative information. Optim Lett 6(3):437–450MathSciNetCrossRefMATH
22.
go back to reference Grippo L, Rinaldi F (2015) A class of derivative-free nonmonotone optimization algorithms employing coordinate rotations and gradient approximations. Computational Optim Appl 60(1):1–33MathSciNetCrossRefMATH Grippo L, Rinaldi F (2015) A class of derivative-free nonmonotone optimization algorithms employing coordinate rotations and gradient approximations. Computational Optim Appl 60(1):1–33MathSciNetCrossRefMATH
23.
go back to reference Cust A (2006) Using simplex gradients of nonsmooth functions in direct search methods. IMA J Numer Anal 28(28):770–784 (15)MathSciNet Cust A (2006) Using simplex gradients of nonsmooth functions in direct search methods. IMA J Numer Anal 28(28):770–784 (15)MathSciNet
24.
25.
26.
go back to reference Hock W, Schittkowski K (1980) Test examples for nonlinear programming codes. J Optim Theory Appl 30(1):127–129CrossRefMATH Hock W, Schittkowski K (1980) Test examples for nonlinear programming codes. J Optim Theory Appl 30(1):127–129CrossRefMATH
27.
go back to reference Schittkowski K (1987) More test examples for nonlinear programming codes. Lecture notes in economics and mathematical systems, vol 282. Springer, BerlinCrossRefMATH Schittkowski K (1987) More test examples for nonlinear programming codes. Lecture notes in economics and mathematical systems, vol 282. Springer, BerlinCrossRefMATH
Metadata
Title
Reducing the number of function evaluations in derivative-free algorithm for bound constrained optimization
Authors
Shanxue Yang
Zuqiao Yang
Yiping Fu
Hongwei Liu
Publication date
21-12-2019
Publisher
Springer Berlin Heidelberg
Published in
Evolutionary Intelligence / Issue 6/2023
Print ISSN: 1864-5909
Electronic ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-019-00324-4

Other articles of this Issue 6/2023

Evolutionary Intelligence 6/2023 Go to the issue

Premium Partner