Skip to main content
Top

2014 | OriginalPaper | Chapter

6. Constrained Optimization: Globalization of Convergence

Authors : Alexey F. Izmailov, Mikhail V. Solodov

Published in: Newton-Type Methods for Optimization and Variational Problems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this chapter we discuss approaches to globalizing the fundamental sequential quadratic programming (SQP) algorithm. This can be done in a number of ways. First, candidate points can be produced either using linesearch in the computed SQP direction or solving SQP subproblems with an additional trust-region constraint. Second, the generated candidate points can be evaluated either by computing the value of a suitable merit function or by a filter dominance criterion. The so-called elastic mode modification is also considered, in the context of the sequential quadratically constrained quadratic programming method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
24.
go back to reference B.T. Boggs, J.W. Tolle, A.J. Kearsley, A truncated SQP algorithm for large scale nonlinear programming problems, in Advances in Optimization and Numerical Analysis, ed. by S. Gomez, J.-P. Hennart. Math. Appl. vol 275 (Kluwer Academic, Dordrecht, 1994), pp. 69–77 B.T. Boggs, J.W. Tolle, A.J. Kearsley, A truncated SQP algorithm for large scale nonlinear programming problems, in Advances in Optimization and Numerical Analysis, ed. by S. Gomez, J.-P. Hennart. Math. Appl. vol 275 (Kluwer Academic, Dordrecht, 1994), pp. 69–77
25.
29.
go back to reference J.F. Bonnans, J.Ch. Gilbert, C. Lemaréchal, C. Sagastizábal, Numerical Optimization: Theoretical and Practical Aspects, 2nd edn. (Springer, Berlin, 2006) J.F. Bonnans, J.Ch. Gilbert, C. Lemaréchal, C. Sagastizábal, Numerical Optimization: Theoretical and Practical Aspects, 2nd edn. (Springer, Berlin, 2006)
33.
go back to reference R.H. Byrd, R.B. Schnabel, G.A. Shultz, A trust region algorithm for nonlinearly constrained optimization. SIAM J. Numer. Anal. 24, 1152–1170 (1987)CrossRefMATHMathSciNet R.H. Byrd, R.B. Schnabel, G.A. Shultz, A trust region algorithm for nonlinearly constrained optimization. SIAM J. Numer. Anal. 24, 1152–1170 (1987)CrossRefMATHMathSciNet
37.
go back to reference R.H. Byrd, F.E. Curtis, J. Nocedal, An inexact SQP method for equality constrained optimization. SIAM J. Optim. 19, 351–369 (2008)CrossRefMATHMathSciNet R.H. Byrd, F.E. Curtis, J. Nocedal, An inexact SQP method for equality constrained optimization. SIAM J. Optim. 19, 351–369 (2008)CrossRefMATHMathSciNet
39.
go back to reference R.H. Byrd, F.E. Curtis, J. Nocedal, An inexact Newton method for nonconvex equality constrained optimization. Math. Program. 122, 273–299 (2010)CrossRefMATHMathSciNet R.H. Byrd, F.E. Curtis, J. Nocedal, An inexact Newton method for nonconvex equality constrained optimization. Math. Program. 122, 273–299 (2010)CrossRefMATHMathSciNet
41.
go back to reference C. Chin, R. Fletcher, On the global convergence of an SLP-filter algorithm that takes EQP steps. Math. Program. 96, 161–177 (2003)CrossRefMATHMathSciNet C. Chin, R. Fletcher, On the global convergence of an SLP-filter algorithm that takes EQP steps. Math. Program. 96, 161–177 (2003)CrossRefMATHMathSciNet
42.
go back to reference M.R. Celis, J.E. Dennis, R.A. Tapia, A trust region algorithm for nonlinear equality constrained optimization, in Numerical Optimization, ed. by P.T. Boggs, R.H. Byrd, R.B. Schnabel (SIAM, Philadelphia, 1985), pp. 71–82 M.R. Celis, J.E. Dennis, R.A. Tapia, A trust region algorithm for nonlinear equality constrained optimization, in Numerical Optimization, ed. by P.T. Boggs, R.H. Byrd, R.B. Schnabel (SIAM, Philadelphia, 1985), pp. 71–82
45.
47.
go back to reference F.E. Curtis, J. Nocedal, A. Wächter, A matrix-free algorithm for equality constrained optimization problems with rank-deficient Jacobians. SIAM J. Optim. 20, 1224–1249 (2009)CrossRefMATHMathSciNet F.E. Curtis, J. Nocedal, A. Wächter, A matrix-free algorithm for equality constrained optimization problems with rank-deficient Jacobians. SIAM J. Optim. 20, 1224–1249 (2009)CrossRefMATHMathSciNet
59.
go back to reference J.E. Dennis, M. El-Alem, M.C. Maciel, A global convergence theory for general trust-region-based algorithms for equality constrained optimization. SIAM J. Optim. 7, 177–207 (1997)CrossRefMATHMathSciNet J.E. Dennis, M. El-Alem, M.C. Maciel, A global convergence theory for general trust-region-based algorithms for equality constrained optimization. SIAM J. Optim. 7, 177–207 (1997)CrossRefMATHMathSciNet
87.
go back to reference R. Fletcher, A model algorithm for composite non-differentiable optimization problems. Math. Program. 17, 67–76 (1982)MATHMathSciNet R. Fletcher, A model algorithm for composite non-differentiable optimization problems. Math. Program. 17, 67–76 (1982)MATHMathSciNet
93.
go back to reference R. Fletcher, N. Gould, S. Leyffer, P. Toint, A. Wächter, Global convergence of trust-region and SQP-filter algorithms for general nonlinear programming. SIAM J. Optim. 13, 635–659 (2002)CrossRefMATHMathSciNet R. Fletcher, N. Gould, S. Leyffer, P. Toint, A. Wächter, Global convergence of trust-region and SQP-filter algorithms for general nonlinear programming. SIAM J. Optim. 13, 635–659 (2002)CrossRefMATHMathSciNet
94.
101.
go back to reference P.E. Gill, W. Murray, M.A. Saunders, M.H. Wright, Some theoretical properties of an augmented Lagrangian merit function, in Advances in Optimization and Parallel Computing, ed. by P.M. Pardalos (North–Holland, Amsterdam, 1992), pp. 101–128 P.E. Gill, W. Murray, M.A. Saunders, M.H. Wright, Some theoretical properties of an augmented Lagrangian merit function, in Advances in Optimization and Parallel Computing, ed. by P.M. Pardalos (North–Holland, Amsterdam, 1992), pp. 101–128
102.
go back to reference P.E. Gill, W. Murray, M.A. Saunders, SNOPT: an SQP algorithm for large-scale constrained optimization. SIAM Rev. 47, 99–131 (2005)CrossRefMATHMathSciNet P.E. Gill, W. Murray, M.A. Saunders, SNOPT: an SQP algorithm for large-scale constrained optimization. SIAM Rev. 47, 99–131 (2005)CrossRefMATHMathSciNet
105.
go back to reference C.C. Gonzaga, E.W. Karas, M. Vanti, A globally convergent filter method for nonlinear programming. SIAM J. Optim. 14, 646–669 (2003)CrossRefMATHMathSciNet C.C. Gonzaga, E.W. Karas, M. Vanti, A globally convergent filter method for nonlinear programming. SIAM J. Optim. 14, 646–669 (2003)CrossRefMATHMathSciNet
114.
go back to reference S.-P. Han, A globally convergent method for nonlinear programming. J. Optim. Theory Appl. 22, 297–309 (1977)CrossRefMATH S.-P. Han, A globally convergent method for nonlinear programming. J. Optim. Theory Appl. 22, 297–309 (1977)CrossRefMATH
147.
go back to reference A.F. Izmailov, M.V. Solodov, A truncated SQP method based on inexact interior-point solutions of subproblems. SIAM J. Optim. 20, 2584–2613 (2010)CrossRefMATHMathSciNet A.F. Izmailov, M.V. Solodov, A truncated SQP method based on inexact interior-point solutions of subproblems. SIAM J. Optim. 20, 2584–2613 (2010)CrossRefMATHMathSciNet
160.
go back to reference H. Jäger, E.W. Sachs, Global convergence of inexact reduced SQP methods. Optim. Method. Softw. 7, 83–110 (1997)CrossRefMATH H. Jäger, E.W. Sachs, Global convergence of inexact reduced SQP methods. Optim. Method. Softw. 7, 83–110 (1997)CrossRefMATH
165.
go back to reference E. Karas, A. Ribeiro, C. Sagastizábal, M. Solodov, A bundle-filter method for nonsmooth convex constrained optimization. Math. Program. 116, 297–320 (2009)CrossRefMATHMathSciNet E. Karas, A. Ribeiro, C. Sagastizábal, M. Solodov, A bundle-filter method for nonsmooth convex constrained optimization. Math. Program. 116, 297–320 (2009)CrossRefMATHMathSciNet
188.
go back to reference N. Maratos, Exact penalty function algorithms for finite dimensional and control optimization problems. Ph.D. thesis, University of London, UK, 1978 N. Maratos, Exact penalty function algorithms for finite dimensional and control optimization problems. Ph.D. thesis, University of London, UK, 1978
204.
go back to reference W. Murray, F.J. Prieto, A sequential quadratic programming algorithm using an incomplete solution of the subproblem. SIAM J. Optim. 5, 590–640 (1995)CrossRefMATHMathSciNet W. Murray, F.J. Prieto, A sequential quadratic programming algorithm using an incomplete solution of the subproblem. SIAM J. Optim. 5, 590–640 (1995)CrossRefMATHMathSciNet
208.
go back to reference J. Nocedal, S.J. Wright, Numerical Optimization, 2nd edn. (Springer, New York, 2006)MATH J. Nocedal, S.J. Wright, Numerical Optimization, 2nd edn. (Springer, New York, 2006)MATH
210.
go back to reference E.O. Omojokun, Trust region algorithms for optimization with nonlinear equality and inequality constraints. Ph.D. thesis, Department of Computer Science, University of Colorado at Boulder, U.S.A., 1989 E.O. Omojokun, Trust region algorithms for optimization with nonlinear equality and inequality constraints. Ph.D. thesis, Department of Computer Science, University of Colorado at Boulder, U.S.A., 1989
220.
go back to reference M.J.D. Powell, Y. Yuan, A recursive quadratic programming algorithm that uses differentiable exact penalty function. Math. Program. 35, 265–278 (1986)CrossRefMATHMathSciNet M.J.D. Powell, Y. Yuan, A recursive quadratic programming algorithm that uses differentiable exact penalty function. Math. Program. 35, 265–278 (1986)CrossRefMATHMathSciNet
230.
go back to reference A.R. Ribeiro, E.W. Karas, C.C. Gonzaga, Global convergence of filter methods for nonlinear programming. SIAM J. Optim. 14, 646–669 (2008)MathSciNet A.R. Ribeiro, E.W. Karas, C.C. Gonzaga, Global convergence of filter methods for nonlinear programming. SIAM J. Optim. 14, 646–669 (2008)MathSciNet
248.
249.
go back to reference M.V. Solodov, Global convergence of an SQP method without boundedness assumptions on any of the iterative sequences. Math. Program. 118, 1–12 (2009)CrossRefMATHMathSciNet M.V. Solodov, Global convergence of an SQP method without boundedness assumptions on any of the iterative sequences. Math. Program. 118, 1–12 (2009)CrossRefMATHMathSciNet
263.
go back to reference A. Vardi, A trust region algorithm for equality constrained minimization: convergence properties and implementation. SIAM J. Numer. Anal. 22, 575–591 (1985)CrossRefMATHMathSciNet A. Vardi, A trust region algorithm for equality constrained minimization: convergence properties and implementation. SIAM J. Numer. Anal. 22, 575–591 (1985)CrossRefMATHMathSciNet
264.
go back to reference A. Wächter, L. Biegler, Line search filter methods for nonlinear programming: local convergence. SIAM J. Optim. 16, 32–48 (2005)CrossRefMATHMathSciNet A. Wächter, L. Biegler, Line search filter methods for nonlinear programming: local convergence. SIAM J. Optim. 16, 32–48 (2005)CrossRefMATHMathSciNet
265.
go back to reference A. Wächter, L. Biegler, Line search filter methods for nonlinear programming: motivation and global convergence. SIAM J. Optim. 16, 1–31 (2005)CrossRefMATHMathSciNet A. Wächter, L. Biegler, Line search filter methods for nonlinear programming: motivation and global convergence. SIAM J. Optim. 16, 1–31 (2005)CrossRefMATHMathSciNet
267.
go back to reference K.A. Williamson, A robust trust region algorithm for nonlinear programming. Ph.D. thesis, Department of Math. Sciences, Rice University, Houston, 1990 K.A. Williamson, A robust trust region algorithm for nonlinear programming. Ph.D. thesis, Department of Math. Sciences, Rice University, Houston, 1990
Metadata
Title
Constrained Optimization: Globalization of Convergence
Authors
Alexey F. Izmailov
Mikhail V. Solodov
Copyright Year
2014
DOI
https://doi.org/10.1007/978-3-319-04247-3_6