Skip to main content

2014 | OriginalPaper | Buchkapitel

3. Variational Problems: Local Methods

verfasst von : Alexey F. Izmailov, Mikhail V. Solodov

Erschienen in: Newton-Type Methods for Optimization and Variational Problems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this chapter, we present local analysis of Newton-type algorithms for variational problems, starting with the fundamental Josephy–Newton method for generalized equations. This method is an important extension of classical Newtonian techniques to more general variational problems. For example, as a specific application, the Josephy–Newton method provides a convenient tool for analyzing the sequential quadratic programming algorithm for optimization. We also discuss semismooth Newton methods for complementarity problems, and active-set methods with identifications based on error bounds.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
4.
Zurück zum Zitat R. Andreani, E.G. Birgin, J.M. Martínez, M.L. Schuverdt, On Augmented Lagrangian methods with general lower-level constraints. SIAM J. Optim. 18, 1286–1309 (2007)CrossRefMATHMathSciNet R. Andreani, E.G. Birgin, J.M. Martínez, M.L. Schuverdt, On Augmented Lagrangian methods with general lower-level constraints. SIAM J. Optim. 18, 1286–1309 (2007)CrossRefMATHMathSciNet
16.
Zurück zum Zitat A.B. Bakushinskii, A regularization algorithm based on the Newton-Kantorovich method for solving variational inequalities. USSR Comput. Math. Math. Phys. 16, 16–23 (1976)CrossRef A.B. Bakushinskii, A regularization algorithm based on the Newton-Kantorovich method for solving variational inequalities. USSR Comput. Math. Math. Phys. 16, 16–23 (1976)CrossRef
20.
Zurück zum Zitat S.C. Billups, Algorithms for complementarity problems and generalized equations. Ph.D. thesis. Technical Report 95-14. Computer Sciences Department, University of Wisconsin, Madison, 1995 S.C. Billups, Algorithms for complementarity problems and generalized equations. Ph.D. thesis. Technical Report 95-14. Computer Sciences Department, University of Wisconsin, Madison, 1995
26.
Zurück zum Zitat J.F. Bonnans, Local analysis of Newton-type methods for variational inequalities and nonlinear programming. Appl. Math. Optim. 29, 161–186 (1994)CrossRefMATHMathSciNet J.F. Bonnans, Local analysis of Newton-type methods for variational inequalities and nonlinear programming. Appl. Math. Optim. 29, 161–186 (1994)CrossRefMATHMathSciNet
44.
Zurück zum Zitat F.H. Clarke, Optimization and Nonsmooth Analysis (Wiley, New York, 1983)MATH F.H. Clarke, Optimization and Nonsmooth Analysis (Wiley, New York, 1983)MATH
48.
Zurück zum Zitat H. Dan, N. Yamashita, M. Fukushima, A superlinearly convergent algorithm for the monotone nonlinear complementarity problem without uniqueness and nondegeneracy conditions. Math. Oper. Res. 27, 743–754 (2002)CrossRefMATHMathSciNet H. Dan, N. Yamashita, M. Fukushima, A superlinearly convergent algorithm for the monotone nonlinear complementarity problem without uniqueness and nondegeneracy conditions. Math. Oper. Res. 27, 743–754 (2002)CrossRefMATHMathSciNet
49.
Zurück zum Zitat A.N. Daryina, A.F. Izmailov, M.V. Solodov, A class of active-set newton methods for mixed complementarity problems. SIAM J. Optim. 15, 409–429 (2004)CrossRefMATHMathSciNet A.N. Daryina, A.F. Izmailov, M.V. Solodov, A class of active-set newton methods for mixed complementarity problems. SIAM J. Optim. 15, 409–429 (2004)CrossRefMATHMathSciNet
50.
Zurück zum Zitat A.N. Daryina, A.F. Izmailov, M.V. Solodov, Mixed complementarity problems: regularity, error bounds, and Newton-type methods. Comput. Mathem. Mathem. Phys. 44, 45–61 (2004) A.N. Daryina, A.F. Izmailov, M.V. Solodov, Mixed complementarity problems: regularity, error bounds, and Newton-type methods. Comput. Mathem. Mathem. Phys. 44, 45–61 (2004)
51.
Zurück zum Zitat A.N. Daryina, A.F. Izmailov, M.V. Solodov, Numerical results for a globalized active-set Newton method for mixed complementarity problems. Comput. Appl. Math. 24, 293–316 (2005)MATHMathSciNet A.N. Daryina, A.F. Izmailov, M.V. Solodov, Numerical results for a globalized active-set Newton method for mixed complementarity problems. Comput. Appl. Math. 24, 293–316 (2005)MATHMathSciNet
52.
Zurück zum Zitat T. De Luca, F. Facchinei, C. Kanzow, A semismooth equation approach to the solution of nonlinear complementarity problems. Math. Program. 75, 407–439 (1996)CrossRefMATH T. De Luca, F. Facchinei, C. Kanzow, A semismooth equation approach to the solution of nonlinear complementarity problems. Math. Program. 75, 407–439 (1996)CrossRefMATH
53.
Zurück zum Zitat T. De Luca, F. Facchinei, C. Kanzow, A theoretical and numerical comparison of some semismooth algorithms for complementarity problems. Comput. Optim. Appl. 16, 173–205 (2000)CrossRefMATHMathSciNet T. De Luca, F. Facchinei, C. Kanzow, A theoretical and numerical comparison of some semismooth algorithms for complementarity problems. Comput. Optim. Appl. 16, 173–205 (2000)CrossRefMATHMathSciNet
61.
Zurück zum Zitat A.L. Dontchev, R.T. Rockafellar, Characterizations of strong regularity for variational inequalities over polyhedral convex sets. SIAM J. Optim. 6, 1087–1105 (1996)CrossRefMATHMathSciNet A.L. Dontchev, R.T. Rockafellar, Characterizations of strong regularity for variational inequalities over polyhedral convex sets. SIAM J. Optim. 6, 1087–1105 (1996)CrossRefMATHMathSciNet
62.
Zurück zum Zitat A.L. Dontchev, R.T. Rockafellar, Implicit Functions and Solution Mappings (Springer, New York, 2009)CrossRefMATH A.L. Dontchev, R.T. Rockafellar, Implicit Functions and Solution Mappings (Springer, New York, 2009)CrossRefMATH
68.
Zurück zum Zitat F. Facchinei, J.-S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problems (Springer, New York, 2003) F. Facchinei, J.-S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problems (Springer, New York, 2003)
69.
Zurück zum Zitat F. Facchinei, J. Soares, A new merit function for nonlinear complementarity problems and a related algorithm. SIAM J. Optim. 7, 225–247 (1997)CrossRefMATHMathSciNet F. Facchinei, J. Soares, A new merit function for nonlinear complementarity problems and a related algorithm. SIAM J. Optim. 7, 225–247 (1997)CrossRefMATHMathSciNet
70.
Zurück zum Zitat F. Facchinei, A. Fischer, C. Kanzow, Regularity properties of a semismooth reformulation of variational inequalities. SIAM J. Optim. 8, 850–869 (1998)CrossRefMATHMathSciNet F. Facchinei, A. Fischer, C. Kanzow, Regularity properties of a semismooth reformulation of variational inequalities. SIAM J. Optim. 8, 850–869 (1998)CrossRefMATHMathSciNet
71.
Zurück zum Zitat F. Facchinei, A. Fischer, C. Kanzow, On the accurate identifcation of active constraints. SIAM J. Optim. 9, 14–32 (1999)CrossRefMathSciNet F. Facchinei, A. Fischer, C. Kanzow, On the accurate identifcation of active constraints. SIAM J. Optim. 9, 14–32 (1999)CrossRefMathSciNet
80.
Zurück zum Zitat M.C. Ferris, C. Kanzow, T.S. Munson, Feasible descent algorithms for mixed complementarity problems. Math. Program. 86, 475–497 (1999)CrossRefMATHMathSciNet M.C. Ferris, C. Kanzow, T.S. Munson, Feasible descent algorithms for mixed complementarity problems. Math. Program. 86, 475–497 (1999)CrossRefMATHMathSciNet
82.
Zurück zum Zitat A. Fischer, A special Newton-type optimization method. Optimization 24, 296–284 (1992)CrossRef A. Fischer, A special Newton-type optimization method. Optimization 24, 296–284 (1992)CrossRef
131.
Zurück zum Zitat A.F. Izmailov, Strongly regular nonsmooth generalized equations. Math. Program. (2013). doi:10.1007/s10107-013-0717-1 A.F. Izmailov, Strongly regular nonsmooth generalized equations. Math. Program. (2013). doi:10.1007/s10107-013-0717-1
134.
Zurück zum Zitat A.F. Izmailov, A.S. Kurennoy, On regularity conditions for complementarity problems. Comput. Optim. Appl. (2013). doi:10.1007/s10589-013-9604-1 A.F. Izmailov, A.S. Kurennoy, On regularity conditions for complementarity problems. Comput. Optim. Appl. (2013). doi:10.1007/s10589-013-9604-1
138.
Zurück zum Zitat A.F. Izmailov, M.V. Solodov, Superlinearly convergent algorithms for solving singular equations and smooth reformulations of complementarity problems. SIAM J. Optim. 13, 386–405 (2002)CrossRefMATHMathSciNet A.F. Izmailov, M.V. Solodov, Superlinearly convergent algorithms for solving singular equations and smooth reformulations of complementarity problems. SIAM J. Optim. 13, 386–405 (2002)CrossRefMATHMathSciNet
139.
Zurück zum Zitat A.F. Izmailov, M.V. Solodov, The theory of 2-regularity for mappings with Lipschitzian derivatives and its applications to optimality conditions. Math. Oper. Res. 27, 614–635 (2002)CrossRefMATHMathSciNet A.F. Izmailov, M.V. Solodov, The theory of 2-regularity for mappings with Lipschitzian derivatives and its applications to optimality conditions. Math. Oper. Res. 27, 614–635 (2002)CrossRefMATHMathSciNet
140.
Zurück zum Zitat A.F. Izmailov, M.V. Solodov, Karush–Kuhn–Tucker systems: regularity conditions, error bounds and a class of Newton-type methods. Math. Program. 95, 631–650 (2003)CrossRefMATHMathSciNet A.F. Izmailov, M.V. Solodov, Karush–Kuhn–Tucker systems: regularity conditions, error bounds and a class of Newton-type methods. Math. Program. 95, 631–650 (2003)CrossRefMATHMathSciNet
148.
Zurück zum Zitat A.F. Izmailov, M.V. Solodov, Inexact Josephy–Newton framework for generalized equations and its applications to local analysis of Newtonian methods for constrained optimization. Comput. Optim. Appl. 46, 347–368 (2010)CrossRefMATHMathSciNet A.F. Izmailov, M.V. Solodov, Inexact Josephy–Newton framework for generalized equations and its applications to local analysis of Newtonian methods for constrained optimization. Comput. Optim. Appl. 46, 347–368 (2010)CrossRefMATHMathSciNet
156.
Zurück zum Zitat A.F. Izmailov, A.L. Pogosyan, M.V. Solodov, Semismooth Newton method for the lifted reformulation of mathematical programs with complementarity constraints. Comput. Optim. Appl. 51, 199–221 (2012)CrossRefMATHMathSciNet A.F. Izmailov, A.L. Pogosyan, M.V. Solodov, Semismooth Newton method for the lifted reformulation of mathematical programs with complementarity constraints. Comput. Optim. Appl. 51, 199–221 (2012)CrossRefMATHMathSciNet
158.
Zurück zum Zitat A.F. Izmailov, A.S. Kurennoy, M.V. Solodov, The Josephy–Newton method for semismooth generalized equations and semismooth SQP for optimization. Set-Valued Variational Anal. 21, 17–45 (2013)CrossRefMATHMathSciNet A.F. Izmailov, A.S. Kurennoy, M.V. Solodov, The Josephy–Newton method for semismooth generalized equations and semismooth SQP for optimization. Set-Valued Variational Anal. 21, 17–45 (2013)CrossRefMATHMathSciNet
161.
Zurück zum Zitat N.H. Josephy, Newton’s method for generalized equations. Technical Summary Report No. 1965. Mathematics Research Center, University of Wisconsin, Madison, 1979 N.H. Josephy, Newton’s method for generalized equations. Technical Summary Report No. 1965. Mathematics Research Center, University of Wisconsin, Madison, 1979
162.
Zurück zum Zitat N.H. Josephy, Quasi-Newton methods for generalized equations. Technical Summary Report No. 1966. Mathematics Research Center, University of Wisconsin, Madison, 1979 N.H. Josephy, Quasi-Newton methods for generalized equations. Technical Summary Report No. 1966. Mathematics Research Center, University of Wisconsin, Madison, 1979
163.
170.
Zurück zum Zitat D. Klatte, K. Tammer, On the second order sufficient conditions to perturbed C 1, 1 optimization problems. Optimization 19, 169–180 (1988)CrossRefMATHMathSciNet D. Klatte, K. Tammer, On the second order sufficient conditions to perturbed C 1, 1 optimization problems. Optimization 19, 169–180 (1988)CrossRefMATHMathSciNet
209.
Zurück zum Zitat C. Oberlin, S.J. Wright, An accelerated Newton method for equations with semismooth Jacobians and nonlinear complementarity problems. Math. Program. 117, 355–386 (2009)CrossRefMATHMathSciNet C. Oberlin, S.J. Wright, An accelerated Newton method for equations with semismooth Jacobians and nonlinear complementarity problems. Math. Program. 117, 355–386 (2009)CrossRefMATHMathSciNet
212.
Zurück zum Zitat J.-S. Pang, S.A. Gabriel, NE/SQP: a robust algorithm for the nonlinear complementarity problem. Math. Program. 60, 295–338 (1993)CrossRefMATHMathSciNet J.-S. Pang, S.A. Gabriel, NE/SQP: a robust algorithm for the nonlinear complementarity problem. Math. Program. 60, 295–338 (1993)CrossRefMATHMathSciNet
221.
Zurück zum Zitat L. Qi, LC1 functions and LC1 optimization problems. Technical Report AMR 91/21. School of Mathematics, The University of New South Wales, Sydney, 1991 L. Qi, LC1 functions and LC1 optimization problems. Technical Report AMR 91/21. School of Mathematics, The University of New South Wales, Sydney, 1991
222.
223.
Zurück zum Zitat L. Qi, Superlinearly convergent approximate Newton methods for LC1 optimization problems. Math. Program. 64, 277–294 (1994)CrossRefMATH L. Qi, Superlinearly convergent approximate Newton methods for LC1 optimization problems. Math. Program. 64, 277–294 (1994)CrossRefMATH
224.
Zurück zum Zitat L. Qi, H. Jiang, Semismooth Karush–Kuhn–Tucker equations and convergence analysis of Newton and quasi-Newton methods for solving these equations. Math. Oper. Res. 22, 301–325 (1997)CrossRefMATHMathSciNet L. Qi, H. Jiang, Semismooth Karush–Kuhn–Tucker equations and convergence analysis of Newton and quasi-Newton methods for solving these equations. Math. Oper. Res. 22, 301–325 (1997)CrossRefMATHMathSciNet
237.
Zurück zum Zitat R.T. Rockafellar, Computational schemes for solving large-scale problems in extended linear-quadratic programming. Math. Program. 48, 447–474 (1990)CrossRefMATHMathSciNet R.T. Rockafellar, Computational schemes for solving large-scale problems in extended linear-quadratic programming. Math. Program. 48, 447–474 (1990)CrossRefMATHMathSciNet
238.
Zurück zum Zitat R.T. Rockafellar, J.B. Wets, Generalized linear-quadratic problems of deterministic and stochastic optimal control in discrete time. SIAM J. Control Optim. 28, 810–922 (1990)CrossRefMATHMathSciNet R.T. Rockafellar, J.B. Wets, Generalized linear-quadratic problems of deterministic and stochastic optimal control in discrete time. SIAM J. Control Optim. 28, 810–922 (1990)CrossRefMATHMathSciNet
Metadaten
Titel
Variational Problems: Local Methods
verfasst von
Alexey F. Izmailov
Mikhail V. Solodov
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-04247-3_3

Premium Partner