Abstract
A survey is given of old and new results on the sensitivity of solutions to systems of optimality conditions with respect to parametric perturbations. Results of this kind play a key role in subtle convergence analysis of various constrained optimization algorithms. General systems of optimality conditions for problems with abstract constraints, Karush-Kuhn-Tucker systems for mathematical programs, and Lagrange systems for problems with equality constraints are examined. Special attention is given to the cases where the traditional constraint qualifications are violated.
Similar content being viewed by others
References
A. F. Izmailov, Sensitivity in Optimization (Fizmatlit, Moscow, 2006) [in Russian].
D. Klatte and B. Kummer, Nonsmooth Equations in Optimization: Regularity, Calculus, Methods, and Applications (Kluwer, Dordrecht, 2002).
S. M. Robinson, “Strongly Regular Generalized Equations,” Math. Operat. Res. 5, 43–62 (1980).
J. Gauvin, “A Necessary and Sufficient Regularity Conditions To Have Bounded Multipliers in Nonconvex Programming,” Math. Program. 12, 136–138 (1977).
J. F. Bonnans and A. Sulem, “Pseudopower Expansion of Solutions of Generalized Equations and Constrained Optimization,” Math. Program. 70, 123–148 (1995).
A. F. Izmailov and M. V. Solodov, Numerical Optimization Methods (Fizmatlit, Moscow, 2003) [in Russian].
A. G. Sukharev, A. V. Timokhov, and V. V. Fedorov, A Course in Optimization Methods (Nauka, Moscow, 1986) [in Russian].
S. M. Robinson, “Implicit B-Differentiability in Generalized Equations,” Tech. Rep. No. 2854 (Math. Res. Center, Univ. Wisconsin, Madison, 1985).
A. Shapiro, “Second-Order Sensitivity Analysis and Asymptotic Theory of Parametrized, Nonlinear Programs,” Math. Program. 33, 280–290 (1985).
D. Klatte and K. Tammer, “Strong Stability of Stationary Solutions and Karush-Kuhn-Tucker Points in Nonlinear Optimization,” Ann. Operat. Res. 27, 285–307 (1990).
A. Levy, “Solution Sensitivity from General Principles,” SIAM J. Control Optim. 40, 1–38 (2001).
J. F. Bonnans and A. Shapiro, Perturbation Analysis of Optimization Problems (Springer-Verlag, New York, 2000).
J. Kyparisis, “Sensitivity Analysis for Nonlinear Programs and Variational Inequalities,” Math. Operat. Res. 15, 286–298 (1990).
Y. Qui and T. L. Magnanti, “Sensitivity Analysis for Variational Inequalities,” Math. Operat. Res. 17, 61–76 (1992).
J. Kyparisis, “Parametric Variational Inequalities with Multivalued Solution Sets,” Math. Operat. Res. 17, 341–364 (1992).
A. Shapiro, “Sensitivity Analysis of Generalized Equations,” J. Math. Sci. 115, 2554–2565 (2003).
A. F. Izmailov and M. V. Solodov, “A Note on Solution Sensitivity for Karush-Kuhn-Tucker Systems,” Math. Methods Operat. Res. 61, 347–363 (2005).
D. Klatte, “Upper Lipschitz Behavior of Solutions to Perturbed C1, 1 Programs,” Math. Program. 88, 285–311 (2000).
D. Klatte and B. Kummer, “Generalized Kojima Functions and Lipschitz Stability of Critical Points,” Comput. Optim. Appl. 13, 61–85 (1999).
D. Klatte, Strong Stability of Stationary Solutions and Iterated Local Minimization, Parametric Optim. Related Topics (Akademie, Berlin, 1991), pp. 119–136.
S. M. Robinson, “A Characterization of Stability in Linear Systems,” Operat. Res. 25, 435–447 (1977).
S. M. Robinson, “Generalized Equations and Their Solutions. Part II: Applications to Nonlinear Programming,” Math. Program. Study 19, 200–221 (1982).
V. M. Alekseev, V. M. Tikhomirov, and S. V. Fomin, Optimal Control (Nauka, Moscow, 1979) [in Russian].
W. W. Hager and M. S. Gowda, “Stability in the Presence of Degeneracy and Error Estimation,” Math. Program. 85, 181–192 (1999).
A. F. Izmailov, “On the Analytical and Numerical Stability of Critical Lagrange Multipliers,” Zh. Vychisl. Mat. Mat. Fiz. 45, 966–982 (2005) [Comput. Math. Math. Phys. 45, 930–946 (2005)].
A. F. Izmailov and A. A. Tret’yakov, Two-Regular Solutions of Nonlinear Problems: Theory and Numerical Metholds (Fizmatlit, Moscow, 1999) [in Russian].
E. R. Avakov, “Theorems about Estimates in the Neighborhood of a Singular Point of a Mapping,” Mat. Zametki 47(5), 3–13 (1990).
A. F. Izmailov, “Theorems on Representation of Families of Nonlinear Mappings and Implicit Function Theorems,” Mat. Zametki 67(1), 57–68 (2000).
A. V. Arutyunov, “Implicit Function Theorem as an Implementation of Lagrange’s Pinstripe: Abnormal Points,” Mat. Sb. 191(1), 3–26 (2000).
A. V. Arutyunov and A. F. Izmailov, “Sensitivity Theory for Abnormal Optimization Problems with Equality Constraints,” Zh. Vychisl. Mat. Mat. Fiz. 43, 186–202 (2003) [Comput. Math. Math. Phys. 43, 178–193 (2003)].
Author information
Authors and Affiliations
Additional information
Original Russian Text © A.F. Izmailov, 2007, published in Zhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki, 2007, Vol. 47, No. 4, pp. 555–577.
Rights and permissions
About this article
Cite this article
Izmailov, A.F. Sensitivity of solutions to systems of optimality conditions under the violation of constraint qualifications. Comput. Math. and Math. Phys. 47, 533–554 (2007). https://doi.org/10.1134/S096554250704001X
Received:
Issue Date:
DOI: https://doi.org/10.1134/S096554250704001X