Skip to main content

2020 | OriginalPaper | Buchkapitel

2. Subgradient Projection Algorithm

verfasst von : Alexander J. Zaslavski

Erschienen in: Convex Optimization with Computational Errors

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this chapter we study the subgradient projection algorithm for minimization of convex and nonsmooth functions and for computing the saddle points of convex–concave functions, under the presence of computational errors. The problem is described by an objective function and a set of feasible points. For this algorithm each iteration consists of two steps. The first step is a calculation of a subgradient of the objective function while in the second one we calculate a projection on the feasible set. In each of these two steps there is a computational error. In general, these two computational errors are different. We show that our algorithm generates a good approximate solution, if all the computational errors are bounded from above by a small positive constant. Moreover, if we know the computational errors for the two steps of our algorithm, we find out what approximate solution can be obtained and how many iterates one needs for this.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Alber YI (1971) On minimization of smooth functional by gradient methods. USSR Comp Math Math Phys 11:752–758MathSciNet Alber YI (1971) On minimization of smooth functional by gradient methods. USSR Comp Math Math Phys 11:752–758MathSciNet
3.
Zurück zum Zitat Alber YI, Iusem AN, Solodov MV (1998) On the projected subgradient method for nonsmooth convex optimization in a Hilbert space. Math Program 81:23–35MathSciNetMATH Alber YI, Iusem AN, Solodov MV (1998) On the projected subgradient method for nonsmooth convex optimization in a Hilbert space. Math Program 81:23–35MathSciNetMATH
11.
Zurück zum Zitat Barty K, Roy J-S, Strugarek C (2007) Hilbert-valued perturbed subgradient algorithms. Math Oper Res 32:551–562MathSciNetCrossRef Barty K, Roy J-S, Strugarek C (2007) Hilbert-valued perturbed subgradient algorithms. Math Oper Res 32:551–562MathSciNetCrossRef
12.
Zurück zum Zitat Bauschke HH, Borwein JM (1996) On projection algorithms for solving convex feasibility problems. SIAM Rev 38:367–426MathSciNetCrossRef Bauschke HH, Borwein JM (1996) On projection algorithms for solving convex feasibility problems. SIAM Rev 38:367–426MathSciNetCrossRef
13.
Zurück zum Zitat Bauschke HH, and Combettes PL (2011) Convex analysis and monotone operator theory in Hilbert spaces. Springer, New YorkCrossRef Bauschke HH, and Combettes PL (2011) Convex analysis and monotone operator theory in Hilbert spaces. Springer, New YorkCrossRef
17.
Zurück zum Zitat Beck A, Teboulle M (2003) Mirror descent and nonlinear projected subgradient methods for convex optimization. Oper Res Lett 31:167–175MathSciNetCrossRef Beck A, Teboulle M (2003) Mirror descent and nonlinear projected subgradient methods for convex optimization. Oper Res Lett 31:167–175MathSciNetCrossRef
22.
Zurück zum Zitat Burachik RS, Grana Drummond LM, Iusem AN, Svaiter BF (1995) Full convergence of the steepest descent method with inexact line searches. Optimization 32:137–146MathSciNetCrossRef Burachik RS, Grana Drummond LM, Iusem AN, Svaiter BF (1995) Full convergence of the steepest descent method with inexact line searches. Optimization 32:137–146MathSciNetCrossRef
27.
Zurück zum Zitat Butnariu D, Resmerita E (2002) Averaged subgradient methods for constrained convex optimization and Nash equilibria computation. Optimization 51:863–888MathSciNetCrossRef Butnariu D, Resmerita E (2002) Averaged subgradient methods for constrained convex optimization and Nash equilibria computation. Optimization 51:863–888MathSciNetCrossRef
29.
Zurück zum Zitat Censor Y, Gibali A, Reich S (2011) The subgradient extragradient method for solving variational inequalities in Hilbert space. J Optim Theory Appl 148:318–335MathSciNetCrossRef Censor Y, Gibali A, Reich S (2011) The subgradient extragradient method for solving variational inequalities in Hilbert space. J Optim Theory Appl 148:318–335MathSciNetCrossRef
30.
Zurück zum Zitat Censor Y, Gibali A, Reich S, Sabach S (2012) Common solutions to variational inequalities. Set-Valued Var Anal 20:229–247MathSciNetCrossRef Censor Y, Gibali A, Reich S, Sabach S (2012) Common solutions to variational inequalities. Set-Valued Var Anal 20:229–247MathSciNetCrossRef
32.
Zurück zum Zitat Chadli O, Konnov IV, Yao JC (2004) Descent methods for equilibrium problems in a Banach space. Comput Math Appl 48:609–616MathSciNetCrossRef Chadli O, Konnov IV, Yao JC (2004) Descent methods for equilibrium problems in a Banach space. Comput Math Appl 48:609–616MathSciNetCrossRef
35.
Zurück zum Zitat Davis D, Drusvyatskiy D, MacPhee KJ, Paquette C (2018) Subgradient methods for sharp weakly convex functions. J Optim Theory Appl 179:962–982MathSciNetCrossRef Davis D, Drusvyatskiy D, MacPhee KJ, Paquette C (2018) Subgradient methods for sharp weakly convex functions. J Optim Theory Appl 179:962–982MathSciNetCrossRef
36.
Zurück zum Zitat Demyanov VF, Vasilyev LV (1985) Nondifferentiable optimization. Optimization Software, New YorkCrossRef Demyanov VF, Vasilyev LV (1985) Nondifferentiable optimization. Optimization Software, New YorkCrossRef
38.
Zurück zum Zitat Facchinei F, Pang J-S (2003) Finite-dimensional variational inequalities and complementarity problems, volume I and volume II. Springer-Verlag, New YorkMATH Facchinei F, Pang J-S (2003) Finite-dimensional variational inequalities and complementarity problems, volume I and volume II. Springer-Verlag, New YorkMATH
39.
Zurück zum Zitat Gibali A, Jadamba B, Khan AA, Raciti F, Winkler B (2016) Gradient and extragradient methods for the elasticity imaging inverse problem using an equation error formulation: a comparative numerical study. Nonlinear Anal Optim Contemp Math 659:65–89MathSciNetMATH Gibali A, Jadamba B, Khan AA, Raciti F, Winkler B (2016) Gradient and extragradient methods for the elasticity imaging inverse problem using an equation error formulation: a comparative numerical study. Nonlinear Anal Optim Contemp Math 659:65–89MathSciNetMATH
43.
Zurück zum Zitat Griva I (2018) Convergence analysis of augmented Lagrangian-fast projected gradient method for convex quadratic problems. Pure Appl Funct Anal 3:417–428MathSciNet Griva I (2018) Convergence analysis of augmented Lagrangian-fast projected gradient method for convex quadratic problems. Pure Appl Funct Anal 3:417–428MathSciNet
46.
Zurück zum Zitat Hiriart-Urruty J-B, Lemarechal C (1993) Convex analysis and minimization algorithms. Springer, BerlinCrossRef Hiriart-Urruty J-B, Lemarechal C (1993) Convex analysis and minimization algorithms. Springer, BerlinCrossRef
53.
55.
92.
Zurück zum Zitat Zaslavski AJ (2016) Numerical optimization with computational errors. Springer, ChamCrossRef Zaslavski AJ (2016) Numerical optimization with computational errors. Springer, ChamCrossRef
93.
Zurück zum Zitat Zaslavski AJ (2016) Approximate solutions of common fixed point problems, Springer optimization and its applications. Springer, ChamCrossRef Zaslavski AJ (2016) Approximate solutions of common fixed point problems, Springer optimization and its applications. Springer, ChamCrossRef
Metadaten
Titel
Subgradient Projection Algorithm
verfasst von
Alexander J. Zaslavski
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-37822-6_2