Skip to main content

2020 | OriginalPaper | Buchkapitel

7. An Optimization Problems with a Composite Objective Function

verfasst von : Alexander J. Zaslavski

Erschienen in: Convex Optimization with Computational Errors

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this chapter we study an algorithm for minimization of the sum of two functions, the first one being smooth and convex and the second being convex. For this algorithm each iteration consists of two steps. The first step is a calculation of a subgradient of the first function while the second one is a proximal gradient step for the second function. In each of these two steps there is a computational error. In general, these two computational errors are different. We show that our algorithm generates a good approximate solution, if all the computational errors are bounded from above by a small positive constant. Moreover, if we know the computational errors for the two steps of our algorithm, we find out what approximate solution can be obtained and how many iterates one needs for this.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
4.
Zurück zum Zitat Alber YI, Yao JC (2009) Another version of the proximal point algorithm in a Banach space. Nonlinear Anal 70:3159–3171MathSciNetCrossRef Alber YI, Yao JC (2009) Another version of the proximal point algorithm in a Banach space. Nonlinear Anal 70:3159–3171MathSciNetCrossRef
5.
Zurück zum Zitat Alvarez F, Lopez J, Ramirez CH (2010) Interior proximal algorithm with variable metric for second-order cone programming: applications to structural optimization and support vector machines. Optim Methods Softw 25:859–881MathSciNetCrossRef Alvarez F, Lopez J, Ramirez CH (2010) Interior proximal algorithm with variable metric for second-order cone programming: applications to structural optimization and support vector machines. Optim Methods Softw 25:859–881MathSciNetCrossRef
7.
Zurück zum Zitat Aragon Artacho FJ, Geoffroy MH (2007) Uniformity and inexact version of a proximal method for metrically regular mappings. J Math Anal Appl 335:168–183MathSciNetCrossRef Aragon Artacho FJ, Geoffroy MH (2007) Uniformity and inexact version of a proximal method for metrically regular mappings. J Math Anal Appl 335:168–183MathSciNetCrossRef
8.
Zurück zum Zitat Attouch H, Bolte J (2009) On the convergence of the proximal algorithm for nonsmooth functions involving analytic features. Math Program Ser B 116:5–16MathSciNetCrossRef Attouch H, Bolte J (2009) On the convergence of the proximal algorithm for nonsmooth functions involving analytic features. Math Program Ser B 116:5–16MathSciNetCrossRef
13.
Zurück zum Zitat Bauschke HH, and Combettes PL (2011) Convex analysis and monotone operator theory in Hilbert spaces. Springer, New YorkCrossRef Bauschke HH, and Combettes PL (2011) Convex analysis and monotone operator theory in Hilbert spaces. Springer, New YorkCrossRef
14.
19.
Zurück zum Zitat Benker H, Hamel A, Tammer C (1996) A proximal point algorithm for control approximation problems, I. Theoretical background. Math Methods Oper Res 43:261–280MathSciNetCrossRef Benker H, Hamel A, Tammer C (1996) A proximal point algorithm for control approximation problems, I. Theoretical background. Math Methods Oper Res 43:261–280MathSciNetCrossRef
23.
Zurück zum Zitat Burachik RS, Iusem AN (1998) A generalized proximal point algorithm for the variational inequality problem in a Hilbert space. SIAM J Optim 8:197–216MathSciNetCrossRef Burachik RS, Iusem AN (1998) A generalized proximal point algorithm for the variational inequality problem in a Hilbert space. SIAM J Optim 8:197–216MathSciNetCrossRef
24.
Zurück zum Zitat Burachik RS, Kaya CY, Sabach S (2012) A generalized univariate Newton method motivated by proximal regularization. J Optim Theory Appl 155:923–940MathSciNetCrossRef Burachik RS, Kaya CY, Sabach S (2012) A generalized univariate Newton method motivated by proximal regularization. J Optim Theory Appl 155:923–940MathSciNetCrossRef
25.
Zurück zum Zitat Burachik RS, Lopes JO, Da Silva GJP (2009) An inexact interior point proximal method for the variational inequality problem. Comput Appl Math 28:15–36MathSciNetCrossRef Burachik RS, Lopes JO, Da Silva GJP (2009) An inexact interior point proximal method for the variational inequality problem. Comput Appl Math 28:15–36MathSciNetCrossRef
26.
Zurück zum Zitat Butnariu D, Kassay G (2008) A proximal-projection method for finding zeros of set-valued operators. SIAM J Control Optim 47:2096–2136MathSciNetCrossRef Butnariu D, Kassay G (2008) A proximal-projection method for finding zeros of set-valued operators. SIAM J Control Optim 47:2096–2136MathSciNetCrossRef
28.
Zurück zum Zitat Ceng LC, Mordukhovich BS, Yao JC (2010) Hybrid approximate proximal method with auxiliary variational inequality for vector optimization. J Optim Theory Appl 146:267–303MathSciNetCrossRef Ceng LC, Mordukhovich BS, Yao JC (2010) Hybrid approximate proximal method with auxiliary variational inequality for vector optimization. J Optim Theory Appl 146:267–303MathSciNetCrossRef
31.
Zurück zum Zitat Censor Y, Zenios SA (1992) The proximal minimization algorithm with D-functions. J Optim Theory Appl 73:451–464MathSciNetCrossRef Censor Y, Zenios SA (1992) The proximal minimization algorithm with D-functions. J Optim Theory Appl 73:451–464MathSciNetCrossRef
33.
Zurück zum Zitat Chen Z, Zhao K (2009) A proximal-type method for convex vector optimization problem in Banach spaces. Numer Funct Anal Optim 30:70–81MathSciNetCrossRef Chen Z, Zhao K (2009) A proximal-type method for convex vector optimization problem in Banach spaces. Numer Funct Anal Optim 30:70–81MathSciNetCrossRef
34.
Zurück zum Zitat Chuong TD, Mordukhovich BS, Yao JC (2011) Hybrid approximate proximal algorithms for efficient solutions in for vector optimization. J Nonlinear Convex Anal 12:861–864MathSciNetMATH Chuong TD, Mordukhovich BS, Yao JC (2011) Hybrid approximate proximal algorithms for efficient solutions in for vector optimization. J Nonlinear Convex Anal 12:861–864MathSciNetMATH
40.
Zurück zum Zitat Gockenbach MS, Jadamba B, Khan AA, Tammer Chr, Winkler B (2015) Proximal methods for the elastography inverse problem of tumor identification using an equation error approach. Adv Var Hemivariational Inequal 33:173–197MathSciNetMATH Gockenbach MS, Jadamba B, Khan AA, Tammer Chr, Winkler B (2015) Proximal methods for the elastography inverse problem of tumor identification using an equation error approach. Adv Var Hemivariational Inequal 33:173–197MathSciNetMATH
45.
47.
Zurück zum Zitat Iusem A, Nasri M (2007) Inexact proximal point methods for equilibrium problems in Banach spaces. Numer Funct Anal Optim 28:1279–1308MathSciNetCrossRef Iusem A, Nasri M (2007) Inexact proximal point methods for equilibrium problems in Banach spaces. Numer Funct Anal Optim 28:1279–1308MathSciNetCrossRef
48.
Zurück zum Zitat Iusem A, Resmerita E (2010) A proximal point method in nonreflexive Banach spaces. Set-Valued Var Anal 18:109–120MathSciNetCrossRef Iusem A, Resmerita E (2010) A proximal point method in nonreflexive Banach spaces. Set-Valued Var Anal 18:109–120MathSciNetCrossRef
69.
Zurück zum Zitat Nguyen TP, Pauwels E, Richard E, Suter BW (2018) Extragradient method in optimization: convergence and complexity. J Optim Theory Appl 176:137–162MathSciNetCrossRef Nguyen TP, Pauwels E, Richard E, Suter BW (2018) Extragradient method in optimization: convergence and complexity. J Optim Theory Appl 176:137–162MathSciNetCrossRef
41.
Zurück zum Zitat Gopfert A, Tammer Chr, Riahi, H (1999) Existence and proximal point algorithms for nonlinear monotone complementarity problems. Optimization 45:57–68MathSciNetCrossRef Gopfert A, Tammer Chr, Riahi, H (1999) Existence and proximal point algorithms for nonlinear monotone complementarity problems. Optimization 45:57–68MathSciNetCrossRef
42.
Zurück zum Zitat Grecksch W, Heyde F, Tammer Chr (2000) Proximal point algorithm for an approximated stochastic optimal control problem. Monte Carlo Methods Appl 6:175–189MathSciNetCrossRef Grecksch W, Heyde F, Tammer Chr (2000) Proximal point algorithm for an approximated stochastic optimal control problem. Monte Carlo Methods Appl 6:175–189MathSciNetCrossRef
43.
Zurück zum Zitat Griva I (2018) Convergence analysis of augmented Lagrangian-fast projected gradient method for convex quadratic problems. Pure Appl Funct Anal 3:417–428MathSciNet Griva I (2018) Convergence analysis of augmented Lagrangian-fast projected gradient method for convex quadratic problems. Pure Appl Funct Anal 3:417–428MathSciNet
44.
Zurück zum Zitat Griva I, Polyak R (2011) Proximal point nonlinear rescaling method for convex optimization. Numer Algebra Control Optim 1:283–299MathSciNetCrossRef Griva I, Polyak R (2011) Proximal point nonlinear rescaling method for convex optimization. Numer Algebra Control Optim 1:283–299MathSciNetCrossRef
Metadaten
Titel
An Optimization Problems with a Composite Objective Function
verfasst von
Alexander J. Zaslavski
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-37822-6_7