Skip to main content
Erschienen in: Calcolo 4/2018

01.12.2018

Tseng type methods for solving inclusion problems and its applications

verfasst von: Aviv Gibali, Duong Viet Thong

Erschienen in: Calcolo | Ausgabe 4/2018

Einloggen, um Zugang zu erhalten

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we introduce two modifications of the forward–backward splitting method with a new step size rule for inclusion problems in real Hilbert spaces. The modifications are based on Mann and viscosity-ideas. Under standard assumptions, such as Lipschitz continuity and monotonicity (also maximal monotonicity), we establish strong convergence of the proposed algorithms. We present two numerical examples, the first in infinite dimensional spaces, which illustrates mainly the strong convergence property of the algorithm. For the second example, we illustrate the performances of our scheme, compared with the classical forward–backward splitting method for the problem of recovering a sparse noisy signal. Our result extend some related works in the literature and the primary experiments might also suggest their potential applicability.
Literatur
1.
Zurück zum Zitat Attouch, H., Peypouquet, J., Redont, P.: Backward–forward algorithms for structured monotone inclusions in Hilbert spaces. J. Math. Anal. Appl. 457, 1095–1117 (2018)MathSciNetCrossRef Attouch, H., Peypouquet, J., Redont, P.: Backward–forward algorithms for structured monotone inclusions in Hilbert spaces. J. Math. Anal. Appl. 457, 1095–1117 (2018)MathSciNetCrossRef
2.
Zurück zum Zitat Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. CMS Books in Mathematics. Springer, New York (2011)CrossRef Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. CMS Books in Mathematics. Springer, New York (2011)CrossRef
3.
Zurück zum Zitat Brézis, H., Chapitre, I.I.: Operateurs maximaux monotones. North-Holland Math. Stud. 5, 19–51 (1973)CrossRef Brézis, H., Chapitre, I.I.: Operateurs maximaux monotones. North-Holland Math. Stud. 5, 19–51 (1973)CrossRef
4.
Zurück zum Zitat Bruck, R.: On the weak convergence of an ergodic iteration for the solution of variational inequalities for monotone operators in Hilbert space. J. Math. Anal. Appl. 61, 159–164 (1977)MathSciNetCrossRef Bruck, R.: On the weak convergence of an ergodic iteration for the solution of variational inequalities for monotone operators in Hilbert space. J. Math. Anal. Appl. 61, 159–164 (1977)MathSciNetCrossRef
5.
Zurück zum Zitat Chen, H.G., Rockafellar, R.T.: Convergence rates in forward–backward splitting. SIAM J. Optim. 7, 421–444 (1997)MathSciNetCrossRef Chen, H.G., Rockafellar, R.T.: Convergence rates in forward–backward splitting. SIAM J. Optim. 7, 421–444 (1997)MathSciNetCrossRef
6.
Zurück zum Zitat Chen, S., Donoho, D.L., Saunders, M.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20, 33–61 (1998)MathSciNetCrossRef Chen, S., Donoho, D.L., Saunders, M.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20, 33–61 (1998)MathSciNetCrossRef
7.
Zurück zum Zitat Cegielski, A.: Iterative Methods for Fixed Point Problems in Hilbert Spaces. Lecture Notes in Mathematics 2057. Springer, Berlin (2012) Cegielski, A.: Iterative Methods for Fixed Point Problems in Hilbert Spaces. Lecture Notes in Mathematics 2057. Springer, Berlin (2012)
8.
Zurück zum Zitat Censor, Y., Elfving, T.: A multiprojection algorithm using Bregman projections in a product space. Numer. Algorithms 8, 221–239 (1994)MathSciNetCrossRef Censor, Y., Elfving, T.: A multiprojection algorithm using Bregman projections in a product space. Numer. Algorithms 8, 221–239 (1994)MathSciNetCrossRef
9.
Zurück zum Zitat Combettes, P.L., Wajs, V.: Signal recovery by proximal forward–backward splitting. SIAM Multiscale Model. Simul. 4, 1168–1200 (2005)MathSciNetCrossRef Combettes, P.L., Wajs, V.: Signal recovery by proximal forward–backward splitting. SIAM Multiscale Model. Simul. 4, 1168–1200 (2005)MathSciNetCrossRef
10.
Zurück zum Zitat Daubechies, I., Defrise, M., De Mol, C.: An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun. Pure Appl. Math. 57, 1413–1457 (2004)MathSciNetCrossRef Daubechies, I., Defrise, M., De Mol, C.: An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun. Pure Appl. Math. 57, 1413–1457 (2004)MathSciNetCrossRef
11.
Zurück zum Zitat Dong, Q., Jiang, D., Cholamjiak, P., Shehu, Y.: A strong convergence result involving an inertial forward-backward algorithm for monotone inclusions. J. Fixed Point Theory Appl. 19, 3097–3118 (2017)MathSciNetCrossRef Dong, Q., Jiang, D., Cholamjiak, P., Shehu, Y.: A strong convergence result involving an inertial forward-backward algorithm for monotone inclusions. J. Fixed Point Theory Appl. 19, 3097–3118 (2017)MathSciNetCrossRef
12.
Zurück zum Zitat Dong, Y.D., Fischer, A.: A family of operator splitting methods revisited. Nonlinear Anal. 72, 4307–4315 (2010)MathSciNetCrossRef Dong, Y.D., Fischer, A.: A family of operator splitting methods revisited. Nonlinear Anal. 72, 4307–4315 (2010)MathSciNetCrossRef
13.
Zurück zum Zitat Duchi, J., Shalev-Shwartz, S., Singer, Y., Chandra, T.: Efficient projections onto the \(l_1\)-ball for learning in high dimensions. In: Proceedings of the 25 th International Conference on Machine Learning, Helsinki, Finland (2008) Duchi, J., Shalev-Shwartz, S., Singer, Y., Chandra, T.: Efficient projections onto the \(l_1\)-ball for learning in high dimensions. In: Proceedings of the 25 th International Conference on Machine Learning, Helsinki, Finland (2008)
14.
Zurück zum Zitat Duchi, J., Singer, Y.: Efficient online and batch learning using forward–backward splitting. J. Mach. Learn. Res. 10, 2899–2934 (2009)MathSciNetMATH Duchi, J., Singer, Y.: Efficient online and batch learning using forward–backward splitting. J. Mach. Learn. Res. 10, 2899–2934 (2009)MathSciNetMATH
15.
Zurück zum Zitat Goebel, K., Reich, S.: Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings. Marcel Dekker, New York (1984)MATH Goebel, K., Reich, S.: Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings. Marcel Dekker, New York (1984)MATH
17.
Zurück zum Zitat Huang, Y.Y., Dong, Y.D.: New properties of forward-backward splitting and a practical proximal-descent algorithm. Appl. Math. Comput. 237, 60–68 (2014)MathSciNetMATH Huang, Y.Y., Dong, Y.D.: New properties of forward-backward splitting and a practical proximal-descent algorithm. Appl. Math. Comput. 237, 60–68 (2014)MathSciNetMATH
18.
Zurück zum Zitat Lions, P.L., Mercier, B.: Splitting algorithms for the sum of two nonlinear operators. SIAM J. Numer. Anal. 16, 964–979 (1979)MathSciNetCrossRef Lions, P.L., Mercier, B.: Splitting algorithms for the sum of two nonlinear operators. SIAM J. Numer. Anal. 16, 964–979 (1979)MathSciNetCrossRef
19.
Zurück zum Zitat Maingé, F.: A hybrid extragradient-viscosity method for monotone operators and fixed point problems. SIAM J. Control Optim. 47, 1499–1515 (2008)MathSciNetCrossRef Maingé, F.: A hybrid extragradient-viscosity method for monotone operators and fixed point problems. SIAM J. Control Optim. 47, 1499–1515 (2008)MathSciNetCrossRef
21.
Zurück zum Zitat Moudafi, A.: Viscosity approximating methods for fixed point problems. J. Math. Anal. Appl. 241, 46–55 (2000)MathSciNetCrossRef Moudafi, A.: Viscosity approximating methods for fixed point problems. J. Math. Anal. Appl. 241, 46–55 (2000)MathSciNetCrossRef
22.
Zurück zum Zitat Passty, G.B.: Ergodic convergence to a zero of the sum of monotone operators in Hilbert space. J. Math. Anal. Appl. 72, 383–390 (1979)MathSciNetCrossRef Passty, G.B.: Ergodic convergence to a zero of the sum of monotone operators in Hilbert space. J. Math. Anal. Appl. 72, 383–390 (1979)MathSciNetCrossRef
23.
Zurück zum Zitat Raguet, H., Fadili, J., Peyré, G.: A generalized forward–backward splitting. SIAM J. Imaging Sci. 6, 1199–1226 (2013)MathSciNetCrossRef Raguet, H., Fadili, J., Peyré, G.: A generalized forward–backward splitting. SIAM J. Imaging Sci. 6, 1199–1226 (2013)MathSciNetCrossRef
24.
Zurück zum Zitat Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control. Optim. 14, 877–898 (1976)MathSciNetCrossRef Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control. Optim. 14, 877–898 (1976)MathSciNetCrossRef
25.
Zurück zum Zitat Takahashi, W.: Nonlinear Functional Analysis-Fixed Point Theory and Its Applications. Yokohama Publishers, Yokohama (2000)MATH Takahashi, W.: Nonlinear Functional Analysis-Fixed Point Theory and Its Applications. Yokohama Publishers, Yokohama (2000)MATH
26.
Zurück zum Zitat Tibshirami, R.: Regression shrinkage and selection via lasso. J. R. Stat. Soc. Ser. B 58, 267–288 (1996)MathSciNet Tibshirami, R.: Regression shrinkage and selection via lasso. J. R. Stat. Soc. Ser. B 58, 267–288 (1996)MathSciNet
27.
Zurück zum Zitat Tseng, P.: A modified forward-backward splitting method for maximal monotone mappings. SIAM J Control Optim. 38, 431–446 (2000)MathSciNetCrossRef Tseng, P.: A modified forward-backward splitting method for maximal monotone mappings. SIAM J Control Optim. 38, 431–446 (2000)MathSciNetCrossRef
Metadaten
Titel
Tseng type methods for solving inclusion problems and its applications
verfasst von
Aviv Gibali
Duong Viet Thong
Publikationsdatum
01.12.2018
Verlag
Springer International Publishing
Erschienen in
Calcolo / Ausgabe 4/2018
Print ISSN: 0008-0624
Elektronische ISSN: 1126-5434
DOI
https://doi.org/10.1007/s10092-018-0292-1

Weitere Artikel der Ausgabe 4/2018

Calcolo 4/2018 Zur Ausgabe