Skip to main content
Erschienen in: Numerical Algorithms 4/2020

22.05.2019 | Original Paper

Convergence analysis of positive-indefinite proximal ADMM with a Glowinski’s relaxation factor

verfasst von: Jiawei Chen, Yiyun Wang, Hongjin He, Yibing Lv

Erschienen in: Numerical Algorithms | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a modified positive-indefinite proximal linearized ADMM (PIPL-ADMM) with a larger Glowinski’s relaxation factor for solving two-block linearly constrained separable convex programming by variational inequality technique. We investigate the internal relationships between the step size coefficient and the penalty coefficient to identify the convergence of PIPL-ADMM. The convergence of PIPL-ADMM and its convergence rate measured by the iteration complexity are established in the ergodic case. Numerical experiments are reported to illustrate the efficiency of the proposed methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2011)MATHCrossRef Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2011)MATHCrossRef
2.
Zurück zum Zitat Chan, R.H., Yang, J.F., Yuan, X.M.: Alternating direction method for image inpainting in wavelet domains. SIAM J. Imag. Sci. 4(3), 807–826 (2011)MathSciNetMATHCrossRef Chan, R.H., Yang, J.F., Yuan, X.M.: Alternating direction method for image inpainting in wavelet domains. SIAM J. Imag. Sci. 4(3), 807–826 (2011)MathSciNetMATHCrossRef
3.
Zurück zum Zitat Chang, T.H., Liao, W.C., Hong, M.Y., Wang, X.F.: Asynchronous distributed ADMM for large-scale optimization-Part II: Linear convergence analysis and numerical performance. IEEE Trans. Signal Process. 64(12), 3131–3144 (2016)MathSciNetMATHCrossRef Chang, T.H., Liao, W.C., Hong, M.Y., Wang, X.F.: Asynchronous distributed ADMM for large-scale optimization-Part II: Linear convergence analysis and numerical performance. IEEE Trans. Signal Process. 64(12), 3131–3144 (2016)MathSciNetMATHCrossRef
4.
Zurück zum Zitat Donoho, D.L., Tsaig, Y.: Fast solution of l1-norm minimization problems when the solution may be sparse. IEEE Trans. Inform. Theory 54, 4789–4812 (2008)MathSciNetMATHCrossRef Donoho, D.L., Tsaig, Y.: Fast solution of l1-norm minimization problems when the solution may be sparse. IEEE Trans. Inform. Theory 54, 4789–4812 (2008)MathSciNetMATHCrossRef
5.
Zurück zum Zitat Fortin, M., Glowinski, R.: Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary-Value Problems, Sole distributors for the U.S.A. and Canada, Elsevier Science Pub. Co (1983) Fortin, M., Glowinski, R.: Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary-Value Problems, Sole distributors for the U.S.A. and Canada, Elsevier Science Pub. Co (1983)
6.
Zurück zum Zitat Gabay, D., Mercier, B.: A dual algorithm for the solution of nonlinear variational problems via finite element approximation. Comput. Math. Appl. 2, 17–40 (1976)MATHCrossRef Gabay, D., Mercier, B.: A dual algorithm for the solution of nonlinear variational problems via finite element approximation. Comput. Math. Appl. 2, 17–40 (1976)MATHCrossRef
7.
Zurück zum Zitat Glowinski, R., Marrocco, A.: Sur l’approximation, paréléments finis d’ordre un, et la résolution, par pénalisation-dualité d’une classe de problèmes de Dirichlet nonlinéaires, Revue fancaise d’atomatique, Informatique Recherche opérationelle. Anal. Numŕ. 9(2), 41–76 (1975) Glowinski, R., Marrocco, A.: Sur l’approximation, paréléments finis d’ordre un, et la résolution, par pénalisation-dualité d’une classe de problèmes de Dirichlet nonlinéaires, Revue fancaise d’atomatique, Informatique Recherche opérationelle. Anal. Numŕ. 9(2), 41–76 (1975)
8.
Zurück zum Zitat Han, D., Yuan, X.M.: A note on the alternating direction method of multipliers. J. Optim. Theory Appl. 155(1), 227–238 (2012)MathSciNetMATHCrossRef Han, D., Yuan, X.M.: A note on the alternating direction method of multipliers. J. Optim. Theory Appl. 155(1), 227–238 (2012)MathSciNetMATHCrossRef
9.
Zurück zum Zitat Han, D., Yuan, X.M., Zhang, W., Cai, X.: An ADM-based splitting method for separable convex programming. Comput. Optim. Appl. 54(2), 343–369 (2013)MathSciNetMATHCrossRef Han, D., Yuan, X.M., Zhang, W., Cai, X.: An ADM-based splitting method for separable convex programming. Comput. Optim. Appl. 54(2), 343–369 (2013)MathSciNetMATHCrossRef
10.
Zurück zum Zitat He, B.S., Liao, L.Z., Han, D., Yang, H.: A new inexact alternating directions method for monotone variational inequalities. Math. Program. 92, 103–118 (2002)MathSciNetMATHCrossRef He, B.S., Liao, L.Z., Han, D., Yang, H.: A new inexact alternating directions method for monotone variational inequalities. Math. Program. 92, 103–118 (2002)MathSciNetMATHCrossRef
11.
Zurück zum Zitat He, B.S., Yuan, X.M.: On the O(1/n) convergence rate of the Douglas-Rachford alternating direction method. SIAM J. Numer. Anal. 50(2), 700–709 (2012)MathSciNetMATHCrossRef He, B.S., Yuan, X.M.: On the O(1/n) convergence rate of the Douglas-Rachford alternating direction method. SIAM J. Numer. Anal. 50(2), 700–709 (2012)MathSciNetMATHCrossRef
12.
Zurück zum Zitat He, B.S., Liu, H., Wang, Z.R., Yuan, X.M.: A strictly contractive Peaceman-Rachford splitting method for convex programming. SIAM J. Optim. 24 (3), 1011–1040 (2014)MathSciNetMATHCrossRef He, B.S., Liu, H., Wang, Z.R., Yuan, X.M.: A strictly contractive Peaceman-Rachford splitting method for convex programming. SIAM J. Optim. 24 (3), 1011–1040 (2014)MathSciNetMATHCrossRef
16.
Zurück zum Zitat Huai, K., Ni, M., Yu, Z., Zheng, X., Ma, F.: A generalized inexact Uzawa method for stable principal component pursuit problem with nonnegative constraints. Numer. Algorith. 77(3), 653–674 (2018)MathSciNetMATHCrossRef Huai, K., Ni, M., Yu, Z., Zheng, X., Ma, F.: A generalized inexact Uzawa method for stable principal component pursuit problem with nonnegative constraints. Numer. Algorith. 77(3), 653–674 (2018)MathSciNetMATHCrossRef
17.
Zurück zum Zitat Lin, Z., Liu, R., Li, H.: Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning. Mach. Learn. 99(2), 287–325 (2015)MathSciNetMATHCrossRef Lin, Z., Liu, R., Li, H.: Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning. Mach. Learn. 99(2), 287–325 (2015)MathSciNetMATHCrossRef
18.
Zurück zum Zitat Monteiro, R.D.C., Svaiter, B.F.: Iteration-complexity of block-decomposition algorithms and the alternatinng direction method of multipliers. SIAM. J. Optim. 23(1), 475–507 (2013)MathSciNetMATHCrossRef Monteiro, R.D.C., Svaiter, B.F.: Iteration-complexity of block-decomposition algorithms and the alternatinng direction method of multipliers. SIAM. J. Optim. 23(1), 475–507 (2013)MathSciNetMATHCrossRef
19.
Zurück zum Zitat Ng, M.K., Weiss, P., Yuan, X.M.: Solving constrained total-variation image restoration and reconstruction problems via alternating direction methods. SIAM. J. Sci. Comput. 32(5), 2710–2736 (2010)MathSciNetMATHCrossRef Ng, M.K., Weiss, P., Yuan, X.M.: Solving constrained total-variation image restoration and reconstruction problems via alternating direction methods. SIAM. J. Sci. Comput. 32(5), 2710–2736 (2010)MathSciNetMATHCrossRef
21.
Zurück zum Zitat Powell, M.J.D.: A method for nonlinear constraints in minimization problems. In: Fletcher, R. (ed.) Optimization, pp 283–298. Academic Press (1969) Powell, M.J.D.: A method for nonlinear constraints in minimization problems. In: Fletcher, R. (ed.) Optimization, pp 283–298. Academic Press (1969)
22.
Zurück zum Zitat Rockfellar, R.T.: Augmented Lagrangians and applications of the proximal point algorithm in convex programming. Math. Oper Res. 1(2), 97–116 (1976)MathSciNetCrossRef Rockfellar, R.T.: Augmented Lagrangians and applications of the proximal point algorithm in convex programming. Math. Oper Res. 1(2), 97–116 (1976)MathSciNetCrossRef
23.
24.
Zurück zum Zitat Wang, Y., Yang, J.F., Yin, W., Zhang, Y.: A new alternating minimization algorithm for total variation image reconstruction. SIAM J. Imag. Sci. 1(3), 248–272 (2008)MathSciNetMATHCrossRef Wang, Y., Yang, J.F., Yin, W., Zhang, Y.: A new alternating minimization algorithm for total variation image reconstruction. SIAM J. Imag. Sci. 1(3), 248–272 (2008)MathSciNetMATHCrossRef
25.
Zurück zum Zitat Xia, F.Q., Huang, N.J.: A projection-proximal point algorithm for solving generalized variational inequalities. J. Optim. Theory Appl. 150, 98–117 (2011)MathSciNetMATHCrossRef Xia, F.Q., Huang, N.J.: A projection-proximal point algorithm for solving generalized variational inequalities. J. Optim. Theory Appl. 150, 98–117 (2011)MathSciNetMATHCrossRef
26.
Zurück zum Zitat Xie, W.S., Yang, Y.F., Zhou, B.: An ADMM algorithm for second-order TV-based MR image reconstruction. Numer. Algorith. 67(4), 827–843 (2014)MathSciNetMATHCrossRef Xie, W.S., Yang, Y.F., Zhou, B.: An ADMM algorithm for second-order TV-based MR image reconstruction. Numer. Algorith. 67(4), 827–843 (2014)MathSciNetMATHCrossRef
27.
Zurück zum Zitat Yang, J.F., Yuan, X.M.: Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization. Math. Comp. 82, 301–329 (2013)MathSciNetMATHCrossRef Yang, J.F., Yuan, X.M.: Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization. Math. Comp. 82, 301–329 (2013)MathSciNetMATHCrossRef
28.
Zurück zum Zitat Yang, J.F., Zhang, Y., Yin, W.: A fast alternating direction method for TVL1-l2 signal reconstruction from partial Fourier data. IEEE J. Sel. Top. Signal Process. 4(2), 288–297 (2010)CrossRef Yang, J.F., Zhang, Y., Yin, W.: A fast alternating direction method for TVL1-l2 signal reconstruction from partial Fourier data. IEEE J. Sel. Top. Signal Process. 4(2), 288–297 (2010)CrossRef
29.
Zurück zum Zitat Zhang, L., Fang, C., Chen, S.: An inertial subgradient-type method for solving single-valued variational inequalities and fixed point problems. Numer. Algorith. 79 (3), 941–956 (2018)MathSciNetMATHCrossRef Zhang, L., Fang, C., Chen, S.: An inertial subgradient-type method for solving single-valued variational inequalities and fixed point problems. Numer. Algorith. 79 (3), 941–956 (2018)MathSciNetMATHCrossRef
30.
Zurück zum Zitat Zhang, X.Q., Burger, M., Osher, S.: A unified primal-dual algorithm framework based on Bergman iteration. J. Sci. Comput. 46, 20–46 (2010)MATHCrossRef Zhang, X.Q., Burger, M., Osher, S.: A unified primal-dual algorithm framework based on Bergman iteration. J. Sci. Comput. 46, 20–46 (2010)MATHCrossRef
Metadaten
Titel
Convergence analysis of positive-indefinite proximal ADMM with a Glowinski’s relaxation factor
verfasst von
Jiawei Chen
Yiyun Wang
Hongjin He
Yibing Lv
Publikationsdatum
22.05.2019
Verlag
Springer US
Erschienen in
Numerical Algorithms / Ausgabe 4/2020
Print ISSN: 1017-1398
Elektronische ISSN: 1572-9265
DOI
https://doi.org/10.1007/s11075-019-00731-9

Weitere Artikel der Ausgabe 4/2020

Numerical Algorithms 4/2020 Zur Ausgabe