Skip to main content
Erschienen in: Journal of Scientific Computing 3/2015

30.01.2015

A New Steplength Selection for Scaled Gradient Methods with Application to Image Deblurring

verfasst von: Federica Porta, Marco Prato, Luca Zanni

Erschienen in: Journal of Scientific Computing | Ausgabe 3/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Gradient methods are frequently used in large scale image deblurring problems since they avoid the onerous computation of the Hessian matrix of the objective function. Second order information is typically sought by a clever choice of the steplength parameter defining the descent direction, as in the case of the well-known Barzilai and Borwein rules. In a recent paper, a strategy for the steplength selection approximating the inverse of some eigenvalues of the Hessian matrix has been proposed for gradient methods applied to unconstrained minimization problems. In the quadratic case, this approach is based on a Lanczos process applied every \(m\) iterations to the matrix of the gradients computed in the previous \(m\) iterations, but the idea can be extended to a general objective function. In this paper we extend this rule to the case of scaled gradient projection methods applied to constrained minimization problems, and we test the effectiveness of the proposed strategy in image deblurring problems in both the presence and the absence of an explicit edge-preserving regularization term.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Acar, R., Vogel, C.R.: Analysis of bounded variation penalty methods for ill-posed problems. Inverse Probl. 10(6), 1217–1229 (2004)MathSciNetCrossRef Acar, R., Vogel, C.R.: Analysis of bounded variation penalty methods for ill-posed problems. Inverse Probl. 10(6), 1217–1229 (2004)MathSciNetCrossRef
2.
Zurück zum Zitat Bardsley, J.M., Goldes, J.: Regularization parameter selection methods for ill-posed Poisson maximum likelihood estimation. Inverse Probl. 25(9), 095005 (2009)MathSciNetCrossRef Bardsley, J.M., Goldes, J.: Regularization parameter selection methods for ill-posed Poisson maximum likelihood estimation. Inverse Probl. 25(9), 095005 (2009)MathSciNetCrossRef
4.
Zurück zum Zitat Bertero, M., Boccacci, P., Talenti, G., Zanella, R., Zanni, L.: A discrepancy principle for Poisson data. Inverse Probl. 26(10), 105004 (2010)MathSciNetCrossRef Bertero, M., Boccacci, P., Talenti, G., Zanella, R., Zanni, L.: A discrepancy principle for Poisson data. Inverse Probl. 26(10), 105004 (2010)MathSciNetCrossRef
5.
Zurück zum Zitat Bertero, M., Lantéri, H., Zanni, L.: Iterative image reconstruction: a point of view. In: Censor, Y., Jiang, M., Louis, A.K. (eds.) Mathematical Methods in Biomedical Imaging and Intensity-Modulated Radiation Therapy, pp. 37–63. Edizioni della Normale, Pisa (2008) Bertero, M., Lantéri, H., Zanni, L.: Iterative image reconstruction: a point of view. In: Censor, Y., Jiang, M., Louis, A.K. (eds.) Mathematical Methods in Biomedical Imaging and Intensity-Modulated Radiation Therapy, pp. 37–63. Edizioni della Normale, Pisa (2008)
6.
Zurück zum Zitat Bertsekas, D.: Nonlinear Programming. Athena Scientific, Belmont (1999)MATH Bertsekas, D.: Nonlinear Programming. Athena Scientific, Belmont (1999)MATH
7.
Zurück zum Zitat Bertsekas, D.: Convex Optimization Theory. Supplementary Chapter 6 on Convex Optimization Algorithms. Athena Scientific, Belmont (2009) Bertsekas, D.: Convex Optimization Theory. Supplementary Chapter 6 on Convex Optimization Algorithms. Athena Scientific, Belmont (2009)
8.
Zurück zum Zitat Birgin, E.G., Martinez, J.M., Raydan, M.: Inexact spectral projected gradient methods on convex sets. IMA J. Numer. Anal. 23(4), 539–559 (2003)MATHMathSciNetCrossRef Birgin, E.G., Martinez, J.M., Raydan, M.: Inexact spectral projected gradient methods on convex sets. IMA J. Numer. Anal. 23(4), 539–559 (2003)MATHMathSciNetCrossRef
9.
Zurück zum Zitat Bonettini, S., Landi, G., Loli Piccolomini, E., Zanni, L.: Scaling techniques for gradient projection-type methods in astronomical image deblurring. Int. J. Comput. Math. 90(1), 9–29 (2013)MATHMathSciNetCrossRef Bonettini, S., Landi, G., Loli Piccolomini, E., Zanni, L.: Scaling techniques for gradient projection-type methods in astronomical image deblurring. Int. J. Comput. Math. 90(1), 9–29 (2013)MATHMathSciNetCrossRef
10.
Zurück zum Zitat Bonettini, S., Prato, M.: Nonnegative image reconstruction from sparse Fourier data: a new deconvolution algorithm. Inverse Probl. 26(9), 095001 (2010)MathSciNetCrossRef Bonettini, S., Prato, M.: Nonnegative image reconstruction from sparse Fourier data: a new deconvolution algorithm. Inverse Probl. 26(9), 095001 (2010)MathSciNetCrossRef
11.
Zurück zum Zitat Bonettini, S., Prato, M.: Accelerated gradient methods for the X-ray imaging of solar flares. Inverse Probl. 30(5), 055004 (2014)MathSciNetCrossRef Bonettini, S., Prato, M.: Accelerated gradient methods for the X-ray imaging of solar flares. Inverse Probl. 30(5), 055004 (2014)MathSciNetCrossRef
13.
Zurück zum Zitat Bonettini, S., Ruggiero, V.: An alternating extragradient method for total variation based image restoration from Poisson data. Inverse Probl. 27(9), 095001 (2011)MathSciNetCrossRef Bonettini, S., Ruggiero, V.: An alternating extragradient method for total variation based image restoration from Poisson data. Inverse Probl. 27(9), 095001 (2011)MathSciNetCrossRef
14.
Zurück zum Zitat Bonettini, S., Ruggiero, V.: On the convergence of primal–dual hybrid gradient algorithms for total variation image restoration. J. Math. Imaging Vis. 44(3), 236–253 (2012)MATHMathSciNetCrossRef Bonettini, S., Ruggiero, V.: On the convergence of primal–dual hybrid gradient algorithms for total variation image restoration. J. Math. Imaging Vis. 44(3), 236–253 (2012)MATHMathSciNetCrossRef
15.
Zurück zum Zitat Bonettini, S., Zanella, R., Zanni, L.: A scaled gradient projection method for constrained image deblurring. Inverse Probl. 25(1), 015002 (2009)MathSciNetCrossRef Bonettini, S., Zanella, R., Zanni, L.: A scaled gradient projection method for constrained image deblurring. Inverse Probl. 25(1), 015002 (2009)MathSciNetCrossRef
16.
Zurück zum Zitat Carlavan, M., Blanc-Féraud, L.: Regularizing parameter estimation for Poisson noisy image restoration. In: International ICST Workshop on New Computational Methods for Inverse Problems, May 2011, Paris, France Carlavan, M., Blanc-Féraud, L.: Regularizing parameter estimation for Poisson noisy image restoration. In: International ICST Workshop on New Computational Methods for Inverse Problems, May 2011, Paris, France
17.
Zurück zum Zitat Chambolle, A.: An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 20(1–2), 89–97 (2004)MathSciNet Chambolle, A.: An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 20(1–2), 89–97 (2004)MathSciNet
18.
Zurück zum Zitat Chambolle, A., Pock, T.: A first-order primal–dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40(1), 120–145 (2011)MATHMathSciNetCrossRef Chambolle, A., Pock, T.: A first-order primal–dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40(1), 120–145 (2011)MATHMathSciNetCrossRef
19.
Zurück zum Zitat Coleman, T.F., Li, Y.: An interior trust region approach for nonlinear minimization subject to bounds. SIAM J. Optim. 6(2), 418–445 (1996)MATHMathSciNetCrossRef Coleman, T.F., Li, Y.: An interior trust region approach for nonlinear minimization subject to bounds. SIAM J. Optim. 6(2), 418–445 (1996)MATHMathSciNetCrossRef
20.
Zurück zum Zitat Cornelio, A., Porta, F., Prato, M., Zanni, L.: On the filtering effect of iterative regularization algorithms for discrete inverse problems. Inverse Probl. 29(12), 125013 (2013)MathSciNetCrossRef Cornelio, A., Porta, F., Prato, M., Zanni, L.: On the filtering effect of iterative regularization algorithms for discrete inverse problems. Inverse Probl. 29(12), 125013 (2013)MathSciNetCrossRef
22.
Zurück zum Zitat Daube-Witherspoon, M.E., Muehllener, G.: An iterative image space reconstruction algorithm suitable for volume ECT. IEEE Trans. Med. Imaging 5(2), 61–66 (1986)CrossRef Daube-Witherspoon, M.E., Muehllener, G.: An iterative image space reconstruction algorithm suitable for volume ECT. IEEE Trans. Med. Imaging 5(2), 61–66 (1986)CrossRef
23.
Zurück zum Zitat De Asmundis, R., Di Serafino, D., Riccio, F., Toraldo, G.: On spectral properties of steepest descent methods. IMA J. Numer. Anal. 33(4), 1416–1435 (2013)MATHMathSciNetCrossRef De Asmundis, R., Di Serafino, D., Riccio, F., Toraldo, G.: On spectral properties of steepest descent methods. IMA J. Numer. Anal. 33(4), 1416–1435 (2013)MATHMathSciNetCrossRef
24.
Zurück zum Zitat De Asmundis, R., Di Serafino, D., Hager, W.W., Toraldo, G., Zhang, H.: An efficient gradient method using the Yuan steplength. Comput. Optim. Appl. 59(3), 541–563 (2014)MATHMathSciNetCrossRef De Asmundis, R., Di Serafino, D., Hager, W.W., Toraldo, G., Zhang, H.: An efficient gradient method using the Yuan steplength. Comput. Optim. Appl. 59(3), 541–563 (2014)MATHMathSciNetCrossRef
26.
Zurück zum Zitat Frassoldati, G., Zanghirati, G., Zanni, L.: New adaptive stepsize selections in gradient methods. J. Ind. Manage. Optim. 4(2), 299–312 (2008)MATHMathSciNetCrossRef Frassoldati, G., Zanghirati, G., Zanni, L.: New adaptive stepsize selections in gradient methods. J. Ind. Manage. Optim. 4(2), 299–312 (2008)MATHMathSciNetCrossRef
27.
Zurück zum Zitat Golub, G.H., Van Loan, C.F.: Matrix Computations, 3rd edn. John Hopkins University Press, Baltimore (1996)MATH Golub, G.H., Van Loan, C.F.: Matrix Computations, 3rd edn. John Hopkins University Press, Baltimore (1996)MATH
28.
Zurück zum Zitat Grippo, L., Lampariello, F., Lucidi, S.: A nonmonotone line search technique for Newton’s method. SIAM J. Numer. Anal. 23(4), 707–716 (1986)MATHMathSciNetCrossRef Grippo, L., Lampariello, F., Lucidi, S.: A nonmonotone line search technique for Newton’s method. SIAM J. Numer. Anal. 23(4), 707–716 (1986)MATHMathSciNetCrossRef
29.
Zurück zum Zitat Hansen, P.C.: Rank-Deficient and Discrete Ill-Posed Problems. SIAM, Philadelphia (1997)MATH Hansen, P.C.: Rank-Deficient and Discrete Ill-Posed Problems. SIAM, Philadelphia (1997)MATH
30.
Zurück zum Zitat Hansen, P.C., Nagy, J.G., O’Leary, D.P.: Deblurring Images: Matrices, Spectra and Filtering. SIAM, Philadelphia (2006)CrossRef Hansen, P.C., Nagy, J.G., O’Leary, D.P.: Deblurring Images: Matrices, Spectra and Filtering. SIAM, Philadelphia (2006)CrossRef
31.
Zurück zum Zitat Harmany, Z.T., Marcia, R.F., Willett, R.M.: This is spiral-tap: sparse Poisson intensity reconstruction algorithms–theory and practice. IEEE Trans. Image Process. 3(21), 1084–1096 (2012)MathSciNetCrossRef Harmany, Z.T., Marcia, R.F., Willett, R.M.: This is spiral-tap: sparse Poisson intensity reconstruction algorithms–theory and practice. IEEE Trans. Image Process. 3(21), 1084–1096 (2012)MathSciNetCrossRef
32.
Zurück zum Zitat Lantéri, H., Roche, M., Aime, C.: Penalized maximum likelihood image restoration with positivity constraints: multiplicative algorithms. Inverse Probl. 18(5), 1397–1419 (2002)MATHCrossRef Lantéri, H., Roche, M., Aime, C.: Penalized maximum likelihood image restoration with positivity constraints: multiplicative algorithms. Inverse Probl. 18(5), 1397–1419 (2002)MATHCrossRef
33.
Zurück zum Zitat Lantéri, H., Roche, M., Cuevas, O., Aime, C.: A general method to devise maximum likelihood signal restoration multiplicative algorithms with non-negativity constraints. Signal Process. 81(5), 945–974 (2001)MATHCrossRef Lantéri, H., Roche, M., Cuevas, O., Aime, C.: A general method to devise maximum likelihood signal restoration multiplicative algorithms with non-negativity constraints. Signal Process. 81(5), 945–974 (2001)MATHCrossRef
34.
Zurück zum Zitat Lucy, L.: An iterative technique for the rectification of observed distributions. Astron. J. 79(6), 745–754 (1974)CrossRef Lucy, L.: An iterative technique for the rectification of observed distributions. Astron. J. 79(6), 745–754 (1974)CrossRef
35.
Zurück zum Zitat Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York (2006)MATH Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York (2006)MATH
36.
Zurück zum Zitat Porta, F., Zanella, R., Zanghirati, G., Zanni, L.: Limited-memory scaled gradient projection methods for real-time image deconvolution in microscopy. Commun. Nonlinear Sci. Numer. Simul. 21, 112–127 (2015)MathSciNetCrossRef Porta, F., Zanella, R., Zanghirati, G., Zanni, L.: Limited-memory scaled gradient projection methods for real-time image deconvolution in microscopy. Commun. Nonlinear Sci. Numer. Simul. 21, 112–127 (2015)MathSciNetCrossRef
37.
Zurück zum Zitat Prato, M., Cavicchioli, R., Zanni, L., Boccacci, P., Bertero, M.: Efficient deconvolution methods for astronomical imaging: algorithms and IDL-GPU codes. Astron. Astrophys. 539, A133 (2012)CrossRef Prato, M., Cavicchioli, R., Zanni, L., Boccacci, P., Bertero, M.: Efficient deconvolution methods for astronomical imaging: algorithms and IDL-GPU codes. Astron. Astrophys. 539, A133 (2012)CrossRef
38.
Zurück zum Zitat Prato, M., La Camera, A., Bonettini, S., Bertero, M.: A convergent blind deconvolution method for post-adaptive-optics astronomical imaging. Inverse Probl. 29(6), 065017 (2013)CrossRef Prato, M., La Camera, A., Bonettini, S., Bertero, M.: A convergent blind deconvolution method for post-adaptive-optics astronomical imaging. Inverse Probl. 29(6), 065017 (2013)CrossRef
39.
Zurück zum Zitat Richardson, W.H.: Bayesian based iterative method of image restoration. J. Opt. Soc. Am. 62(1), 55–59 (1972)CrossRef Richardson, W.H.: Bayesian based iterative method of image restoration. J. Opt. Soc. Am. 62(1), 55–59 (1972)CrossRef
40.
Zurück zum Zitat Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1–4), 259–268 (1992)MATHCrossRef Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1–4), 259–268 (1992)MATHCrossRef
41.
Zurück zum Zitat Ruggiero, V., Zanni, L.: A modified projection algorithm for large strictly-convex quadratic programs. J. Optim. Theory Appl. 104(2), 281–299 (2000)MATHMathSciNetCrossRef Ruggiero, V., Zanni, L.: A modified projection algorithm for large strictly-convex quadratic programs. J. Optim. Theory Appl. 104(2), 281–299 (2000)MATHMathSciNetCrossRef
42.
Zurück zum Zitat Setzer, S., Steidl, G., Teuber, T.: Deblurring Poissonian images by split Bregman techniques. J. Vis. Commun. Image Represent. 21(3), 193–199 (2010)MathSciNetCrossRef Setzer, S., Steidl, G., Teuber, T.: Deblurring Poissonian images by split Bregman techniques. J. Vis. Commun. Image Represent. 21(3), 193–199 (2010)MathSciNetCrossRef
43.
44.
Zurück zum Zitat Yuan, Y.: A new stepsize for the steepest descent method. J. Comput. Math. 24, 149–156 (2006)MATHMathSciNet Yuan, Y.: A new stepsize for the steepest descent method. J. Comput. Math. 24, 149–156 (2006)MATHMathSciNet
45.
Zurück zum Zitat Zanella, R., Boccacci, P., Zanni, L., Bertero, M.: Efficient gradient projection methods for edge-preserving removal of Poisson noise. Inverse Probl. 25(4), 045010 (2009)MathSciNetCrossRef Zanella, R., Boccacci, P., Zanni, L., Bertero, M.: Efficient gradient projection methods for edge-preserving removal of Poisson noise. Inverse Probl. 25(4), 045010 (2009)MathSciNetCrossRef
46.
Zurück zum Zitat Zanella, R., Zanghirati, G., Cavicchioli, R., Zanni, L., Boccacci, P., Bertero, M., Vicidomini, G.: Towards real-time image deconvolution: application to confocal and sted microscopy. Sci. Rep. 3, 2523 (2013)CrossRef Zanella, R., Zanghirati, G., Cavicchioli, R., Zanni, L., Boccacci, P., Bertero, M., Vicidomini, G.: Towards real-time image deconvolution: application to confocal and sted microscopy. Sci. Rep. 3, 2523 (2013)CrossRef
47.
48.
Zurück zum Zitat Zhu, M., Wright, S.J., Chan, T.F.: Duality-based algorithms for total-variation-regularized image restoration. Comput. Optim. Appl. 47(3), 377–400 (2008)MathSciNetCrossRef Zhu, M., Wright, S.J., Chan, T.F.: Duality-based algorithms for total-variation-regularized image restoration. Comput. Optim. Appl. 47(3), 377–400 (2008)MathSciNetCrossRef
Metadaten
Titel
A New Steplength Selection for Scaled Gradient Methods with Application to Image Deblurring
verfasst von
Federica Porta
Marco Prato
Luca Zanni
Publikationsdatum
30.01.2015
Verlag
Springer US
Erschienen in
Journal of Scientific Computing / Ausgabe 3/2015
Print ISSN: 0885-7474
Elektronische ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-015-9991-9

Weitere Artikel der Ausgabe 3/2015

Journal of Scientific Computing 3/2015 Zur Ausgabe