Skip to main content
Top
Published in: Journal of Scientific Computing 1/2016

14-11-2015

Constrained TV\(_p\)-\(\ell _2\) Model for Image Restoration

Authors: Alessandro Lanza, Serena Morigi, Fiorella Sgallari

Published in: Journal of Scientific Computing | Issue 1/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The popular total variation (TV) model for image restoration (Rudin et al. in Phys D 60(1–4):259-268, 1992) can be formulated as a Maximum A Posteriori estimator which uses a half-Laplacian image-independent prior favoring sparse image gradients. We propose a generalization of the TV prior, referred to as TV\(_p\), based on a half-generalized Gaussian distribution with shape parameter p. An automatic estimation of p is introduced so that the prior better fits the real images’ gradient distribution; we will show that, in general, the estimated p value does not necessarily require to be close to zero. The restored image is computed by using an alternating directions methods of multipliers procedure. In this context, a novel result in multivariate proximal calculus is presented which allows for the efficient solution of the proposed model. Numerical examples show that the proposed approach is particularly efficient and well suited for images characterized by a wide range of gradient distributions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Buades, A., Coll, B., Morel, J.M.: The staircasing effect in neighborhood filters and its solution. IEEE Trans. Image Process. 15, 1499–1505 (2006)CrossRef Buades, A., Coll, B., Morel, J.M.: The staircasing effect in neighborhood filters and its solution. IEEE Trans. Image Process. 15, 1499–1505 (2006)CrossRef
2.
go back to reference Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–22 (2011)CrossRefMATH Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–22 (2011)CrossRefMATH
3.
go back to reference Chan, R.H., Tao, M., Yuan, X.M.: Constrained total variational deblurring models and fast algorithms based on alternating direction method of multipliers. SIAM J. Imaging Sci. 6, 680–697 (2013)MathSciNetCrossRefMATH Chan, R.H., Tao, M., Yuan, X.M.: Constrained total variational deblurring models and fast algorithms based on alternating direction method of multipliers. SIAM J. Imaging Sci. 6, 680–697 (2013)MathSciNetCrossRefMATH
4.
go back to reference Chan, R.H., Lanza, A., Morigi, S., Sgallari, F.: An adaptive strategy for the restoration of textured images using fractional order regularization. Numer. Math. Theory Methods Appl. (NMTMA) 6(1), 276–296 (2013)MathSciNetMATH Chan, R.H., Lanza, A., Morigi, S., Sgallari, F.: An adaptive strategy for the restoration of textured images using fractional order regularization. Numer. Math. Theory Methods Appl. (NMTMA) 6(1), 276–296 (2013)MathSciNetMATH
5.
go back to reference Chan, T., Esedoglu, S., Park, F., Yip, A.: Total variation image restoration. Overview and recent developments. In: Paragios, N., Chen, Y., Faugeras, O. (eds.) Handbook of Mathematical Models in Computer Vision, pp. 17–31. Springer, New York (2006)CrossRef Chan, T., Esedoglu, S., Park, F., Yip, A.: Total variation image restoration. Overview and recent developments. In: Paragios, N., Chen, Y., Faugeras, O. (eds.) Handbook of Mathematical Models in Computer Vision, pp. 17–31. Springer, New York (2006)CrossRef
6.
go back to reference Cho, T.S., Zitnick, C.L., Joshi, N., Kang, S.B., Szeliski, R., Freeman, W.T.: Image restoration by matching gradient distributions. IEEE Trans. Pattern Anal. Mach. Intell. 34/4, 683–694 (2012) Cho, T.S., Zitnick, C.L., Joshi, N., Kang, S.B., Szeliski, R., Freeman, W.T.: Image restoration by matching gradient distributions. IEEE Trans. Pattern Anal. Mach. Intell. 34/4, 683–694 (2012)
7.
go back to reference Christiansen, M., Hanke, M.: Deblurring methods using antireflective boundary conditions. SIAM J. Sci. Comput. 30, 855–872 (2008)MathSciNetCrossRefMATH Christiansen, M., Hanke, M.: Deblurring methods using antireflective boundary conditions. SIAM J. Sci. Comput. 30, 855–872 (2008)MathSciNetCrossRefMATH
8.
go back to reference Engl, H.W., Hanke, M., Neubauer, A.: Regularization of Inverse Problems. Kluwer, Dordrecht (1996)CrossRefMATH Engl, H.W., Hanke, M., Neubauer, A.: Regularization of Inverse Problems. Kluwer, Dordrecht (1996)CrossRefMATH
9.
go back to reference Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6, 721–741 (1984)CrossRefMATH Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6, 721–741 (1984)CrossRefMATH
10.
go back to reference Gray, R.M., Davisson, L.D.: An Introduction to Statistical Signal Processing. Cambridge University Press, Cambridge (2010)MATH Gray, R.M., Davisson, L.D.: An Introduction to Statistical Signal Processing. Cambridge University Press, Cambridge (2010)MATH
11.
go back to reference Hong, M., Luo, Z., Razaviyayn, M.: Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems (2014). Preprint, arXiv:1410.1390 Hong, M., Luo, Z., Razaviyayn, M.: Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems (2014). Preprint, arXiv:​1410.​1390
12.
go back to reference He, B., Yuan, X.: On the O(1/n) convergence rate of the Douglas–Rachford alternating direction method. SIAM J. Numer. Anal. 50(2), 700–709 (2012)MathSciNetCrossRefMATH He, B., Yuan, X.: On the O(1/n) convergence rate of the Douglas–Rachford alternating direction method. SIAM J. Numer. Anal. 50(2), 700–709 (2012)MathSciNetCrossRefMATH
13.
go back to reference Keren, D., Werman, M.: Probabilistic analysis of regularization. IEEE Trans. Pattern Anal. Mach. Intell. 15(10), 982–995 (1993)CrossRef Keren, D., Werman, M.: Probabilistic analysis of regularization. IEEE Trans. Pattern Anal. Mach. Intell. 15(10), 982–995 (1993)CrossRef
14.
go back to reference Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-Laplacian priors. In: Bengio, Y., Schuurmans, D., Lafferty, J.D., Williams, C.K.I., Culotta, A. (eds.) Advances in Neural Information Processing Systems 22, pp. 1033–1041 (2009) Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-Laplacian priors. In: Bengio, Y., Schuurmans, D., Lafferty, J.D., Williams, C.K.I., Culotta, A. (eds.) Advances in Neural Information Processing Systems 22, pp. 1033–1041 (2009)
15.
go back to reference Kunisch, K., Pock, T.: A bilevel optimization approach for parameter learning in variational models. SIAM J. Imaging Sci. 6(2), 938–983 (2013)MathSciNetCrossRefMATH Kunisch, K., Pock, T.: A bilevel optimization approach for parameter learning in variational models. SIAM J. Imaging Sci. 6(2), 938–983 (2013)MathSciNetCrossRefMATH
16.
17.
go back to reference Nikolova, M., Ng, M.K., Zhang, S., Ching, W.: Efficient reconstruction of piecewise constant images using nonsmooth nonconvex minimization. SIAM J. Imaging Sci. 1(1), 2–25 (2008)MathSciNetCrossRefMATH Nikolova, M., Ng, M.K., Zhang, S., Ching, W.: Efficient reconstruction of piecewise constant images using nonsmooth nonconvex minimization. SIAM J. Imaging Sci. 1(1), 2–25 (2008)MathSciNetCrossRefMATH
19.
go back to reference Nikolova, M., Ng, M.K., Tam, C.-P.: Fast nonconvex nonsmooth minimization methods for image restoration and reconstruction. Trans. Imaging Proc. 19(12), 3073–3088 (2010)MathSciNetCrossRef Nikolova, M., Ng, M.K., Tam, C.-P.: Fast nonconvex nonsmooth minimization methods for image restoration and reconstruction. Trans. Imaging Proc. 19(12), 3073–3088 (2010)MathSciNetCrossRef
20.
go back to reference Ng, M.K., Chan, R.H., Tang, W.C.: A fast algorithm for deblurring models with Neumann boundary conditions. SIAM J. Sci. Comput. 21, 851–866 (1999)MathSciNetCrossRefMATH Ng, M.K., Chan, R.H., Tang, W.C.: A fast algorithm for deblurring models with Neumann boundary conditions. SIAM J. Sci. Comput. 21, 851–866 (1999)MathSciNetCrossRefMATH
21.
go back to reference Rodriguez, P., Wohlberg, B.: Efficient minimization method for a generalized total variation functional. IEEE Trans. Image Process. 18, 2(322-332) (2009)MathSciNetCrossRef Rodriguez, P., Wohlberg, B.: Efficient minimization method for a generalized total variation functional. IEEE Trans. Image Process. 18, 2(322-332) (2009)MathSciNetCrossRef
22.
go back to reference Rodrguez, P.: Multiplicative updates algorithm to minimize the generalized total variation functional with a non-negativity constraint. In: Proceedings of the IEEE international conference on image processing (ICIP), (Hong Kong), pp. 2509–2512 (2010) Rodrguez, P.: Multiplicative updates algorithm to minimize the generalized total variation functional with a non-negativity constraint. In: Proceedings of the IEEE international conference on image processing (ICIP), (Hong Kong), pp. 2509–2512 (2010)
23.
24.
go back to reference Saquib, S.S., Bouman, C.A., Sauer, K.: ML parameter estimation for Markov random fields with applications to Bayesian tomography. IEEE Trans. Image Process. 7(7), 1029–1044 (1998)CrossRef Saquib, S.S., Bouman, C.A., Sauer, K.: ML parameter estimation for Markov random fields with applications to Bayesian tomography. IEEE Trans. Image Process. 7(7), 1029–1044 (1998)CrossRef
25.
go back to reference Sha, F., Lin, Y., Saul, L., Lee, D.: Multiplicative updates for nonnegative quadratic programming. Neural Comput. 19(8), 2004–2031 (2007)MathSciNetCrossRefMATH Sha, F., Lin, Y., Saul, L., Lee, D.: Multiplicative updates for nonnegative quadratic programming. Neural Comput. 19(8), 2004–2031 (2007)MathSciNetCrossRefMATH
26.
go back to reference Sidky, E.Y., Chartrand, R., Boone, J.M., Pan, X.: Constrained \(T_p\) V minimization for enhanced exploitation of gradient sparsity: application to CT image reconstruction. IEEE J. Transl. Eng. Health Med. 2, 1–18 (2014). doi:10.1109/JTEHM.2014.2300862 CrossRef Sidky, E.Y., Chartrand, R., Boone, J.M., Pan, X.: Constrained \(T_p\) V minimization for enhanced exploitation of gradient sparsity: application to CT image reconstruction. IEEE J. Transl. Eng. Health Med. 2, 1–18 (2014). doi:10.​1109/​JTEHM.​2014.​2300862 CrossRef
27.
go back to reference Song, K.-S.: A globally convergent and consistent method for estimating the shape parameter of a generalized gaussian distribution. IEEE Trans. Inf. Theory 52(2), 510–527 (2006)MathSciNetCrossRefMATH Song, K.-S.: A globally convergent and consistent method for estimating the shape parameter of a generalized gaussian distribution. IEEE Trans. Inf. Theory 52(2), 510–527 (2006)MathSciNetCrossRefMATH
28.
go back to reference Strong, D., Chan, T.: Edge-preserving and scale-dependent properties of total variation regularization. Inverse Probl. 19, 165–187 (2003)MathSciNetCrossRefMATH Strong, D., Chan, T.: Edge-preserving and scale-dependent properties of total variation regularization. Inverse Probl. 19, 165–187 (2003)MathSciNetCrossRefMATH
29.
go back to reference Tao, M., Yang, J.: Alternating direction algorithm for total variation deconvolution in image reconstruction. Department of Mathematics, Nanjing University, Tech. Rep. TR0918 (2009) Tao, M., Yang, J.: Alternating direction algorithm for total variation deconvolution in image reconstruction. Department of Mathematics, Nanjing University, Tech. Rep. TR0918 (2009)
30.
go back to reference Varanasi, M., Aazhang, B.: Parametric generalized Gaussian density estimation. J. Acoust. Soc. Am. 86(4), 1404–1414 (1989)CrossRef Varanasi, M., Aazhang, B.: Parametric generalized Gaussian density estimation. J. Acoust. Soc. Am. 86(4), 1404–1414 (1989)CrossRef
32.
go back to reference Wen, Y., Chan, R.H.: Parameter selection for total variation based image restoration using discrepancy principle. IEEE Trans. Image Process. 21(4), 1770–1781 (2012)MathSciNetCrossRef Wen, Y., Chan, R.H.: Parameter selection for total variation based image restoration using discrepancy principle. IEEE Trans. Image Process. 21(4), 1770–1781 (2012)MathSciNetCrossRef
33.
go back to reference Yan, J., Lu, W.-S.: Image denoising by generalized total variation regularization and least squares fidelity. J. Multidimens. Syst. Signal Process. 26(1), 243–266 (2015)MathSciNetCrossRef Yan, J., Lu, W.-S.: Image denoising by generalized total variation regularization and least squares fidelity. J. Multidimens. Syst. Signal Process. 26(1), 243–266 (2015)MathSciNetCrossRef
34.
go back to reference Yu, S., Zhang, A., Li, H.: A review of estimating the shape parameter of generalized Gaussian distribution. J. Comput. Inf. Syst. 8(21), 9055–9064 (2012) Yu, S., Zhang, A., Li, H.: A review of estimating the shape parameter of generalized Gaussian distribution. J. Comput. Inf. Syst. 8(21), 9055–9064 (2012)
35.
go back to reference Zhu, M., Chan, T.: An efficient primal-dual hybrid gradient algorithm for total variation image restoration. UCLA CAM Report 08-34, (2007) Zhu, M., Chan, T.: An efficient primal-dual hybrid gradient algorithm for total variation image restoration. UCLA CAM Report 08-34, (2007)
36.
go back to reference Zuo, W., Meng, D., Zhang, L., Feng, X., Zhang, D.: A generalized iterated shrinkage algorithm for non-convex sparse coding. In: IEEE international conference on computer vision (ICCV), pp. 217–224 (2013) Zuo, W., Meng, D., Zhang, L., Feng, X., Zhang, D.: A generalized iterated shrinkage algorithm for non-convex sparse coding. In: IEEE international conference on computer vision (ICCV), pp. 217–224 (2013)
Metadata
Title
Constrained TV- Model for Image Restoration
Authors
Alessandro Lanza
Serena Morigi
Fiorella Sgallari
Publication date
14-11-2015
Publisher
Springer US
Published in
Journal of Scientific Computing / Issue 1/2016
Print ISSN: 0885-7474
Electronic ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-015-0129-x

Other articles of this Issue 1/2016

Journal of Scientific Computing 1/2016 Go to the issue

Premium Partner