Skip to main content

2018 | OriginalPaper | Buchkapitel

Deblurring Natural Image Using Super-Gaussian Fields

verfasst von : Yuhang Liu, Wenyong Dong, Dong Gong, Lei Zhang, Qinfeng Shi

Erschienen in: Computer Vision – ECCV 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Blind image deblurring is a challenging problem due to its ill-posed nature, of which the success is closely related to a proper image prior. Although a large number of sparsity-based priors, such as the sparse gradient prior, have been successfully applied for blind image deblurring, they inherently suffer from several drawbacks, limiting their applications. Existing sparsity-based priors are usually rooted in modeling the response of images to some specific filters (e.g., image gradients), which are insufficient to capture the complicated image structures. Moreover, the traditional sparse priors or regularizations model the filter response (e.g., image gradients) independently and thus fail to depict the long-range correlation among them. To address the above issues, we present a novel image prior for image deblurring based on a Super-Gaussian field model with adaptive structures. Instead of modeling the response of the fixed short-term filters, the proposed Super-Gaussian fields capture the complicated structures in natural images by integrating potentials on all cliques (e.g., centring at each pixel) into a joint probabilistic distribution. Considering that the fixed filters in different scales are impractical for the coarse-to-fine framework of image deblurring, we define each potential function as a super-Gaussian distribution. Through this definition, the partition function, the curse for traditional MRFs, can be theoretically ignored, and all model parameters of the proposed Super-Gaussian fields can be data-adaptively learned and inferred from the blurred observation with a variational framework. Extensive experiments on both blind deblurring and non-blind deblurring demonstrate the effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., Harmeling, S.: Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7578, pp. 27–40. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33786-4_3CrossRef Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., Harmeling, S.: Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7578, pp. 27–40. Springer, Heidelberg (2012). https://​doi.​org/​10.​1007/​978-3-642-33786-4_​3CrossRef
2.
Zurück zum Zitat Cho, S., Lee, S.: Fast motion deblurring. In: ACM SIGGRAPH Asia 2009 Papers, pp. 145:1–145:8 (2009) Cho, S., Lee, S.: Fast motion deblurring. In: ACM SIGGRAPH Asia 2009 Papers, pp. 145:1–145:8 (2009)
4.
Zurück zum Zitat Pan, J., Sun, D., Pfister, H., Yang, M.H.: Blind image deblurring using dark channel prior. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1628–1636 (2016) Pan, J., Sun, D., Pfister, H., Yang, M.H.: Blind image deblurring using dark channel prior. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1628–1636 (2016)
5.
Zurück zum Zitat Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(25), 787–794 (2006)CrossRef Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(25), 787–794 (2006)CrossRef
6.
Zurück zum Zitat Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Efficient marginal likelihood optimization in blind deconvolution. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 2657–2664 (2011) Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Efficient marginal likelihood optimization in blind deconvolution. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 2657–2664 (2011)
7.
Zurück zum Zitat Babacan, S.D., Molina, R., Katsaggelos, A.K.: Variational Bayesian blind deconvolution using a total variation prior. IEEE Trans. Image Process. 18(1), 12–26 (2009)MathSciNetCrossRef Babacan, S.D., Molina, R., Katsaggelos, A.K.: Variational Bayesian blind deconvolution using a total variation prior. IEEE Trans. Image Process. 18(1), 12–26 (2009)MathSciNetCrossRef
8.
Zurück zum Zitat Perrone, D., Favaro, P.: Total variation blind deconvolution: the devil is in the details. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 2909–2916 (2014) Perrone, D., Favaro, P.: Total variation blind deconvolution: the devil is in the details. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 2909–2916 (2014)
9.
Zurück zum Zitat Tzikas, D., Likas, A., Galatsanos, N.: Variational Bayesian blind image deconvolution with student-T priors. In: IEEE International Conference on Image Processing, pp. 109–112 (2007) Tzikas, D., Likas, A., Galatsanos, N.: Variational Bayesian blind image deconvolution with student-T priors. In: IEEE International Conference on Image Processing, pp. 109–112 (2007)
11.
Zurück zum Zitat Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 233–240. IEEE (2011) Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 233–240. IEEE (2011)
12.
Zurück zum Zitat Xu, L., Zheng, S., Jia, J.: Unnatural l0 sparse representation for natural image deblurring. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1107–1114 (2013) Xu, L., Zheng, S., Jia, J.: Unnatural l0 sparse representation for natural image deblurring. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1107–1114 (2013)
13.
Zurück zum Zitat Ge, D., Idier, J., Carpentier, E.L.: Enhanced sampling schemes for MCMC based blind Bernoulli Gaussian deconvolution. Signal Process. 91(4), 759–772 (2009)CrossRef Ge, D., Idier, J., Carpentier, E.L.: Enhanced sampling schemes for MCMC based blind Bernoulli Gaussian deconvolution. Signal Process. 91(4), 759–772 (2009)CrossRef
14.
Zurück zum Zitat Roth, S., Black, M.J.: Fields of experts. Int. J. Comput. Vis. 82(2), 205 (2009)CrossRef Roth, S., Black, M.J.: Fields of experts. Int. J. Comput. Vis. 82(2), 205 (2009)CrossRef
15.
Zurück zum Zitat Cho, T.S., Paris, S., Horn, B.K.P., Freeman, W.T.: Blur kernel estimation using the radon transform. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 241–248 (2011) Cho, T.S., Paris, S., Horn, B.K.P., Freeman, W.T.: Blur kernel estimation using the radon transform. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 241–248 (2011)
16.
Zurück zum Zitat Joshi, N., Szeliski, R., Kriegman, D.J.: PSF estimation using sharp edge prediction. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008) Joshi, N., Szeliski, R., Kriegman, D.J.: PSF estimation using sharp edge prediction. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
17.
Zurück zum Zitat Sun, L., Cho, S., Wang, J., Hays, J.: Edge-based blur kernel estimation using patch priors. In: IEEE International Conference on Computational Photography, pp. 1–8 (2013) Sun, L., Cho, S., Wang, J., Hays, J.: Edge-based blur kernel estimation using patch priors. In: IEEE International Conference on Computational Photography, pp. 1–8 (2013)
18.
Zurück zum Zitat Lai, W.S., Ding, J.J., Lin, Y.Y., Chuang, Y.Y.: Blur kernel estimation using normalized color-line priors. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 64–72 (2015) Lai, W.S., Ding, J.J., Lin, Y.Y., Chuang, Y.Y.: Blur kernel estimation using normalized color-line priors. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 64–72 (2015)
22.
Zurück zum Zitat Gong, D., Tan, M., Zhang, Y., Hengel, A.V.D., Shi, Q.: Blind image deconvolution by automatic gradient activation. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1827–1836 (2016) Gong, D., Tan, M., Zhang, Y., Hengel, A.V.D., Shi, Q.: Blind image deconvolution by automatic gradient activation. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1827–1836 (2016)
23.
Zurück zum Zitat Gong, D., Tan, M., Zhang, Y., van den Hengel, A., Shi, Q.: Self-paced kernel estimation for robust blind image deblurring. In: International Conference on Computer Vision, pp. 1661–1670 (2017) Gong, D., Tan, M., Zhang, Y., van den Hengel, A., Shi, Q.: Self-paced kernel estimation for robust blind image deblurring. In: International Conference on Computer Vision, pp. 1661–1670 (2017)
24.
Zurück zum Zitat Yan, Y., Ren, W., Guo, Y., Wang, R., Cao, X.: Image deblurring via extreme channels prior. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 6978–6986 (2017) Yan, Y., Ren, W., Guo, Y., Wang, R., Cao, X.: Image deblurring via extreme channels prior. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 6978–6986 (2017)
25.
Zurück zum Zitat Nimisha, T., Singh, A.K., Rajagopalan, A.: Blur-invariant deep learning for blind-deblurring. In: The IEEE International Conference on Computer Vision, vol. 2 (2017) Nimisha, T., Singh, A.K., Rajagopalan, A.: Blur-invariant deep learning for blind-deblurring. In: The IEEE International Conference on Computer Vision, vol. 2 (2017)
26.
Zurück zum Zitat Xu, X., Pan, J., Zhang, Y.J., Yang, M.H.: Motion blur kernel estimation via deep learning. IEEE Trans. Image Process. 27(1), 194–205 (2018)MathSciNetCrossRef Xu, X., Pan, J., Zhang, Y.J., Yang, M.H.: Motion blur kernel estimation via deep learning. IEEE Trans. Image Process. 27(1), 194–205 (2018)MathSciNetCrossRef
27.
Zurück zum Zitat Zhang, L., Wei, W., Zhang, Y., Shen, C., van den Hengel, A., Shi, Q.: Cluster sparsity field: an internal hyperspectral imagery prior for reconstruction. Int. J. Comput. Vis. 126(8), 797–821 (2018)CrossRef Zhang, L., Wei, W., Zhang, Y., Shen, C., van den Hengel, A., Shi, Q.: Cluster sparsity field: an internal hyperspectral imagery prior for reconstruction. Int. J. Comput. Vis. 126(8), 797–821 (2018)CrossRef
28.
Zurück zum Zitat Besag, J.: Spatial interaction and the statistical analysis of lattice systems. J. R. Stat. Soc. Ser. B (Methodological) 36(2), 192–236 (1974)MathSciNetMATH Besag, J.: Spatial interaction and the statistical analysis of lattice systems. J. R. Stat. Soc. Ser. B (Methodological) 36(2), 192–236 (1974)MathSciNetMATH
29.
Zurück zum Zitat Schmidt, U., Gao, Q., Roth, S.: A generative perspective on MRFs in low-level vision. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1751–1758 (2010) Schmidt, U., Gao, Q., Roth, S.: A generative perspective on MRFs in low-level vision. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1751–1758 (2010)
30.
Zurück zum Zitat Weiss, Y., Freeman, W.T.: What makes a good model of natural images? In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007) Weiss, Y., Freeman, W.T.: What makes a good model of natural images? In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
31.
Zurück zum Zitat Schmidt, U., Schelten, K., Roth, S.: Bayesian deblurring with integrated noise estimation. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 2625–2632 (2011) Schmidt, U., Schelten, K., Roth, S.: Bayesian deblurring with integrated noise estimation. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 2625–2632 (2011)
32.
Zurück zum Zitat Zhang, H., Zhang, Y., Li, H., Huang, T.S.: Generative Bayesian image super resolution with natural image prior. IEEE Trans. Image Process. 21(9), 4054–4067 (2012)MathSciNetCrossRef Zhang, H., Zhang, Y., Li, H., Huang, T.S.: Generative Bayesian image super resolution with natural image prior. IEEE Trans. Image Process. 21(9), 4054–4067 (2012)MathSciNetCrossRef
33.
Zurück zum Zitat Palmer, J.A., Wipf, D.P., Kreutz-Delgado, K., Rao, B.D.: Variational EM algorithms for non-Gaussian latent variable models. In: Advances in Neural Information Processing Systems, pp. 1059–1066 (2005) Palmer, J.A., Wipf, D.P., Kreutz-Delgado, K., Rao, B.D.: Variational EM algorithms for non-Gaussian latent variable models. In: Advances in Neural Information Processing Systems, pp. 1059–1066 (2005)
34.
Zurück zum Zitat Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding blind deconvolution algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2354 (2011)CrossRef Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding blind deconvolution algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2354 (2011)CrossRef
35.
Zurück zum Zitat Murphy, K.P.: Machine Learning: A Probabilistic Perspective. MIT Press, Cambridge (2012)MATH Murphy, K.P.: Machine Learning: A Probabilistic Perspective. MIT Press, Cambridge (2012)MATH
36.
Zurück zum Zitat Wipf, D., Zhang, H.: Revisiting Bayesian blind deconvolution. J. Mach. Learn. Res. 15(1), 3595–3634 (2014)MathSciNetMATH Wipf, D., Zhang, H.: Revisiting Bayesian blind deconvolution. J. Mach. Learn. Res. 15(1), 3595–3634 (2014)MathSciNetMATH
37.
Zurück zum Zitat Whyte, O., Sivic, J., Zisserman, A., Ponce, J.: Non-uniform deblurring for shaken images. Int. J. Comput. Vis. 98(2), 168–186 (2012)MathSciNetCrossRef Whyte, O., Sivic, J., Zisserman, A., Ponce, J.: Non-uniform deblurring for shaken images. Int. J. Comput. Vis. 98(2), 168–186 (2012)MathSciNetCrossRef
38.
Zurück zum Zitat Hirsch, M., Schuler, C.J., Harmeling, S., Scholkopf, B.: Fast removal of non-uniform camera shake. In: International Conference on Computer Vision, pp. 463–470 (2011) Hirsch, M., Schuler, C.J., Harmeling, S., Scholkopf, B.: Fast removal of non-uniform camera shake. In: International Conference on Computer Vision, pp. 463–470 (2011)
39.
Zurück zum Zitat Hirsch, M., Sra, S., Scholkopf, B., Harmeling, S.: Efficient filter flow for space-variant multiframe blind deconvolution. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 607–614 (2010) Hirsch, M., Sra, S., Scholkopf, B., Harmeling, S.: Efficient filter flow for space-variant multiframe blind deconvolution. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 607–614 (2010)
40.
Zurück zum Zitat Martin, D.R., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of the International Conference on Computer Vision, vol. 2, no. 11, pp. 416–423 (2002) Martin, D.R., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of the International Conference on Computer Vision, vol. 2, no. 11, pp. 416–423 (2002)
41.
Zurück zum Zitat Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1964–1971 (2009) Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 1964–1971 (2009)
42.
Zurück zum Zitat Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26(3), 70 (2007)CrossRef Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26(3), 70 (2007)CrossRef
43.
Zurück zum Zitat Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: IEEE International Conference on Computer Vision, pp. 479–486 (2011) Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: IEEE International Conference on Computer Vision, pp. 479–486 (2011)
44.
Zurück zum Zitat Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 15–19 (2008)CrossRef Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 15–19 (2008)CrossRef
45.
Zurück zum Zitat Whyte, O., Sivic, J., Zisserman, A.: Deblurring shaken and partially saturated images. Int. J. Comput. Vis. 110(2), 185–201 (2014)CrossRef Whyte, O., Sivic, J., Zisserman, A.: Deblurring shaken and partially saturated images. Int. J. Comput. Vis. 110(2), 185–201 (2014)CrossRef
46.
Zurück zum Zitat He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2011)CrossRef He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2011)CrossRef
47.
Zurück zum Zitat Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-Laplacian priors. In: Advances in Neural Information Processing Systems, pp. 1033–1041 (2009) Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-Laplacian priors. In: Advances in Neural Information Processing Systems, pp. 1033–1041 (2009)
Metadaten
Titel
Deblurring Natural Image Using Super-Gaussian Fields
verfasst von
Yuhang Liu
Wenyong Dong
Dong Gong
Lei Zhang
Qinfeng Shi
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01246-5_28

Premium Partner