Skip to main content

2018 | OriginalPaper | Buchkapitel

Learning Data Terms for Non-blind Deblurring

verfasst von : Jiangxin Dong, Jinshan Pan, Deqing Sun, Zhixun Su, Ming-Hsuan Yang

Erschienen in: Computer Vision – ECCV 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Existing deblurring methods mainly focus on developing effective image priors and assume that blurred images contain insignificant amounts of noise. However, state-of-the-art deblurring methods do not perform well on real-world images degraded with significant noise or outliers. To address these issues, we show that it is critical to learn data fitting terms beyond the commonly used \(\ell _1\) or \(\ell _2\) norm. We propose a simple and effective discriminative framework to learn data terms that can adaptively handle blurred images in the presence of severe noise and outliers. Instead of learning the distribution of the data fitting errors, we directly learn the associated shrinkage function for the data term using a cascaded architecture, which is more flexible and efficient. Our analysis shows that the shrinkage functions learned at the intermediate stages can effectively suppress noise and preserve image structures. Extensive experimental results show that the proposed algorithm performs favorably against state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
The parameters \(\tau \) and \(\gamma \) are included into the weights \(\varvec{\pi _i}\) of (11) and (12) and fused with \(\beta \) and \(\lambda \) in (10).
 
2
Note that we assume \(\mathcal {R}_0(\cdot )\!=\!\Vert \cdot \Vert _2^2\) as the initialization in (6) and its closed-form solution is a line-shaped function.
 
Literatur
1.
Zurück zum Zitat Bar, L., Kiryati, N., Sochen, N.: Image deblurring in the presence of impulsive noise. IJCV 70(3), 279–298 (2006)CrossRef Bar, L., Kiryati, N., Sochen, N.: Image deblurring in the presence of impulsive noise. IJCV 70(3), 279–298 (2006)CrossRef
2.
Zurück zum Zitat Chen, Y., Yu, W., Pock, T.: On learning optimized reaction diffusion processes for effective image restoration. In: CVPR, pp. 87–90 (2015) Chen, Y., Yu, W., Pock, T.: On learning optimized reaction diffusion processes for effective image restoration. In: CVPR, pp. 87–90 (2015)
3.
Zurück zum Zitat Cho, S., Wang, J., Lee, S.: Handling outliers in non-blind image deconvolution. In: ICCV, pp. 495–502 (2011) Cho, S., Wang, J., Lee, S.: Handling outliers in non-blind image deconvolution. In: ICCV, pp. 495–502 (2011)
4.
Zurück zum Zitat Dong, J., Pan, J., Su, Z., Yang, M.H.: Blind image deblurring with outlier handling. In: ICCV, pp. 2478–2486 (2017) Dong, J., Pan, J., Su, Z., Yang, M.H.: Blind image deblurring with outlier handling. In: ICCV, pp. 2478–2486 (2017)
5.
6.
Zurück zum Zitat Jin, M., Roth, S., Favaro, P.: Noise-blind image deblurring. In: CVPR, pp. 3510–3518 (2017) Jin, M., Roth, S., Favaro, P.: Noise-blind image deblurring. In: CVPR, pp. 3510–3518 (2017)
7.
Zurück zum Zitat Krishnan, D., Fergus, R.: Fast image deconvolution using Hyper-Laplacian priors. In: NIPS, pp. 1033–1041 (2009) Krishnan, D., Fergus, R.: Fast image deconvolution using Hyper-Laplacian priors. In: NIPS, pp. 1033–1041 (2009)
8.
Zurück zum Zitat Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: CVPR, pp. 1964–1971 (2009) Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: CVPR, pp. 1964–1971 (2009)
9.
Zurück zum Zitat Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM TOG 26(3), 70 (2007)CrossRef Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM TOG 26(3), 70 (2007)CrossRef
10.
Zurück zum Zitat Lucy, L.B.: An iterative technique for the rectification of observed distributions. Astron. J. 79(6), 745 (1974)CrossRef Lucy, L.B.: An iterative technique for the rectification of observed distributions. Astron. J. 79(6), 745 (1974)CrossRef
11.
Zurück zum Zitat Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: ICCV, pp. 416–423 (2001) Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: ICCV, pp. 416–423 (2001)
12.
Zurück zum Zitat Pan, J., Lin, Z., Su, Z., Yang, M.H.: Robust kernel estimation with outliers handling for image deblurring. In: CVPR, pp. 2800–2808 (2016) Pan, J., Lin, Z., Su, Z., Yang, M.H.: Robust kernel estimation with outliers handling for image deblurring. In: CVPR, pp. 2800–2808 (2016)
13.
Zurück zum Zitat Richardson, W.H.: Bayesian-based iterative method of image restoration*. J. Opt. Soc. Am. 62(1), 55–59 (1972)MathSciNetCrossRef Richardson, W.H.: Bayesian-based iterative method of image restoration*. J. Opt. Soc. Am. 62(1), 55–59 (1972)MathSciNetCrossRef
14.
Zurück zum Zitat Roth, S., Black, M.J.: Fields of experts: a framework for learning image priors. In: CVPR, pp. 860–867 (2005) Roth, S., Black, M.J.: Fields of experts: a framework for learning image priors. In: CVPR, pp. 860–867 (2005)
15.
Zurück zum Zitat Schmidt, U., Gao, Q., Roth, S.: A generative perspective on MRFs in low-level vision. In: CVPR, pp. 1751–1758 (2010) Schmidt, U., Gao, Q., Roth, S.: A generative perspective on MRFs in low-level vision. In: CVPR, pp. 1751–1758 (2010)
16.
Zurück zum Zitat Schmidt, U., Roth, S.: Shrinkage fields for effective image restoration. In: CVPR, pp. 2774–2781 (2014) Schmidt, U., Roth, S.: Shrinkage fields for effective image restoration. In: CVPR, pp. 2774–2781 (2014)
17.
Zurück zum Zitat Schmidt, U., Rother, C., Nowozin, S., Jancsary, J., Roth, S.: Discriminative non-blind deblurring. In: CVPR, pp. 604–611 (2013) Schmidt, U., Rother, C., Nowozin, S., Jancsary, J., Roth, S.: Discriminative non-blind deblurring. In: CVPR, pp. 604–611 (2013)
18.
Zurück zum Zitat Schuler, C.J., Burger, H.C., Harmeling, S., Scholkopf, B.: A machine learning approach for non-blind image deconvolution. In: CVPR, pp. 1067–1074 (2013) Schuler, C.J., Burger, H.C., Harmeling, S., Scholkopf, B.: A machine learning approach for non-blind image deconvolution. In: CVPR, pp. 1067–1074 (2013)
19.
Zurück zum Zitat Schuler, C.J., Hirsch, M., Harmeling, S., Schölkopf, B.: Learning to deblur. TPAMI 38(7), 1439–1451 (2016)CrossRef Schuler, C.J., Hirsch, M., Harmeling, S., Schölkopf, B.: Learning to deblur. TPAMI 38(7), 1439–1451 (2016)CrossRef
21.
Zurück zum Zitat Wang, Y., Yang, J., Yin, W., Zhang, Y.: A new alternating minimization algorithm for total variation image reconstruction. SIAM J. Imaging Sci. 1(3), 248–272 (2008)MathSciNetCrossRef Wang, Y., Yang, J., Yin, W., Zhang, Y.: A new alternating minimization algorithm for total variation image reconstruction. SIAM J. Imaging Sci. 1(3), 248–272 (2008)MathSciNetCrossRef
22.
Zurück zum Zitat Whyte, O., Sivic, J., Zisserman, A.: Deblurring shaken and partially saturated images. IJCV 110(2), 185–201 (2014)CrossRef Whyte, O., Sivic, J., Zisserman, A.: Deblurring shaken and partially saturated images. IJCV 110(2), 185–201 (2014)CrossRef
23.
Zurück zum Zitat Wiener, N.: Extrapolation, interpolation, and smoothing of stationary time series: with engineering applications. MIT Press 113(21), 1043–54 (1949) Wiener, N.: Extrapolation, interpolation, and smoothing of stationary time series: with engineering applications. MIT Press 113(21), 1043–54 (1949)
26.
Zurück zum Zitat Xu, L., Ren, J.S., Liu, C., Jia, J.: Deep convolutional neural network for image deconvolution. In: NIPS, pp. 1790–1798 (2014) Xu, L., Ren, J.S., Liu, C., Jia, J.: Deep convolutional neural network for image deconvolution. In: NIPS, pp. 1790–1798 (2014)
27.
Zurück zum Zitat Zhang, J., Pan, J., Lai, W.S., Lau, R., Yang, M.H.: Learning fully convolutional networks for iterative non-blind deconvolution. In: CVPR, pp. 3817–3825 (2017) Zhang, J., Pan, J., Lai, W.S., Lau, R., Yang, M.H.: Learning fully convolutional networks for iterative non-blind deconvolution. In: CVPR, pp. 3817–3825 (2017)
28.
Zurück zum Zitat Zhang, K., Zuo, W., Gu, S., Zhang, L.: Learning deep CNN denoiser prior for image restoration. In: CVPR, pp. 3929–3938 (2017) Zhang, K., Zuo, W., Gu, S., Zhang, L.: Learning deep CNN denoiser prior for image restoration. In: CVPR, pp. 3929–3938 (2017)
29.
Zurück zum Zitat Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: ICCV, pp. 479–486 (2012) Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: ICCV, pp. 479–486 (2012)
Metadaten
Titel
Learning Data Terms for Non-blind Deblurring
verfasst von
Jiangxin Dong
Jinshan Pan
Deqing Sun
Zhixun Su
Ming-Hsuan Yang
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01252-6_46

Premium Partner