Skip to main content

2018 | OriginalPaper | Buchkapitel

Normalized Blind Deconvolution

verfasst von : Meiguang Jin, Stefan Roth, Paolo Favaro

Erschienen in: Computer Vision – ECCV 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We introduce a family of novel approaches to single-image blind deconvolution, i.e., the problem of recovering a sharp image and a blur kernel from a single blurry input. This problem is highly ill-posed, because infinite (image, blur) pairs produce the same blurry image. Most research effort has been devoted to the design of priors for natural images and blur kernels, which can drastically prune the set of possible solutions. Unfortunately, these priors are usually not sufficient to favor the sharp solution. In this paper we address this issue by looking at a much less studied aspect: the relative scale ambiguity between the sharp image and the blur. Most prior work eliminates this ambiguity by fixing the \(L^1\) norm of the blur kernel. In principle, however, this choice is arbitrary. We show that a careful design of the blur normalization yields a blind deconvolution formulation with remarkable accuracy and robustness to noise. Specifically, we show that using the Frobenius norm to fix the scale ambiguity enables convex image priors, such as the total variation, to achieve state-of-the-art results on both synthetic and real datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Blind deconvolution is a mathematical problem with a corresponding physical problem (image deblurring). From the mathematical point of view, there is an ambiguous scale between the blur kernel and the sharp image, and \(L^1\) normalization, as with any other arbitrary norm, is one possible choice to fix the scale of the blur kernel. However, as a model of a physical system, the blur kernel corresponds to the point spread function (PSF) of the camera lens(es), and in this case physics indicates that normalization is through the \(L^1\) norm [3]. Therefore, we first solve the mathematical problem with an arbitrary norm, and then we map the final solution to a physically valid PSF by normalizing it in terms of \(L^1\). This way we benefit from the mathematical freedom while ensuring physical validity in the end.
 
2
Please note that prior work showed how convex image priors together with an \(L^1\) constraint on the kernel do not favor the sharp image as a solution [22, 30].
 
Literatur
1.
Zurück zum Zitat Arbelaez, P., Maire, M., Fowlkes, C.C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE TPAMI 33(5), 898–916 (2011)CrossRef Arbelaez, P., Maire, M., Fowlkes, C.C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE TPAMI 33(5), 898–916 (2011)CrossRef
3.
Zurück zum Zitat Born, M.: Principles of Optics - Electromagnetic Theory of Propagation, Interference and Diffraction of Light, 7th edn. Cambridge University Press, Cambridge (1999)CrossRef Born, M.: Principles of Optics - Electromagnetic Theory of Propagation, Interference and Diffraction of Light, 7th edn. Cambridge University Press, Cambridge (1999)CrossRef
5.
Zurück zum Zitat Chan, T.F., Wong, C.: Total variation blind deconvolution. IEEE TIP 7, 370–375 (1998) Chan, T.F., Wong, C.: Total variation blind deconvolution. IEEE TIP 7, 370–375 (1998)
7.
Zurück zum Zitat Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graph. 28, 145:1–145:8 (2009)CrossRef Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graph. 28, 145:1–145:8 (2009)CrossRef
8.
Zurück zum Zitat Cho, S., Lee, S.: Convergence analysis of map based blur kernel estimation. In: ICCV (2017) Cho, S., Lee, S.: Convergence analysis of map based blur kernel estimation. In: ICCV (2017)
9.
Zurück zum Zitat Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(3), 787–794 (2006)CrossRef Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(3), 787–794 (2006)CrossRef
10.
11.
Zurück zum Zitat Gast, J., Sellent, A., Roth, S.: Parametric object motion from blur. In: CVPR (2016) Gast, J., Sellent, A., Roth, S.: Parametric object motion from blur. In: CVPR (2016)
12.
Zurück zum Zitat Gorski, J., Pfeuffer, F., Klamroth, K.: Biconvex sets and optimization with biconvex functions: a survey and extensions. Math. Methods Oper. Res. 66, 373–407 (2007)MathSciNetCrossRef Gorski, J., Pfeuffer, F., Klamroth, K.: Biconvex sets and optimization with biconvex functions: a survey and extensions. Math. Methods Oper. Res. 66, 373–407 (2007)MathSciNetCrossRef
13.
Zurück zum Zitat Hirsch, M., Schuler, C.J., Harmeling, S., Schölkopf, B.: Fast removal of non-uniform camera shake. In: ICCV (2011) Hirsch, M., Schuler, C.J., Harmeling, S., Schölkopf, B.: Fast removal of non-uniform camera shake. In: ICCV (2011)
14.
Zurück zum Zitat Hirsch, M., Sra, S., Schölkopf, B., Harmeling, S.: Efficient filter flow for space-variant multiframe blind deconvolution. In: CVPR (2010) Hirsch, M., Sra, S., Schölkopf, B., Harmeling, S.: Efficient filter flow for space-variant multiframe blind deconvolution. In: CVPR (2010)
15.
Zurück zum Zitat Jin, M., Hirsch, M., Favaro, P.: Learning face deblurring fast and wide. In: CVPR Workshops (2018) Jin, M., Hirsch, M., Favaro, P.: Learning face deblurring fast and wide. In: CVPR Workshops (2018)
16.
Zurück zum Zitat Jin, M., Meishvili, G., Favaro, P.: Learning to extract a video sequence from a single motion-blurred image. In: CVPR (2018) Jin, M., Meishvili, G., Favaro, P.: Learning to extract a video sequence from a single motion-blurred image. In: CVPR (2018)
17.
Zurück zum Zitat Kim, T.H., Ahn, B., Lee, K.M.: Dynamic scene deblurring. In: ICCV (2013) Kim, T.H., Ahn, B., Lee, K.M.: Dynamic scene deblurring. In: ICCV (2013)
18.
Zurück zum Zitat Kim, T.H., Lee, K.M.: Segmentation-free dynamic scene deblurring. In: CVPR (2014) Kim, T.H., Lee, K.M.: Segmentation-free dynamic scene deblurring. In: CVPR (2014)
19.
Zurück zum Zitat Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., Harmeling, S.: Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7578, pp. 27–40. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33786-4_3CrossRef Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., Harmeling, S.: Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7578, pp. 27–40. Springer, Heidelberg (2012). https://​doi.​org/​10.​1007/​978-3-642-33786-4_​3CrossRef
20.
Zurück zum Zitat Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: CVPR (2011) Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: CVPR (2011)
21.
Zurück zum Zitat Lai, W., Huang, J., Hu, Z., Ahuja, N., Yang, M.: A comparative study for single image blind deblurring. In: CVPR (2016) Lai, W., Huang, J., Hu, Z., Ahuja, N., Yang, M.: A comparative study for single image blind deblurring. In: CVPR (2016)
22.
Zurück zum Zitat Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: CVPR (2009) Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: CVPR (2009)
23.
Zurück zum Zitat Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Efficient marginal likelihood optimization in blind deconvolution. In: CVPR (2011) Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Efficient marginal likelihood optimization in blind deconvolution. In: CVPR (2011)
25.
Zurück zum Zitat Nah, S., Kim, T.H., Lee, K.M.: Deep multi-scale convolutional neural network for dynamic scene deblurring. In: CVPR (2017) Nah, S., Kim, T.H., Lee, K.M.: Deep multi-scale convolutional neural network for dynamic scene deblurring. In: CVPR (2017)
27.
Zurück zum Zitat Pan, J., Hu, Z., Su, Z., Lee, H., Yang, M.: Soft-segmentation guided object motion deblurring. In: CVPR (2016) Pan, J., Hu, Z., Su, Z., Lee, H., Yang, M.: Soft-segmentation guided object motion deblurring. In: CVPR (2016)
28.
Zurück zum Zitat Pan, J., Hu, Z., Su, Z., Yang, M.: Deblurring text images via L0-regularized intensity and gradient prior. In: CVPR (2014) Pan, J., Hu, Z., Su, Z., Yang, M.: Deblurring text images via L0-regularized intensity and gradient prior. In: CVPR (2014)
29.
Zurück zum Zitat Pan, J., Sun, D., Pfister, H., Yang, M.H.: Blind image deblurring using dark channel prior. In: CVPR (2016) Pan, J., Sun, D., Pfister, H., Yang, M.H.: Blind image deblurring using dark channel prior. In: CVPR (2016)
30.
Zurück zum Zitat Perrone, D., Favaro, P.: Total variation blind deconvolution: The devil is in the details. In: CVPR (2014) Perrone, D., Favaro, P.: Total variation blind deconvolution: The devil is in the details. In: CVPR (2014)
31.
Zurück zum Zitat Perrone, D., Favaro, P.: A logarithmic image prior for blind deconvolution. IJCV (2016) Perrone, D., Favaro, P.: A logarithmic image prior for blind deconvolution. IJCV (2016)
32.
Zurück zum Zitat Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60, 259–268 (1992)MathSciNetCrossRef Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60, 259–268 (1992)MathSciNetCrossRef
33.
Zurück zum Zitat Schelten, K., Nowozin, S., Jancsary, J., Rother, C., Roth, S.: Interleaved regression tree field cascades for blind image deconvolution. In: WACV (2015) Schelten, K., Nowozin, S., Jancsary, J., Rother, C., Roth, S.: Interleaved regression tree field cascades for blind image deconvolution. In: WACV (2015)
34.
Zurück zum Zitat Schelten, K., Roth, S.: Localized image blur removal through non-parametric kernel estimation. In: ICPR (2014) Schelten, K., Roth, S.: Localized image blur removal through non-parametric kernel estimation. In: ICPR (2014)
35.
Zurück zum Zitat Schuler, C.J., Hirsch, M., Harmeling, S., Schölkopf, B.: Learning to deblur. IEEE TPAMI 38(7), 1439–1451 (2016)CrossRef Schuler, C.J., Hirsch, M., Harmeling, S., Schölkopf, B.: Learning to deblur. IEEE TPAMI 38(7), 1439–1451 (2016)CrossRef
36.
Zurück zum Zitat Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 73 (2008)CrossRef Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 73 (2008)CrossRef
37.
Zurück zum Zitat Srivastava, A., Lee, A.B., Simoncelli, E.P., Zhu, S.: On advances in statistical modeling of natural images. J. Math. Imaging Vis. 18, 17–33 (2003)MathSciNetCrossRef Srivastava, A., Lee, A.B., Simoncelli, E.P., Zhu, S.: On advances in statistical modeling of natural images. J. Math. Imaging Vis. 18, 17–33 (2003)MathSciNetCrossRef
38.
Zurück zum Zitat Sun, J., Cao, W., Xu, Z., Ponce, J.: Learning a convolutional neural network for non-uniform motion blur removal. In: CVPR (2015) Sun, J., Cao, W., Xu, Z., Ponce, J.: Learning a convolutional neural network for non-uniform motion blur removal. In: CVPR (2015)
39.
Zurück zum Zitat Sun, L., Cho, S., Wang, J., Hays, J.: Edge-based blur kernel estimation using patch priors. In: ICCP (2013) Sun, L., Cho, S., Wang, J., Hays, J.: Edge-based blur kernel estimation using patch priors. In: ICCP (2013)
40.
Zurück zum Zitat Whyte, O., Sivic, J., Zisserman, A., Ponce, J.: Non-uniform deblurring for shaken images. IJCV 98, 168–186 (2012)MathSciNetCrossRef Whyte, O., Sivic, J., Zisserman, A., Ponce, J.: Non-uniform deblurring for shaken images. IJCV 98, 168–186 (2012)MathSciNetCrossRef
42.
Zurück zum Zitat Wipf, D., Zhang, H.: Revisiting Bayesian blind deconvolution. J. Mach. Learn. Res. 15, 3595–3634 (2014)MathSciNetMATH Wipf, D., Zhang, H.: Revisiting Bayesian blind deconvolution. J. Mach. Learn. Res. 15, 3595–3634 (2014)MathSciNetMATH
45.
Zurück zum Zitat Xu, L., Zheng, S., Jia, J.: Unnatural L0 sparse representation for natural image deblurring. In: CVPR (2013) Xu, L., Zheng, S., Jia, J.: Unnatural L0 sparse representation for natural image deblurring. In: CVPR (2013)
46.
Zurück zum Zitat Yan, Y., Ren, W., Guo, Y., Wang, R., Cao, X.: Image deblurring via extreme channels prior. In: CVPR (2017) Yan, Y., Ren, W., Guo, Y., Wang, R., Cao, X.: Image deblurring via extreme channels prior. In: CVPR (2017)
47.
Zurück zum Zitat Zhang, H., Wipf, D.P., Zhang, Y.: Multi-image blind deblurring using a coupled adaptive sparse prior. In: CVPR (2013) Zhang, H., Wipf, D.P., Zhang, Y.: Multi-image blind deblurring using a coupled adaptive sparse prior. In: CVPR (2013)
48.
Zurück zum Zitat Zhang, H., Yang, J.: Intra-frame deblurring by leveraging inter-frame camera motion. In: CVPR (2015) Zhang, H., Yang, J.: Intra-frame deblurring by leveraging inter-frame camera motion. In: CVPR (2015)
49.
Zurück zum Zitat Zhang, Y., Lau, Y., Kuo, H.W., Cheung, S., Pasupathy, A., Wright, J.: On the global geometry of sphere-constrained sparse blind deconvolution. In: CVPR (2017) Zhang, Y., Lau, Y., Kuo, H.W., Cheung, S., Pasupathy, A., Wright, J.: On the global geometry of sphere-constrained sparse blind deconvolution. In: CVPR (2017)
50.
Zurück zum Zitat Zhu, C., Byrd, R.H., Lu, P., Nocedal, J.: L-BFGS-B: fortran subroutines for large-scale bound constrained optimization. ACM Trans. Math. Softw. (1994) Zhu, C., Byrd, R.H., Lu, P., Nocedal, J.: L-BFGS-B: fortran subroutines for large-scale bound constrained optimization. ACM Trans. Math. Softw. (1994)
51.
Zurück zum Zitat Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: ICCV (2011) Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: ICCV (2011)
52.
Zurück zum Zitat Zuo, W., Ren, D., Gu, S., Lin, L., Zhang, L.: Discriminative learning of iteration-wise priors for blind deconvolution. In: CVPR (2015) Zuo, W., Ren, D., Gu, S., Lin, L., Zhang, L.: Discriminative learning of iteration-wise priors for blind deconvolution. In: CVPR (2015)
Metadaten
Titel
Normalized Blind Deconvolution
verfasst von
Meiguang Jin
Stefan Roth
Paolo Favaro
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01234-2_41

Premium Partner