Skip to main content
Top

2020 | OriginalPaper | Chapter

OID: Outlier Identifying and Discarding in Blind Image Deblurring

Authors : Liang Chen, Faming Fang, Jiawei Zhang, Jun Liu, Guixu Zhang

Published in: Computer Vision – ECCV 2020

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Blind deblurring methods are sensitive to outliers, such as saturated pixels and non-Gaussian noise. Even a small amount of outliers can dramatically degrade the quality of the estimated blur kernel, because the outliers are not conforming to the linear formation of the blurring process. Prior arts develop sophisticated edge-selecting steps or noise filtering pre-processing steps to deal with outliers (i.e. indirect approaches). However, these indirect approaches may fail when massive outliers are presented, since informative details may be polluted by outliers or erased during the pre-processing steps. To address these problems, this paper develops a simple yet effective Outlier Identifying and Discarding (OID) method, which alleviates limitations in existing Maximum A Posteriori (MAP)-based deblurring models when significant outliers are presented. Unlike previous indirect outlier processing methods, OID tackles outliers directly by explicitly identifying and discarding them, when updating both the latent image and the blur kernel during the deblurring process, where the outliers are detected by using the sparse and entropy-based modules. OID is easy to implement and extendable for non-blind restoration. Extensive experiments demonstrate the superiority of OID against recent works both quantitatively and qualitatively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Bar, L., Kiryati, N., Sochen, N.: Image deblurring in the presence of impulsive noise. Int. J. Comput. Vis. 70(3), 279–298 (2006)CrossRef Bar, L., Kiryati, N., Sochen, N.: Image deblurring in the presence of impulsive noise. Int. J. Comput. Vis. 70(3), 279–298 (2006)CrossRef
2.
go back to reference Chen, L., Fang, F., Wang, T., Zhang, G.: Blind image deblurring with local maximum gradient prior. In: IEEE CVPR (2019) Chen, L., Fang, F., Wang, T., Zhang, G.: Blind image deblurring with local maximum gradient prior. In: IEEE CVPR (2019)
3.
go back to reference Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graph. 28(5), 145 (2009)CrossRef Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graph. 28(5), 145 (2009)CrossRef
4.
go back to reference Cho, S., Wang, J., Lee, S.: Handling outliers in non-blind image deconvolution. In: IEEE ICCV (2011) Cho, S., Wang, J., Lee, S.: Handling outliers in non-blind image deconvolution. In: IEEE ICCV (2011)
5.
go back to reference Dong, J., Pan, J., Su, Z., Yang, M.H.: Blind image deblurring with outlier handling. In: IEEE ICCV (2017) Dong, J., Pan, J., Su, Z., Yang, M.H.: Blind image deblurring with outlier handling. In: IEEE ICCV (2017)
6.
go back to reference Dong, J., Pan, J., Sun, D., Su, Z., Yang, M.: Learning data terms for non-blind deblurring. In: ECCV (2018) Dong, J., Pan, J., Sun, D., Su, Z., Yang, M.: Learning data terms for non-blind deblurring. In: ECCV (2018)
7.
go back to reference Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(3), 787–794 (2006)CrossRef Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(3), 787–794 (2006)CrossRef
8.
go back to reference Gong, D., Tan, M., Zhang, Y., van den Hengel, A., Shi, Q.: Blind image deconvolution by automatic gradient activation. In: IEEE CVPR (2016) Gong, D., Tan, M., Zhang, Y., van den Hengel, A., Shi, Q.: Blind image deconvolution by automatic gradient activation. In: IEEE CVPR (2016)
9.
go back to reference Guo, X., Lin, Z.: ROUTE: robust outlier estimation for low rank matrix recovery. In: International Joint Conference on Artificial Intelligence (2017) Guo, X., Lin, Z.: ROUTE: robust outlier estimation for low rank matrix recovery. In: International Joint Conference on Artificial Intelligence (2017)
10.
go back to reference Hu, Z., Cho, S., Wang, J., Yang, M.H.: Deblurring low-light images with light streaks. In: IEEE CVPR (2014) Hu, Z., Cho, S., Wang, J., Yang, M.H.: Deblurring low-light images with light streaks. In: IEEE CVPR (2014)
12.
go back to reference Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., Harmeling, S.: Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7578, pp. 27–40. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33786-4_3CrossRef Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., Harmeling, S.: Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7578, pp. 27–40. Springer, Heidelberg (2012). https://​doi.​org/​10.​1007/​978-3-642-33786-4_​3CrossRef
13.
go back to reference Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: IEEE CVPR (2011) Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: IEEE CVPR (2011)
14.
go back to reference Lai, W., Ding, J., Lin, Y., Chuang, Y.: Blur kernel estimation using normalized color-line priors. In: IEEE CVPR (2015) Lai, W., Ding, J., Lin, Y., Chuang, Y.: Blur kernel estimation using normalized color-line priors. In: IEEE CVPR (2015)
15.
go back to reference Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26(3), 70 (2007)CrossRef Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26(3), 70 (2007)CrossRef
16.
go back to reference Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: IEEE CVPR (2009) Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: IEEE CVPR (2009)
17.
go back to reference Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Efficient marginal likelihood optimization in blind deconvolution. In: IEEE CVPR (2011) Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Efficient marginal likelihood optimization in blind deconvolution. In: IEEE CVPR (2011)
18.
go back to reference Li, L., Pan, J., Lai, W.S., Gao, C., Sang, N., Yang, M.H.: Learning a discriminative prior for blind image deblurring. In: IEEE CVPR (2018) Li, L., Pan, J., Lai, W.S., Gao, C., Sang, N., Yang, M.H.: Learning a discriminative prior for blind image deblurring. In: IEEE CVPR (2018)
19.
go back to reference Liu, J., Yan, M., Zeng, T.: Surface-aware blind image deblurring. IEEE Trans. Pattern Anal. Mach. Intell. (2019) Liu, J., Yan, M., Zeng, T.: Surface-aware blind image deblurring. IEEE Trans. Pattern Anal. Mach. Intell. (2019)
21.
go back to reference Pan, J., Hu, Z., Su, Z., Yang, M.H.: \( l_0 \)-regularized intensity and gradient prior for deblurring text images and beyond. IEEE Trans. Pattern Anal. Mach. Intell. 39(2), 342–355 (2017)CrossRef Pan, J., Hu, Z., Su, Z., Yang, M.H.: \( l_0 \)-regularized intensity and gradient prior for deblurring text images and beyond. IEEE Trans. Pattern Anal. Mach. Intell. 39(2), 342–355 (2017)CrossRef
22.
go back to reference Pan, J., Lin, Z., Su, Z., Yang, M.H.: Robust kernel estimation with outliers handling for image deblurring. In: IEEE CVPR (2016) Pan, J., Lin, Z., Su, Z., Yang, M.H.: Robust kernel estimation with outliers handling for image deblurring. In: IEEE CVPR (2016)
23.
go back to reference Pan, J., Sun, D., Pfister, H., Yang, M.H.: Blind image deblurring using dark channel prior. In: IEEE CVPR (2016) Pan, J., Sun, D., Pfister, H., Yang, M.H.: Blind image deblurring using dark channel prior. In: IEEE CVPR (2016)
24.
go back to reference Ren, W., Cao, X., Pan, J., Guo, X., Zuo, W., Yang, M.H.: Image deblurring via enhanced low-rank prior. IEEE Trans. Image Process. 25(7), 3426–3437 (2016)MathSciNetCrossRef Ren, W., Cao, X., Pan, J., Guo, X., Zuo, W., Yang, M.H.: Image deblurring via enhanced low-rank prior. IEEE Trans. Image Process. 25(7), 3426–3437 (2016)MathSciNetCrossRef
25.
go back to reference Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 73 (2008)CrossRef Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 73 (2008)CrossRef
26.
go back to reference Whyte, O., Sivic, J., Zisserman, A.: Deblurring shaken and partially saturated images. Int. J. Comput. Vis. 110(2), 185–201 (2014)CrossRef Whyte, O., Sivic, J., Zisserman, A.: Deblurring shaken and partially saturated images. Int. J. Comput. Vis. 110(2), 185–201 (2014)CrossRef
27.
go back to reference Wipf, D.P., Zhang, H.: Revisiting bayesian blind deconvolution. J. Mach. Learn. Res. 15(1), 3595–3634 (2014)MathSciNetMATH Wipf, D.P., Zhang, H.: Revisiting bayesian blind deconvolution. J. Mach. Learn. Res. 15(1), 3595–3634 (2014)MathSciNetMATH
29.
go back to reference Xu, L., Zheng, S., Jia, J.: Unnatural \(l_0\) sparse representation for natural image deblurring. In: IEEE CVPR (2013) Xu, L., Zheng, S., Jia, J.: Unnatural \(l_0\) sparse representation for natural image deblurring. In: IEEE CVPR (2013)
30.
go back to reference Yan, Y., Ren, W., Guo, Y., Wang, R., Cao, X.: Image deblurring via extreme channels prior. In: IEEE CVPR (2017) Yan, Y., Ren, W., Guo, Y., Wang, R., Cao, X.: Image deblurring via extreme channels prior. In: IEEE CVPR (2017)
31.
go back to reference Zhong, L., Cho, S., Metaxas, D., Paris, S., Wang, J.: Handling noise in single image deblurring using directional filters. In: IEEE CVPR (2013) Zhong, L., Cho, S., Metaxas, D., Paris, S., Wang, J.: Handling noise in single image deblurring using directional filters. In: IEEE CVPR (2013)
Metadata
Title
OID: Outlier Identifying and Discarding in Blind Image Deblurring
Authors
Liang Chen
Faming Fang
Jiawei Zhang
Jun Liu
Guixu Zhang
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-58595-2_36

Premium Partner