Skip to main content

2015 | OriginalPaper | Buchkapitel

A Generalized Additive Convolution Model for Efficient Deblurring of Camera Shaken Image

verfasst von : Hong Deng, Dongwei Ren, Hongzhi Zhang, Kuanquan Wang, Wangmeng Zuo

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Image blur caused by camera shake is often spatially variant, which makes it more challenging to recover the latent sharp image. Geometrical camera shake model based non-uniform deblurring methods, modeling the blurry image as a weighted summation of the homographically transformed images of the latent sharp image, although can achieve satisfactory deblurring results, still suffer from the problems of heavy computation or extensive memory cost. In this paper, we propose a generalized additive convolution (GAC) model for efficient non-uniform deblurring. A camera motion trajectory can be decomposed into a compact set of in-plane translations (slice) and roll rotations (fiber), which with an insightful analysis can both be formulated as convolution. The GAC model provides a promising way to overcome the difficulties of both computational load and memory burden. The experimental results show that GAC can obtain satisfactory deblurring results, and is much more efficient than state-of-the-arts.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Beck, A., Teboulle, M.: Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE TIP 18(11), 2419–2434 (2009)MathSciNet Beck, A., Teboulle, M.: Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE TIP 18(11), 2419–2434 (2009)MathSciNet
2.
Zurück zum Zitat Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graph. 28(5), 145 (2009)CrossRef Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graph. 28(5), 145 (2009)CrossRef
3.
Zurück zum Zitat Deng, H., Zuo, W., Zhang, H., Zhang, D.: An additive convolution model for fast restoration of nonuniform blurred images. Int. J. Comput. Math. 91(11), 2446–2466 (2014)CrossRefMathSciNet Deng, H., Zuo, W., Zhang, H., Zhang, D.: An additive convolution model for fast restoration of nonuniform blurred images. Int. J. Comput. Math. 91(11), 2446–2466 (2014)CrossRefMathSciNet
4.
Zurück zum Zitat Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(3), 787–794 (2006)CrossRef Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(3), 787–794 (2006)CrossRef
5.
Zurück zum Zitat Gupta, A., Joshi, N., Lawrence Zitnick, C., Cohen, M., Curless, B.: Single image deblurring using motion density functions. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 171–184. Springer, Heidelberg (2010) CrossRef Gupta, A., Joshi, N., Lawrence Zitnick, C., Cohen, M., Curless, B.: Single image deblurring using motion density functions. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 171–184. Springer, Heidelberg (2010) CrossRef
6.
Zurück zum Zitat Harmeling, S., Hirsch, M., Schölkopf, B.: Space-variant single-image blind deconvolution for removing camera shake. In: NIPS, pp. 829–837 (2010) Harmeling, S., Hirsch, M., Schölkopf, B.: Space-variant single-image blind deconvolution for removing camera shake. In: NIPS, pp. 829–837 (2010)
7.
Zurück zum Zitat Hirsch, M., Schuler, C.J., Harmeling, S., Schölkopf, B.: Fast removal of non-uniform camera shake. In: ICCV (2011) Hirsch, M., Schuler, C.J., Harmeling, S., Schölkopf, B.: Fast removal of non-uniform camera shake. In: ICCV (2011)
8.
Zurück zum Zitat Hirsch, M., Sra, S., Schölkopf, B., Harmeling, S.: Efficient filter flow for space-variant multiframe blind deconvolution. In: CVPR, pp. 607–614, June 2010 Hirsch, M., Sra, S., Schölkopf, B., Harmeling, S.: Efficient filter flow for space-variant multiframe blind deconvolution. In: CVPR, pp. 607–614, June 2010
9.
Zurück zum Zitat Hu, Z., Xu, L., Yang, M.H.: Joint depth estimation and camera shake removal from single blurry image. In: CVPR (2014) Hu, Z., Xu, L., Yang, M.H.: Joint depth estimation and camera shake removal from single blurry image. In: CVPR (2014)
10.
Zurück zum Zitat Hu, Z., Yang, M.H.: Fast non-uniform deblurring using constrained camera pose subspace. In: BMVC (2012) Hu, Z., Yang, M.H.: Fast non-uniform deblurring using constrained camera pose subspace. In: BMVC (2012)
11.
Zurück zum Zitat Ji, H., Wang, K.: A two-stage approach to blind spatially-varying motion deblurring. In: CVPR (2012) Ji, H., Wang, K.: A two-stage approach to blind spatially-varying motion deblurring. In: CVPR (2012)
12.
Zurück zum Zitat Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., Harmeling, S.: Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 27–40. Springer, Heidelberg (2012) CrossRef Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B., Harmeling, S.: Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 27–40. Springer, Heidelberg (2012) CrossRef
13.
Zurück zum Zitat Levin, A., Weiss, Y., Durand, F., Freeman, W.: Efficient marginal likelihood optimization in blind deconvolution. In: CVPR (2011) Levin, A., Weiss, Y., Durand, F., Freeman, W.: Efficient marginal likelihood optimization in blind deconvolution. In: CVPR (2011)
14.
Zurück zum Zitat Liu, G., Chang, S., Ma, Y.: Blind image deblurring using spectral properties of convolution operators. IEEE TIP 23, 5047–5056 (2014)MathSciNet Liu, G., Chang, S., Ma, Y.: Blind image deblurring using spectral properties of convolution operators. IEEE TIP 23, 5047–5056 (2014)MathSciNet
15.
Zurück zum Zitat Matungka, R., Zheng, Y.F., Ewing, R.L.: Image registration using adaptive polar transform. IEEE TIP 18(10), 2340–2354 (2009)MathSciNet Matungka, R., Zheng, Y.F., Ewing, R.L.: Image registration using adaptive polar transform. IEEE TIP 18(10), 2340–2354 (2009)MathSciNet
16.
Zurück zum Zitat Perrone, D., Favaro, P.: Total variation blind deconvolution - the devil is in the details. In: CVPR (2014) Perrone, D., Favaro, P.: Total variation blind deconvolution - the devil is in the details. In: CVPR (2014)
17.
Zurück zum Zitat Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 73 (2008)CrossRef Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3), 73 (2008)CrossRef
18.
Zurück zum Zitat Stančin, S., Tomažič, S.: Angle estimation of simultaneous orthogonal rotations from 3d gyroscope measurements. Sensors 11(9), 8536–8549 (2011)CrossRef Stančin, S., Tomažič, S.: Angle estimation of simultaneous orthogonal rotations from 3d gyroscope measurements. Sensors 11(9), 8536–8549 (2011)CrossRef
19.
Zurück zum Zitat Tai, Y.W., Tan, P., Brown, M.S.: Richardson-lucy deblurring for scenes under a projective motion path. IEEE TPAMI 33(8), 1603–1618 (2011)CrossRef Tai, Y.W., Tan, P., Brown, M.S.: Richardson-lucy deblurring for scenes under a projective motion path. IEEE TPAMI 33(8), 1603–1618 (2011)CrossRef
20.
Zurück zum Zitat Whyte, O., Sivic, J., Zisserman, A., Ponce, J.: Non-uniform deblurring for shaken images. Int. J. Comp. Vis. 98(2), 168–186 (2012)CrossRefMathSciNetMATH Whyte, O., Sivic, J., Zisserman, A., Ponce, J.: Non-uniform deblurring for shaken images. Int. J. Comp. Vis. 98(2), 168–186 (2012)CrossRefMathSciNetMATH
21.
Zurück zum Zitat Xu, L., Zheng, S., Jia, J.: Unnatural l0 sparse representation for natural image deblurring. In: CVPR (2013) Xu, L., Zheng, S., Jia, J.: Unnatural l0 sparse representation for natural image deblurring. In: CVPR (2013)
22.
Zurück zum Zitat Yue, T., Cho, S., Wang, J., Dai, Q.: Hybrid image deblurring by fusing edge and power spectrum information. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part VII. LNCS, vol. 8695, pp. 79–93. Springer, Heidelberg (2014) Yue, T., Cho, S., Wang, J., Dai, Q.: Hybrid image deblurring by fusing edge and power spectrum information. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part VII. LNCS, vol. 8695, pp. 79–93. Springer, Heidelberg (2014)
23.
Zurück zum Zitat Zhang, H., Wipf, D.: Non-uniform camera shake removal using a spatially-adaptive sparse penalty. In: NIPS (2013) Zhang, H., Wipf, D.: Non-uniform camera shake removal using a spatially-adaptive sparse penalty. In: NIPS (2013)
Metadaten
Titel
A Generalized Additive Convolution Model for Efficient Deblurring of Camera Shaken Image
verfasst von
Hong Deng
Dongwei Ren
Hongzhi Zhang
Kuanquan Wang
Wangmeng Zuo
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-21978-3_9

Premium Partner