Skip to main content
Top

2017 | OriginalPaper | Chapter

Non-local \(L_{0}\) Gradient Minimization Filter and Its Applications for Depth Image Upsampling

Authors : Hang Yang, Xueqi Sun, Ming Zhu, Kun Wu

Published in: Image and Graphics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this work, we propose a non-local \(L_{0}\) gradient minimization filter. The nonlocal idea is to restore an unknown pixel using other similar pixels, and the nonlocal gradient model has been verified for feature and structure-preserving. We introduce the nonlocal idea into a \(L_{0}\) gradient minimization approach, which is effective for preserving major edges while eliminating the low-amplitude structures. An optimization framework is designed for achieving this effort. Many optimized based filters do not have the property of joint filtering, so they can not be used in many problems, such as joint denoising, joint upsampling, while the proposed filter not only inherits the advantages of the \(L_{0}\) gradient minimization filter, but also has the property of the joint filtering. So our filter can be applied to joint super resolution. With the guidance of the high-resolution image, we propose upsampling the low-resolution depth image with the proposed filter. Experimental results demonstrate the effectiveness of our method both qualitatively and quantitatively compared with the state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 60–65. IEEE (2005) Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 60–65. IEEE (2005)
2.
go back to reference Chan, D., Buisman, H., Theobalt, C., Thrun. S.: A noise-aware filter for real-time depth upsampling. In: The Workshop on Multi-camera Multi-modal Sensor Fusion Algorithms Applications (2008) Chan, D., Buisman, H., Theobalt, C., Thrun. S.: A noise-aware filter for real-time depth upsampling. In: The Workshop on Multi-camera Multi-modal Sensor Fusion Algorithms Applications (2008)
3.
go back to reference Farbman, Z., Fattal, R., Lischinski, D., Szeliski, R.: Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 67 (2008)CrossRef Farbman, Z., Fattal, R., Lischinski, D., Szeliski, R.: Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 67 (2008)CrossRef
4.
go back to reference Ferstl, D., Reinbacher, C., Ranftl, R., Ruether, M., Bischof, H.: Guided depth upsampling using anisotropic total generalized variation. IEEE International Conference on Computer Vision, pp. 993–1000. IEEE (2013) Ferstl, D., Reinbacher, C., Ranftl, R., Ruether, M., Bischof, H.: Guided depth upsampling using anisotropic total generalized variation. IEEE International Conference on Computer Vision, pp. 993–1000. IEEE (2013)
5.
go back to reference Ferstl, D., Ruther, M., Bischof, H.: Variational depth superresolution using example-based edge representations. In: IEEE International Conference on Computer Vision (ICCV), pp. 513–521. IEEE (2015) Ferstl, D., Ruther, M., Bischof, H.: Variational depth superresolution using example-based edge representations. In: IEEE International Conference on Computer Vision (ICCV), pp. 513–521. IEEE (2015)
6.
7.
go back to reference Gong, Y.: Bernstein filter: a new solver for mean curvature regularized models. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1701–1705. IEEE (2016) Gong, Y.: Bernstein filter: a new solver for mean curvature regularized models. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1701–1705. IEEE (2016)
8.
go back to reference He, K., Sun, J., Tang, X.: Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1397–1409 (2013)CrossRef He, K., Sun, J., Tang, X.: Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1397–1409 (2013)CrossRef
9.
go back to reference Hornacek, M., Rhemann, C., Gelautz, M., Rother, C.: Depth super resolution by rigid body self-similarity in 3D. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1123–1130. IEEE (2013) Hornacek, M., Rhemann, C., Gelautz, M., Rother, C.: Depth super resolution by rigid body self-similarity in 3D. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1123–1130. IEEE (2013)
10.
go back to reference Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5197–5206. IEEE (2015) Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5197–5206. IEEE (2015)
13.
go back to reference Park, J., Kim, H., Tai, Y.W., Brown, M.S., Kweon, I.: High quality depth map upsampling for 3D-TOF cameras. In: IEEE International Conference on Computer Vision (ICCV), pp. 1623–1630. IEEE (2011) Park, J., Kim, H., Tai, Y.W., Brown, M.S., Kweon, I.: High quality depth map upsampling for 3D-TOF cameras. In: IEEE International Conference on Computer Vision (ICCV), pp. 1623–1630. IEEE (2011)
14.
go back to reference Petschnigg, G., Szeliski, R., Agrawala, M.: Digital photography with flash and no-flash image pairs. ACM Trans. Graph. (TOG) 23, 664–672 (2004)CrossRef Petschnigg, G., Szeliski, R., Agrawala, M.: Digital photography with flash and no-flash image pairs. ACM Trans. Graph. (TOG) 23, 664–672 (2004)CrossRef
15.
go back to reference Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenom. 60, 259–268 (1992)MathSciNetCrossRefMATH Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenom. 60, 259–268 (1992)MathSciNetCrossRefMATH
16.
go back to reference Song, X., Dai, Y., Qin, X.: Deep depth super-resolution: learning depth super-resolution using deep convolutional neural network. arXiv preprint arXiv:1607.01977 (2016) Song, X., Dai, Y., Qin, X.: Deep depth super-resolution: learning depth super-resolution using deep convolutional neural network. arXiv preprint arXiv:​1607.​01977 (2016)
17.
go back to reference Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: International Conference on Computer Vision, pp. 839–846. IEEE (1998) Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: International Conference on Computer Vision, pp. 839–846. IEEE (1998)
18.
go back to reference Wang, Z., Bovik, A.C., Sheikh, H.R.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)CrossRef
19.
go back to reference Xie, J., Feris, R.S., Sun, M.T.: Edge-guided single depth image super resolution. IEEE Trans. Image Process. 25, 428–438 (2016)MathSciNetCrossRef Xie, J., Feris, R.S., Sun, M.T.: Edge-guided single depth image super resolution. IEEE Trans. Image Process. 25, 428–438 (2016)MathSciNetCrossRef
20.
go back to reference Xu, L., Lu, C., Xu, Y., Jia, J.: Image smoothing via \(\text{ L }_0\) gradient minimization. ACM Trans. Graph. 30, 174 (2011) Xu, L., Lu, C., Xu, Y., Jia, J.: Image smoothing via \(\text{ L }_0\) gradient minimization. ACM Trans. Graph. 30, 174 (2011)
21.
go back to reference Xue, H., Zhang, S., Cai, D.: Depth image inpainting: improving low rank matrix completion with low gradient regularization. arXiv preprint arXiv:160405817 (2016) Xue, H., Zhang, S., Cai, D.: Depth image inpainting: improving low rank matrix completion with low gradient regularization. arXiv preprint arXiv:​160405817 (2016)
22.
go back to reference Yang, J., Ye, X., Li, K., Hou, C., Wang, Y.: Color-guided depth recovery from RGB-D data using an adaptive autoregressive model. IEEE Trans. Image Process. 23, 3443–3458 (2014)MathSciNetCrossRefMATH Yang, J., Ye, X., Li, K., Hou, C., Wang, Y.: Color-guided depth recovery from RGB-D data using an adaptive autoregressive model. IEEE Trans. Image Process. 23, 3443–3458 (2014)MathSciNetCrossRefMATH
24.
go back to reference Zhang, X., Burger, M., Bresson, X.: Bregmanized nonlocal regularization for deconvolution and sparse reconstruction. SIAM J. Imaging Sci. 3, 253–276 (2010)MathSciNetCrossRefMATH Zhang, X., Burger, M., Bresson, X.: Bregmanized nonlocal regularization for deconvolution and sparse reconstruction. SIAM J. Imaging Sci. 3, 253–276 (2010)MathSciNetCrossRefMATH
Metadata
Title
Non-local Gradient Minimization Filter and Its Applications for Depth Image Upsampling
Authors
Hang Yang
Xueqi Sun
Ming Zhu
Kun Wu
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-71607-7_8

Premium Partner