Skip to main content

2018 | OriginalPaper | Buchkapitel

GMM Based Single Depth Image Super-Resolution

verfasst von : Chandra Shaker Balure, M. Ramesh Kini, Arnav Bhavsar

Erschienen in: Computer Vision, Pattern Recognition, Image Processing, and Graphics

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Super-resolution (SR) is a technique to improve the resolution of an image from a sequence of input images or from a single image. As SR is an ill-posed inverse problem, it leads to many suboptimal solutions. Since modern depth cameras suffer from low-spatial resolution and are noisy, we present a Gaussian mixture model (GMM) based method for depth image super-resolution (SR). We train GMM from a set of high-resolution and low-resolution (HR-LR) synthetic training depth images to learn the relation between the HR and the LR patches in the form of covariance matrices. We use expectation-maximization (EM) algorithm to converge to an optimal solution. We show the promising results qualitatively and quantitatively in comparison to other depth image SR methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chan, D., Buisman, H., Theobalt, C., Thrun, S.: A noise-aware filter for real-time depth upsampling. In: 2008 Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications-M2SFA2 (2008) Chan, D., Buisman, H., Theobalt, C., Thrun, S.: A noise-aware filter for real-time depth upsampling. In: 2008 Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications-M2SFA2 (2008)
2.
Zurück zum Zitat Diebel, J., Thrun, S.: An application of markov random fields to range sensing. In: NIPS, vol. 5, pp. 291–298 (2005) Diebel, J., Thrun, S.: An application of markov random fields to range sensing. In: NIPS, vol. 5, pp. 291–298 (2005)
3.
Zurück zum Zitat Ferstl, D., Reinbacher, C., Ranftl, R., Rüther, M., Bischof, H.: Image guided depth upsampling using anisotropic total generalized variation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 993–1000 (2013) Ferstl, D., Reinbacher, C., Ranftl, R., Rüther, M., Bischof, H.: Image guided depth upsampling using anisotropic total generalized variation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 993–1000 (2013)
4.
Zurück zum Zitat Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Comput. Graph. Appl. 22(2), 56–65 (2002)CrossRef Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Comput. Graph. Appl. 22(2), 56–65 (2002)CrossRef
5.
Zurück zum Zitat Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 349–356. IEEE (2009) Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 349–356. IEEE (2009)
7.
Zurück zum Zitat Hua, K.L., Lo, K.H., Wang, Y.C.F.F.: Extended guided filtering for depth map upsampling. IEEE Multimed. 23(2), 72–83 (2016)CrossRef Hua, K.L., Lo, K.H., Wang, Y.C.F.F.: Extended guided filtering for depth map upsampling. IEEE Multimed. 23(2), 72–83 (2016)CrossRef
8.
Zurück zum Zitat Konno, Y., Monno, Y., Kiku, D., Tanaka, M., Okutomi, M.: Intensity guided depth upsampling by residual interpolation. In: The Abstracts of the International Conference on Advanced Mechatronics, Toward Evolutionary Fusion of IT and Mechatronics (ICAM) Abstracts, vol. 2015, pp. 1–2 (2015)CrossRef Konno, Y., Monno, Y., Kiku, D., Tanaka, M., Okutomi, M.: Intensity guided depth upsampling by residual interpolation. In: The Abstracts of the International Conference on Advanced Mechatronics, Toward Evolutionary Fusion of IT and Mechatronics (ICAM) Abstracts, vol. 2015, pp. 1–2 (2015)CrossRef
9.
Zurück zum Zitat Kopf, J., Cohen, M.F., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. ACM Trans. Graph. (ToG) 26, 96 (2007)CrossRef Kopf, J., Cohen, M.F., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. ACM Trans. Graph. (ToG) 26, 96 (2007)CrossRef
10.
Zurück zum Zitat Li, J., Lu, Z., Zeng, G., Gan, R., Zha, H.: Similarity-aware patchwork assembly for depth image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3374–3381 (2014) Li, J., Lu, Z., Zeng, G., Gan, R., Zha, H.: Similarity-aware patchwork assembly for depth image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3374–3381 (2014)
11.
12.
Zurück zum Zitat Sandeep, P., Jacob, T.: Single image super-resolution using a joint GMM method. IEEE Trans. Image Process. 25(9), 4233–4244 (2016)MathSciNet Sandeep, P., Jacob, T.: Single image super-resolution using a joint GMM method. IEEE Trans. Image Process. 25(9), 4233–4244 (2016)MathSciNet
13.
Zurück zum Zitat Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47(1–3), 7–42 (2002)CrossRef Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47(1–3), 7–42 (2002)CrossRef
14.
Zurück zum Zitat Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: 1998 Sixth International Conference on Computer Vision, pp. 839–846. IEEE (1998) Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: 1998 Sixth International Conference on Computer Vision, pp. 839–846. IEEE (1998)
15.
Zurück zum Zitat Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
Metadaten
Titel
GMM Based Single Depth Image Super-Resolution
verfasst von
Chandra Shaker Balure
M. Ramesh Kini
Arnav Bhavsar
Copyright-Jahr
2018
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-0020-2_22