Skip to main content

2016 | OriginalPaper | Buchkapitel

Enhanced Joint Trilateral Up-sampling for Super-Resolution

verfasst von : Liang Yuan, Xin Jin, Chun Yuan

Erschienen in: Advances in Multimedia Information Processing - PCM 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this work, we propose a new depth image super-resolution method. We use low resolution depth image, refined high resolution color image and generated HR depth image to conduct iterative joint trilateral up-sampling. During the process of up-sampling, we put forward an algorithm to smooth the area in color image with overmuch texture to solve the texture copying problem. Based on the assumption that LR image is a counterpart of HR image with missing pixels, we defined an evaluation criterion to ensure the convergence of iteration and simultaneously make the final generated image close to the true HR depth image as far as possible. Our approach can generate HR depth image with sharp edges, none texture copying and little noises. Experiments are conducted on various datasets including Middlebury to demonstrate the superiority of the proposed method and show the improvement over state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gribbon, K.T., Bailey, D.G.: A novel approach to real-time bilinear interpolation. In: Second IEEE International Workshop on Electronic Design, Test and Applications, Perth, Australia, pp. 126–131, January 2004 Gribbon, K.T., Bailey, D.G.: A novel approach to real-time bilinear interpolation. In: Second IEEE International Workshop on Electronic Design, Test and Applications, Perth, Australia, pp. 126–131, January 2004
2.
Zurück zum Zitat Keys, R.G.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. 29(6), 1153–1160 (1981)MathSciNetCrossRefMATH Keys, R.G.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. 29(6), 1153–1160 (1981)MathSciNetCrossRefMATH
3.
Zurück zum Zitat Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Process. 10, 1521–1527 (2001)CrossRef Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Process. 10, 1521–1527 (2001)CrossRef
4.
Zurück zum Zitat Wang, Q., Ward, R.K.: A new orientation-adaptive interpolation method. IEEE Trans. Image Process. 16(4), 889–900 (2007)MathSciNetCrossRef Wang, Q., Ward, R.K.: A new orientation-adaptive interpolation method. IEEE Trans. Image Process. 16(4), 889–900 (2007)MathSciNetCrossRef
5.
Zurück zum Zitat Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Comput. Graph. Appl. 22(2), 56–65 (2002) Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Comput. Graph. Appl. 22(2), 56–65 (2002)
6.
Zurück zum Zitat Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(22), 2323–2326 (2000)CrossRef Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(22), 2323–2326 (2000)CrossRef
7.
Zurück zum Zitat Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: CVPR, vol. 1, pp. 275–282 (2004) Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: CVPR, vol. 1, pp. 275–282 (2004)
8.
Zurück zum Zitat Yang, J.C., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef Yang, J.C., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef
9.
Zurück zum Zitat Kiechle, M., Hawe, S., Kleinsteuber, M.: A joint intensity and depth co-sparse analysis model for depth map super-resolution. In: ICCV, pp. 1545–1552 (2013) Kiechle, M., Hawe, S., Kleinsteuber, M.: A joint intensity and depth co-sparse analysis model for depth map super-resolution. In: ICCV, pp. 1545–1552 (2013)
10.
Zurück zum Zitat Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2010. LNCS, vol. 6920, pp. 711–730. Springer, Heidelberg (2012). doi:10.1007/978-3-642-27413-8_47 CrossRef Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2010. LNCS, vol. 6920, pp. 711–730. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-27413-8_​47 CrossRef
11.
Zurück zum Zitat Dong, C., Loy, C.C., He, K., Tang, X.: Learning a deep convolutional network for image super-resolution. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 184–199. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10593-2_13 Dong, C., Loy, C.C., He, K., Tang, X.: Learning a deep convolutional network for image super-resolution. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 184–199. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10593-2_​13
12.
Zurück zum Zitat Schulter, S., Leistner, C., Bischof, H.: Fast and accurate image upscalling with super-resolution forests. In: CVPR 2015, pp. 3791–3799 (2015) Schulter, S., Leistner, C., Bischof, H.: Fast and accurate image upscalling with super-resolution forests. In: CVPR 2015, pp. 3791–3799 (2015)
13.
Zurück zum Zitat Kopf, J., Cohen, M., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. ACM TOG 26(3), 96 (2007)CrossRef Kopf, J., Cohen, M., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. ACM TOG 26(3), 96 (2007)CrossRef
14.
Zurück zum Zitat Yang, Q., Yang, R., Davis, J.: Spatial-depth super resolution for range images. In: CVPR (2007) Yang, Q., Yang, R., Davis, J.: Spatial-depth super resolution for range images. In: CVPR (2007)
15.
Zurück zum Zitat He, K., Sun, J., Tang, X.: Guided image filtering. In: ECCV, pp. 1–10 (2010) He, K., Sun, J., Tang, X.: Guided image filtering. In: ECCV, pp. 1–10 (2010)
16.
Zurück zum Zitat Lu, J., Forsyth, D.: Sparse depth super resolution. In: CVPR 2015, pp. 2245–2253 (2015) Lu, J., Forsyth, D.: Sparse depth super resolution. In: CVPR 2015, pp. 2245–2253 (2015)
17.
Zurück zum Zitat Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986). PAMI Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986). PAMI
20.
Zurück zum Zitat Chan, D., Buisman, H., Theobalt, C.: A noise-aware filter for real-time depth upsampling. In: Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications (2008) Chan, D., Buisman, H., Theobalt, C.: A noise-aware filter for real-time depth upsampling. In: Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications (2008)
21.
Zurück zum Zitat Diebel, J., Thrun, S.: An application of markov random fields to range sensing. In: Proceedings of Advances in Neural Information Processing System (2005) Diebel, J., Thrun, S.: An application of markov random fields to range sensing. In: Proceedings of Advances in Neural Information Processing System (2005)
22.
Zurück zum Zitat Park, J., Kim, H., Tai, W.Y.: High quality depth map upsampling for 3D-TOF cameras. In: ICCV (2011) Park, J., Kim, H., Tai, W.Y.: High quality depth map upsampling for 3D-TOF cameras. In: ICCV (2011)
Metadaten
Titel
Enhanced Joint Trilateral Up-sampling for Super-Resolution
verfasst von
Liang Yuan
Xin Jin
Chun Yuan
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48896-7_51

Neuer Inhalt