Skip to main content
Top

2016 | OriginalPaper | Chapter

Enhanced Joint Trilateral Up-sampling for Super-Resolution

Authors : Liang Yuan, Xin Jin, Chun Yuan

Published in: Advances in Multimedia Information Processing - PCM 2016

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this work, we propose a new depth image super-resolution method. We use low resolution depth image, refined high resolution color image and generated HR depth image to conduct iterative joint trilateral up-sampling. During the process of up-sampling, we put forward an algorithm to smooth the area in color image with overmuch texture to solve the texture copying problem. Based on the assumption that LR image is a counterpart of HR image with missing pixels, we defined an evaluation criterion to ensure the convergence of iteration and simultaneously make the final generated image close to the true HR depth image as far as possible. Our approach can generate HR depth image with sharp edges, none texture copying and little noises. Experiments are conducted on various datasets including Middlebury to demonstrate the superiority of the proposed method and show the improvement over state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Gribbon, K.T., Bailey, D.G.: A novel approach to real-time bilinear interpolation. In: Second IEEE International Workshop on Electronic Design, Test and Applications, Perth, Australia, pp. 126–131, January 2004 Gribbon, K.T., Bailey, D.G.: A novel approach to real-time bilinear interpolation. In: Second IEEE International Workshop on Electronic Design, Test and Applications, Perth, Australia, pp. 126–131, January 2004
2.
go back to reference Keys, R.G.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. 29(6), 1153–1160 (1981)MathSciNetCrossRefMATH Keys, R.G.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. 29(6), 1153–1160 (1981)MathSciNetCrossRefMATH
3.
go back to reference Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Process. 10, 1521–1527 (2001)CrossRef Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Process. 10, 1521–1527 (2001)CrossRef
4.
go back to reference Wang, Q., Ward, R.K.: A new orientation-adaptive interpolation method. IEEE Trans. Image Process. 16(4), 889–900 (2007)MathSciNetCrossRef Wang, Q., Ward, R.K.: A new orientation-adaptive interpolation method. IEEE Trans. Image Process. 16(4), 889–900 (2007)MathSciNetCrossRef
5.
go back to reference Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Comput. Graph. Appl. 22(2), 56–65 (2002) Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Comput. Graph. Appl. 22(2), 56–65 (2002)
6.
go back to reference Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(22), 2323–2326 (2000)CrossRef Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(22), 2323–2326 (2000)CrossRef
7.
go back to reference Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: CVPR, vol. 1, pp. 275–282 (2004) Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: CVPR, vol. 1, pp. 275–282 (2004)
8.
go back to reference Yang, J.C., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef Yang, J.C., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef
9.
go back to reference Kiechle, M., Hawe, S., Kleinsteuber, M.: A joint intensity and depth co-sparse analysis model for depth map super-resolution. In: ICCV, pp. 1545–1552 (2013) Kiechle, M., Hawe, S., Kleinsteuber, M.: A joint intensity and depth co-sparse analysis model for depth map super-resolution. In: ICCV, pp. 1545–1552 (2013)
10.
go back to reference Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2010. LNCS, vol. 6920, pp. 711–730. Springer, Heidelberg (2012). doi:10.1007/978-3-642-27413-8_47 CrossRef Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2010. LNCS, vol. 6920, pp. 711–730. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-27413-8_​47 CrossRef
11.
go back to reference Dong, C., Loy, C.C., He, K., Tang, X.: Learning a deep convolutional network for image super-resolution. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 184–199. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10593-2_13 Dong, C., Loy, C.C., He, K., Tang, X.: Learning a deep convolutional network for image super-resolution. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 184–199. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10593-2_​13
12.
go back to reference Schulter, S., Leistner, C., Bischof, H.: Fast and accurate image upscalling with super-resolution forests. In: CVPR 2015, pp. 3791–3799 (2015) Schulter, S., Leistner, C., Bischof, H.: Fast and accurate image upscalling with super-resolution forests. In: CVPR 2015, pp. 3791–3799 (2015)
13.
go back to reference Kopf, J., Cohen, M., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. ACM TOG 26(3), 96 (2007)CrossRef Kopf, J., Cohen, M., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. ACM TOG 26(3), 96 (2007)CrossRef
14.
go back to reference Yang, Q., Yang, R., Davis, J.: Spatial-depth super resolution for range images. In: CVPR (2007) Yang, Q., Yang, R., Davis, J.: Spatial-depth super resolution for range images. In: CVPR (2007)
15.
go back to reference He, K., Sun, J., Tang, X.: Guided image filtering. In: ECCV, pp. 1–10 (2010) He, K., Sun, J., Tang, X.: Guided image filtering. In: ECCV, pp. 1–10 (2010)
16.
go back to reference Lu, J., Forsyth, D.: Sparse depth super resolution. In: CVPR 2015, pp. 2245–2253 (2015) Lu, J., Forsyth, D.: Sparse depth super resolution. In: CVPR 2015, pp. 2245–2253 (2015)
17.
go back to reference Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986). PAMI Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986). PAMI
20.
go back to reference Chan, D., Buisman, H., Theobalt, C.: A noise-aware filter for real-time depth upsampling. In: Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications (2008) Chan, D., Buisman, H., Theobalt, C.: A noise-aware filter for real-time depth upsampling. In: Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications (2008)
21.
go back to reference Diebel, J., Thrun, S.: An application of markov random fields to range sensing. In: Proceedings of Advances in Neural Information Processing System (2005) Diebel, J., Thrun, S.: An application of markov random fields to range sensing. In: Proceedings of Advances in Neural Information Processing System (2005)
22.
go back to reference Park, J., Kim, H., Tai, W.Y.: High quality depth map upsampling for 3D-TOF cameras. In: ICCV (2011) Park, J., Kim, H., Tai, W.Y.: High quality depth map upsampling for 3D-TOF cameras. In: ICCV (2011)
Metadata
Title
Enhanced Joint Trilateral Up-sampling for Super-Resolution
Authors
Liang Yuan
Xin Jin
Chun Yuan
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-48896-7_51