Skip to main content

2015 | OriginalPaper | Buchkapitel

Efficient Disparity Map Generation Using Stereo and Time-of-Flight Depth Cameras

verfasst von : Woo-Seok Jang, Yo-Sung Ho

Erschienen in: Advances in Multimedia Information Processing -- PCM 2015

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Three-dimensional content (3D) creation has received a lot of attention due to numerous successes of 3D entertainment. Accurate estimation of depth information is necessary for efficient 3D content creation. In this paper, we propose a disparity map estimation method based on stereo correspondence. The proposed system utilizes depth and stereo camera sets. While the stereo set carries out disparity estimation, depth camera information is projected to left and right camera positions using 3D warping and upsampling is processed in accordance with the image size. The upsampled depth is used for obtaining disparity data of left and right positions. Finally, disparity data from each depth sensor are combined. The experimental results demonstrate that our method produces more accurate disparity maps compared to the conventional approaches which use stereo cameras and a single depth sensor.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3DTV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRef Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3DTV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRef
2.
Zurück zum Zitat Tech, G., Muller, K., Wiegand, T.: Evaluation of view synthesis algorithms for mobile 3DTV. In: 3DTV Conference, pp. 132(1–4) (2011) Tech, G., Muller, K., Wiegand, T.: Evaluation of view synthesis algorithms for mobile 3DTV. In: 3DTV Conference, pp. 132(1–4) (2011)
3.
Zurück zum Zitat Lee, E.K., Ho, Y.S.: Generation of multi-view video using a fusion camera system for 3D displays. IEEE Trans. Consum. Electron. 56(4), 2797–2805 (2010)CrossRef Lee, E.K., Ho, Y.S.: Generation of multi-view video using a fusion camera system for 3D displays. IEEE Trans. Consum. Electron. 56(4), 2797–2805 (2010)CrossRef
4.
Zurück zum Zitat Jang, W.S., Ho, Y.S.: Efficient disparity map estimation using occlusion handling for various 3D multimedia applications. IEEE Trans. Consum. Electron. 57(4), 1937–1943 (2011)CrossRef Jang, W.S., Ho, Y.S.: Efficient disparity map estimation using occlusion handling for various 3D multimedia applications. IEEE Trans. Consum. Electron. 57(4), 1937–1943 (2011)CrossRef
5.
Zurück zum Zitat Scharstein, D., Szeliski, R., Zabih, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7–42 (2002)CrossRefMATH Scharstein, D., Szeliski, R., Zabih, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7–42 (2002)CrossRefMATH
6.
Zurück zum Zitat Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn, pp. 262–278. Cambridge University Press, Cambridge (2003)MATH Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn, pp. 262–278. Cambridge University Press, Cambridge (2003)MATH
7.
Zurück zum Zitat Jang, W.S., Ho, Y.S.: Discontinuity preserving disparity estimation with occlusion handling. J. Vis. Commun. Image Represent. 25(7), 1595–1603 (2014)CrossRef Jang, W.S., Ho, Y.S.: Discontinuity preserving disparity estimation with occlusion handling. J. Vis. Commun. Image Represent. 25(7), 1595–1603 (2014)CrossRef
8.
Zurück zum Zitat Lee, E.K., Ho, Y.S.: Generation of high-quality depth maps using hybrid camera system for 3-D video. J. Vis. Commun. Image Represent. 22(1), 73–84 (2011)MathSciNetCrossRef Lee, E.K., Ho, Y.S.: Generation of high-quality depth maps using hybrid camera system for 3-D video. J. Vis. Commun. Image Represent. 22(1), 73–84 (2011)MathSciNetCrossRef
9.
Zurück zum Zitat Kang, Y.S., Ho, Y.S.: Generation of multi-view images using stereo and time-of-flight depth cameras. In: International Conference on Embedded Systems and Intelligent Technology, pp. 104–107 (2013) Kang, Y.S., Ho, Y.S.: Generation of multi-view images using stereo and time-of-flight depth cameras. In: International Conference on Embedded Systems and Intelligent Technology, pp. 104–107 (2013)
10.
Zurück zum Zitat Hirschmuller, H., Innocent, P.R., Garibaldi, J.M.: Real-time correlation-based stereo vision with reduced border errors. Int. J. Comput. Vis. 47(1/2/3), 229–246 (2002)CrossRefMATH Hirschmuller, H., Innocent, P.R., Garibaldi, J.M.: Real-time correlation-based stereo vision with reduced border errors. Int. J. Comput. Vis. 47(1/2/3), 229–246 (2002)CrossRefMATH
11.
Zurück zum Zitat Veksler, O.: Fast variable window for stereo correspondence using integral images. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. 1, 556–561 (2003) Veksler, O.: Fast variable window for stereo correspondence using integral images. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. 1, 556–561 (2003)
12.
Zurück zum Zitat Sun, J., Zheng, N.N., Shum, H.Y.: Stereo matching using belief propagation. IEEE Trans. Pattern Anal. Mach. Intell. 25(7), 787–800 (2003)CrossRefMATH Sun, J., Zheng, N.N., Shum, H.Y.: Stereo matching using belief propagation. IEEE Trans. Pattern Anal. Mach. Intell. 25(7), 787–800 (2003)CrossRefMATH
13.
Zurück zum Zitat Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)CrossRef Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)CrossRef
14.
Zurück zum Zitat Yang, Q., Wang, L., Ahuja, N.: A constant-space belief propagation algorithm for stereo matching. In: Computer Vision and Pattern Recognition, pp. 1458–1465 (2010) Yang, Q., Wang, L., Ahuja, N.: A constant-space belief propagation algorithm for stereo matching. In: Computer Vision and Pattern Recognition, pp. 1458–1465 (2010)
15.
Zurück zum Zitat Kang, Y.S., Ho, Y.S.: High-quality multi-view depth generation using multiple color and depth cameras. In: International Workshop on Hot Topics in 3D, pp. 1405–1408 (2010) Kang, Y.S., Ho, Y.S.: High-quality multi-view depth generation using multiple color and depth cameras. In: International Workshop on Hot Topics in 3D, pp. 1405–1408 (2010)
16.
Zurück zum Zitat Yang, Q., Engels, C., Akbarzadeh, A.: Near real-time stereo for weakly-textured scenes. In: British Machine Vision Conference, pp. 80–87 (2008) Yang, Q., Engels, C., Akbarzadeh, A.: Near real-time stereo for weakly-textured scenes. In: British Machine Vision Conference, pp. 80–87 (2008)
Metadaten
Titel
Efficient Disparity Map Generation Using Stereo and Time-of-Flight Depth Cameras
verfasst von
Woo-Seok Jang
Yo-Sung Ho
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24078-7_64

Neuer Inhalt