Skip to main content
Top

2014 | OriginalPaper | Chapter

High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth

Authors : Daniel Scharstein, Heiko Hirschmüller, York Kitajima, Greg Krathwohl, Nera Nešić, Xi Wang, Porter Westling

Published in: Pattern Recognition

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present a structured lighting system for creating high-resolution stereo datasets of static indoor scenes with highly accurate ground-truth disparities. The system includes novel techniques for efficient 2D subpixel correspondence search and self-calibration of cameras and projectors with modeling of lens distortion. Combining disparity estimates from multiple projector positions we are able to achieve a disparity accuracy of 0.2 pixels on most observed surfaces, including in half-occluded regions. We contribute 33 new 6-megapixel datasets obtained with our system and demonstrate that they present new challenges for the next generation of stereo algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Batlle, J., Mouaddib, E., Salvi, J.: Recent progress in coded structured light as a technique to solve the correspondence problem: a survey. Pat. Rec. 31(7), 963–982 (1998)CrossRef Batlle, J., Mouaddib, E., Salvi, J.: Recent progress in coded structured light as a technique to solve the correspondence problem: a survey. Pat. Rec. 31(7), 963–982 (1998)CrossRef
4.
go back to reference Besl, P.: Active optical range imaging sensors. MV&A 1(2), 127–152 (1988) Besl, P.: Active optical range imaging sensors. MV&A 1(2), 127–152 (1988)
5.
go back to reference Brown, M., Burschka, D., Hager, G.: Advances in computational stereo. TPAMI 25(8), 993–1008 (2003)CrossRef Brown, M., Burschka, D., Hager, G.: Advances in computational stereo. TPAMI 25(8), 993–1008 (2003)CrossRef
6.
go back to reference Davis, J., Nehab, D., Ramamoorthi, R., Rusinkiewicz, S.: Spacetime stereo: a unifying framework for depth from triangulation. TPAMI 27(2), 296–302 (2005)CrossRef Davis, J., Nehab, D., Ramamoorthi, R., Rusinkiewicz, S.: Spacetime stereo: a unifying framework for depth from triangulation. TPAMI 27(2), 296–302 (2005)CrossRef
7.
go back to reference Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: CVPR, pp. 3354–3361 (2012) Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: CVPR, pp. 3354–3361 (2012)
8.
go back to reference Geiger, A., Roser, M., Urtasun, R.: Efficient large-scale stereo matching. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part I. LNCS, vol. 6492, pp. 25–38. Springer, Heidelberg (2011)CrossRef Geiger, A., Roser, M., Urtasun, R.: Efficient large-scale stereo matching. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part I. LNCS, vol. 6492, pp. 25–38. Springer, Heidelberg (2011)CrossRef
9.
go back to reference Gupta, M., Agrawal, A., Veeraraghavan, A., Narasimhan, S.: A practical approach to 3D scanning in the presence of interreflections, subsurface scattering and defocus. IJCV 102(1–3), 33–55 (2013)CrossRef Gupta, M., Agrawal, A., Veeraraghavan, A., Narasimhan, S.: A practical approach to 3D scanning in the presence of interreflections, subsurface scattering and defocus. IJCV 102(1–3), 33–55 (2013)CrossRef
10.
go back to reference Gupta, M., Nayar, S.: Micro phase shifting. In: CVPR, pp. 813–820 (2012) Gupta, M., Nayar, S.: Micro phase shifting. In: CVPR, pp. 813–820 (2012)
11.
go back to reference Hansen, P., Alismail, H., Rander, P., Browning, B.: Online continuous stereo extrinsic parameter estimation. In: CVPR, pp. 1059–1066 (2012) Hansen, P., Alismail, H., Rander, P., Browning, B.: Online continuous stereo extrinsic parameter estimation. In: CVPR, pp. 1059–1066 (2012)
12.
go back to reference Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)MATH Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)MATH
13.
go back to reference Hirschmüller, H., Gehrig, S.: Stereo matching in the presence of sub-pixel calibration errors. In: CVPR, pp. 437–444 (2009) Hirschmüller, H., Gehrig, S.: Stereo matching in the presence of sub-pixel calibration errors. In: CVPR, pp. 437–444 (2009)
14.
go back to reference Hirschmüller, H., Scharstein, D.: Evaluation of stereo matching costs on images with radiometric differences. TPAMI 31(9), 1582–1599 (2009)CrossRef Hirschmüller, H., Scharstein, D.: Evaluation of stereo matching costs on images with radiometric differences. TPAMI 31(9), 1582–1599 (2009)CrossRef
15.
go back to reference Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. TPAMI 30(2), 328–341 (2008)CrossRef Hirschmüller, H.: Stereo processing by semiglobal matching and mutual information. TPAMI 30(2), 328–341 (2008)CrossRef
16.
go back to reference Hirschmüller, H., Innocent, P., Garibaldi, J.: Real-time correlation-based stereo vision with reduced border errors. IJCV 47(1–3), 229–246 (2002)CrossRefMATH Hirschmüller, H., Innocent, P., Garibaldi, J.: Real-time correlation-based stereo vision with reduced border errors. IJCV 47(1–3), 229–246 (2002)CrossRefMATH
17.
go back to reference Hosni, A., Bleyer, M., Gelautz, M.: Secrets of adaptive support weight techniques for local stereo matching. CVIU 117(6), 620–632 (2013) Hosni, A., Bleyer, M., Gelautz, M.: Secrets of adaptive support weight techniques for local stereo matching. CVIU 117(6), 620–632 (2013)
18.
go back to reference Hu, X., Mordohai, P.: A quantitative evaluation of confidence measures for stereo vision. TPAMI 34(11), 2121–2133 (2012)CrossRef Hu, X., Mordohai, P.: A quantitative evaluation of confidence measures for stereo vision. TPAMI 34(11), 2121–2133 (2012)CrossRef
19.
go back to reference Izadi, S., et al.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: ACM UIST, pp. 559–568 (2011) Izadi, S., et al.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: ACM UIST, pp. 559–568 (2011)
20.
go back to reference Lazaros, N., Sirakoulis, G., Gasteratos, A.: Review of stereo vision algorithms: from software to hardware. J. Optomechatron. 2(4), 435–462 (2008)CrossRef Lazaros, N., Sirakoulis, G., Gasteratos, A.: Review of stereo vision algorithms: from software to hardware. J. Optomechatron. 2(4), 435–462 (2008)CrossRef
21.
go back to reference Levoy, M., et al.: The digital Michelangelo project: 3D scanning of large statues. In: SIGGRAPH, pp. 131–144 (2000) Levoy, M., et al.: The digital Michelangelo project: 3D scanning of large statues. In: SIGGRAPH, pp. 131–144 (2000)
24.
go back to reference Nakamura, Y., Matsuura, T., Satoh, K., Ohta, Y.: Occlusion detectable stereo - occlusion patterns in camera matrix. In: CVPR, pp. 371–378 (1996) Nakamura, Y., Matsuura, T., Satoh, K., Ohta, Y.: Occlusion detectable stereo - occlusion patterns in camera matrix. In: CVPR, pp. 371–378 (1996)
25.
go back to reference Posdamer, J., Altschuler, M.: Surface measurement by space-encoded projected beam systems. CGIP 18(1), 1–17 (1982) Posdamer, J., Altschuler, M.: Surface measurement by space-encoded projected beam systems. CGIP 18(1), 1–17 (1982)
26.
go back to reference Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry. Pat. Rec. 43(8), 2666–2680 (2010)CrossRefMATH Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry. Pat. Rec. 43(8), 2666–2680 (2010)CrossRefMATH
28.
go back to reference Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. IJCV 47(1–3), 7–42 (2002)CrossRefMATH Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. IJCV 47(1–3), 7–42 (2002)CrossRefMATH
29.
go back to reference Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light. In: CVPR, vol. I, pp. 195–202 (2003) Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light. In: CVPR, vol. I, pp. 195–202 (2003)
30.
go back to reference Seitz, S., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: CVPR, vol. 1, pp. 519–528 (2006) Seitz, S., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: CVPR, vol. 1, pp. 519–528 (2006)
31.
go back to reference Strecha, C., von Hansen, W., Van Gool, L., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: CVPR, pp. 1–8 (2008) Strecha, C., von Hansen, W., Van Gool, L., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: CVPR, pp. 1–8 (2008)
32.
go back to reference Will, P., Pennington, K.: Grid coding: A preprocessing technique for robot and machine vision. In: IJCAI, pp. 66–70 (1971) Will, P., Pennington, K.: Grid coding: A preprocessing technique for robot and machine vision. In: IJCAI, pp. 66–70 (1971)
33.
go back to reference Zabih, R., Woodfill, J.: Non-parametric local transforms for computing visual correspondence. In: ECCV, pp. 151–158 (1994) Zabih, R., Woodfill, J.: Non-parametric local transforms for computing visual correspondence. In: ECCV, pp. 151–158 (1994)
34.
go back to reference Zhang, L., Curless, B., Seitz, S.: Spacetime stereo: shape recovery for dynamic scenes. In: CVPR, vol. II, pp. 367–374 (2003) Zhang, L., Curless, B., Seitz, S.: Spacetime stereo: shape recovery for dynamic scenes. In: CVPR, vol. II, pp. 367–374 (2003)
Metadata
Title
High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth
Authors
Daniel Scharstein
Heiko Hirschmüller
York Kitajima
Greg Krathwohl
Nera Nešić
Xi Wang
Porter Westling
Copyright Year
2014
DOI
https://doi.org/10.1007/978-3-319-11752-2_3

Premium Partner