Skip to main content

2014 | OriginalPaper | Buchkapitel

3. Calibration Between Depth and Color Sensors for Commodity Depth Cameras

verfasst von : Cha Zhang, Zhengyou Zhang

Erschienen in: Computer Vision and Machine Learning with RGB-D Sensors

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Commodity depth cameras have created many interesting new applications in the research community recently. These applications often require the calibration information between the color and the depth cameras. Traditional checkerboard-based calibration schemes fail to work well for the depth camera, since its corner features cannot be reliably detected in the depth image. In this chapter, we present a maximum likelihood solution for the joint depth and color calibration based on two principles. First, in the depth image, points on the checkerboard shall be coplanar, and the plane is known from color camera calibration. Second, additional point correspondences between the depth and color images may be manually specified or automatically established to help improve calibration accuracy. Uncertainty in depth values has been taken into account systematically. The proposed algorithm is reliable and accurate, as demonstrated by extensive experimental results on simulated and real-world examples.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cui Y, Schuon S, Chan D, Thrun S, Theobalt C (2010) 3D shape scanning with a time-of-flight camera. In: CVPR Cui Y, Schuon S, Chan D, Thrun S, Theobalt C (2010) 3D shape scanning with a time-of-flight camera. In: CVPR
2.
Zurück zum Zitat Crabb R, Tracey C, Puranik A, Davis J (2008) Real-time foreground segmentation via range and color imaging. In: CVPR workshop on ToF-camera based computer vision Crabb R, Tracey C, Puranik A, Davis J (2008) Real-time foreground segmentation via range and color imaging. In: CVPR workshop on ToF-camera based computer vision
3.
Zurück zum Zitat Cai Q, Gallup D, Zhang C, Zhang Z (2010) 3D deformable face tracking with a commodity depth camera. In: ECCV Cai Q, Gallup D, Zhang C, Zhang Z (2010) 3D deformable face tracking with a commodity depth camera. In: ECCV
4.
Zurück zum Zitat Tsai R (1987) A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf tv cameras and lens. IEEE J Robot Autom RA–3(4):323–344CrossRef Tsai R (1987) A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf tv cameras and lens. IEEE J Robot Autom RA–3(4):323–344CrossRef
5.
Zurück zum Zitat Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef
6.
Zurück zum Zitat Kuhnert KD, Stommel M (2006) Fusion of stereo-camera and pmd-camera data for real-time suited precise 3D environment reconstruction. In: Intelligent robots and systems, 2006 IEEE/RSJ international conference on, IEEE, pp 4780–4785 Kuhnert KD, Stommel M (2006) Fusion of stereo-camera and pmd-camera data for real-time suited precise 3D environment reconstruction. In: Intelligent robots and systems, 2006 IEEE/RSJ international conference on, IEEE, pp 4780–4785
7.
Zurück zum Zitat Beder C, Koch R (2008) Calibration of focal length and 3d pose based on the reflectance and depth image of a planar object. Int J Intell Syst Technol Appl 5(3):285–294 Beder C, Koch R (2008) Calibration of focal length and 3d pose based on the reflectance and depth image of a planar object. Int J Intell Syst Technol Appl 5(3):285–294
8.
Zurück zum Zitat Fuchs S, Hirzinger G (2008) Extrinsic and depth calibration of tof-cameras. In: CVPR, IEEE, pp 1–6 Fuchs S, Hirzinger G (2008) Extrinsic and depth calibration of tof-cameras. In: CVPR, IEEE, pp 1–6
9.
Zurück zum Zitat Lindner M, Schiller I, Kolb A, Koch R (2010) Time-of-flight sensor calibration for accurate range sensing. Comput Vis Image Underst 114(12):1318–1328CrossRef Lindner M, Schiller I, Kolb A, Koch R (2010) Time-of-flight sensor calibration for accurate range sensing. Comput Vis Image Underst 114(12):1318–1328CrossRef
10.
Zurück zum Zitat Shim H, Adelsberger R, Kim JD, Rhee SM, Rhee T, Sim JY, Gross M, Kim C (2012) Time-of-flight sensor and color camera calibration for multi-view acquisition. Vis Comput 28(12):1139–1151CrossRef Shim H, Adelsberger R, Kim JD, Rhee SM, Rhee T, Sim JY, Gross M, Kim C (2012) Time-of-flight sensor and color camera calibration for multi-view acquisition. Vis Comput 28(12):1139–1151CrossRef
11.
Zurück zum Zitat Herrera D, Kannala J, Heikkilä J (2011) Accurate and practical calibration of a depth and color camera pair. In: Computer analysis of images and patterns, Springer, pp 437–445 Herrera D, Kannala J, Heikkilä J (2011) Accurate and practical calibration of a depth and color camera pair. In: Computer analysis of images and patterns, Springer, pp 437–445
12.
Zurück zum Zitat Zhang C, Zhang Z (2011) Calibration between depth and color sensors for commodity depth cameras. In: International workshop on hot topics in 3D, IEEE, pp 1–6 Zhang C, Zhang Z (2011) Calibration between depth and color sensors for commodity depth cameras. In: International workshop on hot topics in 3D, IEEE, pp 1–6
13.
Zurück zum Zitat Herrera C, Kannala J, Heikkilä J et al (2012) Joint depth and color camera calibration with distortion correction. Pattern Anal Mach Intell, IEEE Trans 34(10):2058–2064CrossRef Herrera C, Kannala J, Heikkilä J et al (2012) Joint depth and color camera calibration with distortion correction. Pattern Anal Mach Intell, IEEE Trans 34(10):2058–2064CrossRef
14.
Zurück zum Zitat Raposo C, Barreto JP, Nunes U (2013) Fast and accurate calibration of a kinect sensor. In: 3DTV-conference, 2013 international conference on, IEEE, pp 342–349 Raposo C, Barreto JP, Nunes U (2013) Fast and accurate calibration of a kinect sensor. In: 3DTV-conference, 2013 international conference on, IEEE, pp 342–349
15.
Zurück zum Zitat Liu W, Fan Y, Zhong Z, Lei T (2012) A new method for calibrating depth and color camera pair based on kinect. In: Audio, language and image processing (ICALIP), 2012 international conference on, IEEE, pp 212–217 Liu W, Fan Y, Zhong Z, Lei T (2012) A new method for calibrating depth and color camera pair based on kinect. In: Audio, language and image processing (ICALIP), 2012 international conference on, IEEE, pp 212–217
16.
Zurück zum Zitat Mikhelson IV, Lee PG, Sahakian AV, Wu Y, Katsaggelos AK (2014) Automatic, fast, online calibration between depth and color cameras. J Vis Commun Image Represent 25(1):218–226CrossRef Mikhelson IV, Lee PG, Sahakian AV, Wu Y, Katsaggelos AK (2014) Automatic, fast, online calibration between depth and color cameras. J Vis Commun Image Represent 25(1):218–226CrossRef
17.
Zurück zum Zitat More J (1978) The Levenberg-Marquardt algorithm: implementation and theory. Numerl Anal, Lect Notes Math 630(1978):105–116 More J (1978) The Levenberg-Marquardt algorithm: implementation and theory. Numerl Anal, Lect Notes Math 630(1978):105–116
18.
Zurück zum Zitat Arun K, Huang T, Blostein S (1987) Least-squares fitting of two 3-d point sets. IEEE Trans PAMI 9(5):698–700CrossRef Arun K, Huang T, Blostein S (1987) Least-squares fitting of two 3-d point sets. IEEE Trans PAMI 9(5):698–700CrossRef
19.
Zurück zum Zitat Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395CrossRefMathSciNet Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395CrossRefMathSciNet
20.
Zurück zum Zitat Yuan JS-C (1989) A general photogrammetric method for determining object position and orientation. IEEE Trans Robot Autom 5(2):129–142CrossRef Yuan JS-C (1989) A general photogrammetric method for determining object position and orientation. IEEE Trans Robot Autom 5(2):129–142CrossRef
21.
Zurück zum Zitat Dementhon D, Davis L (1995) Model-based object pose in 25 lines of code. Int J Comput Vis 15(1):123–141CrossRef Dementhon D, Davis L (1995) Model-based object pose in 25 lines of code. Int J Comput Vis 15(1):123–141CrossRef
Metadaten
Titel
Calibration Between Depth and Color Sensors for Commodity Depth Cameras
verfasst von
Cha Zhang
Zhengyou Zhang
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-08651-4_3