Skip to main content

2018 | OriginalPaper | Buchkapitel

Evaluation of Combined Time-Offset Estimation and Hand-Eye Calibration on Robotic Datasets

verfasst von : Fadri Furrer, Marius Fehr, Tonci Novkovic, Hannes Sommer, Igor Gilitschenski, Roland Siegwart

Erschienen in: Field and Service Robotics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Using multiple sensors often requires the knowledge of static transformations between those sensors. If these transformations are unknown, hand-eye calibration is used to obtain them. Additionally, sensors are often unsynchronized, thus requiring time-alignment of measurements. This alignment can further be hindered by having sensors that fail at providing useful data over a certain time period. We present an end-to-end calibration framework to solve the hand-eye calibration. After an initial time-alignment step, we use the time-aligned pose estimates to perform the static transformation estimation based on different prefiltering methods, which are robust to outliers. In a final step, we employ a non-linear optimization to locally refine the calibration and time-alignment. Successful application of this estimation framework is demonstrated on multiple robotic systems with different sensor configurations. This framework is released as open source software together with the datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
For intrinsic camera calibration, the Kalibr framework (https://​github.​com/​ethz-asl/​kalibr) was used and we refer the reader to [7, 8, 16] for more details.
 
3
Traditional B-splines in parameter space are not equivariant with respect to transformations of the world and body frame. Therefore, for a given trajectory the local expressiveness of such a representation typically depends on where the trajectory is in that segment. Furthermore, they can go through ambiguous or unstable regions of the parameter space. The Lie-group valued B-splines we use are bi-equivariant [22] and are neither locally ambiguous nor unstable.
 
4
This is equivalent to least squares with a Cauchy loss function.
 
5
Approximated with zero-mean Cauchy distributions in the Lie algebra projected to SO(3) using the exponential map.
 
6
For absolute \(d_E, d_H\) the corresponding first measurements, \(i = 1\), are assumed to be dummy variables while the real measurements start with \(i=2\).
 
Literatur
1.
Zurück zum Zitat Ackerman, M.K., Cheng, A., Shiffman, B., Boctor, E., Chirikjian, G.: Sensor calibration with unknown correspondence: solving AX \(=\) XB using euclidean-group invariants. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1308–1313 (2013) Ackerman, M.K., Cheng, A., Shiffman, B., Boctor, E., Chirikjian, G.: Sensor calibration with unknown correspondence: solving AX \(=\) XB using euclidean-group invariants. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1308–1313 (2013)
2.
Zurück zum Zitat Andreff, N., Horaud, R., Espiau, B.: Robot hand-eye calibration using structure-from-motion. Int. J. Robot. Res. 20(3), 228–248 (2001)CrossRef Andreff, N., Horaud, R., Espiau, B.: Robot hand-eye calibration using structure-from-motion. Int. J. Robot. Res. 20(3), 228–248 (2001)CrossRef
3.
Zurück zum Zitat Chou, J.C.K., Kamel, M.: Finding the position and orientation of a sensor on a robot manipulator using quaternions. Int. J. Robot. Res. 10(3), 240–254 (1991)CrossRef Chou, J.C.K., Kamel, M.: Finding the position and orientation of a sensor on a robot manipulator using quaternions. Int. J. Robot. Res. 10(3), 240–254 (1991)CrossRef
4.
5.
Zurück zum Zitat English, A., Ross, P., Ball, D., Upcroft, B., Corke, P.: Triggersync: A time synchronisation tool. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 6220–6226. IEEE (2015) English, A., Ross, P., Ball, D., Upcroft, B., Corke, P.: Triggersync: A time synchronisation tool. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 6220–6226. IEEE (2015)
6.
Zurück zum Zitat Fassi, I., Legnani, G.: Hand to sensor calibration: a geometrical interpretation of the matrix equation AX = XB. J. Robot. Syst. 22(9), 497–506 (2005)CrossRefMATH Fassi, I., Legnani, G.: Hand to sensor calibration: a geometrical interpretation of the matrix equation AX = XB. J. Robot. Syst. 22(9), 497–506 (2005)CrossRefMATH
7.
Zurück zum Zitat Furgale, P., Barfoot, T.D., Sibley, G.: Continuous-time batch estimation using temporal basis functions. In: 2012 IEEE International Conference on Robotics and Automation, pp. 2088–2095 (2012) Furgale, P., Barfoot, T.D., Sibley, G.: Continuous-time batch estimation using temporal basis functions. In: 2012 IEEE International Conference on Robotics and Automation, pp. 2088–2095 (2012)
8.
Zurück zum Zitat Furgale, P., Rehder, J., Siegwart, R.: Unified temporal and spatial calibration for multi-sensor systems. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1280–1286 (2013) Furgale, P., Rehder, J., Siegwart, R.: Unified temporal and spatial calibration for multi-sensor systems. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1280–1286 (2013)
9.
Zurück zum Zitat Furgale, P., Tong, C.H., Barfoot, T.D., Sibley, G.: Continuous-time batch trajectory estimation using temporal basis functions. Int. J. Robot. Res. 34(14), 1688–1710 (2015)CrossRef Furgale, P., Tong, C.H., Barfoot, T.D., Sibley, G.: Continuous-time batch trajectory estimation using temporal basis functions. Int. J. Robot. Res. 34(14), 1688–1710 (2015)CrossRef
10.
Zurück zum Zitat Google. ATAP Project Tango Google (2014) Google. ATAP Project Tango Google (2014)
11.
Zurück zum Zitat Harrison, A., Newman, P.: Ticsync: Knowing when things happened. In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 356–363. IEEE (2011) Harrison, A., Newman, P.: Ticsync: Knowing when things happened. In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 356–363. IEEE (2011)
12.
Zurück zum Zitat Heller, J., Havlena, M., Sugimoto, A., Pajdla, T.: Structure-from-motion based hand-eye calibration using l minimization. In: 2011 Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3497–3503 (2011) Heller, J., Havlena, M., Sugimoto, A., Pajdla, T.: Structure-from-motion based hand-eye calibration using l minimization. In: 2011 Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3497–3503 (2011)
13.
Zurück zum Zitat Horaud, R., Dornaika, F.: Hand-eye calibration. Int. J. Robot. Res. 14(3), 195–210 (1995)CrossRef Horaud, R., Dornaika, F.: Hand-eye calibration. Int. J. Robot. Res. 14(3), 195–210 (1995)CrossRef
14.
Zurück zum Zitat Kelly, J., Sukhatme, G.S.: A general framework for temporal calibration of multiple proprioceptive and exteroceptive sensors. In: Experimental Robotics, pp. 195–209. Springer (2014) Kelly, J., Sukhatme, G.S.: A general framework for temporal calibration of multiple proprioceptive and exteroceptive sensors. In: Experimental Robotics, pp. 195–209. Springer (2014)
15.
Zurück zum Zitat Koenig, N., Howard, A.: Design and use paradigms for gazebo, an open-source multi-robot simulator. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), vol. 3, pp. 2149–2154 (2004) Koenig, N., Howard, A.: Design and use paradigms for gazebo, an open-source multi-robot simulator. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), vol. 3, pp. 2149–2154 (2004)
16.
Zurück zum Zitat Maye, J., Furgale, P., Siegwart, R.: Self-supervised calibration for robotic systems. In: 2013 IEEE Intelligent Vehicles Symposium (IV), pp. 473–480 (2013) Maye, J., Furgale, P., Siegwart, R.: Self-supervised calibration for robotic systems. In: 2013 IEEE Intelligent Vehicles Symposium (IV), pp. 473–480 (2013)
17.
Zurück zum Zitat Olson, E.: Apriltag: A robust and flexible visual fiducial system. In: 2011 IEEE International Conference on Robotics and Automation, pp. 3400–3407 (2011) Olson, E.: Apriltag: A robust and flexible visual fiducial system. In: 2011 IEEE International Conference on Robotics and Automation, pp. 3400–3407 (2011)
18.
Zurück zum Zitat Park, F.C., Martin, B.J.: Robot sensor calibration: solving AX = XB on the Euclidean Group. IEEE Trans. Robot. Autom. 10(5), 717–721 (1994)CrossRef Park, F.C., Martin, B.J.: Robot sensor calibration: solving AX = XB on the Euclidean Group. IEEE Trans. Robot. Autom. 10(5), 717–721 (1994)CrossRef
19.
Zurück zum Zitat Rehder, J., Siegwart, R., Furgale, P.: A general approach to spatiotemporal calibration in multisensor systems. IEEE Trans. Robot. 32(2), 383–398 (2016)CrossRef Rehder, J., Siegwart, R., Furgale, P.: A general approach to spatiotemporal calibration in multisensor systems. IEEE Trans. Robot. 32(2), 383–398 (2016)CrossRef
20.
Zurück zum Zitat Schmidt, J., Vogt, F., Niemann, H.: Robust hand eye calibration of an endoscopic surgery robot using dual quaternions. In: Vision, Modeling, and Visualization, pp. 21–28 (2004) Schmidt, J., Vogt, F., Niemann, H.: Robust hand eye calibration of an endoscopic surgery robot using dual quaternions. In: Vision, Modeling, and Visualization, pp. 21–28 (2004)
21.
Zurück zum Zitat Shiu, Y.C., Ahmad, S.: Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX \(=\) XB. IEEE Trans. Robot. Autom. 5(1), 16–29 (1989)CrossRef Shiu, Y.C., Ahmad, S.: Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX \(=\) XB. IEEE Trans. Robot. Autom. 5(1), 16–29 (1989)CrossRef
22.
Zurück zum Zitat Sommer, H., Forbes, J.R., Siegwart, R., Furgale, P.: Continuous-time estimation of attitude using b-splines on lie groups. J. Guid. Control Dyn. (2015) Sommer, H., Forbes, J.R., Siegwart, R., Furgale, P.: Continuous-time estimation of attitude using b-splines on lie groups. J. Guid. Control Dyn. (2015)
23.
Zurück zum Zitat Strobl, K.H., Hirzinger, G.: Optimal hand-eye calibration. In: 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4647–4653. IEEE (2006) Strobl, K.H., Hirzinger, G.: Optimal hand-eye calibration. In: 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4647–4653. IEEE (2006)
24.
Zurück zum Zitat Taylor, Z., Nieto, J.: Motion-based calibration of multimodal sensor extrinsics and timing offset estimation. IEEE Trans. Robot. 32(5), 1215–1229 (2016)CrossRef Taylor, Z., Nieto, J.: Motion-based calibration of multimodal sensor extrinsics and timing offset estimation. IEEE Trans. Robot. 32(5), 1215–1229 (2016)CrossRef
25.
Zurück zum Zitat Tsai, R.Y., Lenz, R.K.: A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Trans. Robot. Autom. 5(3), 345–358 (1989)CrossRef Tsai, R.Y., Lenz, R.K.: A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Trans. Robot. Autom. 5(3), 345–358 (1989)CrossRef
26.
Zurück zum Zitat Wang, C.-C.: Extrinsic calibration of a vision sensor mounted on a robot. IEEE Trans. Robot. Autom. 8(2), 161–175 (1992)CrossRefMathSciNet Wang, C.-C.: Extrinsic calibration of a vision sensor mounted on a robot. IEEE Trans. Robot. Autom. 8(2), 161–175 (1992)CrossRefMathSciNet
Metadaten
Titel
Evaluation of Combined Time-Offset Estimation and Hand-Eye Calibration on Robotic Datasets
verfasst von
Fadri Furrer
Marius Fehr
Tonci Novkovic
Hannes Sommer
Igor Gilitschenski
Roland Siegwart
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-67361-5_10

Neuer Inhalt