Skip to main content

2015 | OriginalPaper | Buchkapitel

On Calibration and Alignment of Point Clouds in a Network of RGB-D Sensors for Tracking

verfasst von : George Xu, Shahram Payandeh

Erschienen in: Advances in Visual Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper investigates the integration of multiple time-of-flight (ToF) depth sensors for the purposes of general 3D tracking and specifically of the hands. The advantage of using a network with multiple sensors is in the increased viewing coverage as well as being able to capture a more complete 3D point cloud representation of the object. Given an ideal point cloud representation, tracking can be accomplished without having to first reconstruct a mesh representation of the object. In utilizing a network of depth sensors, calibration between the sensors and the subsequent data alignment of the point clouds poses key challenges. While there has been research on the merging and alignment of scenes with larger objects such as the human body, there is little research available focusing on a smaller and more complicated object such as the human hand. This paper presents a study on ways to merge and align the point clouds from a network of sensors for object and feature tracking from the combined point clouds.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Efficient model-based 3d tracking of hand articulations using kinect. In: Proceedings of the 2011 British Machine Vision Conference, pp. 101.1–101.11 (2011) Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Efficient model-based 3d tracking of hand articulations using kinect. In: Proceedings of the 2011 British Machine Vision Conference, pp. 101.1–101.11 (2011)
2.
Zurück zum Zitat Kıraç, F., Kara, Y.E., Akarun, L.: Hierarchically constrained 3D hand pose estimation using regression forests from single frame depth data. Pattern Recogn. Lett. Spec. Issue Depth Image Anal. (2013) Kıraç, F., Kara, Y.E., Akarun, L.: Hierarchically constrained 3D hand pose estimation using regression forests from single frame depth data. Pattern Recogn. Lett. Spec. Issue Depth Image Anal. (2013)
3.
Zurück zum Zitat Baak, A., Müller, M., Bharaj, G., Seidel, H.-P., Theobalt, C.: A data-driven approach for real-time full body pose reconstruction from a depth camera. In: Proceedings of the 2011 IEEE International Conference on Computer Vision, pp. 1092–1099 (2011) Baak, A., Müller, M., Bharaj, G., Seidel, H.-P., Theobalt, C.: A data-driven approach for real-time full body pose reconstruction from a depth camera. In: Proceedings of the 2011 IEEE International Conference on Computer Vision, pp. 1092–1099 (2011)
4.
Zurück zum Zitat Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. Comput. Vis. Image Underst. (CVIU) 110(3), 346–359 (2008)CrossRef Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. Comput. Vis. Image Underst. (CVIU) 110(3), 346–359 (2008)CrossRef
5.
Zurück zum Zitat Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Proceedings of the 2005 IEEE International Conference on Computer Vision, pp. 1508–1515 (2010) Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Proceedings of the 2005 IEEE International Conference on Computer Vision, pp. 1508–1515 (2010)
6.
Zurück zum Zitat Newcombe, R., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A., Kohli, P., Shotton, J., Hodges, S., Fitzgibbon, A.: KinectFusion: real-time dense surface mapping and tracking. In: Proceedings of the 2011 International Symposium on Mixed and Augmented Reality, pp. 127–136 (2011) Newcombe, R., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A., Kohli, P., Shotton, J., Hodges, S., Fitzgibbon, A.: KinectFusion: real-time dense surface mapping and tracking. In: Proceedings of the 2011 International Symposium on Mixed and Augmented Reality, pp. 127–136 (2011)
7.
Zurück zum Zitat Newcombe, R., Davison, A.J.: Live dense reconstruction with a single moving camera. In: Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1498–1505 (2010) Newcombe, R., Davison, A.J.: Live dense reconstruction with a single moving camera. In: Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1498–1505 (2010)
8.
Zurück zum Zitat Tanskanen, P., Kolev, K., Meier, L., Camposeco, F., Saurer, O., Pollefeys, M.: Live metric 3D reconstruction on mobile phones. In: Proceedings of 2013 IEE International Conference on Computer Vision, pp. 65–72 (2013) Tanskanen, P., Kolev, K., Meier, L., Camposeco, F., Saurer, O., Pollefeys, M.: Live metric 3D reconstruction on mobile phones. In: Proceedings of 2013 IEE International Conference on Computer Vision, pp. 65–72 (2013)
9.
Zurück zum Zitat Marton, Z., Rusu, R., Beetz, M.: On fast surface reconstruction methods for large and noisy point clouds. In: Proceedings of 2009 IEEE International Conference on Robotics and Automation, pp. 3218–3233 (2009) Marton, Z., Rusu, R., Beetz, M.: On fast surface reconstruction methods for large and noisy point clouds. In: Proceedings of 2009 IEEE International Conference on Robotics and Automation, pp. 3218–3233 (2009)
11.
Zurück zum Zitat Berger, K., Ruhl, K., Brümmer, C., Schröder, Y., Scholz, A., Magnor, M.: Markerless motion capture using multiple color-depth sensors. In: Proceedings of the 2011 Vision, Modeling and Visualization, pp. 317–324 (2011) Berger, K., Ruhl, K., Brümmer, C., Schröder, Y., Scholz, A., Magnor, M.: Markerless motion capture using multiple color-depth sensors. In: Proceedings of the 2011 Vision, Modeling and Visualization, pp. 317–324 (2011)
12.
Zurück zum Zitat Xu, G., Payandeh, S.: Sensitivity study for object reconstruction using a network of time-of-flight depth sensors. In: Proceedings of the 2015 IEEE International Conference on Robotics and Automation (2015) Xu, G., Payandeh, S.: Sensitivity study for object reconstruction using a network of time-of-flight depth sensors. In: Proceedings of the 2015 IEEE International Conference on Robotics and Automation (2015)
13.
Zurück zum Zitat Kim, Y., Theobalt, C., Diebel, J., Kosecka, J., Miscusik, B., Thrun, S.: Multi-view Image and ToF sensor fusion for dense 3D reconstruction. In: Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops, pp. 1542–1549 (2009) Kim, Y., Theobalt, C., Diebel, J., Kosecka, J., Miscusik, B., Thrun, S.: Multi-view Image and ToF sensor fusion for dense 3D reconstruction. In: Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops, pp. 1542–1549 (2009)
14.
Zurück zum Zitat Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRef Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)CrossRef
15.
Zurück zum Zitat Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)CrossRefMathSciNet Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)CrossRefMathSciNet
17.
Zurück zum Zitat Agarwal, A., Jawahar, C.V., Narayanan, P.J.: A survey of planar homography estimation techniques. Technical Reports: International Institute of Information Technology Hyderabad (2005) Agarwal, A., Jawahar, C.V., Narayanan, P.J.: A survey of planar homography estimation techniques. Technical Reports: International Institute of Information Technology Hyderabad (2005)
18.
Zurück zum Zitat Kim, Y., Chan, D., Theobalt, C., Thrun, S.: Design and calibration of a multi-view TOF sensor fusion system. In: Proceedings of the 2009 IEEE Computer Vision and Pattern Recognition Workshops, pp. 1–7, June 2009 Kim, Y., Chan, D., Theobalt, C., Thrun, S.: Design and calibration of a multi-view TOF sensor fusion system. In: Proceedings of the 2009 IEEE Computer Vision and Pattern Recognition Workshops, pp. 1–7, June 2009
19.
Zurück zum Zitat Dhawan, A., Honrao, V.: Implementation of hand detection based techniques for human computer interaction. Int. J. Comput. Appl. 72(17), June 2013 Dhawan, A., Honrao, V.: Implementation of hand detection based techniques for human computer interaction. Int. J. Comput. Appl. 72(17), June 2013
20.
Zurück zum Zitat Rusu, R., Cousins, S.: 3D is here: point cloud library (PCL). In: Proceedings of the 2011 IEEE International Conference on Robotics and Automation, May 2011 Rusu, R., Cousins, S.: 3D is here: point cloud library (PCL). In: Proceedings of the 2011 IEEE International Conference on Robotics and Automation, May 2011
Metadaten
Titel
On Calibration and Alignment of Point Clouds in a Network of RGB-D Sensors for Tracking
verfasst von
George Xu
Shahram Payandeh
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-27863-6_52

Premium Partner