Skip to main content

2015 | OriginalPaper | Buchkapitel

Local 3D Pose Estimation of Feature Points Based on RGB-D Information for Object Based Augmented Reality

verfasst von : Daniel M. Tokunaga, Ricado Nakamura, João Bernardes, Edith Ranzini, Romero Tori

Erschienen in: Virtual, Augmented and Mixed Reality

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We here describe a novel approach for locally obtaining pose estimation of match feature points, observed using RGB-D cameras, in order to apply to locally planar object pose estimation with RANSAC method for augmented reality systems. Conventionally, object pose estimation based on RGB-D cameras are achieved by the correlation between observed 3D points captured by feature point matching and known 3D points of the object. However, in such methods, features are simplified as single 3D points, losing information of the feature and its neighborhood surface. This approach based on local 3D pose estimation of locally planar feature points, brings richer information for 3D pose estimation of planar, 3D rigid or deformable objects. This information enables more stable pose estimation across RANSAC settings than conventional three-points RANSAC methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lima, J., Uchiyama, H., Teichrieb, V., Marchand, E.: Texture-less planar object detection and pose estimation using depth-assisted rectification of contours. In: 2012 IEEE International Symposium on Mixed and Augmented Reality, ISMAR, pp. 297–298, November 2012 Lima, J., Uchiyama, H., Teichrieb, V., Marchand, E.: Texture-less planar object detection and pose estimation using depth-assisted rectification of contours. In: 2012 IEEE International Symposium on Mixed and Augmented Reality, ISMAR, pp. 297–298, November 2012
2.
Zurück zum Zitat Lowe, D.: Object recognition from local scale-invariant features. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999) Lowe, D.: Object recognition from local scale-invariant features. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999)
3.
Zurück zum Zitat Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRef Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRef
4.
Zurück zum Zitat Henry, P., Krainin, M., Herbst, E., Ren, X., Fox, D.: Rgb-d mapping: using kinect-style depth cameras for dense 3d modeling of indoor environments. Int. J. Rob. Res. 31(5), 647–663 (2012)CrossRef Henry, P., Krainin, M., Herbst, E., Ren, X., Fox, D.: Rgb-d mapping: using kinect-style depth cameras for dense 3d modeling of indoor environments. Int. J. Rob. Res. 31(5), 647–663 (2012)CrossRef
5.
Zurück zum Zitat Lepetit, V., Moreno-Noguer, F., Fua, P.: Epnp: an accurate o(n) solution to the pnp problem. Int. J. Comput. Vision 81(2), 155–166 (2009)CrossRef Lepetit, V., Moreno-Noguer, F., Fua, P.: Epnp: an accurate o(n) solution to the pnp problem. Int. J. Comput. Vision 81(2), 155–166 (2009)CrossRef
6.
Zurück zum Zitat Pritchard, D., Heidrich, W.: Cloth motion capture. Comput. Graph. Forum 22(3), 263–271 (2003)CrossRef Pritchard, D., Heidrich, W.: Cloth motion capture. Comput. Graph. Forum 22(3), 263–271 (2003)CrossRef
7.
Zurück zum Zitat Marcon, M., Frigerio, E., Sarti, A., Tubaro, S.: 3D correspondences in textured depth-maps through planar similarity transform. In: 2012 IEEE International Conference on Emerging Signal Processing Applications, ESPA, pp. 17–20 January 2012 Marcon, M., Frigerio, E., Sarti, A., Tubaro, S.: 3D correspondences in textured depth-maps through planar similarity transform. In: 2012 IEEE International Conference on Emerging Signal Processing Applications, ESPA, pp. 17–20 January 2012
8.
Zurück zum Zitat Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)MathSciNetCrossRef Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)MathSciNetCrossRef
9.
Zurück zum Zitat Xiang, Y., Mottaghi, R., Savarese, S.: Beyond pascal: a benchmark for 3d object detection in the wild. In: IEEE Winter Conference on Applications of Computer Vision, WACV (2014) Xiang, Y., Mottaghi, R., Savarese, S.: Beyond pascal: a benchmark for 3d object detection in the wild. In: IEEE Winter Conference on Applications of Computer Vision, WACV (2014)
10.
Zurück zum Zitat Lee, W., Park, N., Woo, W.: Depth-assisted real-time 3d object detection for augmented reality. In: International Conference on Artificial Reality and Telexistence, ICAT (2011) Lee, W., Park, N., Woo, W.: Depth-assisted real-time 3d object detection for augmented reality. In: International Conference on Artificial Reality and Telexistence, ICAT (2011)
11.
Zurück zum Zitat Choi, C., Christensen, H.: 3D pose estimation of daily objects using an rgb-d camera. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 3342–3349, October 2012 Choi, C., Christensen, H.: 3D pose estimation of daily objects using an rgb-d camera. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 3342–3349, October 2012
12.
Zurück zum Zitat Jordt, A., Koch, R.: Direct model-based tracking of 3d object deformations in depth and color video. Int. J. Comput. Vision 102(1–3), 239–255 (2013)MathSciNetCrossRef Jordt, A., Koch, R.: Direct model-based tracking of 3d object deformations in depth and color video. Int. J. Comput. Vision 102(1–3), 239–255 (2013)MathSciNetCrossRef
13.
Zurück zum Zitat Lee, K.R., Nguyen, T.: Robust tracking and mapping with a handheld rgb-d camera. In: 2014 IEEE Winter Conference on Applications of Computer Vision, WACV, pp. 1120–1127, March 2014 Lee, K.R., Nguyen, T.: Robust tracking and mapping with a handheld rgb-d camera. In: 2014 IEEE Winter Conference on Applications of Computer Vision, WACV, pp. 1120–1127, March 2014
14.
Zurück zum Zitat Park, Y., Lepetit, V., Woo, W.: Texture-less object tracking with online training using an rgb-d camera. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR, pp. 121–126, October 2011 Park, Y., Lepetit, V., Woo, W.: Texture-less object tracking with online training using an rgb-d camera. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR, pp. 121–126, October 2011
15.
Zurück zum Zitat Taguchi, Y., Jian, Y.D., Ramalingam, S., Feng, C.: Point-plane slam for hand-held 3d sensors. In: 2013 IEEE International Conference on Robotics and Automation, ICRA, pp. 5182–5189, May 2013 Taguchi, Y., Jian, Y.D., Ramalingam, S., Feng, C.: Point-plane slam for hand-held 3d sensors. In: 2013 IEEE International Conference on Robotics and Automation, ICRA, pp. 5182–5189, May 2013
16.
Zurück zum Zitat Morel, J.M., Yu, G.: Asift: a new framework for fully affine invariant image comparison. SIAM J. Img. Sci. 2(2), 438–469 (2009)MathSciNetCrossRefMATH Morel, J.M., Yu, G.: Asift: a new framework for fully affine invariant image comparison. SIAM J. Img. Sci. 2(2), 438–469 (2009)MathSciNetCrossRefMATH
17.
Zurück zum Zitat Horn, B.K.P.: Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4(4), 629–642 (1987)MathSciNetCrossRef Horn, B.K.P.: Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4(4), 629–642 (1987)MathSciNetCrossRef
18.
Zurück zum Zitat Pilet, J., Lepetit, V., Fua, P.: Fast non-rigid surface detection, registration and realistic augmentation. Int. J. Comput. Vision 76(2), 109–122 (2008)CrossRef Pilet, J., Lepetit, V., Fua, P.: Fast non-rigid surface detection, registration and realistic augmentation. Int. J. Comput. Vision 76(2), 109–122 (2008)CrossRef
19.
Zurück zum Zitat Rendl, C., Kim, D., Fanello, S., Parzer, P., Rhemann, C., Taylor, J., Zirkl, M., Scheipl, G., Rothländer, T., Haller, M., Izadi, S.: Flexsense: a transparent self-sensing deformable surface. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. UIST 2014, pp. 129–138. ACM, New York, NY, USA (2014) Rendl, C., Kim, D., Fanello, S., Parzer, P., Rhemann, C., Taylor, J., Zirkl, M., Scheipl, G., Rothländer, T., Haller, M., Izadi, S.: Flexsense: a transparent self-sensing deformable surface. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. UIST 2014, pp. 129–138. ACM, New York, NY, USA (2014)
Metadaten
Titel
Local 3D Pose Estimation of Feature Points Based on RGB-D Information for Object Based Augmented Reality
verfasst von
Daniel M. Tokunaga
Ricado Nakamura
João Bernardes
Edith Ranzini
Romero Tori
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-21067-4_15

Neuer Inhalt