Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Erschienen in:
Shift-Net: Image Inpainting via Deep Feature Rearrangement Kapitel lesen Erstes Kapitel lesen

2018 | OriginalPaper | Buchkapitel

Joint 3D Tracking of a Deformable Object in Interaction with a Hand

verfasst von : Aggeliki Tsoli, Antonis A. Argyros

Erschienen in: Computer Vision – ECCV 2018

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present a novel method that is able to track a complex deformable object in interaction with a hand. This is achieved by formulating and solving an optimization problem that jointly considers the hand, the deformable object and the hand/object contact points. The optimization evaluates several hand/object contact configuration hypotheses and adopts the one that results in the best fit of the object’s model to the available RGBD observations in the vicinity of the hand. Thus, the hand is not treated as a distractor that occludes parts of the deformable object, but as a source of valuable information. Experimental results on a dataset that has been developed specifically for this new problem illustrate the superior performance of the proposed approach against relevant, state of the art solutions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Vorheriges Kapitel Semantically Aware Urban 3D Reconstruction with Plane-Based Regularization
Nächstes Kapitel HBE: Hand Branch Ensemble Network for Real-Time 3D Hand Pose Estimation
Fußnoten
3
Original implementation provided by the authors of [41] and modified to consider an occlusion mask.
 
Literatur
1.
Albrecht, I., Haber, J., Seidel, H.P.: Construction and animation of anatomically based human hand models. In: Eurographics Symposium on Computer Animation, p. 109. Eurographics Association (2003)
2.
3.
Bartoli, A., Gerard, Y., Chadebecq, F., Collins, T., Pizarro, D.: Shape-from-template. IEEE Trans. Patt. Anal. Mach. Intell. 37(10), 2099–2118 (2015)CrossRef
4.
5.
Crivellaro, A., Lepetit, V.: Robust 3D tracking with descriptor fields. In: Conference on Computer Vision and Pattern Recognition (CVPR), No. EPFL-CONF-198219 (2014)
6.
Garg, R., Roussos, A., Agapito, L.: A variational approach to video registration with subspace constraints. Int. J. Comput. Vis. 104(3), 286–314 (2013)MathSciNetCrossRef
7.
Ge, L., Liang, H., Yuan, J., Thalmann, D.: Robust 3D hand pose estimation in single depth images: from single-view CNN to multi-view CNNs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3593–3601 (2016)
8.
Hamer, H., Schindler, K., Koller-Meier, E., Van Gool, L.: Tracking a hand manipulating an object. In: IEEE International Conference on Computer Vision (ICCV), pp. 1475–1482. IEEE (2009)
9.
Hilsmann, A., Eisert, P.: Tracking deformable surfaces with optical flow in the presence of self occlusion in monocular image sequences. In: 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, VPRW 2008, pp. 6, 1 (2008). https://​doi.​org/​10.​1109/​CVPRW.​2008.​4563081
10.
Kyriazis, N., Argyros, A.: Physically plausible 3D scene tracking: the single actor hypothesis. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9–16. IEEE (2013)
11.
Kyriazis, N., Argyros, A.: Scalable 3D tracking of multiple interacting objects. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3430–3437. IEEE (2014)
12.
Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Q. Appl. Math. 2(2), 164–168 (1944)MathSciNetCrossRef
13.
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)MathSciNetCrossRef
14.
Marquardt, D.W.: An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Ind. Appl. Math. 11(2), 431–441 (1963)MathSciNetCrossRef
15.
16.
Mueller, F., Mehta, D., Sotnychenko, O., Sridhar, S., Casas, D., Theobalt, C.: Real-time hand tracking under occlusion from an egocentric RGB-D sensor. In: Proceedings of International Conference on Computer Vision (ICCV), vol. 10 (2017)
17.
Ngo, D.T., Park, S., Jorstad, A., Crivellaro, A., Yoo, C., Fua, P.: Dense image registration and deformable surface reconstruction in presence of occlusions and minimal texture. In: International Conference on Computer Vision (ICCV) (2015)
18.
Oberweger, M., Wohlhart, P., Lepetit, V.: Training a feedback loop for hand pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3316–3324 (2015)
19.
Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Efficient model-based 3D tracking of hand articulations using kinect. In: BMVC, Dundee, UK, August 2011
20.
Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Full DOF tracking of a hand interacting with an object by modeling occlusions and physical constraints. In: International Conference on Computer Vision (ICCV), pp. 2088–2095. IEEE (2011)
21.
Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Tracking the articulated motion of two strongly interacting hands. In: IEEE Computer Vision and Pattern Recognition (CVPR 2012), pp. 1862–1869. IEEE, Providence, June 2012
22.
23.
Panteleris, P., Kyriazis, N., Argyros, A.A.: 3D tracking of human hands in interaction with unknown objects. In: British Machine Vision Conference (BMVC 2015), pp. 123–1. BMVA, Swansea, September 2015
24.
Panteleris, P., Oikonomidis, I., Argyros, A.: Using a single RGB frame for real time 3D hand pose estimation in the wild (2018)
25.
Parashar, S., Pizarro, D., Bartoli, A., Collins, T.: As-rigid-as-possible volumetric shape-from-template. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 891–899 (2015)
26.
Petit, A., Lippiello, V., Siciliano, B.: Tracking an elastic object with an RGB-D sensor for a pizza chef robot
27.
Qian, C., Sun, X., Wei, Y., Tang, X., Sun, J.: Realtime and robust hand tracking from depth. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1106–1113 (2014)
28.
29.
Salzmann, M., Lepetit, V., Fua, P.: Deformable surface tracking ambiguities. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8. IEEE (2007)
30.
Schulman, J., Lee, A., Ho, J., Abbeel, P.: Tracking deformable objects with point clouds. In: Proceedings of the International Conference on Robotics and Automation (ICRA) (2013)
31.
Sharp, T., et al.: Accurate, robust, and flexible real-time hand tracking. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 3633–3642. ACM (2015)
32.
Simon, T., Joo, H., Matthews, I., Sheikh, Y.: Hand keypoint detection in single images using multiview bootstrapping. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2 (2017)
33.
Sinha, A., Choi, C., Ramani, K.: DeepHand: robust hand pose estimation by completing a matrix imputed with deep features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4150–4158 (2016)
34.
35.
Sridhar, S., Oulasvirta, A., Theobalt, C.: Interactive markerless articulated hand motion tracking using RGB and depth data. In: IEEE International Conference on Computer Vision (ICCV), pp. 2456–2463. IEEE (2013)
36.
Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. In: ACM Transactions on Graphics (TOG), vol. 23, pp. 399–405. ACM (2004)
37.
Tagliasacchi, A., Schröder, M., Tkach, A., Bouaziz, S., Botsch, M., Pauly, M.: Robust articulated-ICP for real-time hand tracking. In: Computer Graphics Forum, vol. 34, pp. 101–114. Wiley Online Library (2015)
38.
Tang, D., Jin Chang, H., Tejani, A., Kim, T.K.: Latent regression forest: structured estimation of 3D articulated hand posture. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3786–3793 (2014)
39.
40.
Tompson, J., Stein, M., Lecun, Y., Perlin, K.: Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans. Graph. (ToG) 33(5), 169 (2014)CrossRef
41.
Tsoli, A., Argyros, A.: Tracking deformable surfaces that undergo topological changes using an RGB-D camera. In: Proceedings of International Conference on 3D Vision (3DV), Stanford University, CA, USA, October 2016
42.
Tzionas, D., Ballan, L., Srikantha, A., Aponte, P., Pollefeys, M., Gall, J.: Capturing hands in action using discriminative salient points and physics simulation. Int. J. Comput. Vis. 118(2), 172–193 (2016)MathSciNetCrossRef
43.
Tzionas, D., Gall, J.: 3D object reconstruction from hand-object interactions. In: International Conference on Computer Vision (ICCV), pp. 729–737, December 2015
44.
45.
Wan, C., Probst, T., Van Gool, L., Yao, A.: Crossing nets: combining GANs and VAEs with a shared latent space for hand pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2017)
46.
47.
48.
Metadaten
Titel
Joint 3D Tracking of a Deformable Object in Interaction with a Hand
verfasst von
Aggeliki Tsoli
Antonis A. Argyros
Copyright-Jahr
2018
Buch
Computer Vision – ECCV 2018

Print ISBN: 978-3-030-01263-2

Electronic ISBN: 978-3-030-01264-9

Copyright-Jahr: 2018

DOI
https://doi.org/10.1007/978-3-030-01264-9_30