Skip to main content

2017 | OriginalPaper | Buchkapitel

Synergy-Driven Performance Enhancement of Vision-Based 3D Hand Pose Reconstruction

verfasst von : Simone Ciotti, Edoardo Battaglia, Iason Oikonomidis, Alexandros Makris, Aggeliki Tsoli, Antonio Bicchi, Antonis A. Argyros, Matteo Bianchi

Erschienen in: Wireless Mobile Communication and Healthcare

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this work we propose, for the first time, to improve the performance of a Hand Pose Reconstruction (HPR) technique from RGBD camera data, which is affected by self-occlusions, leveraging upon postural synergy information, i.e., a priori information on how human most commonly use and shape their hands in everyday life tasks. More specifically, in our approach, we ignore joint angle values estimated with low confidence through a vision-based HPR technique and fuse synergistic information with such incomplete measures. Preliminary experiments are reported showing the effectiveness of the proposed integration.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
It is worth to mention that robotics research has leveraged upon neuroscientific insights on synergies to inform the design and control of artificial hands, see e.g. [1416].
 
2
Images and depth maps are captured at \(640\times 480@24\) bit and \(640\times 480@16\) bit, respectively.
 
Literatur
1.
Zurück zum Zitat Ciotti, S., et al.: A synergy-based optimally designed sensing glove for functional grasp recognition. Sensors 16(6), 811 (2016)CrossRef Ciotti, S., et al.: A synergy-based optimally designed sensing glove for functional grasp recognition. Sensors 16(6), 811 (2016)CrossRef
2.
3.
Zurück zum Zitat Dipietro, L., et al.: A survey of glove-based systems and their applications. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 38(4), 461–482 (2008)CrossRef Dipietro, L., et al.: A survey of glove-based systems and their applications. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 38(4), 461–482 (2008)CrossRef
4.
Zurück zum Zitat Bianchi, M., et al.: Synergy-based hand pose sensing: Reconstruction enhancement. Int. J. Robot. Res. 32(4), 396–406 (2013)CrossRef Bianchi, M., et al.: Synergy-based hand pose sensing: Reconstruction enhancement. Int. J. Robot. Res. 32(4), 396–406 (2013)CrossRef
5.
Zurück zum Zitat Oikonomidis, I., et al.: Efficient model-based 3D tracking of hand articulations using kinect. In: British Machine Vision Conference (BMVC 2011), vol. 1, no. 2, pp. 1–11. BMVA, Dundee (2011) Oikonomidis, I., et al.: Efficient model-based 3D tracking of hand articulations using kinect. In: British Machine Vision Conference (BMVC 2011), vol. 1, no. 2, pp. 1–11. BMVA, Dundee (2011)
6.
Zurück zum Zitat Muth, J.T., et al.: Embedded 3D printing of strain sensors within highly stretchable elastomers. Adv. Mater. 26(36), 6307–6312 (2014)CrossRef Muth, J.T., et al.: Embedded 3D printing of strain sensors within highly stretchable elastomers. Adv. Mater. 26(36), 6307–6312 (2014)CrossRef
7.
Zurück zum Zitat Hsiao, P.-C., et al.: Data glove embedded with 9-axis imu and force sensing sensors for evaluation of hand function. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4631–4634. IEEE (2015) Hsiao, P.-C., et al.: Data glove embedded with 9-axis imu and force sensing sensors for evaluation of hand function. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4631–4634. IEEE (2015)
8.
Zurück zum Zitat Bianchi, M., et al.: On the use of postural synergies to improve human hand pose reconstruction. In: 2012 IEEE Haptics Symposium (HAPTICS), pp. 91–98. IEEE (2012) Bianchi, M., et al.: On the use of postural synergies to improve human hand pose reconstruction. In: 2012 IEEE Haptics Symposium (HAPTICS), pp. 91–98. IEEE (2012)
9.
Zurück zum Zitat Bianchi, M., et al.: Synergy-based optimal design of hand pose sensing. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3929–3935, October 2012 Bianchi, M., et al.: Synergy-based optimal design of hand pose sensing. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3929–3935, October 2012
10.
Zurück zum Zitat Bianchi, M., et al.: Synergy-based hand pose sensing: optimal glove design. Int. J. Robot. Res. 32(4), 407–424 (2013)CrossRef Bianchi, M., et al.: Synergy-based hand pose sensing: optimal glove design. Int. J. Robot. Res. 32(4), 407–424 (2013)CrossRef
11.
Zurück zum Zitat Bianchi, M., et al.: Exploiting hand kinematic synergies and wearable under-sensing for hand functional grasp recognition. In: 2014 EAI 4th International Conference on Wireless Mobile Communication and Healthcare (Mobihealth), pp. 168–171, November 2014 Bianchi, M., et al.: Exploiting hand kinematic synergies and wearable under-sensing for hand functional grasp recognition. In: 2014 EAI 4th International Conference on Wireless Mobile Communication and Healthcare (Mobihealth), pp. 168–171, November 2014
12.
Zurück zum Zitat Bianchi, M., et al.: A multi-modal sensing glove for human manual-interaction studies. Electronics 5(3), 42 (2016)CrossRef Bianchi, M., et al.: A multi-modal sensing glove for human manual-interaction studies. Electronics 5(3), 42 (2016)CrossRef
13.
Zurück zum Zitat Santello, M., et al.: Postural hand synergies for tool use. J. Neurosci. 18(23), 10 105–10 115 (1998) Santello, M., et al.: Postural hand synergies for tool use. J. Neurosci. 18(23), 10 105–10 115 (1998)
14.
Zurück zum Zitat Santello, M., et al.: Hand synergies: integration of robotics and neuroscience for understanding the control of biological and artificial hands. Phys. Life Rev. 17, 1–23 (2016)CrossRef Santello, M., et al.: Hand synergies: integration of robotics and neuroscience for understanding the control of biological and artificial hands. Phys. Life Rev. 17, 1–23 (2016)CrossRef
15.
Zurück zum Zitat Catalano, M.G., et al.: Adaptive synergies for the design and control of the Pisa/IIT softhand. Int. J. Robot. Res. 33(5), 768–782 (2014)CrossRef Catalano, M.G., et al.: Adaptive synergies for the design and control of the Pisa/IIT softhand. Int. J. Robot. Res. 33(5), 768–782 (2014)CrossRef
16.
Zurück zum Zitat Matrone, G.C., et al.: Principal components analysis based control of a multi-dof underactuated prosthetic hand. J. Neuroeng. Rehabil. 7(1), 1 (2010)CrossRef Matrone, G.C., et al.: Principal components analysis based control of a multi-dof underactuated prosthetic hand. J. Neuroeng. Rehabil. 7(1), 1 (2010)CrossRef
17.
Zurück zum Zitat Kennedy, J., et al.: Particle swarm optimization. In: International Conference on Neural Networks, vol. 4, no. 3, pp. 1942–1948. IEEE, January 1995 Kennedy, J., et al.: Particle swarm optimization. In: International Conference on Neural Networks, vol. 4, no. 3, pp. 1942–1948. IEEE, January 1995
18.
Zurück zum Zitat Sun, X., et al.: Cascaded hand pose regression. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 824–832 (2015) Sun, X., et al.: Cascaded hand pose regression. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 824–832 (2015)
19.
Zurück zum Zitat Keskin, C., Kıraç, F., Kara, Y.E., Akarun, L.: Hand pose estimation and hand shape classification using multi-layered randomized decision forests. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7577, pp. 852–863. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33783-3_61 CrossRef Keskin, C., Kıraç, F., Kara, Y.E., Akarun, L.: Hand pose estimation and hand shape classification using multi-layered randomized decision forests. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7577, pp. 852–863. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33783-3_​61 CrossRef
Metadaten
Titel
Synergy-Driven Performance Enhancement of Vision-Based 3D Hand Pose Reconstruction
verfasst von
Simone Ciotti
Edoardo Battaglia
Iason Oikonomidis
Alexandros Makris
Aggeliki Tsoli
Antonio Bicchi
Antonis A. Argyros
Matteo Bianchi
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-58877-3_42

Premium Partner