Top

Published in:

2020 | OriginalPaper | Chapter

GHand: A Graph Convolution Network for 3D Hand Pose Estimation

Authors : Pengsheng Wang, Guangtao Xue, Pin Li, Jinman Kim, Bin Sheng, Lijuan Mao

Published in: Advances in Computer Graphics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Vision-based 3D hand pose estimation plays an important role in the field of human-computer interaction. In recent years, with the development of convolutional neural networks (CNN), the field of 3D hand pose estimation has made a great progress, but there is still a long way to go before the problem is solved. Although recent studies based on CNN networks have greatly improved the recognition accuracy, they usually only pay attention on the regression ability of the network itself, and ignore the structural information of the hands, thus leads to a low accuracy in contrast. In this paper we proposed a new hand pose estimation network, which can fully learn the structural information of hands through an adaptive graph convolutional neural network. The experiment on the public dataset shows the accuracy of our graph convolution network exceeds the SOTA methods in 3D hand pose estimation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter 3D Geology Scene Exploring Base on Hand-Track Somatic Interaction

next chapter Bézier Curve as a Generalization of the Easing Function in Computer Animation

Chen, X., Wang, G., Zhang, C., Kim, T., Ji, X.: SHPR-Net: deep semantic hand pose regression from point clouds. IEEE Access 6, 43425–43439 (2018)CrossRef

Chen, X., Wang, G., Guo, H., Zhang, C.: Pose guided structured region ensemble network for cascaded hand pose estimation. Neurocomputing 395, 138–149 (2020) CrossRef

Doosti, B.: Hand pose estimation: a survey. Computer Vision and Pattern Recognition (2019)

Doosti, B., Naha, S., Mirbagheri, M., Crandall, D.: HOPE-Net: a graph-based model for hand-object pose estimation. arxiv.org/abs/2004.00060 (2020)

Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., Twombly, X.: Vision-based hand pose estimation: a review. Comput. Vis. Image Underst. 108(1), 52–73 (2007)CrossRef

Ge, L., Liang, H., Yuan, J.: 3D Convolutional Neural Networks for Efficient and Robust Hand Pose Estimation from Single Depth Images. Supplementary Material. 1–5 (n.d.)

Guo, H., Wang, G., Chen, X., Zhang, C., Qiao, F., Yang, H.: Region ensemble network: improving convolutional network for hand pose estimation. arxiv.org/abs/1702.02447 (2017)

Li, M., Chen, S., Chen, X., Zhang, Y., Wang, Y., Tian, Q.: Actional-structural graph convolutional networks for skeleton-based action recognition. In: Computer Vision and Pattern Recognition, pp. 3595–3603 (2019)

Lu, P., Sheng, B., Luo, S., Jia, X., Wu, W.: Image-based non-photorealistic rendering for realtime virtual sculpting. Multimedia Tools Appl. 74(21), 9697–9714 (2014). https://doi.org/10.1007/s11042-014-2146-4CrossRef

10.

Kamel, A., Sheng, B., Yang, P., Li, P., Shen, R., Feng, D.D.: Deep convolutional neural networks for human action recognition using depth maps and postures. IEEE Trans. Syst. Man Cybern. Syst. 49(9), 1806–1819 (2019)CrossRef

11.

Karambakhsh, A., Kamel, A., Sheng, B., Li, P., Yang, P., Feng, D.D.: Deep gesture interaction for augmented anatomy learning. Int. J. Inf. Manage. 45, 328–336 (2019)CrossRef

12.

Kolotouros, N., Pavlakos, G., Daniilidis, K.: Convolutional mesh regression for single-image human shape reconstruction. In: Computer Vision and Pattern Recognition, pp. 4496–4505 (2019)

13.

Meng, X., et al.: A video information driven football recommendation system. Comput. Electr. Eng. 85, 106699 (2020) CrossRef

14.

Oberweger, M., Wohlhart, P., Lepetit, V.: Hands deep in deep learning for hand pose estimation. arxiv.org/abs/1502.06807 (2015)

15.

Oberweger, M., Wohlhart, P., Lepetit, V.: Training a feedback loop for hand pose estimation. In: International Conference on Computer Vision, pp. 3316–3324 (2015)

16.

Oberweger, M., Lepetit, V.: DeepPrior++: improving fast and accurate 3D hand pose estimation. In: International Conference on Computer Vision Workshops (ICCVW), pp. 585–594 (2017)

17.

Oberweger, M., Wohlhart, P., Lepetit, V.: Generalized feedback loop for joint hand-object pose estimation. Pattern Anal. Mach. Intell. 45, 1898–1912 (2020)CrossRef

18.

Sheng, B., Li, P., Zhang, Y., Mao, L.: GreenSea: visual soccer analysis using broad learning system. IEEE Trans. Cybern. 1–15 (2020)

19.

Taylor, J., Shotton, J., Sharp, T., Fitzgibbon, A.: The Vitruvian manifold: inferring dense correspondences for one-shot human pose estimation. In: Computer Vision and Pattern Recognition, pp. 103–110 (2012)

20.

Tompson, J., Stein, M., Lecun, Y., Perlin, K.: Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans. Graph. (ToG) 33(5), 169 (2014)CrossRef

21.

Yoo, C., Kim, S., Ji, S., Shin, Y., Ko, S.: Capturing hand articulations using re-current neural network for 3D hand pose estimation. arxiv.org/abs/1911.07424 (2019)

22.

Yuan, S., et al.: Depth-based 3D hand pose estimation: from current achievements to future goals. In: Computer Vision and Pattern Recognition, pp. 2636–2645 (2018)

23.

Zhou, X., Wan, Q., Wei, Z., Xue, X., Wei, Y.: Model-based deep hand pose estimation. In: International Joint Conference on Artificial Intelligence, pp. 2421–2427 (2016)

24.

Zhou, Y., Lu, J., Du, K., Lin, X., Sun, Y., Ma, X.: HBE: hand branch ensemble network for real-time 3D hand pose estimation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Computer Vision – ECCV 2018. LNCS, vol. 11218, pp. 521–536. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01264-9_31CrossRef

25.

Zhang, P., Zheng, L., Jiang, Y., Mao, L., Li, Z., Sheng, B.: Tracking soccer players using spatio-temporal context learning under multiple views. Multimedia Tools Appl. 77(15), 18935–18955 (2018)CrossRef

Title: GHand: A Graph Convolution Network for 3D Hand Pose Estimation
Authors: Pengsheng Wang
Guangtao Xue
Pin Li
Jinman Kim
Bin Sheng
Lijuan Mao
Publisher: Springer International Publishing
Book: Advances in Computer Graphics
Print ISBN: 978-3-030-61863-6

Electronic ISBN: 978-3-030-61864-3

Copyright Year: 2020
DOI: https://doi.org/10.1007/978-3-030-61864-3_31

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner