Skip to main content

2019 | OriginalPaper | Buchkapitel

Hand Pose Estimation Using Convolutional Neural Networks and Support Vector Regression

verfasst von : Yufeng Dong, Jian Lu, Qiang Zhang

Erschienen in: E-Learning and Games

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In order to improve the accuracy of hand pose estimation from a depth image, a method based on convolutional neural network (CNN) is proposed in this paper. First of all, we modify the structure of traditional CNN to recognize the 3D joint locations from a depth image. By appending some shortcuts between layers, the proposed network increases the correlation between the front and back layers. This structure can avoid the information loss caused by the simple layer-by-layer transmission, and can improve the estimation accuracy effectively. Afterwards, the estimated joint locations continue to be inputted into a support vector regression (SVR) phase. The use of SVR can introduce the constraint of local joint information, which can get rid of those abnormal estimations further. Extensive experiments show that our method enables significant performance improvement over the-state-of-arts in the accuracy of hand pose estimation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ueda, E., Matsumoto, Y., Imai, M., Ogasawara, T.: A hand-pose estimation for vision-based human interfaces. IEEE Trans. Industr. Electron. 50, 676–684 (2003)CrossRef Ueda, E., Matsumoto, Y., Imai, M., Ogasawara, T.: A hand-pose estimation for vision-based human interfaces. IEEE Trans. Industr. Electron. 50, 676–684 (2003)CrossRef
2.
Zurück zum Zitat Yin, X., Xie, M.: Estimation of the fundamental matrix from uncalibrated stereo hand images for 3D hand gesture recognition. Pattern Recogn. 36, 567–584 (2003)CrossRef Yin, X., Xie, M.: Estimation of the fundamental matrix from uncalibrated stereo hand images for 3D hand gesture recognition. Pattern Recogn. 36, 567–584 (2003)CrossRef
3.
Zurück zum Zitat Tagliasacchi, A., Schr, M., der Tkach, A., Bouaziz, S., Botsch, M., Pauly, M.: Robust articulated-ICP for real-time hand tracking. In: Proceedings of the Eurographics Symposium on Geometry Processing, pp. 101–114. Eurographics Association (2015) Tagliasacchi, A., Schr, M., der Tkach, A., Bouaziz, S., Botsch, M., Pauly, M.: Robust articulated-ICP for real-time hand tracking. In: Proceedings of the Eurographics Symposium on Geometry Processing, pp. 101–114. Eurographics Association (2015)
4.
Zurück zum Zitat Taylor, J., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans. Graph. 35, 1–12 (2016)CrossRef Taylor, J., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans. Graph. 35, 1–12 (2016)CrossRef
5.
Zurück zum Zitat Li, P., Ling, H., Li, X., Liao, C.: 3D hand pose estimation using randomized decision forest with segmentation index points. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 819–827 (2015) Li, P., Ling, H., Li, X., Liao, C.: 3D hand pose estimation using randomized decision forest with segmentation index points. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 819–827 (2015)
6.
Zurück zum Zitat Tang, D., Chang, H.J., Tejani, A., Kim, T.-K.: Latent regression forest: structured estimation of 3D articulated hand posture. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3786–3793. IEEE Computer Society (2014) Tang, D., Chang, H.J., Tejani, A., Kim, T.-K.: Latent regression forest: structured estimation of 3D articulated hand posture. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3786–3793. IEEE Computer Society (2014)
7.
Zurück zum Zitat Oberweger, M., Wohlhart, P., Lepetit, V.: Training a Feedback loop for hand pose estimation. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 3316–3324 (2015) Oberweger, M., Wohlhart, P., Lepetit, V.: Training a Feedback loop for hand pose estimation. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 3316–3324 (2015)
8.
Zurück zum Zitat Oberweger, M., Wohlhart, P., Lepetit, V.: Hands deep in deep learning for hand pose estimation. Computer Science (2015) Oberweger, M., Wohlhart, P., Lepetit, V.: Hands deep in deep learning for hand pose estimation. Computer Science (2015)
9.
Zurück zum Zitat Ge, L., Liang, H., Yuan, J., Thalmann, D.: Robust 3D hand pose estimation in single depth images: from single-view CNN to multi-view CNNs. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3593–3601 (2016) Ge, L., Liang, H., Yuan, J., Thalmann, D.: Robust 3D hand pose estimation in single depth images: from single-view CNN to multi-view CNNs. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3593–3601 (2016)
10.
Zurück zum Zitat Zhou, X., Wan, Q., Zhang, W., Xue, X., Wei, Y.: Model-based deep hand pose estimation. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 2421–2427. AAAI Press (2016) Zhou, X., Wan, Q., Zhang, W., Xue, X., Wei, Y.: Model-based deep hand pose estimation. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 2421–2427. AAAI Press (2016)
11.
Zurück zum Zitat Madadi, M., Escalera, S., Baro, X., Gonzalez, J.: End-to-end global to local CNN learning for hand pose recovery in depth data. arXiv e-prints, pp. 1–11 (2017) Madadi, M., Escalera, S., Baro, X., Gonzalez, J.: End-to-end global to local CNN learning for hand pose recovery in depth data. arXiv e-prints, pp. 1–11 (2017)
13.
Zurück zum Zitat Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv e-prints, vol. 1602, pp. 1–13 (2016) Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv e-prints, vol. 1602, pp. 1–13 (2016)
14.
15.
Zurück zum Zitat Tompson, J., Stein, M., Lecun, Y., Perlin, K.: Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans. Graph. 33, 169 (2014)CrossRef Tompson, J., Stein, M., Lecun, Y., Perlin, K.: Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans. Graph. 33, 169 (2014)CrossRef
16.
Zurück zum Zitat Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the ACM International Conference on Multimedia - MM 2014, pp. 675–678. ACM (2014) Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the ACM International Conference on Multimedia - MM 2014, pp. 675–678. ACM (2014)
17.
Zurück zum Zitat Pedregosa, F., et al.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH Pedregosa, F., et al.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH
Metadaten
Titel
Hand Pose Estimation Using Convolutional Neural Networks and Support Vector Regression
verfasst von
Yufeng Dong
Jian Lu
Qiang Zhang
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-23712-7_56

Premium Partner