Skip to main content

2015 | OriginalPaper | Buchkapitel

Depth-Based Real-Time Hand Tracking with Occlusion Handling Using Kalman Filter and DAM-Shift

verfasst von : Kisang Kim, Hyung-Il Choi

Erschienen in: Computer Vision - ACCV 2014 Workshops

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose real-time hand tracking with a depth camera by using a Kalman Filter and an improved DAM-Shift (Depth-based adaptive mean shift) algorithm for occlusion handling. DAM-Shift is a useful algorithm for hand tracking, but difficult to track when occlusion occurs. To detect the hand region, we use a classifier that combines a boosting and a cascade structure. To verify occlusion, we predict in real time the center position of the hand region using Kalman Filter and calculate the major axis using the central moment of the preceding depth image. Using these factors, we measure real-time hand thickness through a projection and the threshold value of the thickness using a 2nd linear model. If the hand region is partially occluded, we cut the useless region. Experimental results show that the proposed approach outperforms the existing method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Quam, D.L.: Gesture recognition with a DataGlove. In: Proceedings of the IEEE National Aerospace and Electronics Conference, pp. 755–760 (1990) Quam, D.L.: Gesture recognition with a DataGlove. In: Proceedings of the IEEE National Aerospace and Electronics Conference, pp. 755–760 (1990)
2.
Zurück zum Zitat Wang, R.Y., Popovic, J.: Real-time hand-tracking with a color glove. ACM Trans. Graph. 28(3), 63:1–63:8 (2009) Wang, R.Y., Popovic, J.: Real-time hand-tracking with a color glove. ACM Trans. Graph. 28(3), 63:1–63:8 (2009)
3.
Zurück zum Zitat Lamberti, L., Camastra, F.: Handy: a real-time three color glove-based gesture recognizer with learning vector quantization. Expert Syst. Appl. 39(12), 10489–10494 (2012)CrossRef Lamberti, L., Camastra, F.: Handy: a real-time three color glove-based gesture recognizer with learning vector quantization. Expert Syst. Appl. 39(12), 10489–10494 (2012)CrossRef
4.
Zurück zum Zitat Suk, H.I., Sin, B.H.: Dynamic Bayesian network based two-hand gesture recognition. J. KIISE: Softw. Appl. 35(4), 265–279 (2008) Suk, H.I., Sin, B.H.: Dynamic Bayesian network based two-hand gesture recognition. J. KIISE: Softw. Appl. 35(4), 265–279 (2008)
5.
Zurück zum Zitat Bhuyan, M.K., Neog, D.R., Kar, M.K.: Fingertip detection for hand pose recognition. Int. J. Comput. Sci. Eng. 4(3), 501–511 (2012) Bhuyan, M.K., Neog, D.R., Kar, M.K.: Fingertip detection for hand pose recognition. Int. J. Comput. Sci. Eng. 4(3), 501–511 (2012)
6.
Zurück zum Zitat Park, M.S., Hasan, M., Kim, J.M., Chae, O.S.: Hand detection and tracking using depth and color information. In: Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition, pp. 779–785 (2012) Park, M.S., Hasan, M., Kim, J.M., Chae, O.S.: Hand detection and tracking using depth and color information. In: Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition, pp. 779–785 (2012)
7.
Zurück zum Zitat Van den Bergh, M., Van Gool, L.: Combining RGB and ToF cameras for real-time 3D hand gesture interaction. In: Proceedings of the IEEE Workshop on Applications of Computer Vision, pp. 66–72 (2011) Van den Bergh, M., Van Gool, L.: Combining RGB and ToF cameras for real-time 3D hand gesture interaction. In: Proceedings of the IEEE Workshop on Applications of Computer Vision, pp. 66–72 (2011)
8.
Zurück zum Zitat Trindade, P., Lobo, J., Barreto, J.P.: Hand gesture recognition using color and depth images enhanced with hand angular pose data. In: Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, pp. 71–76 (2012) Trindade, P., Lobo, J., Barreto, J.P.: Hand gesture recognition using color and depth images enhanced with hand angular pose data. In: Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, pp. 71–76 (2012)
9.
Zurück zum Zitat Mo, Z., Neumann, U.: Real-time hand pose recognition using low-resolution depth images. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1499–1505 (2006) Mo, Z., Neumann, U.: Real-time hand pose recognition using low-resolution depth images. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1499–1505 (2006)
10.
Zurück zum Zitat Liu, X., Fujimura, K.: Hand gesture recognition using depth data. In: Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 529–534 (2004) Liu, X., Fujimura, K.: Hand gesture recognition using depth data. In: Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 529–534 (2004)
11.
Zurück zum Zitat Malassiotis, S., Strintzis, M.G.: Real-time hand posture recognition using range data. Image Vis. Comput. 26(7), 1027–1037 (2008)CrossRef Malassiotis, S., Strintzis, M.G.: Real-time hand posture recognition using range data. Image Vis. Comput. 26(7), 1027–1037 (2008)CrossRef
12.
Zurück zum Zitat Suryanarayan, P., Subramanian, A., Mandalapu, D.: Dynamic hand pose recognition using depth data. In: Proceedings of the 20th International Conference on Pattern Recognition, pp. 3105–3108 (2010) Suryanarayan, P., Subramanian, A., Mandalapu, D.: Dynamic hand pose recognition using depth data. In: Proceedings of the 20th International Conference on Pattern Recognition, pp. 3105–3108 (2010)
13.
Zurück zum Zitat Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Efficient model-based 3D tracking of hand articulations using Kinect. In: Proceedings of the British Machine Vision Conference (2011) Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Efficient model-based 3D tracking of hand articulations using Kinect. In: Proceedings of the British Machine Vision Conference (2011)
14.
Zurück zum Zitat Joo, S.-I., Weon, S.-H., Choi, H.-I.: Real-time depth-based hand detection and tracking. Sci. World J. 2014, 17 p. (2014) Joo, S.-I., Weon, S.-H., Choi, H.-I.: Real-time depth-based hand detection and tracking. Sci. World J. 2014, 17 p. (2014)
15.
Zurück zum Zitat Park, S., Yu, S., Kim, J., Kim, S., Lee, S.: 3D hand tracking using Kalman filter in depth space. EURASIP J. Adv. Sig. Process. 2012, 18 (2012) Park, S., Yu, S., Kim, J., Kim, S., Lee, S.: 3D hand tracking using Kalman filter in depth space. EURASIP J. Adv. Sig. Process. 2012, 18 (2012)
16.
Zurück zum Zitat Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. In: IEEE Workshop on Applications of Computer Vision, Princeton, NJ, pp. 214-219 (1998) Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. In: IEEE Workshop on Applications of Computer Vision, Princeton, NJ, pp. 214-219 (1998)
Metadaten
Titel
Depth-Based Real-Time Hand Tracking with Occlusion Handling Using Kalman Filter and DAM-Shift
verfasst von
Kisang Kim
Hyung-Il Choi
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16628-5_16