Skip to main content
Erschienen in: Soft Computing 20/2020

23.03.2020 | Methodologies and Application

An efficient method for human hand gesture detection and recognition using deep learning convolutional neural networks

verfasst von: P. S. Neethu, R. Suguna, Divya Sathish

Erschienen in: Soft Computing | Ausgabe 20/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The physical movement of the human hand produces gestures, and hand gesture recognition leads to the advancement in automated vehicle movement system. In this paper, the human hand gestures are detected and recognized using convolutional neural networks (CNN) classification approach. This process flow consists of hand region of interest segmentation using mask image, fingers segmentation, normalization of segmented finger image and finger recognition using CNN classifier. The hand region of the image is segmented from the whole image using mask images. The adaptive histogram equalization method is used as enhancement method for improving the contrast of each pixel in an image. In this paper, connected component analysis algorithm is used in order to segment the finger tips from hand image. The segmented finger regions from hand image are given to the CNN classification algorithm which classifies the image into various classes. The proposed hand gesture detection and recognition methodology using CNN classification approach with enhancement technique stated in this paper achieves high performance with state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ashfaq T, Khurshid K (2016) Classification of hand gestures using gabor filter with bayesian and naïve bayes classifier. Int J Adv Comput Sci Appl 7(3):276–279 Ashfaq T, Khurshid K (2016) Classification of hand gestures using gabor filter with bayesian and naïve bayes classifier. Int J Adv Comput Sci Appl 7(3):276–279
Zurück zum Zitat Chaikhumpha T, Chomphuwiset P (2018) Real—time two hand gesture recognition with condensation and hidden Markov models. In: 2018 international workshop on advanced image technology (IWAIT), Chiang Mai, 2018, pp 1–4 Chaikhumpha T, Chomphuwiset P (2018) Real—time two hand gesture recognition with condensation and hidden Markov models. In: 2018 international workshop on advanced image technology (IWAIT), Chiang Mai, 2018, pp 1–4
Zurück zum Zitat Elmezain M, Al-Hamadi A, Michaelis B (2010) A robust method for hand gesture segmentation and recognition using forward spotting scheme in conditional random fields. In: Proceedings of the 20th international conference on pattern recognition (ICPR’10), August 2010, pp 3850–3853 Elmezain M, Al-Hamadi A, Michaelis B (2010) A robust method for hand gesture segmentation and recognition using forward spotting scheme in conditional random fields. In: Proceedings of the 20th international conference on pattern recognition (ICPR’10), August 2010, pp 3850–3853
Zurück zum Zitat Hong J, Kim ES, Lee H-J (2012) Rotation-invariant hand posture classification with a convexity defect histogram. In: IEEE international symposium on circuits and systems (ISCAS) 20–23 May 2012, pp 774–777 Hong J, Kim ES, Lee H-J (2012) Rotation-invariant hand posture classification with a convexity defect histogram. In: IEEE international symposium on circuits and systems (ISCAS) 20–23 May 2012, pp 774–777
Zurück zum Zitat Kapil Y, Bhattacharya J (2016) Real-time hand gesture detection and recognition for human computer interaction. In: Berretti S, Thampi S, Srivastava P (eds) Intelligent systems technologies and applications. Springer, Cham, pp 559–567 Kapil Y, Bhattacharya J (2016) Real-time hand gesture detection and recognition for human computer interaction. In: Berretti S, Thampi S, Srivastava P (eds) Intelligent systems technologies and applications. Springer, Cham, pp 559–567
Zurück zum Zitat Liu K, Chen C, Jafari R, Kehtarnavaz N (2014) Fusion of inertial and depth sensor data for robust hand gesture recognition. Sens J IEEE 14(6):1898–1903CrossRef Liu K, Chen C, Jafari R, Kehtarnavaz N (2014) Fusion of inertial and depth sensor data for robust hand gesture recognition. Sens J IEEE 14(6):1898–1903CrossRef
Zurück zum Zitat Manresa-Yee C, Varona J, Mas R, Perales FJ (2005) Hand tracking and gesture recognition for human–computer interaction. Electronic letters on computer vision and image analysis 5(3):96–104CrossRef Manresa-Yee C, Varona J, Mas R, Perales FJ (2005) Hand tracking and gesture recognition for human–computer interaction. Electronic letters on computer vision and image analysis 5(3):96–104CrossRef
Zurück zum Zitat Marium A, Rao D, Crasta DR, Acharya K, D’Souza R (2017) Hand gesture recognition using webcam. Am J Intell Syst 7(3):90–94 Marium A, Rao D, Crasta DR, Acharya K, D’Souza R (2017) Hand gesture recognition using webcam. Am J Intell Syst 7(3):90–94
Zurück zum Zitat Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):311–324CrossRef Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):311–324CrossRef
Zurück zum Zitat Park S, Yu S, Kim J, Kim S, Lee S (2012) 3D hand tracking using Kalman filter in depth space. EURASIP J Adv Signal Process 2012(1), 36CrossRef Park S, Yu S, Kim J, Kim S, Lee S (2012) 3D hand tracking using Kalman filter in depth space. EURASIP J Adv Signal Process 2012(1), 36CrossRef
Zurück zum Zitat Rahman MH, Afrin J (2013) Article: hand gesture recognition using multiclass support vector machine. Int J Comput Appl 74(1):39–43 Rahman MH, Afrin J (2013) Article: hand gesture recognition using multiclass support vector machine. Int J Comput Appl 74(1):39–43
Zurück zum Zitat Rao J, Gao T, Gong Z, Jiang Z (2009) Low cost hand gesture learning and recognition system based on hidden markov model. In: Proceedings of the 2009 2nd international symposium on information science and engineering (ISISE ‘09), IEEE, Shanghai, China, December 2009, pp 433–438 Rao J, Gao T, Gong Z, Jiang Z (2009) Low cost hand gesture learning and recognition system based on hidden markov model. In: Proceedings of the 2009 2nd international symposium on information science and engineering (ISISE ‘09), IEEE, Shanghai, China, December 2009, pp 433–438
Zurück zum Zitat Rautaray SS, Agrawal A (2015) Vision based hand gesture recognition for human computer interaction: a survey. Artif Intell Rev 43(1):1–54CrossRef Rautaray SS, Agrawal A (2015) Vision based hand gesture recognition for human computer interaction: a survey. Artif Intell Rev 43(1):1–54CrossRef
Zurück zum Zitat Ren Z, Yuan J, Meng J, Zhang Z (2013) Robust part-based hand gesture recognition using kinect sensor. IEEE Trans Multimed 15(5):1110–1120CrossRef Ren Z, Yuan J, Meng J, Zhang Z (2013) Robust part-based hand gesture recognition using kinect sensor. IEEE Trans Multimed 15(5):1110–1120CrossRef
Zurück zum Zitat Sharma S, Jain S, Khushboo (2019) A static hand gesture and face recognition system for blind people. In: 2019 6th international conference on signal processing and integrated networks (SPIN), Noida, India, 2019, pp 534–539 Sharma S, Jain S, Khushboo (2019) A static hand gesture and face recognition system for blind people. In: 2019 6th international conference on signal processing and integrated networks (SPIN), Noida, India, 2019, pp 534–539
Zurück zum Zitat Suguna R, Neethu PS (2017) Hand gesture recognition using shape features. Int J Pure Appl Math 117(8):51–54 Suguna R, Neethu PS (2017) Hand gesture recognition using shape features. Int J Pure Appl Math 117(8):51–54
Zurück zum Zitat Tauseef H, Fahiem MA, Farhan S (2009) Recognition and translation of hand gestures to Urdu alphabets using a geometrical classification. In: Proceedings of IEEE international conference on visualisation (VIZ), Barcelona, Spain, pp 213–217 Tauseef H, Fahiem MA, Farhan S (2009) Recognition and translation of hand gestures to Urdu alphabets using a geometrical classification. In: Proceedings of IEEE international conference on visualisation (VIZ), Barcelona, Spain, pp 213–217
Zurück zum Zitat Wang Z, Chen B, Wu J (2018) Effective inertial hand gesture recognition using particle filtering based trajectory matching. J Electric Comput Eng 2018, 6296013MathSciNet Wang Z, Chen B, Wu J (2018) Effective inertial hand gesture recognition using particle filtering based trajectory matching. J Electric Comput Eng 2018, 6296013MathSciNet
Zurück zum Zitat Wang Y, Jung C, Yun I, Kim J (2019) SPFEMD: super-pixel based finger earth mover’s distance for hand gesture recognition. In: ICASSP 2019–2019 IEEE international conference on acoustics, speech and signal processing (ICASSP), Brighton, United Kingdom, 2019, pp 4085–4089 Wang Y, Jung C, Yun I, Kim J (2019) SPFEMD: super-pixel based finger earth mover’s distance for hand gesture recognition. In: ICASSP 2019–2019 IEEE international conference on acoustics, speech and signal processing (ICASSP), Brighton, United Kingdom, 2019, pp 4085–4089
Zurück zum Zitat Yao Y, Fu Y (2014) Contour model-based hand-gesture recognition using the Kinect sensor. IEEE Trans Circ Syst Video Technol 24(11):1935–1944CrossRef Yao Y, Fu Y (2014) Contour model-based hand-gesture recognition using the Kinect sensor. IEEE Trans Circ Syst Video Technol 24(11):1935–1944CrossRef
Zurück zum Zitat Yasukochi N, Mitome A, Ishii R (2008) A recognition method of restricted hand shapes in still image and moving image as a man–machine interface. In: IEEE conference on human system interactions, pp 306–310 Yasukochi N, Mitome A, Ishii R (2008) A recognition method of restricted hand shapes in still image and moving image as a man–machine interface. In: IEEE conference on human system interactions, pp 306–310
Zurück zum Zitat Yrk E, Konukoglu E, Sankur B, Darbon J (2006) Shape-based hand recognition. IEEE Trans Image Process 15(7):1803–1815CrossRef Yrk E, Konukoglu E, Sankur B, Darbon J (2006) Shape-based hand recognition. IEEE Trans Image Process 15(7):1803–1815CrossRef
Metadaten
Titel
An efficient method for human hand gesture detection and recognition using deep learning convolutional neural networks
verfasst von
P. S. Neethu
R. Suguna
Divya Sathish
Publikationsdatum
23.03.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 20/2020
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-020-04860-5

Weitere Artikel der Ausgabe 20/2020

Soft Computing 20/2020 Zur Ausgabe

Premium Partner