Skip to main content
Erschienen in: Cluster Computing 2/2019

29.12.2017

Hand gesture recognition based on convolution neural network

verfasst von: Gongfa Li, Heng Tang, Ying Sun, Jianyi Kong, Guozhang Jiang, Du Jiang, Bo Tao, Shuang Xu, Honghai Liu

Erschienen in: Cluster Computing | Sonderheft 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Due to the complexity issue of the hand gesture recognition feature extraction, for example the variation of the light and background. In this paper, the convolution neural network is applied to the recognition of gestures, and the characteristics of convolution neural network are used to avoid the feature extraction process, reduce the number of parameters needs to be trained, and finally achieve the purpose of unsupervised learning. Error back propagation algorithm, is loaded into the convolution neural network algorithm, modify the threshold and weights of neural network to reduce the error of the model. In the classifier, the support vector machine that is added to optimize the classification function of the convolution neural network to improve the validity and robustness of the whole model.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Meng, F., Ju, Z., Zhen, X., Li, J.: Real-time visual tracking based on improved perceptual hashing. Multimed. Tools Appl. 76(3), 4617–4634 (2017)CrossRef Meng, F., Ju, Z., Zhen, X., Li, J.: Real-time visual tracking based on improved perceptual hashing. Multimed. Tools Appl. 76(3), 4617–4634 (2017)CrossRef
2.
Zurück zum Zitat Tavakoli, M., Benussi, C., Lourenco, J.L.: Single channel surface emg control of advanced prosthetic hands: a simple, low cost and efficient approach. Expert Syst. Appl. 79, 322–332 (2017)CrossRef Tavakoli, M., Benussi, C., Lourenco, J.L.: Single channel surface emg control of advanced prosthetic hands: a simple, low cost and efficient approach. Expert Syst. Appl. 79, 322–332 (2017)CrossRef
3.
Zurück zum Zitat Branco, M.P., Freudenburg, Z.V., Aarnoutse, E.J., Bleichner, M.G., Vansteensel, M.J., Ramsey, N.F.: Decoding hand gestures from primary somatosensory cortex using high-density ecog. Neuroimage 147, 130–142 (2017)CrossRef Branco, M.P., Freudenburg, Z.V., Aarnoutse, E.J., Bleichner, M.G., Vansteensel, M.J., Ramsey, N.F.: Decoding hand gestures from primary somatosensory cortex using high-density ecog. Neuroimage 147, 130–142 (2017)CrossRef
4.
Zurück zum Zitat He, Y., Li, G., Liao, Y., Sun, Y., Kong, J., Jiang, G., Jiang, D., Liu, H.: Gesture recognition based on an improved local sparse representation classification algorithm. Clust. Comput. 1, 1–12 (2017) He, Y., Li, G., Liao, Y., Sun, Y., Kong, J., Jiang, G., Jiang, D., Liu, H.: Gesture recognition based on an improved local sparse representation classification algorithm. Clust. Comput. 1, 1–12 (2017)
5.
Zurück zum Zitat Miao, W., Li, G., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Optimal grasp planning of multi-fingered robotic hands: a review. Appl. Comput. Math. 14(3), 238–247 (2015)MathSciNetMATH Miao, W., Li, G., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Optimal grasp planning of multi-fingered robotic hands: a review. Appl. Comput. Math. 14(3), 238–247 (2015)MathSciNetMATH
6.
Zurück zum Zitat Hasan, H., Abdul-Kareem, S.: Retracted article: human-computer interaction using vision-based hand gesture recognition systems: a survey. Neural Comput. Appl. 25(2), 251–261 (2014)CrossRef Hasan, H., Abdul-Kareem, S.: Retracted article: human-computer interaction using vision-based hand gesture recognition systems: a survey. Neural Comput. Appl. 25(2), 251–261 (2014)CrossRef
7.
Zurück zum Zitat Rautaray, S.S., Agrawal, A.: Vision based hand gesture recognition for human computer interaction: a survey. Artif. Intell. Rev. 43(1), 1–54 (2015)CrossRef Rautaray, S.S., Agrawal, A.: Vision based hand gesture recognition for human computer interaction: a survey. Artif. Intell. Rev. 43(1), 1–54 (2015)CrossRef
8.
Zurück zum Zitat Hasan, H.S., Kareem, S.A.: Human computer interaction for vision based hand gesture recognition: a survey. In: Advanced Computer Science Applications and Technologies (ACSAT), 2012 International Conferenve on (pp. 55–60) (2015) Hasan, H.S., Kareem, S.A.: Human computer interaction for vision based hand gesture recognition: a survey. In: Advanced Computer Science Applications and Technologies (ACSAT), 2012 International Conferenve on (pp. 55–60) (2015)
9.
Zurück zum Zitat Fang, Y., Liu, H., Li, G., Zhu, X.: A multichannel surface emg system for hand motion recognition. Int. J. Humanoid Robot. 12(2), 381–509 (2015)CrossRef Fang, Y., Liu, H., Li, G., Zhu, X.: A multichannel surface emg system for hand motion recognition. Int. J. Humanoid Robot. 12(2), 381–509 (2015)CrossRef
10.
Zurück zum Zitat Yin, Q., Li, G., Zhu, J.: Research on the method of step feature extraction for eod robot based on 2d laser radar. Discret. Contin. Dyn. Syst. 8(6), 1415–1421 (2015)MathSciNetMATHCrossRef Yin, Q., Li, G., Zhu, J.: Research on the method of step feature extraction for eod robot based on 2d laser radar. Discret. Contin. Dyn. Syst. 8(6), 1415–1421 (2015)MathSciNetMATHCrossRef
11.
Zurück zum Zitat Chen, D., Li, G., Sun, Y., Jiang, G., Kong, J., Li, J., Liu, H.: Fusion hand gesture segmentation and extraction based on cmos sensor and 3d sensor. Int. J. Wirel. Mob. Comput. 12(3), 305–312 (2017)CrossRef Chen, D., Li, G., Sun, Y., Jiang, G., Kong, J., Li, J., Liu, H.: Fusion hand gesture segmentation and extraction based on cmos sensor and 3d sensor. Int. J. Wirel. Mob. Comput. 12(3), 305–312 (2017)CrossRef
12.
Zurück zum Zitat Kim, D.H., Lee, J., Yoon, H.S., Kim, J., Sohn, J.: Vision-based arm gesture recognition for a long-range human-robot interaction. J. Supercomput. 65(1), 336–352 (2013)CrossRef Kim, D.H., Lee, J., Yoon, H.S., Kim, J., Sohn, J.: Vision-based arm gesture recognition for a long-range human-robot interaction. J. Supercomput. 65(1), 336–352 (2013)CrossRef
13.
Zurück zum Zitat Murthy, G.R.S., Jadon, R.S.: Hand gesture recognition using neural networks. Adv. Comput. Conf. 41, 134–138 (2010) Murthy, G.R.S., Jadon, R.S.: Hand gesture recognition using neural networks. Adv. Comput. Conf. 41, 134–138 (2010)
14.
Zurück zum Zitat Chen, D.S., Li, G.F., Sun, Y., Kong, J.Y., Jiang, G.Z., Tang, H., Ju, Z.J., Yu, H., Liu, H.H.: An interactive image segmentation method in hand gesture recognition. Sensors 17(2), 1–7 (2017)CrossRef Chen, D.S., Li, G.F., Sun, Y., Kong, J.Y., Jiang, G.Z., Tang, H., Ju, Z.J., Yu, H., Liu, H.H.: An interactive image segmentation method in hand gesture recognition. Sensors 17(2), 1–7 (2017)CrossRef
15.
Zurück zum Zitat Li, J., Liu, X., Ouyang, G.: Using relevance feedback to distinguish the changes in EEG during different absence seizure phases. Clin. EEG Neurosci. 47(3), 211–219 (2016)CrossRef Li, J., Liu, X., Ouyang, G.: Using relevance feedback to distinguish the changes in EEG during different absence seizure phases. Clin. EEG Neurosci. 47(3), 211–219 (2016)CrossRef
16.
Zurück zum Zitat Mazumdar, M., Jeong, M.H., You, B.J.: An online optimal path decoder for HMM towards connected hand gesture recognition. IFAC Proc. Vol. 41(2), 736–741 (2008)CrossRef Mazumdar, M., Jeong, M.H., You, B.J.: An online optimal path decoder for HMM towards connected hand gesture recognition. IFAC Proc. Vol. 41(2), 736–741 (2008)CrossRef
17.
Zurück zum Zitat Li, B., Sun, Y., Li, G., Kong, J., Jiang, G., Jiang, D., Liu, H.: Gesture recognition based on modified adaptive orthogonal matching pursuit algorithm. Clust. Comput. 3, 1–10 (2017) Li, B., Sun, Y., Li, G., Kong, J., Jiang, G., Jiang, D., Liu, H.: Gesture recognition based on modified adaptive orthogonal matching pursuit algorithm. Clust. Comput. 3, 1–10 (2017)
18.
Zurück zum Zitat Li, Z., Li, G., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Intelligent computation of grasping and manipulation for multi-fingered robotic hands. J. Comput. Theor. Nanosci. 12(12), 6192–6197 (2015)CrossRef Li, Z., Li, G., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Intelligent computation of grasping and manipulation for multi-fingered robotic hands. J. Comput. Theor. Nanosci. 12(12), 6192–6197 (2015)CrossRef
19.
Zurück zum Zitat Li, Z., Li, G., Kong, J., Sun, Y., Jiang, G., Liu, H.: Development of articulated robot trajectory planning. Int. J. Comput. Sci. Math. 8(1), 52–60 (2017)MathSciNetCrossRef Li, Z., Li, G., Kong, J., Sun, Y., Jiang, G., Liu, H.: Development of articulated robot trajectory planning. Int. J. Comput. Sci. Math. 8(1), 52–60 (2017)MathSciNetCrossRef
20.
21.
Zurück zum Zitat Ding, W., Li, G., Sun, Y., Kong, J., Jiang, G., Liu, H.: D-s evidential theory on semg signal recognition. Int. J. Comput. Sci. Math. 8(2), 138–145 (2017)MathSciNetCrossRef Ding, W., Li, G., Sun, Y., Kong, J., Jiang, G., Liu, H.: D-s evidential theory on semg signal recognition. Int. J. Comput. Sci. Math. 8(2), 138–145 (2017)MathSciNetCrossRef
22.
Zurück zum Zitat Pan, M.S., Tang, J.T.: An adaptive median filter algorithm based on B-spline function, vol. 8, pp. 92–99. Springer-Verlag, New York (2011) Pan, M.S., Tang, J.T.: An adaptive median filter algorithm based on B-spline function, vol. 8, pp. 92–99. Springer-Verlag, New York (2011)
23.
Zurück zum Zitat Liu, W., Zhang, D., Cui, M., Ding, J.: An enhanced depth map based rendering method with directional depth filter and image inpainting. Visual Comput. 32(5), 579–589 (2016)CrossRef Liu, W., Zhang, D., Cui, M., Ding, J.: An enhanced depth map based rendering method with directional depth filter and image inpainting. Visual Comput. 32(5), 579–589 (2016)CrossRef
24.
Zurück zum Zitat Miao, W., Li, G., Sun, Y., Jiang, G., Kong, J., Liu, H.: Gesture recognition based on sparse representation. Int. J. Wirel. Mob. Comput. 11(4), 348–356 (2016)CrossRef Miao, W., Li, G., Sun, Y., Jiang, G., Kong, J., Liu, H.: Gesture recognition based on sparse representation. Int. J. Wirel. Mob. Comput. 11(4), 348–356 (2016)CrossRef
25.
Zurück zum Zitat Stolarek, J.: Improving energy compaction of a wavelet transform using genetic algorithm and fast neural network. Arch. Control Sci. 20(4), 417–433 (2010)MathSciNetMATHCrossRef Stolarek, J.: Improving energy compaction of a wavelet transform using genetic algorithm and fast neural network. Arch. Control Sci. 20(4), 417–433 (2010)MathSciNetMATHCrossRef
26.
Zurück zum Zitat Biradar, N., Dewal, M.L., Rohit, M.K., Jindal, I.: Echocardiographic image denoising using extreme total variation bilateral filter. Optik Int. J. Light Electron Opt. 127(1), 30–38 (2016)CrossRef Biradar, N., Dewal, M.L., Rohit, M.K., Jindal, I.: Echocardiographic image denoising using extreme total variation bilateral filter. Optik Int. J. Light Electron Opt. 127(1), 30–38 (2016)CrossRef
27.
Zurück zum Zitat Ju, Z., Ji, X., Li, J., Liu, H.: An integrative framework of human hand gesture segmentation for human-robot interaction. IEEE Syst. J. 11(3), 1326–1336 (2017)CrossRef Ju, Z., Ji, X., Li, J., Liu, H.: An integrative framework of human hand gesture segmentation for human-robot interaction. IEEE Syst. J. 11(3), 1326–1336 (2017)CrossRef
28.
Zurück zum Zitat Li, G., Kong, J., Jiang, G., Xie, L., Jiang, Z., Zhao, G.: Air-fuel ratio intelligent control in coke oven combustion process. Int. J. Infor. 15(11), 4487–4494 (2012) Li, G., Kong, J., Jiang, G., Xie, L., Jiang, Z., Zhao, G.: Air-fuel ratio intelligent control in coke oven combustion process. Int. J. Infor. 15(11), 4487–4494 (2012)
29.
Zurück zum Zitat Bapat, A., Ravi, A. and Raman, S.: An iterative, non-local approach for restoring depth maps in RGB-D images. In: Communications IEEE, pp. 1–6 (2015) Bapat, A., Ravi, A. and Raman, S.: An iterative, non-local approach for restoring depth maps in RGB-D images. In: Communications IEEE, pp. 1–6 (2015)
30.
Zurück zum Zitat Ijjina, E.P., Chalavadi, K.M.: Human action recognition using genetic algorithms and convolutional neural networks. Pattern Recognit. 59(11), 199–212 (2016)CrossRef Ijjina, E.P., Chalavadi, K.M.: Human action recognition using genetic algorithms and convolutional neural networks. Pattern Recognit. 59(11), 199–212 (2016)CrossRef
31.
Zurück zum Zitat Chen, D., Li, G., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Intelligent computational control of multi-fingered dexterous robotic hand. J. Comput. Theor. Nanosci. 12(12), 6126–6132 (2015)CrossRef Chen, D., Li, G., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Intelligent computational control of multi-fingered dexterous robotic hand. J. Comput. Theor. Nanosci. 12(12), 6126–6132 (2015)CrossRef
32.
Zurück zum Zitat Sanchez-Riera, J., Hua, K.L., Hsiao, Y.S., Lim, T., Hidayati, S.C., Cheng, W.H.: A comparative study of data fusion for RGB-D based visual recognition. Pattern Recognit. Lett. 73, 1–6 (2016)CrossRef Sanchez-Riera, J., Hua, K.L., Hsiao, Y.S., Lim, T., Hidayati, S.C., Cheng, W.H.: A comparative study of data fusion for RGB-D based visual recognition. Pattern Recognit. Lett. 73, 1–6 (2016)CrossRef
33.
Zurück zum Zitat Mahmoudi, M., Sapiro, G.: Sparse representations for range data restoration. IEEE Trans. Image Process. 21(5), 2909–2915 (2012)MathSciNetMATHCrossRef Mahmoudi, M., Sapiro, G.: Sparse representations for range data restoration. IEEE Trans. Image Process. 21(5), 2909–2915 (2012)MathSciNetMATHCrossRef
34.
Zurück zum Zitat Nebti, S., Boukerram, A.: Handwritten characters recognition based on nature-inspired computing and neuro-evolution. Appl. Intell. 38(2), 146–159 (2013)CrossRef Nebti, S., Boukerram, A.: Handwritten characters recognition based on nature-inspired computing and neuro-evolution. Appl. Intell. 38(2), 146–159 (2013)CrossRef
35.
Zurück zum Zitat Li, G., Miao, W., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Intelligent control model and its simulation of flue temperature in coke oven. Discret. Contin. Dyn. Syst. Ser. S 8(6), 1223–1237 (2017)MathSciNetMATH Li, G., Miao, W., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Intelligent control model and its simulation of flue temperature in coke oven. Discret. Contin. Dyn. Syst. Ser. S 8(6), 1223–1237 (2017)MathSciNetMATH
36.
Zurück zum Zitat Ding, W., Li, G., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Intelligent computation in grasping control of dexterous robot hand. J. Comput. Theor. Nanosci. 12(12), 6096–6099 (2015)CrossRef Ding, W., Li, G., Jiang, G., Fang, Y., Ju, Z., Liu, H.: Intelligent computation in grasping control of dexterous robot hand. J. Comput. Theor. Nanosci. 12(12), 6096–6099 (2015)CrossRef
37.
Zurück zum Zitat Li, G., Liu, J., Jiang, G., Liu, H.: Numerical simulation of temperature field and thermal stress field in the new type of ladle with the nanometer adiabatic material. Adv. Mech. Eng. 7(4), 1–13 (2015) Li, G., Liu, J., Jiang, G., Liu, H.: Numerical simulation of temperature field and thermal stress field in the new type of ladle with the nanometer adiabatic material. Adv. Mech. Eng. 7(4), 1–13 (2015)
38.
Zurück zum Zitat Li, G., Gu, Y., Kong, J., Jiang, G., Xie, L., Wu, Z., Li, Z., He, Y., Gao, P.: Intelligent control of air compressor production process. Appl. Math. Inf. Sci. 7(3), 1051–1058 (2013)CrossRef Li, G., Gu, Y., Kong, J., Jiang, G., Xie, L., Wu, Z., Li, Z., He, Y., Gao, P.: Intelligent control of air compressor production process. Appl. Math. Inf. Sci. 7(3), 1051–1058 (2013)CrossRef
39.
Zurück zum Zitat Li, G., Qu, P., Kong, J., Jiang, G., Xie, L., Gao, P., Wu, Z., He, Y.: Coke oven intelligent integrated control system. Appl. Math. Inf. Sci. 7(3), 1043–1050 (2013)CrossRef Li, G., Qu, P., Kong, J., Jiang, G., Xie, L., Gao, P., Wu, Z., He, Y.: Coke oven intelligent integrated control system. Appl. Math. Inf. Sci. 7(3), 1043–1050 (2013)CrossRef
40.
Zurück zum Zitat Li, G., Qu, P., Kong, J., Jiang, G., Xie, L., Wu, Z., Gao, P., He, H.: Influence of working lining parameters on temperature and stress field of ladle. Appl. Math. Inf. Sci. 7(2), 439–448 (2013)CrossRef Li, G., Qu, P., Kong, J., Jiang, G., Xie, L., Wu, Z., Gao, P., He, H.: Influence of working lining parameters on temperature and stress field of ladle. Appl. Math. Inf. Sci. 7(2), 439–448 (2013)CrossRef
41.
Zurück zum Zitat Liao, Y., Sun, Y., Li, G., Kong, J., Jiang, G., Jiang, D., Cai, H., Ju, Z.J., Yu, H., Liu, H.H.: Simultaneous calibration: a joint optimization approach for multiple kinect and external cameras. Sensors 17(7), 1–16 (2017)CrossRef Liao, Y., Sun, Y., Li, G., Kong, J., Jiang, G., Jiang, D., Cai, H., Ju, Z.J., Yu, H., Liu, H.H.: Simultaneous calibration: a joint optimization approach for multiple kinect and external cameras. Sensors 17(7), 1–16 (2017)CrossRef
42.
Zurück zum Zitat Li, G., Liu, Z., Jiang, G., Xiong, H., Liu, H.: Numerical simulation of the influence factors for rotary kiln in temperature field and stress field and the structure optimization. Adv. Mech. Eng. 7(6), 1–15 (2015)CrossRef Li, G., Liu, Z., Jiang, G., Xiong, H., Liu, H.: Numerical simulation of the influence factors for rotary kiln in temperature field and stress field and the structure optimization. Adv. Mech. Eng. 7(6), 1–15 (2015)CrossRef
Metadaten
Titel
Hand gesture recognition based on convolution neural network
verfasst von
Gongfa Li
Heng Tang
Ying Sun
Jianyi Kong
Guozhang Jiang
Du Jiang
Bo Tao
Shuang Xu
Honghai Liu
Publikationsdatum
29.12.2017
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe Sonderheft 2/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-1435-x

Weitere Artikel der Sonderheft 2/2019

Cluster Computing 2/2019 Zur Ausgabe