nach oben

Erschienen in:

2022 | OriginalPaper | Buchkapitel

An Asymmetric Parallel Residual Convolutional Neural Network for Pen-Holding Gesture Recognition

verfasst von : Jinyang Ding, Ran Tao, Xin Luo, Xiangyang Feng

Erschienen in: Knowledge Management in Organisations

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Based on deep residual structure, attention mechanism, and CNN, we propose an asymmetric parallel residual convolutional neural network for pen-holding gesture recognition in this paper. To verify the effectiveness of the network, we build a pen-holding gestures dataset containing 923 images of 7 classes, and quadruple the training set by using data augmentation technology. The experimental results show that the accuracy of the propose network reaches \(76.22\%\) on basic pen-holding gestures dataset, and \(82.16\%\) on the augmentation pen-holding gestures dataset. The network and the dataset construction method proposed in this paper can be used to build a pen-holding gesture recognition system, and have reference value for similar recognition tasks without high-quality public datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Agent-Based Vector-Label Propagation for Explaining Social Network Structures

Nächstes Kapitel Plausible 6G Futures: Scenarios for the Future MNO Business Environment in the 6G Era

Murata, K.G.A., Gotoh, K.: Effects of pen holding posture on handwriting motion. Adv. Soc. Organ. Factors 12, 469–478 (2014)

Schwellnus, H., et al.: Effect of pencil grasp on the speed and legibility of handwriting in children. Am. J. Occup. Ther. 66(6), 718–726 (2012)CrossRef

Kim, Y., Soyata, T., Behnagh, R.F.: Towards emotionally aware AI smart classroom: current issues and directions for engineering and education. IEEE Access 6, 5308–5331 (2018). https://doi.org/10.1109/ACCESS.2018.2791861CrossRef

Xu, P.: A real-time hand gesture recognition and human-computer interaction system. arXiv preprint arXiv:1704.07296 (2017)

Cheok, M.J., Omar, Z., Jaward, M.H.: A review of hand gesture and sign language recognition techniques. Int. J. Mach. Learn. Cybern. 10(1), 131–153 (2017). https://doi.org/10.1007/s13042-017-0705-5CrossRef

Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Commun. ACM 60(6), 84–90 (2017)CrossRef

Zhao, Z., Zheng, P., Xu, S., Wu, X.: Object detection with deep learning: a review. IEEE Trans. Neural Netw. Learn. Syst. 30(11), 3212–3232 (2019). https://doi.org/10.1109/TNNLS.2018.2876865CrossRef

Hao, S., Zhou, Y., Guo, Y.: A brief survey on semantic segmentation with deep learning. Neurocomputing 406, 302–321 (2020)CrossRef

Usachokcharoen, P., Washizawa, Y., Pasupa, K.: Sign language recognition with microsoft Kinect’s depth and colour sensors. In: 2015 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), pp. 186–190 (2015). https://doi.org/10.1109/ICSIPA.2015.7412187

10.

Liang, H., Yuan, J., Thalmann, D.: Parsing the hand in depth images. IEEE Trans. Multimed. 16(5), 1241–1253 (2014). https://doi.org/10.1109/TMM.2014.2306177CrossRef

11.

Dadashzadeh, A., et al.: HGR-Net: a fusion network for hand gesture segmentation and recognition. IET Comput. Vis. 13(8), 700–707 (2019)CrossRef

12.

Naji, S., Jalab, H.A., Kareem, S.A.: A survey on skin detection in colored images. Artif. Intell. Rev. 52(2), 1041–1087 (2019). https://doi.org/10.1007/s10462-018-9664-9CrossRef

13.

Basilio, J.A.M., et al.: Explicit image detection using YCbCr space color model as skin detection. In: Applications of Mathematics and Computer Engineering, pp. 123–128 (2011)

14.

Kolkur, S., et al.: Human skin detection using RGB, HSV and YCbCr color models. arXiv preprint arXiv:1708.02694 (2017)

15.

Maharani, D.A., Fakhrurroja, H., Riyanto, Machbub, C.: Hand gesture recognition using K-means clustering and support vector machine. In: 2018 IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE), pp. 1–6 (2018). https://doi.org/10.1109/ISCAIE.2018.8405435

16.

Liu, Y., Wang, X., Yan, K.: Hand gesture recognition based on concentric circular scan lines and weighted K-nearest neighbor algorithm. Multimed. Tools Appl. 77(1), 209–223 (2016). https://doi.org/10.1007/s11042-016-4265-6CrossRef

17.

Rosalina, Yusnita, L., Hadisukmana, N., Wahyu, R.B., Roestam, R., Wahyu, Y.: Implementation of real-time static hand gesture recognition using artificial neural network. In: 2017 4th International Conference on Computer Applications and Information Processing Technology (CAIPT), pp. 1–6 (2017). https://doi.org/10.1109/CAIPT.2017.8320692

18.

Adithya, V., Rajesh, R.: A deep convolutional neural network approach for static hand gesture recognition. Procedia Comput. Sci. 171, 2353–2361 (2020)CrossRef

19.

Pinto, R.F., et al.: Static hand gesture recognition based on convolutional neural networks. J. Electr. Comput. Eng. 2019 (2019). APA

20.

Islam, M.Z., et al.: Static hand gesture recognition using convolutional neural network with data augmentation. In: 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR). IEEE (2019)

21.

Gao, Q., Liu, J., Zhaojie, J., Li, Y., Tian, L.: Static hand gesture recognition with parallel CNNs for space human-robot interaction. In: Huang, YongAn, Hao, Wu., Liu, H., Yin, Z. (eds.) ICIRA 2017. LNCS (LNAI), vol. 10462, pp. 462–473. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65289-4_44CrossRef

22.

He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1904–1916 (2015). https://doi.org/10.1109/TPAMI.2015.2389824CrossRef

23.

Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems (2017)

24.

Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018)

25.

Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., Hu, Q.: ECA-Net: efficient channel attention for deep convolutional neural networks. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11531–11539 (2020). https://doi.org/10.1109/CVPR42600.2020.01155

26.

Woo, S., Park, J., Lee, J.-Y., Kweon, I.S.: CBAM: convolutional block attention module. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 3–19. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_1CrossRef

27.

Hou, Q., Zhou, D., Feng, J.: Coordinate attention for efficient mobile network design. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2021)

28.

He, K., et al.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)

29.

Chattopadhay, A., Sarkar, A., Howlader, P., Balasubramanian, V.N.: Grad-CAM++: generalized gradient-based visual explanations for deep convolutional networks. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 839–847 (2018). https://doi.org/10.1109/WACV.2018.00097

Titel: An Asymmetric Parallel Residual Convolutional Neural Network for Pen-Holding Gesture Recognition
verfasst von: Jinyang Ding
Ran Tao
Xin Luo
Xiangyang Feng
Verlag: Springer International Publishing
Buch: Knowledge Management in Organisations
Print ISBN: 978-3-031-07919-1

Electronic ISBN: 978-3-031-07920-7

Copyright-Jahr: 2022
DOI: https://doi.org/10.1007/978-3-031-07920-7_25

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner