Skip to main content
Top

2018 | OriginalPaper | Chapter

A Novel Hand Written Technique Using Touch-Less Finger Gesture Movement for Human Computer Interaction

Authors : Y. A. Joarder, Md Bipul Hossain, Md Jashim Uddin, Md Zahidul Islam

Published in: Human-Computer Interaction. Interaction Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Presently for various reasons people are concerned about directly touching the biometric scanners, therefore touch-less and non-invasive approach seems to be useful in practical applications. For the importance and complexity of handwritten character input in human-computer interaction system, a touch-less character input method has been proposed. A person uses his Finger Gesture Movement spot for writing in the air in this method, the video of Finger Gesture movement in air is recorded by a camera and processed utilizing computer vision technology, then the handwritten character image is reconstructed, finally, the reconstructed character is recognized. The algorithm of Finger Gesture spot detection and character image recovery is given, and their effectively has been verified experimentally in this paper. Depending on the hand motion dynamics, treated as a bio-metrics; as an input pattern for recognition system, finger Gesture movement can be a sufficient base for efficient user identification.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bagdanov, A.D., Del Bimbo, A., Seidenari, L., Usai, L.: Real-time hand status recognition from RGB-D imagery. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR 2012), pp. 2456–2459, November 2012 Bagdanov, A.D., Del Bimbo, A., Seidenari, L., Usai, L.: Real-time hand status recognition from RGB-D imagery. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR 2012), pp. 2456–2459, November 2012
2.
go back to reference Elmezain, M., Al-Hamadi, A., Michaelis, B.: A robust method for hand gesture segmentation and recognition using forward spotting scheme in conditional random fields. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR 2010), pp. 3850–3853, August 2010 Elmezain, M., Al-Hamadi, A., Michaelis, B.: A robust method for hand gesture segmentation and recognition using forward spotting scheme in conditional random fields. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR 2010), pp. 3850–3853, August 2010
3.
go back to reference Lee, C.-S., Chun, S.Y., Park, S.W.: Articulated hand configuration and rotation estimation using extended torus manifold embedding. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR 2012), pp. 441–444, November 2012 Lee, C.-S., Chun, S.Y., Park, S.W.: Articulated hand configuration and rotation estimation using extended torus manifold embedding. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR 2012), pp. 441–444, November 2012
4.
go back to reference Malgireddy, M.R., Corso, J.J., Setlur, S., Govindaraju, V., Mandalapu, D.: A framework for hand gesture recognition and spotting using sub-gesture modeling. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR 2010), pp. 3780–3783, August 2010 Malgireddy, M.R., Corso, J.J., Setlur, S., Govindaraju, V., Mandalapu, D.: A framework for hand gesture recognition and spotting using sub-gesture modeling. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR 2010), pp. 3780–3783, August 2010
5.
go back to reference Suryanarayan, P., Subramanian, A., Mandalapu, D.: Dynamic hand pose recognition using depth data. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR 2010), pp. 3105–3108, August 2010 Suryanarayan, P., Subramanian, A., Mandalapu, D.: Dynamic hand pose recognition using depth data. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR 2010), pp. 3105–3108, August 2010
6.
go back to reference Park, S., Yu, S., Kim, J., Kim, S., Lee, S.: 3D hand tracking using Kalman filter in depth space. Eurasip J. Adv. Signal Process. 2012(1), Article 36 (2012) Park, S., Yu, S., Kim, J., Kim, S., Lee, S.: 3D hand tracking using Kalman filter in depth space. Eurasip J. Adv. Signal Process. 2012(1), Article 36 (2012)
7.
go back to reference Raheja, J.L., Chaudhary, A., Singal, K.: Tracking of fingertips and centers of palm using KINECT. In: Proceedings of the 2nd International Conference on Computational Intelligence, Modelling and Simulation (CIMSim 2011), pp. 248–252, September 2011 Raheja, J.L., Chaudhary, A., Singal, K.: Tracking of fingertips and centers of palm using KINECT. In: Proceedings of the 2nd International Conference on Computational Intelligence, Modelling and Simulation (CIMSim 2011), pp. 248–252, September 2011
8.
go back to reference Wang, Y., Yang, C., Wu, X., Xu, S., Li, H.: Kinect based dynamic hand gesture recognition algorithm research. In: Proceedings of the 4th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC 2012), pp. 274– 279, August 2012 Wang, Y., Yang, C., Wu, X., Xu, S., Li, H.: Kinect based dynamic hand gesture recognition algorithm research. In: Proceedings of the 4th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC 2012), pp. 274– 279, August 2012
9.
go back to reference Panwar, M.: Hand gesture recognition based on shape parameters. In: Proceedings of the International Conference on Computing, Communication and Applications (ICCCA 2012), pp. 1–6, February 2012 Panwar, M.: Hand gesture recognition based on shape parameters. In: Proceedings of the International Conference on Computing, Communication and Applications (ICCCA 2012), pp. 1–6, February 2012
10.
go back to reference Meng, Z.Y., Pan, J.-S., Tseng, K.-K., Zheng, W.: Dominant points based hand finger counting for recognition under skin color extraction in hand gesture control system. In: Proceedings of the 6th International Conference on Genetic and Evolutionary Computing (ICGEC 2012), pp. 364–367, August 2012 Meng, Z.Y., Pan, J.-S., Tseng, K.-K., Zheng, W.: Dominant points based hand finger counting for recognition under skin color extraction in hand gesture control system. In: Proceedings of the 6th International Conference on Genetic and Evolutionary Computing (ICGEC 2012), pp. 364–367, August 2012
11.
go back to reference Harshitha, R., Syed, I.A., Srivasthava, S.: HCI using hand gesture recognition for digital sand model. In: Proceedings of the 2nd IEEE International Conference on Image Information Processing (ICIIP 2013), pp. 453–457 (2013) Harshitha, R., Syed, I.A., Srivasthava, S.: HCI using hand gesture recognition for digital sand model. In: Proceedings of the 2nd IEEE International Conference on Image Information Processing (ICIIP 2013), pp. 453–457 (2013)
12.
go back to reference Yang, R., Sarkar, S., Loeding, B.: Handling movement epenthesis and hand segmentation ambiguities in continuous sign language recognition using nested dynamic programming. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 462–477 (2010)CrossRef Yang, R., Sarkar, S., Loeding, B.: Handling movement epenthesis and hand segmentation ambiguities in continuous sign language recognition using nested dynamic programming. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 462–477 (2010)CrossRef
13.
go back to reference Zafrulla, Z., Brashear, H., Starner, T., Hamilton, H., Presti, P.: American sign language recognition with the Kinect. In: Proceedings of the 13th ACM International Conference on Multimodal Interfaces (ICMI 2011), pp. 279–286, November 2011 Zafrulla, Z., Brashear, H., Starner, T., Hamilton, H., Presti, P.: American sign language recognition with the Kinect. In: Proceedings of the 13th ACM International Conference on Multimodal Interfaces (ICMI 2011), pp. 279–286, November 2011
14.
go back to reference Uebersax, D., Gall, J., Van den Bergh, M., Van Gool, L.: Realtime sign language letter and word recognition from depth data. In: Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV 2011), pp. 383–390, November 2011 Uebersax, D., Gall, J., Van den Bergh, M., Van Gool, L.: Realtime sign language letter and word recognition from depth data. In: Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV 2011), pp. 383–390, November 2011
15.
go back to reference Pugeault, N., Bowden, R.: Spelling it out: real-time ASL fingerspelling recognition. In: Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV 2011), pp. 1114–1119, November 2011 Pugeault, N., Bowden, R.: Spelling it out: real-time ASL fingerspelling recognition. In: Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV 2011), pp. 1114–1119, November 2011
16.
go back to reference Wickeroth, D., Benolken, P., Lang, U.: Markerless gesture based interaction for design review scenarios. In: Proceedings of the 2nd International Conference on the Applications of Digital Information and Web Technologies (ICADIWT 2009), pp. 682–687, August 2009 Wickeroth, D., Benolken, P., Lang, U.: Markerless gesture based interaction for design review scenarios. In: Proceedings of the 2nd International Conference on the Applications of Digital Information and Web Technologies (ICADIWT 2009), pp. 682–687, August 2009
17.
go back to reference Frati, V., Prattichizzo, D.: Using Kinect for hand tracking and rendering in wearable haptics. In: Proceedings of the IEEE World Haptics Conference (WHC 2011), pp. 317–321, June 2011 Frati, V., Prattichizzo, D.: Using Kinect for hand tracking and rendering in wearable haptics. In: Proceedings of the IEEE World Haptics Conference (WHC 2011), pp. 317–321, June 2011
18.
go back to reference Choi, J., Park, H., Park, J.-I.: Hand shape recognition using distance transform and shape decomposition. In: Proceedings of the 18th IEEE International Conference on Image Processing (ICIP 2011), pp. 3605–3608, September 2011 Choi, J., Park, H., Park, J.-I.: Hand shape recognition using distance transform and shape decomposition. In: Proceedings of the 18th IEEE International Conference on Image Processing (ICIP 2011), pp. 3605–3608, September 2011
19.
go back to reference Tan, T.-D., Guo, Z.-M.: Research of hand positioning and gesture recognition based on binocular vision. In: Proceedings of the IEEE International Symposium on Virtual Reality Innovations (ISVRI 2011), pp. 311–315, March 2011 Tan, T.-D., Guo, Z.-M.: Research of hand positioning and gesture recognition based on binocular vision. In: Proceedings of the IEEE International Symposium on Virtual Reality Innovations (ISVRI 2011), pp. 311–315, March 2011
20.
go back to reference Zeng, J., Sun, Y., Wang, F.: A natural hand gesture system for intelligent human-computer interaction and medical assistance. In: Proceedings of the 3rd Global Congress on Intelligent Systems (GCIS 2012), pp. 382–385, November 2012 Zeng, J., Sun, Y., Wang, F.: A natural hand gesture system for intelligent human-computer interaction and medical assistance. In: Proceedings of the 3rd Global Congress on Intelligent Systems (GCIS 2012), pp. 382–385, November 2012
21.
go back to reference Droeschel, D., Stuckler, J., Behnke, S.: Learning to interpret pointing gestures with a time-of-flight camera. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2011), pp. 481–488, March 2011 Droeschel, D., Stuckler, J., Behnke, S.: Learning to interpret pointing gestures with a time-of-flight camera. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2011), pp. 481–488, March 2011
22.
go back to reference Hu, K., Canavan, S., Yin, L.: Hand pointing estimation for human computer interaction based on two orthogonal-views. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR 2010), pp. 3760–3763, August 2010 Hu, K., Canavan, S., Yin, L.: Hand pointing estimation for human computer interaction based on two orthogonal-views. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR 2010), pp. 3760–3763, August 2010
23.
go back to reference Hachaj, T., Ogiela, M.R., Piekarczyk, M.: Dependence of Kinect sensors number and position on gestures recognition with Gesture Description Language semantic classifier. In: Proceedings of the FedCSIS. Series: Annals of Computer Science and Information Systems, vol. 1, pp. 571–575 (2013) Hachaj, T., Ogiela, M.R., Piekarczyk, M.: Dependence of Kinect sensors number and position on gestures recognition with Gesture Description Language semantic classifier. In: Proceedings of the FedCSIS. Series: Annals of Computer Science and Information Systems, vol. 1, pp. 571–575 (2013)
25.
go back to reference Sae-bae, N., et al.: Multitouch gesture-based authentication. IEEE Trans. Inf. Forensics Secur. 9(4), 568–582 (2014)CrossRef Sae-bae, N., et al.: Multitouch gesture-based authentication. IEEE Trans. Inf. Forensics Secur. 9(4), 568–582 (2014)CrossRef
26.
go back to reference Piekarczyk, M., Ogiela, M.R.: On using palm and finger movements as a gesture-based biometrics. In: Proceedings of International Conference on Intelligent Networking and Collaborative Systems, pp. 211–216. IEEE, Los Alamitos (2015). https://doi.org/10.1109/incos.2015.83 Piekarczyk, M., Ogiela, M.R.: On using palm and finger movements as a gesture-based biometrics. In: Proceedings of International Conference on Intelligent Networking and Collaborative Systems, pp. 211–216. IEEE, Los Alamitos (2015). https://​doi.​org/​10.​1109/​incos.​2015.​83
27.
go back to reference Piekarczyk, M., Ogiela, M.R.: The touchless person authentication using gesture-types emulation of handwritten signature templates. In: Proceedings of Tenth International Conference on Broadband and Wireless Computing, Communication and Applications, pp. 132–136. IEEE, Los Alamitos (2015) Piekarczyk, M., Ogiela, M.R.: The touchless person authentication using gesture-types emulation of handwritten signature templates. In: Proceedings of Tenth International Conference on Broadband and Wireless Computing, Communication and Applications, pp. 132–136. IEEE, Los Alamitos (2015)
29.
30.
go back to reference Chen, Z., Kim, J.-T., Liang, J., Zhang, J., Yuan, Y.-B.: Real-time hand gesture recognition using finger segmentation. Sci. World J. 2014, Article ID 267872, 9 pages (2014) Chen, Z., Kim, J.-T., Liang, J., Zhang, J., Yuan, Y.-B.: Real-time hand gesture recognition using finger segmentation. Sci. World J. 2014, Article ID 267872, 9 pages (2014)
31.
go back to reference Yun, S.N., Zhong, L.X.: Experimental research on handwritten character written in the air recognition based on computer vision. In: 2011 4th International Congress on Image and Signal Processing Image and Signal Processing (CISP) (2011) Yun, S.N., Zhong, L.X.: Experimental research on handwritten character written in the air recognition based on computer vision. In: 2011 4th International Congress on Image and Signal Processing Image and Signal Processing (CISP) (2011)
32.
go back to reference Piekarczyk, M., Ogiela, M.R.: Touch-less personal verification using palm and fingers movements tracking. In: Dang, P., Ku, M., Qian, T., Rodino, L. (eds.) New Trends in Analysis and Interdisciplinary Applications. Trends in Mathematics. Birkhäuser, Cham (2017) Piekarczyk, M., Ogiela, M.R.: Touch-less personal verification using palm and fingers movements tracking. In: Dang, P., Ku, M., Qian, T., Rodino, L. (eds.) New Trends in Analysis and Interdisciplinary Applications. Trends in Mathematics. Birkhäuser, Cham (2017)
33.
go back to reference Cheng, H.D., Jiang, X.H., Sun, Y., et al.: Color image segmentation: advances and prospects. Pattern Recogn. 34(12), 2259–2281 (2001)CrossRef Cheng, H.D., Jiang, X.H., Sun, Y., et al.: Color image segmentation: advances and prospects. Pattern Recogn. 34(12), 2259–2281 (2001)CrossRef
34.
go back to reference Kurugollu, F., Sankur, B., Harmanci, A.E.: Color image segmentation using histogram multithresholding and fusion. Image Vis. Comput. 19(13), 915–928 (2001)CrossRef Kurugollu, F., Sankur, B., Harmanci, A.E.: Color image segmentation using histogram multithresholding and fusion. Image Vis. Comput. 19(13), 915–928 (2001)CrossRef
Metadata
Title
A Novel Hand Written Technique Using Touch-Less Finger Gesture Movement for Human Computer Interaction
Authors
Y. A. Joarder
Md Bipul Hossain
Md Jashim Uddin
Md Zahidul Islam
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-91250-9_22