Skip to main content
Top

2019 | OriginalPaper | Chapter

Single Fingertip Detection Using Simple Geometric Properties of the Hand Image: A Case Study for Augmented Reality in an Educational App

Authors : Nikolaos Nomikos, Dimitris Kalles

Published in: Computer Vision Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We propose a fingertip detection method suitable for portable devices’ applications where the user can interact with objects or interface elements located in the augmented space. The method has been experimentally implemented in the context of an application that uses a board containing ArUco markers [1]. The user can press virtual buttons laid on the board or drag items along predetermined paths on the board level by extending the index finger (or thumb) and placing its edge on the object of interest, while the other hand holds the device so that both the object and the hand are visible. We present brief but indicative results of our technique.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F., Marín-Jiménez, M.: Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn. 47(6), 2280–2292 (2014)CrossRef Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F., Marín-Jiménez, M.: Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn. 47(6), 2280–2292 (2014)CrossRef
2.
go back to reference Fukumoto, M., Tonomura, Y.: Body coupled FingerRing: wireless wearable keyboard. In: ACM SIGCHI Conference on Human factors in computing systems (CHI ‘97), New York, USA (1997) Fukumoto, M., Tonomura, Y.: Body coupled FingerRing: wireless wearable keyboard. In: ACM SIGCHI Conference on Human factors in computing systems (CHI ‘97), New York, USA (1997)
4.
go back to reference Buchmann, V., Violich, S., Billinghurst, M., Cockburn, A.: FingARtips: gesture based direct manipulation in augmented reality. In: 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (GRAPHITE ‘04). Suntec City, Singapore (2004) Buchmann, V., Violich, S., Billinghurst, M., Cockburn, A.: FingARtips: gesture based direct manipulation in augmented reality. In: 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (GRAPHITE ‘04). Suntec City, Singapore (2004)
5.
go back to reference Feng, Z., Xu, S., Zhang, X., Jin, L., Ye, Z., Yang, W.: Real-time fingertip tracking and detection using Kinect depth sensor for a new writing-in-the air system. In: 4th International Conference on Internet Multimedia Computing and Service (ICIMCS ‘12), Wuhan, China (2012) Feng, Z., Xu, S., Zhang, X., Jin, L., Ye, Z., Yang, W.: Real-time fingertip tracking and detection using Kinect depth sensor for a new writing-in-the air system. In: 4th International Conference on Internet Multimedia Computing and Service (ICIMCS ‘12), Wuhan, China (2012)
6.
go back to reference Shah, S.A.H., Ahmed, A., Mahmood, I., Khurshid, K.: Hand gesture based user interface for computer using a camera and projector. In: 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuala Lumpur, Malaysia (2011) Shah, S.A.H., Ahmed, A., Mahmood, I., Khurshid, K.: Hand gesture based user interface for computer using a camera and projector. In: 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuala Lumpur, Malaysia (2011)
7.
go back to reference Letessier, J., Bérard, F.: Visual tracking of bare fingers for interactive surfaces. In: 17th Annual ACM Symposium on User Interface Software and Technology (UIST ‘04), Santa Fe, New Mexico (2004) Letessier, J., Bérard, F.: Visual tracking of bare fingers for interactive surfaces. In: 17th Annual ACM Symposium on User Interface Software and Technology (UIST ‘04), Santa Fe, New Mexico (2004)
8.
go back to reference Malik, S., Laszlo, J.: Visual touchpad: a two-handed gestural input device. In: 6th International Conference on Multimodal Interfaces (ICMI ‘04), State College, PA, USA (2004) Malik, S., Laszlo, J.: Visual touchpad: a two-handed gestural input device. In: 6th International Conference on Multimodal Interfaces (ICMI ‘04), State College, PA, USA (2004)
9.
go back to reference Wilson, D.A.: PlayAnywhere: a compact interactive tabletop projection-vision system. In: 18th Annual ACM Symposium on User Interface Software and Technology (UIST ‘05), Seattle, WA, USA (2005) Wilson, D.A.: PlayAnywhere: a compact interactive tabletop projection-vision system. In: 18th Annual ACM Symposium on User Interface Software and Technology (UIST ‘05), Seattle, WA, USA (2005)
10.
go back to reference Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: a class of displays on the reality-virtuality continuum. In: Telemanipulator and Telepresence Technologies, Boston, MA, United States (1995) Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: a class of displays on the reality-virtuality continuum. In: Telemanipulator and Telepresence Technologies, Boston, MA, United States (1995)
12.
go back to reference El Kabtane, H., El Adnani, M., Sadgal, M., Mourdi, Y.: Toward an occluded augmented reality framework in E-learning platforms for practical activities. J. Eng. Sci. Technol. 13(2), 394–408 (2018) El Kabtane, H., El Adnani, M., Sadgal, M., Mourdi, Y.: Toward an occluded augmented reality framework in E-learning platforms for practical activities. J. Eng. Sci. Technol. 13(2), 394–408 (2018)
13.
go back to reference Sinclair, P.A.S., Martinez, K., Millard, D.E., Weal, M.J.: Augmented reality as an interface to adaptive. New Rev. Hypermedia Multimedia 9, 117–136 (2003)CrossRef Sinclair, P.A.S., Martinez, K., Millard, D.E., Weal, M.J.: Augmented reality as an interface to adaptive. New Rev. Hypermedia Multimedia 9, 117–136 (2003)CrossRef
14.
go back to reference Cai, S., Chiang, F.-K., Sun, Y., Lin, C., Lee, J.J.: Applications of augmented reality-based natural interactive learning in magnetic field instruction. Interact. Learn. Environ. 25, 778–791 (2017)CrossRef Cai, S., Chiang, F.-K., Sun, Y., Lin, C., Lee, J.J.: Applications of augmented reality-based natural interactive learning in magnetic field instruction. Interact. Learn. Environ. 25, 778–791 (2017)CrossRef
15.
go back to reference Martin-Gonzalez, A., Chi-Poot, A., Uc-Cetina, V.: Usability evaluation of an augmented reality system for teaching Euclidean vectors. Innov. Educ. Teach. Int. 53, 627–636 (2016)CrossRef Martin-Gonzalez, A., Chi-Poot, A., Uc-Cetina, V.: Usability evaluation of an augmented reality system for teaching Euclidean vectors. Innov. Educ. Teach. Int. 53, 627–636 (2016)CrossRef
Metadata
Title
Single Fingertip Detection Using Simple Geometric Properties of the Hand Image: A Case Study for Augmented Reality in an Educational App
Authors
Nikolaos Nomikos
Dimitris Kalles
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-34995-0_55

Premium Partner