Skip to main content
Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) 3/2017

04.07.2016 | Original Paper

Accuracy in fingertip tracking using Leap Motion Controller for interactive virtual applications

verfasst von: Pier Paolo Valentini, Eugenio Pezzuti

Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper deals with an experimental assessment of the Leap Motion Controller\(^{\textregistered }\). This device is able to track the user’s hands in a real environment. Due to low-invasiveness and easiness of use, it is promising for the integration in virtual or augmented reality, research and entertainment scenarios. The assessment is performed in a real context using volunteers that were asked to point with the fingertips to a set of predefined locations in space. A specific test rig has been designed and built. It is comprised of a transparent plate supported by adjustable pillars and mounted over the Leap. The data are processed to assess the errors in tracking the five fingertips of the right hand. Results show that the accuracy and precision of the Leap is suitable for robust tracking of the user’s hand. The results also unveil that there are preferable zones in which the tracking performance is better.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev 37, 311–324 (2007)CrossRef Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev 37, 311–324 (2007)CrossRef
2.
Zurück zum Zitat Merienne, F.: Human factors consideration in the interaction process with virtual environment. Int. J. Interact. Des. Manuf. 4(2), 83–86 (2000)CrossRef Merienne, F.: Human factors consideration in the interaction process with virtual environment. Int. J. Interact. Des. Manuf. 4(2), 83–86 (2000)CrossRef
3.
Zurück zum Zitat Bowman, D.A., Kruijf, E., La Viola, J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley, New York (2005) Bowman, D.A., Kruijf, E., La Viola, J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley, New York (2005)
4.
Zurück zum Zitat Valentini, P.P.: Interactive virtual assembling in augmented reality. Int. J. Interact. Des. Manuf. 3, 109–119 (2009)CrossRef Valentini, P.P.: Interactive virtual assembling in augmented reality. Int. J. Interact. Des. Manuf. 3, 109–119 (2009)CrossRef
5.
Zurück zum Zitat Valentini, P.P.: Interactive cable harnessing in augmented reality. Int. J. Interact. Des. Manuf. 5, 45–53 (2011)CrossRef Valentini, P.P.: Interactive cable harnessing in augmented reality. Int. J. Interact. Des. Manuf. 5, 45–53 (2011)CrossRef
6.
Zurück zum Zitat Valentini, P.P., Pezzuti, E.: Design and interactive simulation of cross-axis compliant pivot using dynamic splines. Int. J. Interact. Des. Manuf. 7(4), 261–269 (2013)CrossRef Valentini, P.P., Pezzuti, E.: Design and interactive simulation of cross-axis compliant pivot using dynamic splines. Int. J. Interact. Des. Manuf. 7(4), 261–269 (2013)CrossRef
7.
Zurück zum Zitat Mariti, L., Valentini, P.P.: Efficiency and precise interaction for multibody simulations in augmented reality. Multibody Dyn. Comput. Methods Appl. Ser. Comput. Methods Appl. Sci. (Springer) 28, 173–192 (2013)MATH Mariti, L., Valentini, P.P.: Efficiency and precise interaction for multibody simulations in augmented reality. Multibody Dyn. Comput. Methods Appl. Ser. Comput. Methods Appl. Sci. (Springer) 28, 173–192 (2013)MATH
8.
Zurück zum Zitat Valentini, P.P.: Natural interface in augmented reality interactive simulations. Virtual Phys. Prototyp. 7, 137–151 (2012)CrossRef Valentini, P.P.: Natural interface in augmented reality interactive simulations. Virtual Phys. Prototyp. 7, 137–151 (2012)CrossRef
9.
Zurück zum Zitat Valentini, P.P.: Human Factors in Augmented Reality Environments. Enhancing user role in augmented reality interactive simulations. Springer, New York (2013) Valentini, P.P.: Human Factors in Augmented Reality Environments. Enhancing user role in augmented reality interactive simulations. Springer, New York (2013)
10.
Zurück zum Zitat Kim, M., Lee, J.Y.: Touch and hand gesture-based interactions for directly manipulating 3D virtual objects in mobile augmented reality. Multimed. Tools Appl. (in press) (2016) Kim, M., Lee, J.Y.: Touch and hand gesture-based interactions for directly manipulating 3D virtual objects in mobile augmented reality. Multimed. Tools Appl. (in press) (2016)
11.
Zurück zum Zitat Katahira, R., Soga, M.: Development and evaluation of a system for AR enabling realistic display of gripping motions using Leap Motion Controller. Proc. Comput. Sci. 60, 1595–1603 (2015)CrossRef Katahira, R., Soga, M.: Development and evaluation of a system for AR enabling realistic display of gripping motions using Leap Motion Controller. Proc. Comput. Sci. 60, 1595–1603 (2015)CrossRef
12.
Zurück zum Zitat Regenbrecht, H., Collins, J., Hoermann, S.: A leap-supported, hybrid AR interface approach. In: Proceedings of the 25th Australian Computer–Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, Adelaide, 25–29 November 2013, pp. 81–284 (2013) Regenbrecht, H., Collins, J., Hoermann, S.: A leap-supported, hybrid AR interface approach. In: Proceedings of the 25th Australian Computer–Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, Adelaide, 25–29 November 2013, pp. 81–284 (2013)
13.
Zurück zum Zitat Beattie, N., Horan, B., McKenzie, S.: Taking the LEAP with the Oculus HMD and CAD—plucking at thin air? Proc. Technol. 20, 149–154 (2015)CrossRef Beattie, N., Horan, B., McKenzie, S.: Taking the LEAP with the Oculus HMD and CAD—plucking at thin air? Proc. Technol. 20, 149–154 (2015)CrossRef
14.
Zurück zum Zitat Covarrubias, M., Bordegoni, M., Cugini, U.: A hand gestural interaction system for handling a desktop haptic strip for shape rendering. Sens. Actuators A 233, 500–511 (2015)CrossRef Covarrubias, M., Bordegoni, M., Cugini, U.: A hand gestural interaction system for handling a desktop haptic strip for shape rendering. Sens. Actuators A 233, 500–511 (2015)CrossRef
15.
Zurück zum Zitat Oropesa, I., de Jong, T.L., Sánchez-González, P., Dankelman, J., Gómez, E.J.: Feasibility of tracking laparoscopic instruments in a box trainer using a Leap Motion Controller. Measurement 80, 115–124 (2016)CrossRef Oropesa, I., de Jong, T.L., Sánchez-González, P., Dankelman, J., Gómez, E.J.: Feasibility of tracking laparoscopic instruments in a box trainer using a Leap Motion Controller. Measurement 80, 115–124 (2016)CrossRef
16.
Zurück zum Zitat Bizzotto, N., Costanzo, A., Bizzotto, L., Regis, D., Sandri, A., Magnan, B.: Leap motion gesture control with OsiriX in the operating room to control imaging: first experiences during live surgery. Surg. Innov. 21(6), 655–656 (2014)CrossRef Bizzotto, N., Costanzo, A., Bizzotto, L., Regis, D., Sandri, A., Magnan, B.: Leap motion gesture control with OsiriX in the operating room to control imaging: first experiences during live surgery. Surg. Innov. 21(6), 655–656 (2014)CrossRef
17.
Zurück zum Zitat Potter, L.E., Araullo, J., Carter, L.: The Leap Motion Controller: a view on sign language. In: Proceedings of the 25th Australian Computer–Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, Adelaide, 25–29 November 2013, pp. 175–178 (2013) Potter, L.E., Araullo, J., Carter, L.: The Leap Motion Controller: a view on sign language. In: Proceedings of the 25th Australian Computer–Human Interaction Conference: Augmentation, Application, Innovation, Collaboration, Adelaide, 25–29 November 2013, pp. 175–178 (2013)
18.
Zurück zum Zitat Vikram, S., Li, L., Russell, S.: Writing and sketching in the air, recognizing and controlling on the fly. In: CHI ’13 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, pp. 1179–1184 (2013) Vikram, S., Li, L., Russell, S.: Writing and sketching in the air, recognizing and controlling on the fly. In: CHI ’13 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, pp. 1179–1184 (2013)
19.
Zurück zum Zitat Ebert, L.C., Flach, P.M., Thali, M.J., Ross, S.: Out of touch—a plugin for controlling OsiriX with gestures using the Leap Controller. J. Forensic Radiol. Imaging 2, 126–128 (2014)CrossRef Ebert, L.C., Flach, P.M., Thali, M.J., Ross, S.: Out of touch—a plugin for controlling OsiriX with gestures using the Leap Controller. J. Forensic Radiol. Imaging 2, 126–128 (2014)CrossRef
20.
Zurück zum Zitat Ridel, B., Reuter, P., Laviole, J., Mellado, N., Couture, N., et al.: The revealing flashlight: interactive spatial augmented reality for detail exploration of cultural heritage artifacts. J. Comput. Cult. Herit. Assoc. Comput. Mach. 7(2), 1–18 (2014)CrossRef Ridel, B., Reuter, P., Laviole, J., Mellado, N., Couture, N., et al.: The revealing flashlight: interactive spatial augmented reality for detail exploration of cultural heritage artifacts. J. Comput. Cult. Herit. Assoc. Comput. Mach. 7(2), 1–18 (2014)CrossRef
21.
Zurück zum Zitat MacKenzie, I.S., Kauppinen, T., Silfverberg, M.: Accuracy measures for evaluating computer pointing devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, pp. 9–16 (2001) MacKenzie, I.S., Kauppinen, T., Silfverberg, M.: Accuracy measures for evaluating computer pointing devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, pp. 9–16 (2001)
22.
Zurück zum Zitat Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the Leap Motion Controller. Sensors 13(5), 6380–6393 (2013)CrossRef Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the Leap Motion Controller. Sensors 13(5), 6380–6393 (2013)CrossRef
23.
Zurück zum Zitat Guna, J., Jakus, G., Pogačnik, M., Tomažič, S., Sodnik, J.: An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors 14(2), 3702–3720 (2014)CrossRef Guna, J., Jakus, G., Pogačnik, M., Tomažič, S., Sodnik, J.: An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors 14(2), 3702–3720 (2014)CrossRef
24.
Zurück zum Zitat Apostolellis, P., Bortz, B., Peng, M., Polys, N., Hoegh, A.: Exploring the integrality and separability of the Leap Motion Controller for direct manipulation 3D interaction. In: Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI), Minneapolis, 29–30 March 2014, pp. 153–154 (2014) Apostolellis, P., Bortz, B., Peng, M., Polys, N., Hoegh, A.: Exploring the integrality and separability of the Leap Motion Controller for direct manipulation 3D interaction. In: Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI), Minneapolis, 29–30 March 2014, pp. 153–154 (2014)
25.
Zurück zum Zitat Bachmann, D., Weichert, F., Rinkenauer, G.: Evaluation of the Leap Motion Controller as a new contact-free pointing device. Sensors 15(1), 214–233 (2015)CrossRef Bachmann, D., Weichert, F., Rinkenauer, G.: Evaluation of the Leap Motion Controller as a new contact-free pointing device. Sensors 15(1), 214–233 (2015)CrossRef
26.
Zurück zum Zitat Coelho, J.C., Verbeek, F.J.: The leap motion controller in a 3D virtual environment: explorations and evaluations of poiting tasks. In: Proceedings of the 8th International Conference on Interfaces and Human Computer Interaction—Part of the Multi Conference on Computer Science and Information Systems, MCCSIS, 15–17 July 2014, Lisbon (2014) Coelho, J.C., Verbeek, F.J.: The leap motion controller in a 3D virtual environment: explorations and evaluations of poiting tasks. In: Proceedings of the 8th International Conference on Interfaces and Human Computer Interaction—Part of the Multi Conference on Computer Science and Information Systems, MCCSIS, 15–17 July 2014, Lisbon (2014)
27.
Zurück zum Zitat Microscribe: Microscribe Specifications. RevWare, Raleigh (2012) Microscribe: Microscribe Specifications. RevWare, Raleigh (2012)
28.
Zurück zum Zitat Leap Motion: Documentation Developers’ Guide—API Overview. The Leap Motion Inc., San Francisco (2014) Leap Motion: Documentation Developers’ Guide—API Overview. The Leap Motion Inc., San Francisco (2014)
Metadaten
Titel
Accuracy in fingertip tracking using Leap Motion Controller for interactive virtual applications
verfasst von
Pier Paolo Valentini
Eugenio Pezzuti
Publikationsdatum
04.07.2016
Verlag
Springer Paris
Erschienen in
International Journal on Interactive Design and Manufacturing (IJIDeM) / Ausgabe 3/2017
Print ISSN: 1955-2513
Elektronische ISSN: 1955-2505
DOI
https://doi.org/10.1007/s12008-016-0339-y

Weitere Artikel der Ausgabe 3/2017

International Journal on Interactive Design and Manufacturing (IJIDeM) 3/2017 Zur Ausgabe