Skip to main content
Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) 4/2018

05.03.2018 | Original Paper

Natural interface for interactive virtual assembly in augmented reality using Leap Motion Controller

verfasst von: Pier Paolo Valentini

Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) | Ausgabe 4/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, an augmented reality methodology based on the use of a low-invasiveness hand tracking device is presented. The developed methodology, allows the user to be visually immersed into an augmented scene by means of a head-mounted display. He can interact with the virtual objects without any wearable sensor using the Leap Motion Controller that is able to acquire the pose of each finger of both hands by optical triangulation without markers. In this way, the interaction between the user and the scene can be considered “natural”. The interaction between hands and objects and the assembling among objects is achieved by the modification of the Object Active Feature–Grasping Active Feature methodology, based on the use of algebraic kinematic constraint equations. The approach has been adapted to take into account the specific information coming from the tracking device. An example of implementation is reported and an experimental usability study discussed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Valentini, P.P., Pezzuti, E., Gattamelata, D.: Virtual Engineering in Augmented Reality, Computer Animation, Series “Computer Science, Technology and Applications”. Nova Publishing, New York (2010) Valentini, P.P., Pezzuti, E., Gattamelata, D.: Virtual Engineering in Augmented Reality, Computer Animation, Series “Computer Science, Technology and Applications”. Nova Publishing, New York (2010)
2.
Zurück zum Zitat Merienne, F.: Human factors consideration in the interaction process with virtual environment. Int. J. Interact. Des. Manuf. 4(2), 83–86 (2000)CrossRef Merienne, F.: Human factors consideration in the interaction process with virtual environment. Int. J. Interact. Des. Manuf. 4(2), 83–86 (2000)CrossRef
3.
Zurück zum Zitat Valentini, P.P.: Enhancing User Role in Augmented Reality Interactive Simulations, in Human Factors in Augmented Reality Environments, pp. 233–256. Springer, New York (2013)CrossRef Valentini, P.P.: Enhancing User Role in Augmented Reality Interactive Simulations, in Human Factors in Augmented Reality Environments, pp. 233–256. Springer, New York (2013)CrossRef
4.
Zurück zum Zitat Wiedenmaier, S., Oehme, O., Schmidt, L., Luczak, H.: Augmented reality (AR) for assembly processes design and experimental evaluation. Int. J. Hum. Comput. Interact. 16, 497–514 (2003)CrossRef Wiedenmaier, S., Oehme, O., Schmidt, L., Luczak, H.: Augmented reality (AR) for assembly processes design and experimental evaluation. Int. J. Hum. Comput. Interact. 16, 497–514 (2003)CrossRef
5.
Zurück zum Zitat Pang, Y., Nee, A.Y.C., Ong, S.K., Yuan, M.L., Youcef-Toumi, K.: Assembly feature design in an augmented reality environment. Assem. Autom. 26(1), 34–43 (2006)CrossRef Pang, Y., Nee, A.Y.C., Ong, S.K., Yuan, M.L., Youcef-Toumi, K.: Assembly feature design in an augmented reality environment. Assem. Autom. 26(1), 34–43 (2006)CrossRef
6.
Zurück zum Zitat Ong, S.K., Pang, Y., Nee, A.Y.C.: Augmented reality aided assembly design and planning. Ann. CIRP 56–1, 49–52 (2007)CrossRef Ong, S.K., Pang, Y., Nee, A.Y.C.: Augmented reality aided assembly design and planning. Ann. CIRP 56–1, 49–52 (2007)CrossRef
7.
Zurück zum Zitat Saaski, J., Salonen, T., Hakkarainen, M., Siltanen, S., Woodward, C., Lempiainen, J.: Integration of design and assembly using augmented reality. In: Ratchev, S., Koelemeijer, S. (eds.) IFIP International Federation for Information Processing. Micro-Assembly, Technologies and Applications, vol. 260, pp. 395–404. Springer, Boston (2008) Saaski, J., Salonen, T., Hakkarainen, M., Siltanen, S., Woodward, C., Lempiainen, J.: Integration of design and assembly using augmented reality. In: Ratchev, S., Koelemeijer, S. (eds.) IFIP International Federation for Information Processing. Micro-Assembly, Technologies and Applications, vol. 260, pp. 395–404. Springer, Boston (2008)
8.
Zurück zum Zitat Valentini, P.P.: Interactive virtual assembling in augmented reality. Int. J. Interact. Des. Manuf. 3, 109–119 (2009)CrossRef Valentini, P.P.: Interactive virtual assembling in augmented reality. Int. J. Interact. Des. Manuf. 3, 109–119 (2009)CrossRef
9.
Zurück zum Zitat Chamaret, D., Ullah, S., Richard, P., Naud, M.: Integration and evaluation of haptic feedbacks: from CAD models to virtual prototyping. Int. J. Interact. Des. Manuf. 4, 87–94 (2010)CrossRef Chamaret, D., Ullah, S., Richard, P., Naud, M.: Integration and evaluation of haptic feedbacks: from CAD models to virtual prototyping. Int. J. Interact. Des. Manuf. 4, 87–94 (2010)CrossRef
10.
Zurück zum Zitat Toma, M.I., Girbacia, F., Antonya, C.: A comparative evaluation of human interaction for design and assembly of 3D CAD models in desktop and immersive environments. Int. J. Interact. Des. Manuf. 6, 179–193 (2012)CrossRef Toma, M.I., Girbacia, F., Antonya, C.: A comparative evaluation of human interaction for design and assembly of 3D CAD models in desktop and immersive environments. Int. J. Interact. Des. Manuf. 6, 179–193 (2012)CrossRef
11.
Zurück zum Zitat Fiorentino, M., Radkowski, R., Stritzke, C., Uva, A.E., Monno, G.: Design review of CAD assemblies using bimanual natural interface. Int. J. Interact. Des. Manuf. 7, 249–260 (2013)CrossRef Fiorentino, M., Radkowski, R., Stritzke, C., Uva, A.E., Monno, G.: Design review of CAD assemblies using bimanual natural interface. Int. J. Interact. Des. Manuf. 7, 249–260 (2013)CrossRef
12.
Zurück zum Zitat Valentini, P.P., Pezzuti, E.: Accuracy in fingertip tracking using Leap Motion Controller for interactive virtual applications. Int. J. Interact. Des. Manuf. 11, 641–650 (2017)CrossRef Valentini, P.P., Pezzuti, E.: Accuracy in fingertip tracking using Leap Motion Controller for interactive virtual applications. Int. J. Interact. Des. Manuf. 11, 641–650 (2017)CrossRef
13.
Zurück zum Zitat Katahira, R., Soga, M.: Development and evaluation of a system for AR enabling realistic display of gripping motions using Leap Motion Controller. Procedia Comput. Sci. 60, 1595–1603 (2015)CrossRef Katahira, R., Soga, M.: Development and evaluation of a system for AR enabling realistic display of gripping motions using Leap Motion Controller. Procedia Comput. Sci. 60, 1595–1603 (2015)CrossRef
14.
Zurück zum Zitat Beattie, N., Horan, B., McKenzie, S.: Taking the LEAP with the Oculus HMD and CAD—plucking at thin air? Procedia Technol. 20, 149–154 (2015)CrossRef Beattie, N., Horan, B., McKenzie, S.: Taking the LEAP with the Oculus HMD and CAD—plucking at thin air? Procedia Technol. 20, 149–154 (2015)CrossRef
15.
Zurück zum Zitat Hui, Z.: Head-mounted display-based intuitive virtual reality training system for the mining industry. Int. J. Min. Sci. Technol. 27, 717–722 (2017)CrossRef Hui, Z.: Head-mounted display-based intuitive virtual reality training system for the mining industry. Int. J. Min. Sci. Technol. 27, 717–722 (2017)CrossRef
16.
Zurück zum Zitat Chang, K.-H.: E-Design—Computer-Aided Engineering Design. Elsevier, New York (2015) Chang, K.-H.: E-Design—Computer-Aided Engineering Design. Elsevier, New York (2015)
17.
Zurück zum Zitat Haug, E.J.: Computer-Aided Kinematics and Dynamics of Mechanical Systems. Allyn and Bacon, Boston (1988) Haug, E.J.: Computer-Aided Kinematics and Dynamics of Mechanical Systems. Allyn and Bacon, Boston (1988)
Metadaten
Titel
Natural interface for interactive virtual assembly in augmented reality using Leap Motion Controller
verfasst von
Pier Paolo Valentini
Publikationsdatum
05.03.2018
Verlag
Springer Paris
Erschienen in
International Journal on Interactive Design and Manufacturing (IJIDeM) / Ausgabe 4/2018
Print ISSN: 1955-2513
Elektronische ISSN: 1955-2505
DOI
https://doi.org/10.1007/s12008-018-0461-0

Weitere Artikel der Ausgabe 4/2018

International Journal on Interactive Design and Manufacturing (IJIDeM) 4/2018 Zur Ausgabe

Premium Partner