Skip to main content

2019 | OriginalPaper | Buchkapitel

Exploring the Benefits of the Virtual Reality Technologies for Assembly Retrieval Applications

verfasst von : Katia Lupinetti, Brigida Bonino, Franca Giannini, Marina Monti

Erschienen in: Augmented Reality, Virtual Reality, and Computer Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Virtual reality technologies offer several intuitive and natural interactions that can be used to enhance and increase awareness during the different phases of the product design, such as the virtual prototyping or the project reviews. In this work, we focus on the benefits of virtual reality environments for assembly retrieval applications, which usually are employed to reuse existing CAD models by operating minor modifications. The retrieval system adopted to evaluate the different similarity among CAD assemblies is able to detect three different similarity criteria (i.e. shape, joint and position) at different levels (globally and locally). Considering the complexity of assembly models, conveying these different types of information simultaneously is quite difficult, especially through the traditional desktop systems. Hence, this paper presents a system for the visualization and the inspection of the results returned by a retrieval system with the aim of easing the analysis especially when the retrieved objects to analyze are complex. The proposed tool exploits the 3D space to represent and communicate the different types of similarity and gestures as well as voice commands to interact in the VR environment. Finally, the usability of the system has been tested over a sample of interviewers, who used the system and the different functionalities provided and then expressed their judgment filling out a questionnaire. The results indicate that user are able to interpret the different similarity criteria and that the gestures help acting in a natural manner.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abraham, L., Urru, A., Normani, N., Wilk, M., Walsh, M., O’Flynn, B.: Hand tracking and gesture recognition using lensless smart sensors. Sensors 18(9), 2834 (2018)CrossRef Abraham, L., Urru, A., Normani, N., Wilk, M., Walsh, M., O’Flynn, B.: Hand tracking and gesture recognition using lensless smart sensors. Sensors 18(9), 2834 (2018)CrossRef
2.
Zurück zum Zitat Abulrub, A.H.G., Attridge, A.N., Williams, M.A.: Virtual reality in engineering education: the future of creative learning. In: 2011 IEEE Global Engineering Education Conference (EDUCON), pp. 751–757. IEEE (2011) Abulrub, A.H.G., Attridge, A.N., Williams, M.A.: Virtual reality in engineering education: the future of creative learning. In: 2011 IEEE Global Engineering Education Conference (EDUCON), pp. 751–757. IEEE (2011)
3.
Zurück zum Zitat Argelaguet, F., Andujar, C.: A survey of 3D object selection techniques for virtual environments. Comput. Graph. 37(3), 121–136 (2013)CrossRef Argelaguet, F., Andujar, C.: A survey of 3D object selection techniques for virtual environments. Comput. Graph. 37(3), 121–136 (2013)CrossRef
4.
Zurück zum Zitat Bachmann, D., Weichert, F., Rinkenauer, G.: Review of three-dimensional human-computer interaction with focus on the leap motion controller. Sensors 18(7), 2194 (2018)CrossRef Bachmann, D., Weichert, F., Rinkenauer, G.: Review of three-dimensional human-computer interaction with focus on the leap motion controller. Sensors 18(7), 2194 (2018)CrossRef
5.
Zurück zum Zitat Beattie, N., Horan, B., McKenzie, S.: Taking the leap with the oculus hmd and CAD-plucking at thin air? Proc. Technol. 20, 149–154 (2015)CrossRef Beattie, N., Horan, B., McKenzie, S.: Taking the leap with the oculus hmd and CAD-plucking at thin air? Proc. Technol. 20, 149–154 (2015)CrossRef
7.
Zurück zum Zitat Bougaa, M., Bornhofen, S., Kadima, H., Rivière, A.: Virtual reality for manufacturing engineering in the factories of the future. Appl. Mech. Mater. 789, 1275–1282 (2015)CrossRef Bougaa, M., Bornhofen, S., Kadima, H., Rivière, A.: Virtual reality for manufacturing engineering in the factories of the future. Appl. Mech. Mater. 789, 1275–1282 (2015)CrossRef
8.
Zurück zum Zitat Bourdot, P., Convard, T., Picon, F., Ammi, M., Touraine, D., Vézien, J.M.: VR-CAD integration: multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models. Comput. Aided Des. 42(5), 445–461 (2010)CrossRef Bourdot, P., Convard, T., Picon, F., Ammi, M., Touraine, D., Vézien, J.M.: VR-CAD integration: multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models. Comput. Aided Des. 42(5), 445–461 (2010)CrossRef
10.
Zurück zum Zitat Choi, S., Jung, K., Noh, S.D.: Virtual reality applications in manufacturing industries: past research, present findings, and future directions. Concur. Eng. 23(1), 40–63 (2015)CrossRef Choi, S., Jung, K., Noh, S.D.: Virtual reality applications in manufacturing industries: past research, present findings, and future directions. Concur. Eng. 23(1), 40–63 (2015)CrossRef
11.
Zurück zum Zitat Choi, S., Cheung, H.: A versatile virtual prototyping system for rapid product development. Comput. Ind. 59(5), 477–488 (2008)CrossRef Choi, S., Cheung, H.: A versatile virtual prototyping system for rapid product development. Comput. Ind. 59(5), 477–488 (2008)CrossRef
12.
Zurück zum Zitat Cook, M.: Virtual serendipity: preserving embodied browsing activity in the 21st century research library. J. Acad. Librariansh. 44(1), 145–149 (2018)CrossRef Cook, M.: Virtual serendipity: preserving embodied browsing activity in the 21st century research library. J. Acad. Librariansh. 44(1), 145–149 (2018)CrossRef
13.
Zurück zum Zitat Cordeiro, E., Giannini, F., Monti, M., Mendes, D., Ferreira, A.: A study on natural 3D shape manipulation in VR. In: Livesu, M., Pintore, G., Signoroni, A. (eds.) Smart Tools and Apps for Graphics - Eurographics Italian Chapter Conference. The Eurographics Association (2018). https://doi.org/10.2312/stag.20181296 Cordeiro, E., Giannini, F., Monti, M., Mendes, D., Ferreira, A.: A study on natural 3D shape manipulation in VR. In: Livesu, M., Pintore, G., Signoroni, A. (eds.) Smart Tools and Apps for Graphics - Eurographics Italian Chapter Conference. The Eurographics Association (2018). https://​doi.​org/​10.​2312/​stag.​20181296
14.
Zurück zum Zitat Cui, J., Kuijper, A., Fellner, D.W., Sourin, A.: Understanding people’s mental models of mid-air interaction for virtual assembly and shape modeling. In: Proceedings of the 29th International Conference on Computer Animation and Social Agents, pp. 139–146. ACM (2016) Cui, J., Kuijper, A., Fellner, D.W., Sourin, A.: Understanding people’s mental models of mid-air interaction for virtual assembly and shape modeling. In: Proceedings of the 29th International Conference on Computer Animation and Social Agents, pp. 139–146. ACM (2016)
15.
Zurück zum Zitat Cui, J., Kuijper, A., Sourin, A.: Exploration of natural free-hand interaction for shape modeling using leap motion controller. In: 2016 International Conference on Cyberworlds (CW), pp. 41–48. IEEE (2016) Cui, J., Kuijper, A., Sourin, A.: Exploration of natural free-hand interaction for shape modeling using leap motion controller. In: 2016 International Conference on Cyberworlds (CW), pp. 41–48. IEEE (2016)
16.
Zurück zum Zitat Cui, J., Sourin, A.: Mid-air interaction with optical tracking for 3D modeling. Comput. Graph. 74, 1–11 (2018)CrossRef Cui, J., Sourin, A.: Mid-air interaction with optical tracking for 3D modeling. Comput. Graph. 74, 1–11 (2018)CrossRef
17.
Zurück zum Zitat Gunawardane, P., Medagedara, N.T.: Comparison of hand gesture inputs of leap motion controller & data glove in to a soft finger. In: 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), pp. 62–68. IEEE (2017) Gunawardane, P., Medagedara, N.T.: Comparison of hand gesture inputs of leap motion controller & data glove in to a soft finger. In: 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), pp. 62–68. IEEE (2017)
18.
Zurück zum Zitat Henriques, D., Mendes, D., Pascoal, P., Trancoso, I., Ferreira, A.: Poster: evaluation of immersive visualization techniques for 3D object retrieval. In: 2014 IEEE Symposium on 3D User Interfaces (3DUI), pp. 145–146. IEEE (2014) Henriques, D., Mendes, D., Pascoal, P., Trancoso, I., Ferreira, A.: Poster: evaluation of immersive visualization techniques for 3D object retrieval. In: 2014 IEEE Symposium on 3D User Interfaces (3DUI), pp. 145–146. IEEE (2014)
19.
Zurück zum Zitat Jezernik, A., Hren, G.: A solution to integrate computer-aided design (CAD) and virtual reality (VR) databases in design and manufacturing processes. Int. J. Adv. Manuf. Technol. 22(11–12), 768–774 (2003)CrossRef Jezernik, A., Hren, G.: A solution to integrate computer-aided design (CAD) and virtual reality (VR) databases in design and manufacturing processes. Int. J. Adv. Manuf. Technol. 22(11–12), 768–774 (2003)CrossRef
20.
Zurück zum Zitat Koutsabasis, P., Domouzis, C.K.: Mid-air browsing and selection in image collections. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 21–27. ACM (2016) Koutsabasis, P., Domouzis, C.K.: Mid-air browsing and selection in image collections. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 21–27. ACM (2016)
21.
Zurück zum Zitat Kovar, J., Mouralova, K., Ksica, F., Kroupa, J., Andrs, O., Hadas, Z.: Virtual reality in context of industry 4.0 proposed projects at brno university of technology. In: 2016 17th International Conference on Mechatronics-Mechatronika (ME), pp. 1–7. IEEE (2016) Kovar, J., Mouralova, K., Ksica, F., Kroupa, J., Andrs, O., Hadas, Z.: Virtual reality in context of industry 4.0 proposed projects at brno university of technology. In: 2016 17th International Conference on Mechatronics-Mechatronika (ME), pp. 1–7. IEEE (2016)
22.
Zurück zum Zitat Lawson, G., Salanitri, D., Waterfield, B.: Future directions for the development of virtual reality within an automotive manufacturer. Appl. Ergon. 53, 323–330 (2016)CrossRef Lawson, G., Salanitri, D., Waterfield, B.: Future directions for the development of virtual reality within an automotive manufacturer. Appl. Ergon. 53, 323–330 (2016)CrossRef
23.
Zurück zum Zitat Lin, J., Schulze, J.P.: Towards naturally grabbing and moving objects in VR. Electron. Imaging 2016(4), 1–6 (2016)CrossRef Lin, J., Schulze, J.P.: Towards naturally grabbing and moving objects in VR. Electron. Imaging 2016(4), 1–6 (2016)CrossRef
25.
Zurück zum Zitat Liu, L., Huai, Y.: Dynamic hand gesture recognition using lmc for flower and plant interaction. Int. J. Pattern Recognit Artif Intell. 33(01), 1950003 (2018)CrossRef Liu, L., Huai, Y.: Dynamic hand gesture recognition using lmc for flower and plant interaction. Int. J. Pattern Recognit Artif Intell. 33(01), 1950003 (2018)CrossRef
27.
Zurück zum Zitat Lupinetti, K., Giannini, F., Monti, M., Pernot, J.P.: Multi-criteria retrieval of CAD assembly models. J. Comput. Des. Eng. 5(1), 41–53 (2018) Lupinetti, K., Giannini, F., Monti, M., Pernot, J.P.: Multi-criteria retrieval of CAD assembly models. J. Comput. Des. Eng. 5(1), 41–53 (2018)
28.
Zurück zum Zitat Mujber, T.S., Szecsi, T., Hashmi, M.S.: Virtual reality applications in manufacturing process simulation. J. Mater. Process. Technol. 155, 1834–1838 (2004)CrossRef Mujber, T.S., Szecsi, T., Hashmi, M.S.: Virtual reality applications in manufacturing process simulation. J. Mater. Process. Technol. 155, 1834–1838 (2004)CrossRef
30.
Zurück zum Zitat Nguyen, T.T.H., Duval, T., Pontonnier, C.: A new direct manipulation technique for immersive 3D virtual environments. In: ICAT-EGVE 2014: the 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments, p. 8 (2014) Nguyen, T.T.H., Duval, T., Pontonnier, C.: A new direct manipulation technique for immersive 3D virtual environments. In: ICAT-EGVE 2014: the 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments, p. 8 (2014)
31.
Zurück zum Zitat Okuya, Y., Ladeveze, N., Fleury, C., Bourdot, P.: Shapeguide: shape-based 3D interaction for parameter modification of native CAD data. Front. Robot. AI 5, 118 (2018)CrossRef Okuya, Y., Ladeveze, N., Fleury, C., Bourdot, P.: Shapeguide: shape-based 3D interaction for parameter modification of native CAD data. Front. Robot. AI 5, 118 (2018)CrossRef
32.
Zurück zum Zitat Okuya, Y., Ladeveze, N., Gladin, O., Fleury, C., Bourdot, P.: Distributed architecture for remote collaborative modification of parametric CAD data. In: IEEE VR International Workshop on 3D Collaborative Virtual Environments (3DCVE 2018) (2018) Okuya, Y., Ladeveze, N., Gladin, O., Fleury, C., Bourdot, P.: Distributed architecture for remote collaborative modification of parametric CAD data. In: IEEE VR International Workshop on 3D Collaborative Virtual Environments (3DCVE 2018) (2018)
33.
Zurück zum Zitat Ottosson, S.: Virtual reality in the product development process. J. Eng. Des. 13(2), 159–172 (2002)CrossRef Ottosson, S.: Virtual reality in the product development process. J. Eng. Des. 13(2), 159–172 (2002)CrossRef
34.
Zurück zum Zitat Park, H., Son, J.S., Lee, K.H.: Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation. J. Eng. Des. 19(4), 359–375 (2008)CrossRef Park, H., Son, J.S., Lee, K.H.: Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation. J. Eng. Des. 19(4), 359–375 (2008)CrossRef
35.
Zurück zum Zitat Peng, C., Hansberger, J.T., Cao, L., Shanthakumar, V.A.: Hand gesture controls for image categorization in immersive virtual environments. In: 2017 IEEE Virtual Reality (VR), pp. 331–332. IEEE (2017) Peng, C., Hansberger, J.T., Cao, L., Shanthakumar, V.A.: Hand gesture controls for image categorization in immersive virtual environments. In: 2017 IEEE Virtual Reality (VR), pp. 331–332. IEEE (2017)
37.
Zurück zum Zitat Seif, M.A., Umeda, R., Higa, H.: An attempt to control a 3D object in medical training system using leap motion. In: 2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 159–162. IEEE (2017) Seif, M.A., Umeda, R., Higa, H.: An attempt to control a 3D object in medical training system using leap motion. In: 2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 159–162. IEEE (2017)
39.
Zurück zum Zitat Vanacken, L., Grossman, T., Coninx, K.: Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In: IEEE Symposium on 3D User Interfaces, pp. 115–222. IEEE (2007) Vanacken, L., Grossman, T., Coninx, K.: Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In: IEEE Symposium on 3D User Interfaces, pp. 115–222. IEEE (2007)
40.
Zurück zum Zitat Vitali, A., Regazzoni, D., Rizzi, C.: Guidelines to develop natural user interfaces for virtual reality solutions. In: International Conference on Innovative Design and Manufacturing: ICIDM2017, Milan, Italy, July 2017 (2017) Vitali, A., Regazzoni, D., Rizzi, C.: Guidelines to develop natural user interfaces for virtual reality solutions. In: International Conference on Innovative Design and Manufacturing: ICIDM2017, Milan, Italy, July 2017 (2017)
41.
Zurück zum Zitat Vosinakis, S., Koutsabasis, P., Makris, D., Sagia, E.: A kinesthetic approach to digital heritage using leap motion: the cycladic sculpture application. In: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), pp. 1–8 (2016). https://doi.org/10.1109/VS-GAMES.2016.7590334 Vosinakis, S., Koutsabasis, P., Makris, D., Sagia, E.: A kinesthetic approach to digital heritage using leap motion: the cycladic sculpture application. In: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), pp. 1–8 (2016). https://​doi.​org/​10.​1109/​VS-GAMES.​2016.​7590334
Metadaten
Titel
Exploring the Benefits of the Virtual Reality Technologies for Assembly Retrieval Applications
verfasst von
Katia Lupinetti
Brigida Bonino
Franca Giannini
Marina Monti
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-25965-5_5