Top

Published in:

2019 | OriginalPaper | Chapter

Exploring the Benefits of the Virtual Reality Technologies for Assembly Retrieval Applications

Authors : Katia Lupinetti, Brigida Bonino, Franca Giannini, Marina Monti

Published in: Augmented Reality, Virtual Reality, and Computer Graphics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Virtual reality technologies offer several intuitive and natural interactions that can be used to enhance and increase awareness during the different phases of the product design, such as the virtual prototyping or the project reviews. In this work, we focus on the benefits of virtual reality environments for assembly retrieval applications, which usually are employed to reuse existing CAD models by operating minor modifications. The retrieval system adopted to evaluate the different similarity among CAD assemblies is able to detect three different similarity criteria (i.e. shape, joint and position) at different levels (globally and locally). Considering the complexity of assembly models, conveying these different types of information simultaneously is quite difficult, especially through the traditional desktop systems. Hence, this paper presents a system for the visualization and the inspection of the results returned by a retrieval system with the aim of easing the analysis especially when the retrieved objects to analyze are complex. The proposed tool exploits the 3D space to represent and communicate the different types of similarity and gestures as well as voice commands to interact in the VR environment. Finally, the usability of the system has been tested over a sample of interviewers, who used the system and the different functionalities provided and then expressed their judgment filling out a questionnaire. The results indicate that user are able to interpret the different similarity criteria and that the gestures help acting in a natural manner.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Collaborative Web-Based Merged Volumetric and Mesh Rendering Framework

next chapter Metaphors for Software Visualization Systems Based on Virtual Reality

Abraham, L., Urru, A., Normani, N., Wilk, M., Walsh, M., O’Flynn, B.: Hand tracking and gesture recognition using lensless smart sensors. Sensors 18(9), 2834 (2018)CrossRef

Abulrub, A.H.G., Attridge, A.N., Williams, M.A.: Virtual reality in engineering education: the future of creative learning. In: 2011 IEEE Global Engineering Education Conference (EDUCON), pp. 751–757. IEEE (2011)

Argelaguet, F., Andujar, C.: A survey of 3D object selection techniques for virtual environments. Comput. Graph. 37(3), 121–136 (2013)CrossRef

Bachmann, D., Weichert, F., Rinkenauer, G.: Review of three-dimensional human-computer interaction with focus on the leap motion controller. Sensors 18(7), 2194 (2018)CrossRef

Beattie, N., Horan, B., McKenzie, S.: Taking the leap with the oculus hmd and CAD-plucking at thin air? Proc. Technol. 20, 149–154 (2015)CrossRef

Bordegoni, M.: Product Virtualization: An Effective Method for the Evaluation of Concept Design of New Products, pp. 117–141. Springer, London (2011). https://doi.org/10.1007/978-0-85729-775-4_7CrossRef

Bougaa, M., Bornhofen, S., Kadima, H., Rivière, A.: Virtual reality for manufacturing engineering in the factories of the future. Appl. Mech. Mater. 789, 1275–1282 (2015)CrossRef

Bourdot, P., Convard, T., Picon, F., Ammi, M., Touraine, D., Vézien, J.M.: VR-CAD integration: multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models. Comput. Aided Des. 42(5), 445–461 (2010)CrossRef

Caggianese, G., Gallo, L., Neroni, P.: An investigation of leap motion based 3D manipulation techniques for use in egocentric viewpoint. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9769, pp. 318–330. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40651-0_26CrossRef

10.

Choi, S., Jung, K., Noh, S.D.: Virtual reality applications in manufacturing industries: past research, present findings, and future directions. Concur. Eng. 23(1), 40–63 (2015)CrossRef

11.

Choi, S., Cheung, H.: A versatile virtual prototyping system for rapid product development. Comput. Ind. 59(5), 477–488 (2008)CrossRef

12.

Cook, M.: Virtual serendipity: preserving embodied browsing activity in the 21st century research library. J. Acad. Librariansh. 44(1), 145–149 (2018)CrossRef

13.

Cordeiro, E., Giannini, F., Monti, M., Mendes, D., Ferreira, A.: A study on natural 3D shape manipulation in VR. In: Livesu, M., Pintore, G., Signoroni, A. (eds.) Smart Tools and Apps for Graphics - Eurographics Italian Chapter Conference. The Eurographics Association (2018). https://doi.org/10.2312/stag.20181296

14.

Cui, J., Kuijper, A., Fellner, D.W., Sourin, A.: Understanding people’s mental models of mid-air interaction for virtual assembly and shape modeling. In: Proceedings of the 29th International Conference on Computer Animation and Social Agents, pp. 139–146. ACM (2016)

15.

Cui, J., Kuijper, A., Sourin, A.: Exploration of natural free-hand interaction for shape modeling using leap motion controller. In: 2016 International Conference on Cyberworlds (CW), pp. 41–48. IEEE (2016)

16.

Cui, J., Sourin, A.: Mid-air interaction with optical tracking for 3D modeling. Comput. Graph. 74, 1–11 (2018)CrossRef

17.

Gunawardane, P., Medagedara, N.T.: Comparison of hand gesture inputs of leap motion controller & data glove in to a soft finger. In: 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), pp. 62–68. IEEE (2017)

18.

Henriques, D., Mendes, D., Pascoal, P., Trancoso, I., Ferreira, A.: Poster: evaluation of immersive visualization techniques for 3D object retrieval. In: 2014 IEEE Symposium on 3D User Interfaces (3DUI), pp. 145–146. IEEE (2014)

19.

Jezernik, A., Hren, G.: A solution to integrate computer-aided design (CAD) and virtual reality (VR) databases in design and manufacturing processes. Int. J. Adv. Manuf. Technol. 22(11–12), 768–774 (2003)CrossRef

20.

Koutsabasis, P., Domouzis, C.K.: Mid-air browsing and selection in image collections. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 21–27. ACM (2016)

21.

Kovar, J., Mouralova, K., Ksica, F., Kroupa, J., Andrs, O., Hadas, Z.: Virtual reality in context of industry 4.0 proposed projects at brno university of technology. In: 2016 17th International Conference on Mechatronics-Mechatronika (ME), pp. 1–7. IEEE (2016)

22.

Lawson, G., Salanitri, D., Waterfield, B.: Future directions for the development of virtual reality within an automotive manufacturer. Appl. Ergon. 53, 323–330 (2016)CrossRef

23.

Lin, J., Schulze, J.P.: Towards naturally grabbing and moving objects in VR. Electron. Imaging 2016(4), 1–6 (2016)CrossRef

24.

Liu, H., Ju, Z., Ji, X., Chan, C.S., Khoury, M.: Human Motion Sensing and Recognition. SCI, vol. 675. Springer, Heidelberg (2017). https://doi.org/10.1007/978-3-662-53692-6CrossRef

25.

Liu, L., Huai, Y.: Dynamic hand gesture recognition using lmc for flower and plant interaction. Int. J. Pattern Recognit Artif Intell. 33(01), 1950003 (2018)CrossRef

26.

Lupinetti, K., Giannini, F., Monti, M., Pernot, J.P.: Multi-criteria similarity assessment for CAD assembly models retrieval. IMATI Report Series (18–07), 21 (08/2018 2018). http://irs.imati.cnr.it/reports/irs18-07

27.

Lupinetti, K., Giannini, F., Monti, M., Pernot, J.P.: Multi-criteria retrieval of CAD assembly models. J. Comput. Des. Eng. 5(1), 41–53 (2018)

28.

Mujber, T.S., Szecsi, T., Hashmi, M.S.: Virtual reality applications in manufacturing process simulation. J. Mater. Process. Technol. 155, 1834–1838 (2004)CrossRef

29.

Nakazato, M., Huang, T.S.: 3D Mars: immersive virtual reality for content-based image retrieval. In: IEEE International Conference on Multimedia and Expo, 2001. ICME 2001. (ICME). pp. 44–47 (2001). https://doi.org/10.1109/ICME.2001.1237651

30.

Nguyen, T.T.H., Duval, T., Pontonnier, C.: A new direct manipulation technique for immersive 3D virtual environments. In: ICAT-EGVE 2014: the 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments, p. 8 (2014)

31.

Okuya, Y., Ladeveze, N., Fleury, C., Bourdot, P.: Shapeguide: shape-based 3D interaction for parameter modification of native CAD data. Front. Robot. AI 5, 118 (2018)CrossRef

32.

Okuya, Y., Ladeveze, N., Gladin, O., Fleury, C., Bourdot, P.: Distributed architecture for remote collaborative modification of parametric CAD data. In: IEEE VR International Workshop on 3D Collaborative Virtual Environments (3DCVE 2018) (2018)

33.

Ottosson, S.: Virtual reality in the product development process. J. Eng. Des. 13(2), 159–172 (2002)CrossRef

34.

Park, H., Son, J.S., Lee, K.H.: Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation. J. Eng. Des. 19(4), 359–375 (2008)CrossRef

35.

Peng, C., Hansberger, J.T., Cao, L., Shanthakumar, V.A.: Hand gesture controls for image categorization in immersive virtual environments. In: 2017 IEEE Virtual Reality (VR), pp. 331–332. IEEE (2017)

36.

Rucco, M., Lupinetti, K., Giannini, F., Monti, M., Pernot, J.-P.: CAD assembly retrieval and browsing. In: Ríos, J., Bernard, A., Bouras, A., Foufou, S. (eds.) PLM 2017. IAICT, vol. 517, pp. 499–508. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-72905-3_44CrossRef

37.

Seif, M.A., Umeda, R., Higa, H.: An attempt to control a 3D object in medical training system using leap motion. In: 2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 159–162. IEEE (2017)

38.

Toyama, S., Al Sada, M., Nakajima, T.: VRowser: a virtual reality parallel web browser. In: Chen, J.Y.C., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10909, pp. 230–244. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91581-4_17CrossRef

39.

Vanacken, L., Grossman, T., Coninx, K.: Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In: IEEE Symposium on 3D User Interfaces, pp. 115–222. IEEE (2007)

40.

Vitali, A., Regazzoni, D., Rizzi, C.: Guidelines to develop natural user interfaces for virtual reality solutions. In: International Conference on Innovative Design and Manufacturing: ICIDM2017, Milan, Italy, July 2017 (2017)

41.

Vosinakis, S., Koutsabasis, P., Makris, D., Sagia, E.: A kinesthetic approach to digital heritage using leap motion: the cycladic sculpture application. In: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), pp. 1–8 (2016). https://doi.org/10.1109/VS-GAMES.2016.7590334

Title: Exploring the Benefits of the Virtual Reality Technologies for Assembly Retrieval Applications
Authors: Katia Lupinetti
Brigida Bonino
Franca Giannini
Marina Monti
Publisher: Springer International Publishing
Book: Augmented Reality, Virtual Reality, and Computer Graphics
Print ISBN: 978-3-030-25964-8

Electronic ISBN: 978-3-030-25965-5

Copyright Year: 2019
DOI: https://doi.org/10.1007/978-3-030-25965-5_5

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner