Skip to main content
Top
Published in: International Journal on Interactive Design and Manufacturing (IJIDeM) 3/2017

23-04-2016 | Original Paper

Towards a methodology to build virtual reality manufacturing systems based on free open software technologies

Authors: Isidro Calvo, Fernando López, Ekaitz Zulueta, Pablo González-Nalda

Published in: International Journal on Interactive Design and Manufacturing (IJIDeM) | Issue 3/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Virtual reality and augmented reality are being increasingly used in the manufacturing field for different purposes. As a result, these technologies seem to have a very promising future in the manufacturing industry. However, most of the current applications are based on the use of expensive proprietary software packages (such as specific CAD modules). This work presents a methodology that helps programmers to build virtual and augmented reality systems, which is valid for a broad number of industrial plants. Differently to other approaches, ours is based on open technologies, most of them free of cost. The technologies proposed to build the virtual worlds are already mature at the entertainment industry. The presented approach opens new possibilities for creating virtual reality models aimed at two major directions: (1) pure simulation of real processes and products for different purposes (e.g. staff training; prototype designing; manufacturing optimization; marketing) and (2) teleoperation of real processes (e.g. in dangerous environments or in micro and macro scale manufacturing). The application of the methodology is illustrated by means of the creation of a non-immersive virtual world which represents a part-classifying station, allowing both the simulation of the real plant as well as its remote operation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Andrisano, A.O., Leali, F., Pellicciari, M., Pini, F., Vergnano, A.: Hybrid reconfigurable system design and optimization through virtual prototyping and digital manufacturing tools. Int. J. Interact. Des. Manuf. 6(1), 17–27 (2012)CrossRef Andrisano, A.O., Leali, F., Pellicciari, M., Pini, F., Vergnano, A.: Hybrid reconfigurable system design and optimization through virtual prototyping and digital manufacturing tools. Int. J. Interact. Des. Manuf. 6(1), 17–27 (2012)CrossRef
3.
go back to reference Ang, Q.-Z., Horan, B., Nahavandi, S.: Multipoint haptic mediator interface for robotic teleoperation. IEEE Syst. J. 9(1), 86–97 (2015)CrossRef Ang, Q.-Z., Horan, B., Nahavandi, S.: Multipoint haptic mediator interface for robotic teleoperation. IEEE Syst. J. 9(1), 86–97 (2015)CrossRef
4.
go back to reference Bruyninckx, H.: Robotics software: the future should be open. IEEE Robot. Autom. Mag. 15(1), 9–11 (2008)CrossRef Bruyninckx, H.: Robotics software: the future should be open. IEEE Robot. Autom. Mag. 15(1), 9–11 (2008)CrossRef
5.
go back to reference Cecil, J., Bharathi Raj Kumar, M.B., Lu, Y., Basallali, V.: A review of micro-devices assembly techniques and technology. Int. J. Adv. Manuf. Technol (2015). doi:10.1007/s00170-015-7698-6 (Article in Press) Cecil, J., Bharathi Raj Kumar, M.B., Lu, Y., Basallali, V.: A review of micro-devices assembly techniques and technology. Int. J. Adv. Manuf. Technol (2015). doi:10.​1007/​s00170-015-7698-6 (Article in Press)
6.
go back to reference Calvo, I., Marcos, M., Orive, D., Sarachaga, I.: A methodology based on distributed object-oriented technologies for providing remote access to industrial plants. Control Engineering Practice 14(8), 975–990 (2006)CrossRef Calvo, I., Marcos, M., Orive, D., Sarachaga, I.: A methodology based on distributed object-oriented technologies for providing remote access to industrial plants. Control Engineering Practice 14(8), 975–990 (2006)CrossRef
7.
go back to reference Calvo, I., Marcos, M., Orive, D., Sarachaga, I.: Building complex remote learning laboratories. Comput. Appl. Eng. Educ. 18(1), 53–66 (2010) Calvo, I., Marcos, M., Orive, D., Sarachaga, I.: Building complex remote learning laboratories. Comput. Appl. Eng. Educ. 18(1), 53–66 (2010)
8.
go back to reference Comm, C.L.: Mathaisel Dennis FX: A paradigm for benchmarking lean initiatives for quality improvement. Benchmark Int J 7(2), 118–127 (2000)CrossRef Comm, C.L.: Mathaisel Dennis FX: A paradigm for benchmarking lean initiatives for quality improvement. Benchmark Int J 7(2), 118–127 (2000)CrossRef
9.
go back to reference Dewar R.G, Carpenter I.D, Ritchie J.M, Simmons J.E.L.: Assembly planning in a virtual environment. In: Proc. Portland Int’l Conf. on Management of Engineering and Technology. IEEE Press, Piscataway, pp 664–667 (1997) Dewar R.G, Carpenter I.D, Ritchie J.M, Simmons J.E.L.: Assembly planning in a virtual environment. In: Proc. Portland Int’l Conf. on Management of Engineering and Technology. IEEE Press, Piscataway, pp 664–667 (1997)
10.
go back to reference Dow, L., Campbell, A., Miller, A., McCaffery, J., Oliver, I., Davies, C.J., Kennedy, S., Allison, C.: An immersive platform for collaborative projects: In: Proc. Frontiers in Education Conf., FIE, 2015-February, (2015) Dow, L., Campbell, A., Miller, A., McCaffery, J., Oliver, I., Davies, C.J., Kennedy, S., Allison, C.: An immersive platform for collaborative projects: In: Proc. Frontiers in Education Conf., FIE, 2015-February, (2015)
11.
go back to reference De Jong, T., Linn, M.C., Zacharia, Z.C.: Physical and virtual laboratories in science and engineering education. Science 340(6130), 305–308 (2013)CrossRef De Jong, T., Linn, M.C., Zacharia, Z.C.: Physical and virtual laboratories in science and engineering education. Science 340(6130), 305–308 (2013)CrossRef
12.
go back to reference Duncan, I., Miller, A., Jiang, S.: A taxonomy of virtual worlds usage in education. Brit. J. Educ. Technol. 43(6), 949–964 (2012)CrossRef Duncan, I., Miller, A., Jiang, S.: A taxonomy of virtual worlds usage in education. Brit. J. Educ. Technol. 43(6), 949–964 (2012)CrossRef
14.
go back to reference Ferrise, F., Graziosi, S., Bordegoni, M.: Prototyping strategies for multisensory product experience engineering, J. Intell. Manuf. 1–13 (2015). doi:10.1007/s10845-015-1163-0 (Article in Press) Ferrise, F., Graziosi, S., Bordegoni, M.: Prototyping strategies for multisensory product experience engineering, J. Intell. Manuf. 1–13 (2015). doi:10.​1007/​s10845-015-1163-0 (Article in Press)
15.
go back to reference Fuchs, H., State, A., Bazin, J.-C.: Immersive 3D telepresence. Computer 47(7), 46–52 (2014)CrossRef Fuchs, H., State, A., Bazin, J.-C.: Immersive 3D telepresence. Computer 47(7), 46–52 (2014)CrossRef
16.
go back to reference Galambos, P., Baranyi, P., Rudas, I. J.: Merged physical and virtual reality in collaborative virtual workspaces: The VirCA approach. In: Proc. of the 40th IEEE Annual Conf. of the IEEE (IECON), pp. 2585-2590, (2014) Galambos, P., Baranyi, P., Rudas, I. J.: Merged physical and virtual reality in collaborative virtual workspaces: The VirCA approach. In: Proc. of the 40th IEEE Annual Conf. of the IEEE (IECON), pp. 2585-2590, (2014)
17.
go back to reference Gomes, L., Bogosyan, S.: Current trends in remote laboratories. IEEE Trans. Ind. Electron. 56(12), 4744–4756 (2009)CrossRef Gomes, L., Bogosyan, S.: Current trends in remote laboratories. IEEE Trans. Ind. Electron. 56(12), 4744–4756 (2009)CrossRef
18.
go back to reference Galambos, P., Csapó, A., Zentay, P., Fülöp, I.M., Haidegger, T., Baranyi, P., Rudas, I.J.: Design, programming and orchestration of heterogeneous manufacturing systems through VR-powered remote collaboration. Robotics and Computer-Integrated Manufacturing 33, 68–77 (2015)CrossRef Galambos, P., Csapó, A., Zentay, P., Fülöp, I.M., Haidegger, T., Baranyi, P., Rudas, I.J.: Design, programming and orchestration of heterogeneous manufacturing systems through VR-powered remote collaboration. Robotics and Computer-Integrated Manufacturing 33, 68–77 (2015)CrossRef
19.
go back to reference Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns Elem. Reusable Object-Orient. Softw. Addison-Wesley, Reading (1995) Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns Elem. Reusable Object-Orient. Softw. Addison-Wesley, Reading (1995)
20.
go back to reference Hořejší, P.: Augmented reality system for virtual training of parts assembly. Procedia Eng. 100, 699–706 (2015) Hořejší, P.: Augmented reality system for virtual training of parts assembly. Procedia Eng. 100, 699–706 (2015)
21.
go back to reference Hu, W., Liu, G.-P., Zhou, H.: Web-based 3-D control laboratory for remote real-time experimentation. IEEE Trans. Ind. Electron. 60(10), 4673–4682 (2013)CrossRef Hu, W., Liu, G.-P., Zhou, H.: Web-based 3-D control laboratory for remote real-time experimentation. IEEE Trans. Ind. Electron. 60(10), 4673–4682 (2013)CrossRef
23.
go back to reference Kato, Y.: A remote navigation system for a simple tele-presence robot with virtual reality. In: IEEE Int. Conf. on Intelligent Robots and Systems, pp. 4524-4529 (2015) Kato, Y.: A remote navigation system for a simple tele-presence robot with virtual reality. In: IEEE Int. Conf. on Intelligent Robots and Systems, pp. 4524-4529 (2015)
24.
go back to reference Krasner, G.E., Pope, S.T.: A cookbook for using the model-view controller user interface paradigm in Smalltalk-80. J. Object-Orient. Programm. 1(3), 26–49 (1988) Krasner, G.E., Pope, S.T.: A cookbook for using the model-view controller user interface paradigm in Smalltalk-80. J. Object-Orient. Programm. 1(3), 26–49 (1988)
26.
go back to reference Liang, J.S., Chao, K.-M., Ivey, P.: VR-based wheeled mobile robot in application of remote real-time assembly. Int. J. Adv. Manuf. Technol. 64(9–12), 1765–1779 (2013)CrossRef Liang, J.S., Chao, K.-M., Ivey, P.: VR-based wheeled mobile robot in application of remote real-time assembly. Int. J. Adv. Manuf. Technol. 64(9–12), 1765–1779 (2013)CrossRef
27.
go back to reference Lawson, G., Herriotts, P., Malcolm, L., Gabrecht, K., Hermawati, S.: The use of virtual reality and physical tools in the development and validation of ease of entry and exit in passenger vehicles. Applied Ergonomics 48, 240–251 (2015)CrossRef Lawson, G., Herriotts, P., Malcolm, L., Gabrecht, K., Hermawati, S.: The use of virtual reality and physical tools in the development and validation of ease of entry and exit in passenger vehicles. Applied Ergonomics 48, 240–251 (2015)CrossRef
28.
go back to reference Lei, Z., Hu, W., Zhou, H., Zhong, L., Gao, X.: A DC motor position control system in a 3D real-time virtual laboratory environment based on NCSLab 3D. Int. J. Online Eng. 11(3), 49–55 (2015)CrossRef Lei, Z., Hu, W., Zhou, H., Zhong, L., Gao, X.: A DC motor position control system in a 3D real-time virtual laboratory environment based on NCSLab 3D. Int. J. Online Eng. 11(3), 49–55 (2015)CrossRef
29.
go back to reference Lee, C., Park, S.: Survey on the virtual commissioning of manufacturing systems. Journal of Computational Design and Engineering 3(1), 213–222 (2014)CrossRef Lee, C., Park, S.: Survey on the virtual commissioning of manufacturing systems. Journal of Computational Design and Engineering 3(1), 213–222 (2014)CrossRef
30.
go back to reference Mostefa, M., Boudadi, L.K.E., Loukil, A., Mohamed, K., Amine, D.: Design of mobile robot teleoperation system based on virtual reality. In: Proc. 3rd Int. Conf. on Control, Engineering and Information Technology, CEIT (2015) Mostefa, M., Boudadi, L.K.E., Loukil, A., Mohamed, K., Amine, D.: Design of mobile robot teleoperation system based on virtual reality. In: Proc. 3rd Int. Conf. on Control, Engineering and Information Technology, CEIT (2015)
31.
go back to reference Müller, D., Chilliischi, A., Langer, S.: Integrating immersive 3D worlds and real lab equipment for teaching mechatronics. In: Proceedings of the 9th International Conference on Remote Engineering and Virtual Instrumentation, REV (2012) Müller, D., Chilliischi, A., Langer, S.: Integrating immersive 3D worlds and real lab equipment for teaching mechatronics. In: Proceedings of the 9th International Conference on Remote Engineering and Virtual Instrumentation, REV (2012)
32.
go back to reference Matsas, E., Vosniakos, G.C.: Design of a virtual reality training system for human–robot collaboration in manufacturing tasks. Int. J. Interact. Des. Manuf. (2015). doi:10.1007/s12008-015-0259-2 (Article in Press) Matsas, E., Vosniakos, G.C.: Design of a virtual reality training system for human–robot collaboration in manufacturing tasks. Int. J. Interact. Des. Manuf. (2015). doi:10.​1007/​s12008-015-0259-2 (Article in Press)
33.
go back to reference Petridis, P., Dunwell, I., Panzoli, D., Arnab, S., Protopsaltis, A., Hendrix, M., Freitas, S.: Game engines selection framework for high-fidelity serious applications. Int. J. Interact. World 1–19 (2012) Petridis, P., Dunwell, I., Panzoli, D., Arnab, S., Protopsaltis, A., Hendrix, M., Freitas, S.: Game engines selection framework for high-fidelity serious applications. Int. J. Interact. World 1–19 (2012)
34.
go back to reference Pinheiro, A., Fernandes, P., Maia, A., Cruz, G., Pedrosa, D., Fonseca, B., Paredes, H., Martins, P., Morgado, L., Rafael, J.: Development of a mechanical maintenance training simulator in OpenSimulator for F-16 aircraft engines. Entertainment Computing 5(4), 347–355 (2014)CrossRef Pinheiro, A., Fernandes, P., Maia, A., Cruz, G., Pedrosa, D., Fonseca, B., Paredes, H., Martins, P., Morgado, L., Rafael, J.: Development of a mechanical maintenance training simulator in OpenSimulator for F-16 aircraft engines. Entertainment Computing 5(4), 347–355 (2014)CrossRef
35.
go back to reference Pereira, C.E., Paladini, S., Schaf, F.M.: Control and automation engineering education: combining physical, remote and virtual labs. In: Proceedings of the 9th International Multi-Conference on Systems, Signals and Devices (2012) Pereira, C.E., Paladini, S., Schaf, F.M.: Control and automation engineering education: combining physical, remote and virtual labs. In: Proceedings of the 9th International Multi-Conference on Systems, Signals and Devices (2012)
37.
go back to reference Raffaeli, R., Germani, M.: Advanced computer aided technologies for design automation in footwear industry. Int. J. Interact. Des. Manuf. 5(3), 137–149 (2011)CrossRef Raffaeli, R., Germani, M.: Advanced computer aided technologies for design automation in footwear industry. Int. J. Interact. Des. Manuf. 5(3), 137–149 (2011)CrossRef
38.
go back to reference Rico, M., Ramirez, J., Riofrío, D., Berrocal, M., de Antonio, A.: An architecture for virtual labs in engineering education. In: Proc. of the 2012 IEEE Global Engineering Education Conf. EDUCON, pp. 210–214 (2012) Rico, M., Ramirez, J., Riofrío, D., Berrocal, M., de Antonio, A.: An architecture for virtual labs in engineering education. In: Proc. of the 2012 IEEE Global Engineering Education Conf. EDUCON, pp. 210–214 (2012)
39.
go back to reference Sghaier, A., Soriano, T.: Using high-level models for modeling industrial machines in a virtual environment”. International Journal on Interactive Design and Manufacturing 2(2), 99–106 (2008)CrossRef Sghaier, A., Soriano, T.: Using high-level models for modeling industrial machines in a virtual environment”. International Journal on Interactive Design and Manufacturing 2(2), 99–106 (2008)CrossRef
40.
go back to reference Tyagi, S.K., Ghorpade, A., Karunakaran, K.P., Tiwari, M.K.: Optimal part orientation in layered manufacturing using evolutionary stickers-based DNA algorithm. Virtual Phys. Prototype 2(1), 3–19 (2007)CrossRef Tyagi, S.K., Ghorpade, A., Karunakaran, K.P., Tiwari, M.K.: Optimal part orientation in layered manufacturing using evolutionary stickers-based DNA algorithm. Virtual Phys. Prototype 2(1), 3–19 (2007)CrossRef
41.
go back to reference Tyagi, S., Vadrevu, S.: Immersive virtual reality to vindicate the application of value stream mapping in an US-based SME. International Journal of Advanced Manufacturing Technology 81(5–8), 1259–1272 (2015)CrossRef Tyagi, S., Vadrevu, S.: Immersive virtual reality to vindicate the application of value stream mapping in an US-based SME. International Journal of Advanced Manufacturing Technology 81(5–8), 1259–1272 (2015)CrossRef
42.
go back to reference Tideman, M., van der Voort, M.C., van Houten, F.J.A.M.: A new product design method based on virtual reality, gaming and scenarios”. Int. J. Interact. Des. Manuf. 2(4), 1–11 (2008)CrossRef Tideman, M., van der Voort, M.C., van Houten, F.J.A.M.: A new product design method based on virtual reality, gaming and scenarios”. Int. J. Interact. Des. Manuf. 2(4), 1–11 (2008)CrossRef
43.
go back to reference Wang, L.: Collaborative robot monitoring and control for enhanced sustainability. International Journal of Advanced Manufacturing Technology 81(9–12), 1433–1445 (2015)CrossRef Wang, L.: Collaborative robot monitoring and control for enhanced sustainability. International Journal of Advanced Manufacturing Technology 81(9–12), 1433–1445 (2015)CrossRef
44.
go back to reference Wang, C.G., Mitrouchev, P., Li, G.Q., Lu, L.X.: Disassembly operations’ efficiency evaluation in a virtual environment. Int. J. Comput. Integrat. Manuf. 29(3), 309–322 (2015)CrossRef Wang, C.G., Mitrouchev, P., Li, G.Q., Lu, L.X.: Disassembly operations’ efficiency evaluation in a virtual environment. Int. J. Comput. Integrat. Manuf. 29(3), 309–322 (2015)CrossRef
45.
go back to reference Yew, A.W.W., Ong, S.K., Nee, A.Y.C.: Towards a griddable distributed manufacturing system with augmented reality interfaces. Robotics and Computer-Integrated Manufacturing 39, 43–55 (2016)CrossRef Yew, A.W.W., Ong, S.K., Nee, A.Y.C.: Towards a griddable distributed manufacturing system with augmented reality interfaces. Robotics and Computer-Integrated Manufacturing 39, 43–55 (2016)CrossRef
Metadata
Title
Towards a methodology to build virtual reality manufacturing systems based on free open software technologies
Authors
Isidro Calvo
Fernando López
Ekaitz Zulueta
Pablo González-Nalda
Publication date
23-04-2016
Publisher
Springer Paris
Published in
International Journal on Interactive Design and Manufacturing (IJIDeM) / Issue 3/2017
Print ISSN: 1955-2513
Electronic ISSN: 1955-2505
DOI
https://doi.org/10.1007/s12008-016-0311-x

Other articles of this Issue 3/2017

International Journal on Interactive Design and Manufacturing (IJIDeM) 3/2017 Go to the issue

Premium Partner