Skip to main content
Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) 2/2024

10.01.2024 | Original Article

Impulse dynamics and augmented reality for real-time interactive digital twin exploration and interrogation

verfasst von: Marco Cirelli, Alessio Cellupica, Pietro Canonico, Pier Paolo Valentini

Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) | Ausgabe 2/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Digital twins are revolutionizing many engineering fields due to the availability of advanced and reliable instruments for continuous real-time monitoring, control, interrogation, and optimization of a system throughout its entire life cycle. Digital twins can be successfully integrated with augmented reality tools to enhance and facilitate communication from and to the user. The paper discusses a comprehensive methodology to implement and manage digital twins of rigid-link mechanisms, which require real-time dynamic simulation with input and output from sensors and actuators. The entire methodology is enhanced by integrating the Microsoft Hololens 2 augmented reality headset to implement interactive communication using natural interfaces. The paper includes an in-depth discussion of the general and modular approach and a detailed example of an application with an assessment of the accuracy of the simulation results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Grieves, M.: Digital twin of physical systems: opportunities and challenges, In: Proceedings of the ASME 2002 International Mechanical Engineering Congress and Exposition, 17–22 November, New Orleans, USA, (2002) Grieves, M.: Digital twin of physical systems: opportunities and challenges, In: Proceedings of the ASME 2002 International Mechanical Engineering Congress and Exposition, 17–22 November, New Orleans, USA, (2002)
2.
Zurück zum Zitat Merienne, F.: Human factors consideration in the interaction process with virtual environment. Int. J. Interact. Des. Manuf. 4(2), 83–86 (2000)CrossRef Merienne, F.: Human factors consideration in the interaction process with virtual environment. Int. J. Interact. Des. Manuf. 4(2), 83–86 (2000)CrossRef
3.
Zurück zum Zitat Valentini, P.P.: Enhancing user role in augmented reality interactive simulations, pp. 233–256. Human Factors in Augmented Reality Environments, Springer, New York (2013) Valentini, P.P.: Enhancing user role in augmented reality interactive simulations, pp. 233–256. Human Factors in Augmented Reality Environments, Springer, New York (2013)
4.
Zurück zum Zitat Chaudhari, S.S., Bhole, K.S., Rane, S., Deshmukh, S.: A generic digital twin application framework for emerging trends in industrial process heaters. Procedia CIRP 119, 1128–1133 (2023)CrossRef Chaudhari, S.S., Bhole, K.S., Rane, S., Deshmukh, S.: A generic digital twin application framework for emerging trends in industrial process heaters. Procedia CIRP 119, 1128–1133 (2023)CrossRef
7.
Zurück zum Zitat Valentini, P.P., Pavia, D., Marotta, E., Cirelli, M.: Interactive simulation of realistic flexible and tearable membrane using virtual reality and haptic force-feedback interface. Int. J. Interact. Des. Manuf. 14, 813–822 (2020)CrossRef Valentini, P.P., Pavia, D., Marotta, E., Cirelli, M.: Interactive simulation of realistic flexible and tearable membrane using virtual reality and haptic force-feedback interface. Int. J. Interact. Des. Manuf. 14, 813–822 (2020)CrossRef
8.
Zurück zum Zitat Ke, S., Xiang, F., Zhang, Z., Zuo, Y.: An enhanced interaction framework based on VR, AR, MR in digital twin. Procedia CIRP 83, 753–758 (2019)CrossRef Ke, S., Xiang, F., Zhang, Z., Zuo, Y.: An enhanced interaction framework based on VR, AR, MR in digital twin. Procedia CIRP 83, 753–758 (2019)CrossRef
9.
Zurück zum Zitat Yin, Y., Zheng, P., Li, C., Wang, L.: A state-of-the-art survey on augmented reality-assisted digital twin for futuristic human-centric industry transformation. Robot. Comput. Integr. Manuf. 81, 102515 (2023)CrossRef Yin, Y., Zheng, P., Li, C., Wang, L.: A state-of-the-art survey on augmented reality-assisted digital twin for futuristic human-centric industry transformation. Robot. Comput. Integr. Manuf. 81, 102515 (2023)CrossRef
10.
Zurück zum Zitat Cai, Y., Wang, Y., Burnett, M.: Using augmented reality to build digital twin for reconfigurable additive manufacturing system. J. Manuf. Syst. 56, 598–604 (2020)CrossRef Cai, Y., Wang, Y., Burnett, M.: Using augmented reality to build digital twin for reconfigurable additive manufacturing system. J. Manuf. Syst. 56, 598–604 (2020)CrossRef
11.
Zurück zum Zitat Li, C., Zheng, P., Li, S., Pang, Y., Lee, C.K.M.: AR-assisted digital twin-enabled robot collaborative manufacturing system with human-in-the-loop. Robot. Comput. Integr. Manuf. 76, 102321 (2022)CrossRef Li, C., Zheng, P., Li, S., Pang, Y., Lee, C.K.M.: AR-assisted digital twin-enabled robot collaborative manufacturing system with human-in-the-loop. Robot. Comput. Integr. Manuf. 76, 102321 (2022)CrossRef
12.
Zurück zum Zitat García, A., Bregon, A., Martínez-Prieto, M.: Towards a connected digital twin learning ecosystem in manufacturing: enablers and challenges. Comput. Ind. Eng.. Ind. Eng. 171, 108463 (2022)CrossRef García, A., Bregon, A., Martínez-Prieto, M.: Towards a connected digital twin learning ecosystem in manufacturing: enablers and challenges. Comput. Ind. Eng.. Ind. Eng. 171, 108463 (2022)CrossRef
13.
Zurück zum Zitat Liu, S., Vincent, X., Wang, L.: Digital twin-enabled advance execution for human-robot collaborative assembly. CIRP Ann. 71, 25–28 (2022)CrossRef Liu, S., Vincent, X., Wang, L.: Digital twin-enabled advance execution for human-robot collaborative assembly. CIRP Ann. 71, 25–28 (2022)CrossRef
14.
Zurück zum Zitat Choi, S.H., Park, K.B., Roh, D.H., Lee, J.Y., Mohammed, M., Ghasemi, Y., Jeong, H.: An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation. Robot. Comput. Integr. Manuf. 73, 102258 (2022)CrossRef Choi, S.H., Park, K.B., Roh, D.H., Lee, J.Y., Mohammed, M., Ghasemi, Y., Jeong, H.: An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation. Robot. Comput. Integr. Manuf. 73, 102258 (2022)CrossRef
15.
Zurück zum Zitat Valentini, P.P.: Interactive virtual assembling in augmented reality. Int. J. Interact. Des. Manuf. 3, 109–119 (2009)CrossRef Valentini, P.P.: Interactive virtual assembling in augmented reality. Int. J. Interact. Des. Manuf. 3, 109–119 (2009)CrossRef
16.
Zurück zum Zitat Qiu, C., Zhou, S., Liu, Z., Gao, Q., Tan, J.: Digital assembly technology based on augmented reality and digital twins: a review. Virtual Real. Intell. Hardw. 1(6), 597–610 (2019)CrossRef Qiu, C., Zhou, S., Liu, Z., Gao, Q., Tan, J.: Digital assembly technology based on augmented reality and digital twins: a review. Virtual Real. Intell. Hardw. 1(6), 597–610 (2019)CrossRef
17.
Zurück zum Zitat Chen, C.H., Lin, C.W., Huang, C.C.: The convergence of augmented reality and digital twins: a new approach to product development and manufacturing, J. Intell. Manuf. (2019) Chen, C.H., Lin, C.W., Huang, C.C.: The convergence of augmented reality and digital twins: a new approach to product development and manufacturing, J. Intell. Manuf. (2019)
18.
Zurück zum Zitat Shah, M.M., Khan, M.M.A., Alshamran, S.A.: Augmented reality and digital twins: a new paradigm for manufacturing, Manuf. Lett. (2020) Shah, M.M., Khan, M.M.A., Alshamran, S.A.: Augmented reality and digital twins: a new paradigm for manufacturing, Manuf. Lett. (2020)
19.
Zurück zum Zitat Valentini, P.P., Biancolini, M.E.: Interactive sculpting using augmented-reality mesh morphing, and force feedback: force-feedback capabilities in an augmented reality environment. IEEE Consum. Electron. Mag. 7(2), 83–89 (2018)CrossRef Valentini, P.P., Biancolini, M.E.: Interactive sculpting using augmented-reality mesh morphing, and force feedback: force-feedback capabilities in an augmented reality environment. IEEE Consum. Electron. Mag. 7(2), 83–89 (2018)CrossRef
20.
Zurück zum Zitat Valentini, P.P.: Interactive cable harnessing in augmented reality. Int. J. Interact. Des. Manuf. 5, 45–53 (2011)CrossRef Valentini, P.P.: Interactive cable harnessing in augmented reality. Int. J. Interact. Des. Manuf. 5, 45–53 (2011)CrossRef
21.
Zurück zum Zitat Valentini, P.P., Pennestrì, E.: Compliant four-bar linkage synthesis with second-order flexure hinge approximation. Mech. Mach. Theory 128, 225–233 (2018)CrossRef Valentini, P.P., Pennestrì, E.: Compliant four-bar linkage synthesis with second-order flexure hinge approximation. Mech. Mach. Theory 128, 225–233 (2018)CrossRef
22.
Zurück zum Zitat Valentini, P.P.: Natural Interface in Augmented Reality Interactive Simulations. Virtual and Physical Prototyping 7, 137–151 (2012)CrossRef Valentini, P.P.: Natural Interface in Augmented Reality Interactive Simulations. Virtual and Physical Prototyping 7, 137–151 (2012)CrossRef
23.
Zurück zum Zitat Valentini, P.P., Pezzuti, E.: Accuracy in fingertip tracking using Leap Motion Controller for interactive virtual applications. Int. J. Interact. Des. Manuf. 11, 641–650 (2017)CrossRef Valentini, P.P., Pezzuti, E.: Accuracy in fingertip tracking using Leap Motion Controller for interactive virtual applications. Int. J. Interact. Des. Manuf. 11, 641–650 (2017)CrossRef
24.
Zurück zum Zitat Valentini, P.P.: Natural interface for interactive virtual assembly in augmented reality using leap motion controller. Int. J. Interact. Des. Manuf. 12(4), 1157–1165 (2018)CrossRef Valentini, P.P.: Natural interface for interactive virtual assembly in augmented reality using leap motion controller. Int. J. Interact. Des. Manuf. 12(4), 1157–1165 (2018)CrossRef
25.
Zurück zum Zitat Belfiore, N.P., Mariti, L., Pennestrì, E., Valentini, P.P.: Comparison of solution strategies for multibody dynamics equations. Int. J. Numer. Meth. Eng.Numer. Meth. Eng. 88(7), 637–656 (2011)ADSMathSciNetCrossRef Belfiore, N.P., Mariti, L., Pennestrì, E., Valentini, P.P.: Comparison of solution strategies for multibody dynamics equations. Int. J. Numer. Meth. Eng.Numer. Meth. Eng. 88(7), 637–656 (2011)ADSMathSciNetCrossRef
26.
Zurück zum Zitat Mirtich, B.V.: Impulse-based dynamic simulation of rigid body systems, PhD thesis, University of California, Berkeley, CA, USA (1996) Mirtich, B.V.: Impulse-based dynamic simulation of rigid body systems, PhD thesis, University of California, Berkeley, CA, USA (1996)
27.
Zurück zum Zitat Schmitt, A., Bender J.: Impulse-based dynamic simulation of multibody systems: numerical comparison with standard methods, In: Proceedings of automation of discrete production engineering, Sozopol, Bulgaria, pp. 324–329, (2005) Schmitt, A., Bender J.: Impulse-based dynamic simulation of multibody systems: numerical comparison with standard methods, In: Proceedings of automation of discrete production engineering, Sozopol, Bulgaria, pp. 324–329, (2005)
28.
Zurück zum Zitat Valentini, P.P., Pezzuti, E.: Interactive multibody simulation in augmented reality. J. Theor. Appl. Mech.Theor. Appl. Mech. 48(3), 733–750 (2010) Valentini, P.P., Pezzuti, E.: Interactive multibody simulation in augmented reality. J. Theor. Appl. Mech.Theor. Appl. Mech. 48(3), 733–750 (2010)
29.
Zurück zum Zitat Haug, E.J.: Computer aided kinematics and dynamics of mechanical systems, Pearson College Div, USA, (1989) Haug, E.J.: Computer aided kinematics and dynamics of mechanical systems, Pearson College Div, USA, (1989)
30.
Zurück zum Zitat Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. 21(6), 34–47 (2001)CrossRef Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. 21(6), 34–47 (2001)CrossRef
31.
Zurück zum Zitat Liarokapis, F.: An augmented reality interface for visualizing and interacting with virtual content. Virtual Real. 11, 23–43 (2007)CrossRef Liarokapis, F.: An augmented reality interface for visualizing and interacting with virtual content. Virtual Real. 11, 23–43 (2007)CrossRef
Metadaten
Titel
Impulse dynamics and augmented reality for real-time interactive digital twin exploration and interrogation
verfasst von
Marco Cirelli
Alessio Cellupica
Pietro Canonico
Pier Paolo Valentini
Publikationsdatum
10.01.2024
Verlag
Springer Paris
Erschienen in
International Journal on Interactive Design and Manufacturing (IJIDeM) / Ausgabe 2/2024
Print ISSN: 1955-2513
Elektronische ISSN: 1955-2505
DOI
https://doi.org/10.1007/s12008-023-01704-y

Weitere Artikel der Ausgabe 2/2024

International Journal on Interactive Design and Manufacturing (IJIDeM) 2/2024 Zur Ausgabe

Premium Partner