Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 1/2024

13.07.2023 | Original Article

Validation of real-time inside-out tracking and depth realization technologies for augmented reality-based neuronavigation

verfasst von: Yun-Sik Dho, Byeong Cheol Lee, Hyeong Cheol Moon, Kyung Min Kim, Ho Kang, Eun Jung Lee, Min-Sung Kim, Jin Wook Kim, Yong Hwy Kim, Sang Joon Park, Chul-Kee Park

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 1/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Concomitant with the significant advances in computing technology, the utilization of augmented reality-based navigation in clinical applications is being actively researched. In this light, we developed novel object tracking and depth realization technologies to apply augmented reality-based neuronavigation to brain surgery.

Methods

We developed real-time inside-out tracking based on visual inertial odometry and a visual inertial simultaneous localization and mapping algorithm. The cube quick response marker and depth data obtained from light detection and ranging sensors are used for continuous tracking. For depth realization, order-independent transparency, clipping, and annotation and measurement functions were developed. In this study, the augmented reality model of a brain tumor patient was applied to its life-size three-dimensional (3D) printed model.

Results

Using real-time inside-out tracking, we confirmed that the augmented reality model remained consistent with the 3D printed patient model without flutter, regardless of the movement of the visualization device. The coordination accuracy during real-time inside-out tracking was also validated. The average movement error of the X and Y axes was 0.34 ± 0.21 and 0.04 ± 0.08 mm, respectively. Further, the application of order-independent transparency with multilayer alpha blending and filtered alpha compositing improved the perception of overlapping internal brain structures. Clipping, and annotation and measurement functions were also developed to aid depth perception and worked perfectly during real-time coordination. We named this system METAMEDIP navigation.

Conclusions

The results validate the efficacy of the real-time inside-out tracking and depth realization technology. With these novel technologies developed for continuous tracking and depth perception in augmented reality environments, we are able to overcome the critical obstacles in the development of clinically applicable augmented reality neuronavigation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
12.
Zurück zum Zitat Louis RG, Steinberg GK, Duma C, Britz G, Mehta V, Pace J, Selman W, Jean WC (2021) Early experience with virtual and synchronized augmented reality platform for preoperative planning and intraoperative navigation: a case series. Oper Neurosurg (Hagerstown) 21:189–196. https://doi.org/10.1093/ons/opab188CrossRefPubMed Louis RG, Steinberg GK, Duma C, Britz G, Mehta V, Pace J, Selman W, Jean WC (2021) Early experience with virtual and synchronized augmented reality platform for preoperative planning and intraoperative navigation: a case series. Oper Neurosurg (Hagerstown) 21:189–196. https://​doi.​org/​10.​1093/​ons/​opab188CrossRefPubMed
14.
Zurück zum Zitat Bichlmeier C, Wimmer F, Heining SM, Navab N (2007) Contextual anatomic mimesis hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality. In: 6th IEEE and ACM international symposium on mixed and augmented reality, vol. 2007, 2007, pp 129–138. https://doi.org/10.1109/ISMAR.2007.4538837 Bichlmeier C, Wimmer F, Heining SM, Navab N (2007) Contextual anatomic mimesis hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality. In: 6th IEEE and ACM international symposium on mixed and augmented reality, vol. 2007, 2007, pp 129–138. https://​doi.​org/​10.​1109/​ISMAR.​2007.​4538837
15.
Zurück zum Zitat Sielhorst T, Bichlmeier C, Heining SM, Navab N (2006) Depth perception—a major issue in medical AR: Evaluation study by twenty surgeons. In: Larsen R, Nielsen M, Sporring J (eds) Medical Image Computing and Computer-Assisted Intervention. Lecture Notes in Computer Science, vol 4190, Springer, Berlin, Heidelberg. pp 364–372. https://doi.org/10.1007/11866565_45 Sielhorst T, Bichlmeier C, Heining SM, Navab N (2006) Depth perception—a major issue in medical AR: Evaluation study by twenty surgeons. In: Larsen R, Nielsen M, Sporring J (eds) Medical Image Computing and Computer-Assisted Intervention. Lecture Notes in Computer Science, vol 4190, Springer, Berlin, Heidelberg. pp 364–372. https://​doi.​org/​10.​1007/​11866565_​45
20.
Zurück zum Zitat Cidota MA, Clifford RMS, Lukosch SG, Bilinghurst M (2016) Using visual effects to facilitate depth perception for spatial tasks in virtual and augmented reality. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), vol. 2016, 2016, pp 172–177. https://doi.org/10.1109/ISMAR-Adjunct.2016.0070 Cidota MA, Clifford RMS, Lukosch SG, Bilinghurst M (2016) Using visual effects to facilitate depth perception for spatial tasks in virtual and augmented reality. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), vol. 2016, 2016, pp 172–177. https://​doi.​org/​10.​1109/​ISMAR-Adjunct.​2016.​0070
22.
Zurück zum Zitat Reitinger B, Welrberger P, Bornik A, Beichel R, Schmalstieg D (2005) Spatial measurements for medical augmented reality. In: Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05). IEEE, pp 208–209. https://doi.org/10.1109/ISMAR.2005.53 Reitinger B, Welrberger P, Bornik A, Beichel R, Schmalstieg D (2005) Spatial measurements for medical augmented reality. In: Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05). IEEE, pp 208–209. https://​doi.​org/​10.​1109/​ISMAR.​2005.​53
Metadaten
Titel
Validation of real-time inside-out tracking and depth realization technologies for augmented reality-based neuronavigation
verfasst von
Yun-Sik Dho
Byeong Cheol Lee
Hyeong Cheol Moon
Kyung Min Kim
Ho Kang
Eun Jung Lee
Min-Sung Kim
Jin Wook Kim
Yong Hwy Kim
Sang Joon Park
Chul-Kee Park
Publikationsdatum
13.07.2023
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 1/2024
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-02993-0

Weitere Artikel der Ausgabe 1/2024

International Journal of Computer Assisted Radiology and Surgery 1/2024 Zur Ausgabe

Premium Partner