Skip to main content

2016 | OriginalPaper | Buchkapitel

3D Augmented Reality Based Orthopaedic Interventions

verfasst von : Xinran Zhang, Zhencheng Fan, Junchen Wang, Hongen Liao

Erschienen in: Computational Radiology for Orthopaedic Interventions

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Augmented reality (AR) techniques, which can merge virtual computer-generated guidance information into real medical interventions, help surgeons obtain dynamic “see-through” scenes during orthopaedic interventions. Among various AR techniques, 3D integral videography (IV) image overlay is a promising solution because of its simplicity in implementation as well as the ability to produce a full parallax augmented natural view for multiple observers and improve surgeons’ hand-eye coordination. To obtain a precise fused result, patient-3D image registration is a vital technique in the IV overlay based orthopaedic interventions. Marker or marker-less based registration techniques are alternative depending on a particular clinical application. According to accurate AR information, minimally invasive therapy including cutting, drilling, implantation and other related operations, can be performed more easily and safely. This chapter reviews related augmented reality techniques for image-guided surgery and analyses several examples about clinical applications. Eventually, we discuss the future development of 3D AR based orthopaedic interventions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142CrossRef Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142CrossRef
2.
Zurück zum Zitat DiGioia AM III, Jaramaz B, Colgan BD (1998) Computer assisted orthopaedic surgery: image guided and robotic assistive technologies. Clin Orthop Relat Res 354:8–16CrossRef DiGioia AM III, Jaramaz B, Colgan BD (1998) Computer assisted orthopaedic surgery: image guided and robotic assistive technologies. Clin Orthop Relat Res 354:8–16CrossRef
3.
Zurück zum Zitat Peters T, Cleary K (2008) Image-guided interventions: technology and applications. Springer, Berlin Peters T, Cleary K (2008) Image-guided interventions: technology and applications. Springer, Berlin
4.
Zurück zum Zitat Liao H, Edwards PJ (2013) Introduction to the special issues of mixed reality guidance of therapy-Towards clinical implementation. Comput Med Imag Gr Off J Comput Med Imaging Soc 37.2: 81 Liao H, Edwards PJ (2013) Introduction to the special issues of mixed reality guidance of therapy-Towards clinical implementation. Comput Med Imag Gr Off J Comput Med Imaging Soc 37.2: 81
5.
Zurück zum Zitat Suenaga H, Tran HH, Liao H et al (2013) Real-time in situ three-dimensional integral videography and surgical navigation using augmented reality: a pilot study. Int J Oral Sci 5(2):98–102CrossRef Suenaga H, Tran HH, Liao H et al (2013) Real-time in situ three-dimensional integral videography and surgical navigation using augmented reality: a pilot study. Int J Oral Sci 5(2):98–102CrossRef
6.
Zurück zum Zitat Lamata P, Ali W, Cano A et al (2010) Augmented reality for minimally invasive surgery: overview and some recent advances. Augment Real 73–98 Lamata P, Ali W, Cano A et al (2010) Augmented reality for minimally invasive surgery: overview and some recent advances. Augment Real 73–98
7.
Zurück zum Zitat Sauer F, Vogt S, Khamene A (2008) Augmented reality. In: Image-guided interventions. Springer, US, pp 81–119 Sauer F, Vogt S, Khamene A (2008) Augmented reality. In: Image-guided interventions. Springer, US, pp 81–119
8.
Zurück zum Zitat Fichtinger G, Deguet A, Masamune K, et al (2004) Needle insertion in CT scanner with image overlay–cadaver studies. In: Medical image computing and computer-assisted intervention–MICCAI 2004. Springer, Berlin, pp 795–803 Fichtinger G, Deguet A, Masamune K, et al (2004) Needle insertion in CT scanner with image overlay–cadaver studies. In: Medical image computing and computer-assisted intervention–MICCAI 2004. Springer, Berlin, pp 795–803
9.
Zurück zum Zitat Tran HH, Suenaga H, Kuwana K et al (2011) Augmented reality system for oral surgery using 3D auto stereoscopic visualization. In: Medical image computing and computer-assisted intervention–MICCAI 2011. Springer, Berlin, pp 81–88 Tran HH, Suenaga H, Kuwana K et al (2011) Augmented reality system for oral surgery using 3D auto stereoscopic visualization. In: Medical image computing and computer-assisted intervention–MICCAI 2011. Springer, Berlin, pp 81–88
10.
Zurück zum Zitat Wang J, Suenaga H, Hoshi K et al (2014) Augmented reality navigation with automatic marker-free image registration using 3D image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1303CrossRef Wang J, Suenaga H, Hoshi K et al (2014) Augmented reality navigation with automatic marker-free image registration using 3D image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1303CrossRef
11.
Zurück zum Zitat Liao H, Sakuma I, Dohi T (2007) Development and evaluation of a medical autostereoscopic image integral videography for surgical navigation. In: IEEE/ICME international conference on complex medical engineering, 2007, CME 2007. IEEE, New York Liao H, Sakuma I, Dohi T (2007) Development and evaluation of a medical autostereoscopic image integral videography for surgical navigation. In: IEEE/ICME international conference on complex medical engineering, 2007, CME 2007. IEEE, New York
12.
Zurück zum Zitat Lippmann G (1908) La Photographie integrale. Academie des Sciences, Comtes Rendus, pp 446–451 Lippmann G (1908) La Photographie integrale. Academie des Sciences, Comtes Rendus, pp 446–451
13.
Zurück zum Zitat Liao H, Nakajima S, Iwahara M et al (2001) Intra-operative real-time 3-D information display system based on integral videography. In: Medical image computing and computer-assisted intervention–MICCAI 2001. Springer, Berlin Liao H, Nakajima S, Iwahara M et al (2001) Intra-operative real-time 3-D information display system based on integral videography. In: Medical image computing and computer-assisted intervention–MICCAI 2001. Springer, Berlin
14.
Zurück zum Zitat Liao H, Nomura K, Dohi T (2005) Autostereoscopic integral photography imaging using pixel distribution of computer graphics generated image. In: ACM SIGGRAPH 2005 Posters. ACM, Texas Liao H, Nomura K, Dohi T (2005) Autostereoscopic integral photography imaging using pixel distribution of computer graphics generated image. In: ACM SIGGRAPH 2005 Posters. ACM, Texas
15.
Zurück zum Zitat Liao H, Dohi T, Nomura K (2011) Autostereoscopic 3D display with long visualization depth using referential viewing area-based integral photography. IEEE Trans Vis Comput Gr 17(11):1690–1701CrossRef Liao H, Dohi T, Nomura K (2011) Autostereoscopic 3D display with long visualization depth using referential viewing area-based integral photography. IEEE Trans Vis Comput Gr 17(11):1690–1701CrossRef
16.
Zurück zum Zitat Wang J, Sakuma I, Liao H (2013) A hybrid flexible rendering pipeline for real-time 3D medical imaging using GPU-accelerated integral videography. Int J Comput Assist Radiol Surg S287–S288 Wang J, Sakuma I, Liao H (2013) A hybrid flexible rendering pipeline for real-time 3D medical imaging using GPU-accelerated integral videography. Int J Comput Assist Radiol Surg S287–S288
17.
Zurück zum Zitat Wang J, Suenaga H, Liao H et al (2014) Real-time computer-generated integral imaging and 3D image calibration for augmented reality surgical navigation. Comput Med Imaging Graph 147:159 Wang J, Suenaga H, Liao H et al (2014) Real-time computer-generated integral imaging and 3D image calibration for augmented reality surgical navigation. Comput Med Imaging Graph 147:159
18.
Zurück zum Zitat Liao H, Inomata T, Sakuma I et al (2010) 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng 57(6):1476–1486CrossRef Liao H, Inomata T, Sakuma I et al (2010) 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng 57(6):1476–1486CrossRef
19.
Zurück zum Zitat Liao H, Hata N, Nakajima S et al (2004) Surgical navigation by autostereoscopic image overlay of integral videography. IEEE Trans Inf Technol Biomed 8(2):114–121CrossRef Liao H, Hata N, Nakajima S et al (2004) Surgical navigation by autostereoscopic image overlay of integral videography. IEEE Trans Inf Technol Biomed 8(2):114–121CrossRef
20.
Zurück zum Zitat Lamata P, Ali W, Cano A et al (2010) Augmented reality for minimally invasive surgery: overview and some recent advances. Augment Real 73–98 Lamata P, Ali W, Cano A et al (2010) Augmented reality for minimally invasive surgery: overview and some recent advances. Augment Real 73–98
21.
Zurück zum Zitat Arun S, Huang S, Blostein D (1987) Least-squares fitting of two 3-D point sets. IEEE Trans Pattern Anal Mach Intell 5:698–700 Arun S, Huang S, Blostein D (1987) Least-squares fitting of two 3-D point sets. IEEE Trans Pattern Anal Mach Intell 5:698–700
22.
Zurück zum Zitat Eggers G, Mühling J, Marmulla R (2006) Image-to-patient registration techniques in head surgery. Int J Oral Maxillofac Surg 35(12):1081–1095CrossRef Eggers G, Mühling J, Marmulla R (2006) Image-to-patient registration techniques in head surgery. Int J Oral Maxillofac Surg 35(12):1081–1095CrossRef
23.
Zurück zum Zitat Marmulla R, Hassfeld S, Lüth T et al (2003) Laser-scan-based navigation in cranio-maxillofacial surgery. J Cranio-Maxillofac Surg 31(5):267–277CrossRef Marmulla R, Hassfeld S, Lüth T et al (2003) Laser-scan-based navigation in cranio-maxillofacial surgery. J Cranio-Maxillofac Surg 31(5):267–277CrossRef
24.
Zurück zum Zitat Hassfeld S, Mühling J (2001) Computer assisted oral and maxillofacial surgery–a review and an assessment of technology. Int J Oral Maxillofac Surg 30(1):2–13CrossRef Hassfeld S, Mühling J (2001) Computer assisted oral and maxillofacial surgery–a review and an assessment of technology. Int J Oral Maxillofac Surg 30(1):2–13CrossRef
25.
Zurück zum Zitat Liao H, Inomata T, Hata N et al (2004) Integral videography overlay navigation system using mutual information-based registration. In: Medical imaging and augmented reality. Springer, Berlin, pp 361–368 Liao H, Inomata T, Hata N et al (2004) Integral videography overlay navigation system using mutual information-based registration. In: Medical imaging and augmented reality. Springer, Berlin, pp 361–368
26.
Zurück zum Zitat Luebbers HT, Messmer P, Obwegeser JA et al (2008) Comparison of different registration methods for surgical navigation in cranio-maxillofacial surgery. J Cranio-Maxillofac Surg 36(2):109–116CrossRef Luebbers HT, Messmer P, Obwegeser JA et al (2008) Comparison of different registration methods for surgical navigation in cranio-maxillofacial surgery. J Cranio-Maxillofac Surg 36(2):109–116CrossRef
27.
Zurück zum Zitat Hostettler A, Nicolau SA, Rémond Y et al (2010) A real-time predictive simulation of abdominal viscera positions during quiet free breathing. Prog Biophys Mol Biol 103(2):169–184CrossRef Hostettler A, Nicolau SA, Rémond Y et al (2010) A real-time predictive simulation of abdominal viscera positions during quiet free breathing. Prog Biophys Mol Biol 103(2):169–184CrossRef
28.
Zurück zum Zitat Nicolau S, Soler L, Mutter D et al (2011) Augmented reality in laparoscopic surgical oncology. Surg Oncol 20(3):189–201CrossRef Nicolau S, Soler L, Mutter D et al (2011) Augmented reality in laparoscopic surgical oncology. Surg Oncol 20(3):189–201CrossRef
29.
Zurück zum Zitat Fitzpatrick M (2009) Fiducial registration error and target registration error are uncorrelated. In: SPIE Medical Imaging. International Society for Optics and Photonics, Bellingham Fitzpatrick M (2009) Fiducial registration error and target registration error are uncorrelated. In: SPIE Medical Imaging. International Society for Optics and Photonics, Bellingham
30.
Zurück zum Zitat Liao H, Ishihara H, Tran H et al (2010) Precision-guided surgical navigation system using laser guidance and 3D autostereoscopic image overlay. Comput Med Imaging Graph 34(1):46–54CrossRef Liao H, Ishihara H, Tran H et al (2010) Precision-guided surgical navigation system using laser guidance and 3D autostereoscopic image overlay. Comput Med Imaging Graph 34(1):46–54CrossRef
31.
Zurück zum Zitat Seichi A, Takeshita K, Nakajima S et al (2005) Revision cervical spine surgery using transarticular or pedicle screws under a computer-assisted image-guidance system. J Orthop Sci 10(4):385–390CrossRef Seichi A, Takeshita K, Nakajima S et al (2005) Revision cervical spine surgery using transarticular or pedicle screws under a computer-assisted image-guidance system. J Orthop Sci 10(4):385–390CrossRef
32.
Zurück zum Zitat Herlambang N, Liao H, Matsumiya K et al (2005) Realtime integral videography using intra-operative 3-D ultrasound for minimally invasive heart surgery. J Jpn Soc Comput Aided Surg J JSCAS 7.2:163–166 Herlambang N, Liao H, Matsumiya K et al (2005) Realtime integral videography using intra-operative 3-D ultrasound for minimally invasive heart surgery. J Jpn Soc Comput Aided Surg J JSCAS 7.2:163–166
Metadaten
Titel
3D Augmented Reality Based Orthopaedic Interventions
verfasst von
Xinran Zhang
Zhencheng Fan
Junchen Wang
Hongen Liao
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-23482-3_4

Neuer Inhalt