Top

Published in:

2016 | OriginalPaper | Chapter

Augmented Reality in Orthopaedic Interventions and Education

Authors : Pascal Fallavollita, Lejing Wang, Simon Weidert, Nassir Navab

Published in: Computational Radiology for Orthopaedic Interventions

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

During surgery, the surgeon’s view of the patient is complemented with imaging that provides an indirect visual feedback of the treated anatomy. For an advanced visualization, existing image-guided surgical systems employ tracking and registration methods to fuse medical images. Lately, medical augmented reality has enabled in situ visualization by registering three-dimensional preoperative data (e.g. CT, MRI, and PET) with two-dimensional intraoperative images (e.g. X-ray, Ultrasound, and Optics). Including the virtual locations of the surgical instruments within the visualization provides the most intuitive way to facilitate surgical navigation since the surgeon mental mapping between medical images, instruments, and patient is not necessary anymore. This book chapter investigates medical augmented reality solutions within orthopaedics and highlights the innovations that lead surgeons in surgical planning, navigation, and education in an efficient and timely manner.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Intraoperative Three-Dimensional Imaging in Fracture Treatment with a Mobile C-Arm

next chapter State of the Art of Ultrasound-Based Registration in Computer Assisted Orthopedic Interventions

Van Krevelen DWF, Poelman R (2010) A survey of augmented reality technologies, applications and limitations. Int J Virtual Reality 9(2):1

Navab N, Blum T, Wang L, Okur A, Wendler T (2012) First deployments of augmented reality in operating rooms. Computer 7:48–55CrossRef

Stetten G, Cois A, Chang W, Shelton D, Tamburo R, Castellucci J, von Ramm O (2005) C-mode real-time tomographic reflection for a matrix array ultrasound sonic flashlight 1. Acad Radiol 12(5):535–543CrossRef

Fichtinger G, Deguet A, Masamune K, Balogh E, Fischer GS, Mathieu H, Taylor RH, James Zinreich S, Fayad LM (2005) Image overlay guidance for needle insertion in CT scanner. IEEE Trans Biomed Eng 52(8):1415–1424CrossRef

Fischer GS, Deguet A, Csoma C, Taylor RH, Fayad L, Carrino JA, James Zinreich S, Fichtinger G (2007) MRI image overlay: application to arthrography needle insertion. Comput Aided Surg 12(1):2–14CrossRef

Feuerstein M, Mussack T, Heining SM, Navab Nassir (2008) Intraoperative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection. IEEE Trans Med Imaging 27(3):355–369CrossRef

Wendler T, Feuerstein M, Traub J, Lasser T, Vogel J, Daghighian F, Ziegler SI, Navab N (2007) Real-time fusion of ultrasound and gamma probe for navigated localization of liver metastases. In: Medical image computing and computer-assisted intervention–MICCAI 2007. Springer, Berlin, pp 252–260

Wendler T, Hartl A, Lasser T, Traub J, Daghighian F, Ziegler SI, Navab N (2007) Towards intra-operative 3D nuclear imaging: reconstruction of 3D radioactive distributions using tracked gamma probes. In: Medical image computing and computer-assisted intervention–MICCAI 2007. Springer, Berlin, pp 909–917

Okur A, Ahmadi SA, Bigdelou A, Wendler T, Navab N (2011) MR in OR: first analysis of AR/VR visualization in 100 intra-operative freehand SPECT acquisitions. In: 10th IEEE international symposium on mixed and augmented reality (ISMAR). IEEE, pp 211–218

10.

Navab N, Bani-Kashemi A, Mitschke M (1999) Merging visible and invisible: two camera-augmented mobile C-arm (CAMC) applications. In: 2nd IEEE and ACM international workshop on augmented reality (IWAR’99) proceedings. IEEE, pp 134–141

11.

Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423CrossRef

12.

Traub J, Heibel TH, Dressel P, Heining SM, Graumann R, Navab N (2007) A multi-view opto-Xray imaging system. In: Medical image computing and computer-assisted intervention–MICCAI 2007. Springer, Berlin, pp 18–25

13.

Yaniv Z, Joskowicz L (2004) Long bone panoramas from fluoroscopic X-ray images. IEEE Trans Med Imaging 23(1):26–35CrossRef

14.

Messmer P, Matthews F, Wullschleger C, Hügli R, Regazzoni P, Jacob AL (2006) Image fusion for intraoperative control of axis in long bone fracture treatment. Eur J Trauma 32(6):555–561CrossRef

15.

Wang L, Traub J, Weidert S, Heining SM, Euler E, Navab N (2010) Parallax-free intra-operative X-ray image stitching. Med Image Anal 14(5):674–686CrossRef

16.

Kainz B, Grabner M, Rüther M (2008) Fast marker based C-arm pose estimation. In: Medical image computing and computer-assisted intervention–MICCAI 2008. Springer, Berlin, pp 652–659

17.

Pati S, Erat O, Wang L, Weidert S, Euler E, Navab N, Fallavollita P (2013) Accurate pose estimation using single marker single camera calibration system. In: SPIE medical imaging. International Society for Optics and Photonics, pp 867126–867126

18.

Fallavollita P, Burdette EC, Song DY, Abolmaesumi P, Fichtinger G (2011) Technical note: unsupervised c-arm pose tracking with radiographic fiducial. Med Phys 38(4):2241–2245CrossRef

19.

Moult E, Burdette EC, Song DY, Abolmaesumi P, Fichtinger G, Fallavollita P (2011) Automatic C-arm pose estimation via 2D/3D hybrid registration of a radiographic fiducial. In: SPIE medical imaging. International Society for Optics and Photonics, pp 79642S–79642S

20.

Fallavollita P, Burdette C, Song DY, Abolmaesumi P, Fichtinger G (2010) C-arm tracking by intensity-based registration of a fiducial in prostate brachytherapy. In: information processing in computer-assisted interventions. Springer, Berlin, pp 45–55

21.

Wang L, Fallavollita P, Zou R, Chen X, Weidert S, Navab N (2012) Closed-form inverse kinematics for interventional C-arm X-ray imaging with six degrees of freedom: modeling and application. IEEE Trans Med Imaging 31(5):1086–1099CrossRef

22.

Wang L, Fallavollita P, Brand A, Erat O, Weidert S, Thaller PH, Euler E, Navab N (2012) Intra-op measurement of the mechanical axis deviation: an evaluation study on 19 human cadaver legs. In: Medical image computing and computer-assisted intervention–MICCAI 2012. Springer, Berlin, pp 609–616

23.

Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, Navab N, Fallavollita P (2014) The ‘augmented’ circles: a video-guided solution for the down-the-beam positioning of IM nail holes. In: Information processing in computer-assisted interventions. Springer International Publishing, pp 100–107

24.

Diotte B, Fallavollita P, Wang L, Weidert S, Euler E, Thaller P, Navab N (2014) Multi-modal intra-operative navigation during distal locking of intramedullary nails. IEEE Trans Med Imaging 34(2):487–495CrossRef

25.

Thaller PH, Diotte B, Fallavollita P, Wang L, Weidert S, Euler E, Mutschler W, Navab N (2013) Sa4. 8 video-assisted interlocking of intramedullary nails. Injury 44:S25CrossRef

26.

Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, Navab N, Fallavollita P (2015) Intra-operative augmented reality in distal locking. Int J Comput Assisted Radiol Surg 1–9

27.

Pauly O, Katouzian A, Eslami A, Fallavollita P, Navab N (2012) Supervised classification for customized intraoperative augmented reality visualization. In: IEEE International symposium on mixed and augmented reality (ISMAR), 2012. IEEE, pp 311–312

28.

Erat O, Pauly O, Weidert S, Thaller P, Euler E, Mutschler W, Navab N, Fallavollita P (2013) How a surgeon becomes superman by visualization of intelligently fused multi-modalities. SPIE medical imaging. International Society for Optics and Photonics, pp 86710L-86710L

29.

Pauly O, Diotte B, Habert S, Weidert S, Euler E, Fallavollita P, Navab N (2014) Relevance-based visualization to improve surgeon perception. In: Information processing in computer-assisted interventions. Springer International Publishing, pp 178–185

30.

Dressel P, Wang L, Kutter O, Traub J, Heining SM, Navab N (2010) Intraoperative positioning of mobile C-arms using artificial fluoroscopy. In: SPIE medical imaging. International Society for Optics and Photonics, pp 762506–762506

31.

Zheng G, Dong X, Gruetzner PA (2008) Reality-augmented virtual fluoroscopy for computer-assisted diaphyseal long bone fracture osteosynthesis: a novel technique and feasibility study results. Proc Inst Mech Eng [H] 222(1):101–115CrossRef

32.

Abe Y, Sato S, Kato K, Hyakumachi T, Yanagibashi Y, Ito M, Abumi K (2013) A novel 3D guidance system using augmented reality for percutaneous vertebroplasty: technical note. J Neurosurg Spine 19(4):492–501CrossRef

33.

Wu JR, Wang ML, Liu KC, Hu MH, Lee PY (2014) Real-time advanced spinal surgery via visible patient model and augmented reality system. Comput Methods Programs Biomed 113(3):869–881CrossRef

34.

Chang TC, Hsieh CH, Huang CH, Yang JW, Lee ST, Wu CT, Lee JD (2015) Interactive medical augmented reality system for remote surgical assistance. Appl Math 9(1L):97–104

35.

Fritz J, U-Thainual P, Ungi T, Flammang AJ, Cho NB, Fichtinger G, Iordachita II, Carrino JA (2012) Augmented reality visualization with image overlay for MRI-guided intervention: accuracy for lumbar spinal procedures with a 1.5-T MRI system. Am J Roentgenol 198(3): W266–W273

36.

Hu L, Wang M, Song Z (2013) A convenient method of video see-through augmented reality based on image-guided surgery system. In: Seventh international conference on internet computing for engineering and science (ICICSE), 2013. IEEE, pp 100–103

37.

Wang ML, Wu JR, Liu KC, Lee PY, Chiang YY, Lin HY (2012) Innovative 3D augmented reality techniques for spinal surgery applications. In: International symposium on intelligent signal processing and communications systems (ISPACS), 2012. IEEE, pp 16–20

38.

Macedo MCF, Lopes Apolinário A, Souza ACS, Giraldi GA (2014) A semi-automatic markerless augmented reality approach for on-patient volumetric medical data visualization. In: 2014 XVI symposium on virtual and augmented reality (SVR). IEEE, pp 63–70

39.

Macedo MCF, Apolinário AL Jr (2014) Improving on-patient medical data visualization in a markerless augmented reality environment by volume clipping. In: Proceedings of the 2014 27th SIBGRAPI conference on graphics, patterns and images. IEEE Computer Society, pp 149–156

40.

Dixon BJ, Daly MJ, Chan H, Vescan AD, Witterick IJ, Irish JC (2013) Surgeons blinded by enhanced navigation: the effect of augmented reality on attention. Surg Endosc 27(2):454–461CrossRef

41.

Blum T, Stauder R, Euler E, Navab N (2012) Superman-like X-ray vision: towards brain-computer interfaces for medical augmented reality. In: IEEE international symposium on mixed and augmented reality (ISMAR), 2012. IEEE, pp 271–272

42.

Frank JR (ed) (2005) The CanMEDS 2005 physician competency framework: better standards, better physicians, better care. Royal College of Physicians and Surgeons of Canada

43.

McLachlan JC, Bligh J, Bradley P, Searle J (2004) Teaching anatomy without cadavers. Med Educ 38(4):418–424CrossRef

44.

Thomas RG, William John N, Delieu JM (2010) Augmented reality for anatomical education. J Vis Commun Med 33(1):6–15CrossRef

45.

Chien CH, Chen CH, Jeng TS (2010) An Interactive augmented reality system for learning anatomy structure. In: Proceedings of the international multiconference of engineers and computer scientists, IMECS

46.

Blum T, Kleeberger V, Bichlmeier C, Navab N (2012) Mirracle: an augmented reality magic mirror system for anatomy education. In: Virtual reality short papers and posters (VRW), 2012. IEEE, pp 115–116

47.

Kamphuis C, Barsom E, Schijven M, Christoph N (2014) Augmented reality in medical education? Perspect Med Edu 3(4):300–311CrossRef

48.

Ponce BA, Jennings JK, Clay TB, May MB, Huisingh C, Sheppard ED (2014) Telementoring: use of augmented reality in orthopaedic education. J Bone Joint Surg 96(10):e84CrossRef

49.

Bichlmeier CP (2010) Immersive, interactive and contextual in-situ visualization for medical applications. PhD dissertation, München, Technische Universität Dissertation

Title: Augmented Reality in Orthopaedic Interventions and Education
Authors: Pascal Fallavollita
Lejing Wang
Simon Weidert
Nassir Navab
Publisher: Springer International Publishing
Book: Computational Radiology for Orthopaedic Interventions
Print ISBN: 978-3-319-23481-6

Electronic ISBN: 978-3-319-23482-3

Copyright Year: 2016
DOI: https://doi.org/10.1007/978-3-319-23482-3_13

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"