nach oben

International Journal of Computer Assisted Radiology and Surgery

Erschienen in:

01.06.2016 | Original Article

Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization

verfasst von: Sing Chun Lee, Bernhard Fuerst, Javad Fotouhi, Marius Fischer, Greg Osgood, Nassir Navab

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 6/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Purpose

This work proposes a novel algorithm to register cone-beam computed tomography (CBCT) volumes and 3D optical (RGBD) camera views. The co-registered real-time RGBD camera and CBCT imaging enable a novel augmented reality solution for orthopedic surgeries, which allows arbitrary views using digitally reconstructed radiographs overlaid on the reconstructed patient’s surface without the need to move the C-arm.

Methods

An RGBD camera is rigidly mounted on the C-arm near the detector. We introduce a calibration method based on the simultaneous reconstruction of the surface and the CBCT scan of an object. The transformation between the two coordinate spaces is recovered using Fast Point Feature Histogram descriptors and the Iterative Closest Point algorithm.

Results

Several experiments are performed to assess the repeatability and the accuracy of this method. Target registration error is measured on multiple visual and radio-opaque landmarks to evaluate the accuracy of the registration. Mixed reality visualizations from arbitrary angles are also presented for simulated orthopedic surgeries.

Conclusion

To the best of our knowledge, this is the first calibration method which uses only tomographic and RGBD reconstructions. This means that the method does not impose a particular shape of the phantom. We demonstrate a marker-less calibration of CBCT volumes and 3D depth cameras, achieving reasonable registration accuracy. This design requires a one-time factory calibration, is self-contained, and could be integrated into existing mobile C-arms to provide real-time augmented reality views from arbitrary angles.

Vorheriger Artikel Registration of a statistical model to intraoperative ultrasound for scaphoid screw fixation

Nächster Artikel Context region discovery for automatic motion compensation in fluoroscopy

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Open-source code available at https://github.com/Nerei/kinfu_remake.

Dickerson MT, Scot Drysdale RL, McElfresh SA, Welzl E (1994) Fast greedy triangulation algorithms. In: Proceedings of the tenth annual symposium on computational geometry, SCG ’94. pp 211–220. ACM, New York, NY, USA

Diotte B, Fallavollita P, Wang L, Weidert S, Thaller PH, Euler E, Navab N (2012) Radiation-free drill guidance in interlocking of intramedullary nails. In: Ayache N, Delingette H, Golland P, Mori K (eds) Medical image computing and computer-assisted intervention—MICCAI. Springer, Berlin, Heidelberg, pp 18–25

Foix S, Alenya G, Torras C (2011) Lock-in time-of-flight (ToF) cameras: a survey. Sens J IEEE 11(9):1917–1926CrossRef

Fuerst B, Fotouhi J, Navab N (2015) Vision-based intraoperative cone-beam ct stitching for non-overlapping volumes. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention—MICCAI 2015. Springer, Cham, pp 387–395

Habert S, Gardiazabal J, Fallavollita P, Navab N (2015) RGBDX: first design and experimental validation of a mirror-based RGBD Xray imaging system. In: International symposium on mixed and augmented reality (ISMAR). Fukuoka

Habert S, Meng M, Kehl W, Wang X, Tombari F, Fallavollita P, Navab N (2015) Augmenting mobile c-arm fluoroscopes via stereo-RGBD sensors for multimodal visualization. In: International symposium on mixed and augmented reality (ISMAR). Fukuoka

Kim CW, Lee YP, Taylor W, Oygar A, Kim WK (2008) Use of navigation-assisted fluoroscopy to decrease radiation exposure during minimally invasive spine surgery. Spine J 8(4):584–590CrossRefPubMed

Matthews F, Hoigne DJ, Weiser M, Wanner GA, Regazzoni P, Suhm N, Messmer P (2007) Navigating the fluoroscope’s c-arm back into position: an accurate and practicable solution to cut radiation and optimize intraoperative workflow. J Orthop Trauma 21(10):687–692CrossRefPubMed

Merloz P, Troccaz J, Vouaillat H, Vasile C, Tonetti J, Eid A, Plaweski S (2007) Fluoroscopy-based navigation system in spine surgery. Proc Inst Mech Eng Part H J Eng Med 221(7):813–820CrossRef

10.

Navab N, Blum T, Wang L, Okur A, Wendler T (2012) First deployments of augmented reality in operating rooms. Computer 7:48–55CrossRef

11.

Navab N, Heining SM, Traub J (2010) Camera augmented mobile c-arm (camc): calibration, accuracy study, and clinical applications. Med Imaging IEEE Trans 29(7):1412–1423CrossRef

12.

Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) Kinectfusion: Real-time dense surface mapping and tracking. In: International symposium on mixed and augmented reality (ISMAR), pp 127–136

13.

Nicolau S, Lee P, Wu H, Huang M, Lukang R, Soler L, Marescaux J (2011) Fusion of c-arm x-ray image on video view to reduce radiation exposure and improve orthopedic surgery planning: first in-vivo evaluation. In: 15th Annual conference of the international society for computer aided surgery. Computer Assisted Radiology and Surgery

14.

Pfaff JA, Moore GP (2007) Reducing risk in emergency department wound management. Emerg Med Clin N Am 25(1):189–201CrossRef

15.

Reaungamornrat S, Otake Y, Uneri A, Schafer S, Mirota D, Nithiananthan S, Stayman JW, Kleinszig G, Khanna AJ, Taylor RH, Siewerdsen JH (2012) An on-board surgical tracking and video augmentation system for c-arm image guidance. Int J Comput Assist Radiol Surg 7(5):647–665CrossRefPubMed

16.

Rusu R, Blodow N, Beetz M (2009) Fast point feature histograms (FPFH) for 3D registration. In: Robotics and automation (ICRA), IEEE international conference on, pp 3212–3217

17.

Rusu RB, Cousins S (2011) 3d is here: Point cloud library (pcl). In: Robotics and automation (ICRA), IEEE international conference on, pp 1–4. IEEE

18.

Torr P, Zisserman A (2000) Mlesac: a new robust estimator with application to estimating image geometry. Comput Vision Image Underst 78(1):138–156CrossRef

19.

van de Kraats EB, van Walsum T, Kendrick L, Noordhoek NJ, Niessen WJ (2006) Accuracy evaluation of direct navigation with an isocentric 3d rotational X-ray system. Med Image Anal 10(2):113–124CrossRefPubMed

20.

Wang X, Habert S, Meng M, Wang X, Huang CH, Fallavollita P, Navab N (2015) Rgb-d/c-arm calibration and application in medical augmented reality. In: International symposium on mixed and augmented reality (ISMAR). Fukuoka, Japan

21.

Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef

Titel: Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization
verfasst von: Sing Chun Lee
Bernhard Fuerst
Javad Fotouhi
Marius Fischer
Greg Osgood
Nassir Navab
Publikationsdatum: 01.06.2016
Verlag: Springer Berlin Heidelberg
Erschienen in: International Journal of Computer Assisted Radiology and Surgery / Ausgabe 6/2016
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI: https://doi.org/10.1007/s11548-016-1396-1

Springer Professional

Abstract

Purpose

Methods

Results

Conclusion

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 6/2016

Deformable registration of trans-rectal ultrasound (TRUS) and magnetic resonance imaging (MRI) for focal prostate brachytherapy

Detection of prostate cancer using temporal sequences of ultrasound data: a large clinical feasibility study

Comprehensive patient-specific information preprocessing for cardiac surgery simulations

Vessel-based registration of an optical shape sensing catheter for MR navigation

Patient-individualized boundary conditions for CFD simulations using time-resolved 3D angiography

System events: readily accessible features for surgical phase detection

Premium Partner