Top

International Journal of Computer Assisted Radiology and Surgery

Published in:

25-03-2017 | Original Article

Can real-time RGBD enhance intraoperative Cone-Beam CT?

Authors: Javad Fotouhi, Bernhard Fuerst, Wolfgang Wein, Nassir Navab

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 7/2017

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Purpose

Cone-Beam Computed Tomography (CBCT) is an important 3D imaging technology for orthopedic, trauma, radiotherapy guidance, angiography, and dental applications. The major limitation of CBCT is the poor image quality due to scattered radiation, truncation, and patient movement. In this work, we propose to incorporate information from a co-registered Red-Green-Blue-Depth (RGBD) sensor attached near the detector plane of the C-arm to improve the reconstruction quality, as well as correcting for undesired rigid patient movement.

Methods

Calibration of the RGBD and C-arm imaging devices is performed in two steps: (i) calibration of the RGBD sensor and the X-ray source using a multimodal checkerboard pattern, and (ii) calibration of the RGBD surface reconstruction to the CBCT volume. The patient surface is acquired during the CBCT scan and then used as prior information for the reconstruction using Maximum-Likelihood Expectation-Maximization. An RGBD-based simultaneous localization and mapping method is utilized to estimate the rigid patient movement during scanning.

Results

Performance is quantified and demonstrated using artificial data and bone phantoms with and without metal implants. Finally, we present movement-corrected CBCT reconstructions based on RGBD data on an animal specimen, where the average voxel intensity difference reduces from 0.157 without correction to 0.022 with correction.

Conclusion

This work investigated the advantages of a C-arm X-ray imaging system used with an attached RGBD sensor. The experiments show the benefits of the opto/X-ray imaging system in: (i) improving the quality of reconstruction by incorporating the surface information of the patient, reducing the streak artifacts as well as the number of required projections, and (ii) recovering the scanning trajectory for the reconstruction in the presence of undesired patient rigid movement.

previous article Erratum to: An efficient cardiac mapping strategy for radiofrequency catheter ablation with active learning

next article Pose-aware C-arm for automatic re-initialization of interventional 2D/3D image registration

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

http://imfusion.de/products/imfusion-suite.

Values reported as mean ± standard deviation.

Andersen AH (1989) Algebraic reconstruction in CT from limited views. IEEE Trans Med Imaging 8(1):50–55CrossRefPubMed

Beister M, Kolditz D, Kalender WA (2012) Iterative reconstruction methods in X-ray CT. Phys Med 28(2):94–108CrossRefPubMed

Bodensteiner C, Darolti C, Schumacher H, Matthäus L, Schweikard A (2007) Motion and positional error correction for cone beam 3D-reconstruction with mobile C-arms. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 177–185

Endres F, Hess J, Engelhard N, Sturm J, Cremers D, Burgard W (2012) An evaluation of the rgb-d slam system. In: 2012 IEEE International conference on robotics and automation (ICRA). IEEE, pp 1691–1696

Fischer M, Fuerst B, Lee SC, Fotouhi J, Habert S, Weidert S, Euler E, Osgood G, Navab N (2016) Preclinical usability study of multiple augmented reality concepts for K-wire placement. Int J Comput Assist Radiol Surg 11(6):1007–1014. doi:10.1007/s11548-016-1363-x CrossRefPubMed

Fotouhi J, Fuerst B, Johnson A, Taylor R, Osgood G, Navab N, Armand M (2017) Pose-aware c-arm for automatic re-initialization of interventional 2d/3d image registration. Accepted for presentation at IPCAI

Fotouhi J, Fuerst B, Lee SC, Keicher M, Fischer M, Weidert S, Euler E, Navab N, Osgood G (2016) Interventional 3d augmented reality for orthopedic and trauma surgery. In: Meeting of the international society for computer assisted orthopedic surgery

Fuerst B, Fotouhi J, Navab N (2015) Vision-based intraoperative cone-beam CT stitching for non-overlapping volumes. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 387–395

Fuerst B, Mansi T, Carnis F, Slzle M, Boettger T, Bayouth J, Navab N, Kamen A (2015) Patient-specific biomechanical model for the prediction of lung motion from 4-D CT images. IEEE Trans Med Imaging 34(2):599–607CrossRefPubMed

10.

Geiger A, Moosmann F, Car, Ö., Schuster B (2012) Automatic camera and range sensor calibration using a single shot. In: IEEE international conference on robotics and automation, pp 3936–3943

11.

Gordon R, Bender R, Herman GT (1970) Algebraic reconstruction techniques (art) for three-dimensional electron microscopy and x-ray photography. J Theor Biol 29(3):471–481CrossRefPubMed

12.

Hara AK, Paden RG, Silva AC, Kujak JL, Lawder HJ, Pavlicek W (2009) Iterative reconstruction technique for reducing body radiation dose at ct: feasibility study. Am J Roentgenol 193(3):764–771CrossRef

13.

Hwang HS, Chung MJ, Lee JW, Shin SW, Lee KS (2010) C-arm cone-beam CT-guided percutaneous transthoracic lung biopsy: usefulness in evaluation of small pulmonary nodules. Am J Roentgenol 195(6):W400–W407CrossRef

14.

Kainz B, Grabner M, Rüther M (2008) Fast marker based c-arm pose estimation. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 652–659

15.

Klein L (1990) Anesthetic complications in the horse. Vet Clin N Am Equine Pract 6(3):665–692CrossRef

16.

Lange K, Carson R (1984) Em reconstruction algorithms for emission and transmission tomography. J Comput Assist Tomogr 8(2):306–316PubMed

17.

Lee SC, Fuerst B, Fotouhi J, Fischer M, Osgood G, Navab N (2016) Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization. Int J Comput Assist Radiol Surg 11(6):967–975CrossRefPubMed

18.

Navab N, Mitschke M, Schütz O (1999) Medical image computing and computer-assisted intervention, pp 688–697

19.

Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) KinectFusion: Real-time dense surface mapping and tracking. In: IEEE international symposium on mixed and augmented reality, pp 127–136

20.

Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) Kinectfusion: Real-time dense surface mapping and tracking. In: IEEE international symposium on mixed and augmented reality. IEEE, pp 127–136

21.

Oehler M, Buzug T (2007) Statistical image reconstruction for inconsistent CT projection data. Methods Inf Med 46(3):261–269PubMed

22.

Orth RC, Wallace MJ, Kuo MD (2008) Technology assessment committee of the society of interventional radiology: C-arm cone-beam ct: general principles and technical considerations for use in interventional radiology. J Vasc Interv Radiol 19(6):814–820CrossRefPubMed

23.

Otake Y, Armand M, Armiger RS, Kutzer MD, Basafa E, Kazanzides P, Taylor RH (2012) Intraoperative image-based multiview 2d/3d registration for image-guided orthopaedic surgery: incorporation of fiducial-based c-arm tracking and gpu-acceleration. IEEE Trans Med Imaging 31(4):948–962CrossRefPubMed

24.

Ramamurthi K, Prince J (2003) Tomographic reconstruction for truncated cone beam data using prior CT information. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 134–141

25.

Rusu R, Blodow N, Beetz M (2009) Fast Point Feature Histograms for 3D registration. In: International conference on robotics and automation, pp 3212–3217

26.

Scherl H, Keck B, Kowarschik M, Hornegger J (2007) Fast GPU-based CT reconstruction using the common unified device architecture. In: Nuclear science symposium conference record, vol. 6. IEEE, pp 4464–4466

27.

Sidky EY, Pan X (2008) Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization. Phys Med Biol 53(17):4777CrossRefPubMedPubMedCentral

28.

Smith R, Self M, Cheeseman P (1990) Estimating uncertain spatial relationships in robotics. In: Autonomous robot vehicles. Springer, Berlin, pp 167–193

29.

Tam A, Mohamed A, Pfister M, Rohm E, Wallace MJ (2009) C-arm cone beam computed tomographic needle path overlay for fluoroscopic-guided placement of translumbar central venous catheters. Cardiovasc Interv Radiol 32(4):820–824CrossRef

30.

Zhang Q, Hu YC, Liu F, Goodman K, Rosenzweig KE, Mageras GS (2010) Correction of motion artifacts in cone-beam ct using a patient-specific respiratory motion model. Med Phys 37(6):2901–2909CrossRefPubMedCentral

31.

Zhang Z (2000) A flexible new technique for camera calibration. Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef

Title: Can real-time RGBD enhance intraoperative Cone-Beam CT?
Authors: Javad Fotouhi
Bernhard Fuerst
Wolfgang Wein
Nassir Navab
Publication date: 25-03-2017
Publisher: Springer International Publishing
Published in: International Journal of Computer Assisted Radiology and Surgery / Issue 7/2017
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI: https://doi.org/10.1007/s11548-017-1572-y

Springer Professional

Abstract

Purpose

Methods

Results

Conclusion

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 7/2017

Pose-aware C-arm for automatic re-initialization of interventional 2D/3D image registration

Predicting surgical skill from the first N seconds of a task: value over task time using the isogony principle

Hand-eye calibration for surgical cameras: a Procrustean Perspective-n-Point solution

Scale-space for empty catheter segmentation in PCI fluoroscopic images

An efficient cardiac mapping strategy for radiofrequency catheter ablation with active learning

The minimally acceptable classification criterion for surgical skill: intent vectors and separability of raw motion data

Premium Partner