Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 7/2017

25.03.2017 | Original Article

Can real-time RGBD enhance intraoperative Cone-Beam CT?

verfasst von: Javad Fotouhi, Bernhard Fuerst, Wolfgang Wein, Nassir Navab

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 7/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Cone-Beam Computed Tomography (CBCT) is an important 3D imaging technology for orthopedic, trauma, radiotherapy guidance, angiography, and dental applications. The major limitation of CBCT is the poor image quality due to scattered radiation, truncation, and patient movement. In this work, we propose to incorporate information from a co-registered Red-Green-Blue-Depth (RGBD) sensor attached near the detector plane of the C-arm to improve the reconstruction quality, as well as correcting for undesired rigid patient movement.

Methods

Calibration of the RGBD and C-arm imaging devices is performed in two steps: (i) calibration of the RGBD sensor and the X-ray source using a multimodal checkerboard pattern, and (ii) calibration of the RGBD surface reconstruction to the CBCT volume. The patient surface is acquired during the CBCT scan and then used as prior information for the reconstruction using Maximum-Likelihood Expectation-Maximization. An RGBD-based simultaneous localization and mapping method is utilized to estimate the rigid patient movement during scanning.

Results

Performance is quantified and demonstrated using artificial data and bone phantoms with and without metal implants. Finally, we present movement-corrected CBCT reconstructions based on RGBD data on an animal specimen, where the average voxel intensity difference reduces from 0.157 without correction to 0.022 with correction.

Conclusion

This work investigated the advantages of a C-arm X-ray imaging system used with an attached RGBD sensor. The experiments show the benefits of the opto/X-ray imaging system in: (i) improving the quality of reconstruction by incorporating the surface information of the patient, reducing the streak artifacts as well as the number of required projections, and (ii) recovering the scanning trajectory for the reconstruction in the presence of undesired patient rigid movement.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
2
Values reported as mean ± standard deviation.
 
Literatur
1.
Zurück zum Zitat Andersen AH (1989) Algebraic reconstruction in CT from limited views. IEEE Trans Med Imaging 8(1):50–55CrossRefPubMed Andersen AH (1989) Algebraic reconstruction in CT from limited views. IEEE Trans Med Imaging 8(1):50–55CrossRefPubMed
2.
Zurück zum Zitat Beister M, Kolditz D, Kalender WA (2012) Iterative reconstruction methods in X-ray CT. Phys Med 28(2):94–108CrossRefPubMed Beister M, Kolditz D, Kalender WA (2012) Iterative reconstruction methods in X-ray CT. Phys Med 28(2):94–108CrossRefPubMed
3.
Zurück zum Zitat Bodensteiner C, Darolti C, Schumacher H, Matthäus L, Schweikard A (2007) Motion and positional error correction for cone beam 3D-reconstruction with mobile C-arms. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 177–185 Bodensteiner C, Darolti C, Schumacher H, Matthäus L, Schweikard A (2007) Motion and positional error correction for cone beam 3D-reconstruction with mobile C-arms. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 177–185
4.
Zurück zum Zitat Endres F, Hess J, Engelhard N, Sturm J, Cremers D, Burgard W (2012) An evaluation of the rgb-d slam system. In: 2012 IEEE International conference on robotics and automation (ICRA). IEEE, pp 1691–1696 Endres F, Hess J, Engelhard N, Sturm J, Cremers D, Burgard W (2012) An evaluation of the rgb-d slam system. In: 2012 IEEE International conference on robotics and automation (ICRA). IEEE, pp 1691–1696
5.
Zurück zum Zitat Fischer M, Fuerst B, Lee SC, Fotouhi J, Habert S, Weidert S, Euler E, Osgood G, Navab N (2016) Preclinical usability study of multiple augmented reality concepts for K-wire placement. Int J Comput Assist Radiol Surg 11(6):1007–1014. doi:10.1007/s11548-016-1363-x CrossRefPubMed Fischer M, Fuerst B, Lee SC, Fotouhi J, Habert S, Weidert S, Euler E, Osgood G, Navab N (2016) Preclinical usability study of multiple augmented reality concepts for K-wire placement. Int J Comput Assist Radiol Surg 11(6):1007–1014. doi:10.​1007/​s11548-016-1363-x CrossRefPubMed
6.
Zurück zum Zitat Fotouhi J, Fuerst B, Johnson A, Taylor R, Osgood G, Navab N, Armand M (2017) Pose-aware c-arm for automatic re-initialization of interventional 2d/3d image registration. Accepted for presentation at IPCAI Fotouhi J, Fuerst B, Johnson A, Taylor R, Osgood G, Navab N, Armand M (2017) Pose-aware c-arm for automatic re-initialization of interventional 2d/3d image registration. Accepted for presentation at IPCAI
7.
Zurück zum Zitat Fotouhi J, Fuerst B, Lee SC, Keicher M, Fischer M, Weidert S, Euler E, Navab N, Osgood G (2016) Interventional 3d augmented reality for orthopedic and trauma surgery. In: Meeting of the international society for computer assisted orthopedic surgery Fotouhi J, Fuerst B, Lee SC, Keicher M, Fischer M, Weidert S, Euler E, Navab N, Osgood G (2016) Interventional 3d augmented reality for orthopedic and trauma surgery. In: Meeting of the international society for computer assisted orthopedic surgery
8.
Zurück zum Zitat Fuerst B, Fotouhi J, Navab N (2015) Vision-based intraoperative cone-beam CT stitching for non-overlapping volumes. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 387–395 Fuerst B, Fotouhi J, Navab N (2015) Vision-based intraoperative cone-beam CT stitching for non-overlapping volumes. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 387–395
9.
Zurück zum Zitat Fuerst B, Mansi T, Carnis F, Slzle M, Boettger T, Bayouth J, Navab N, Kamen A (2015) Patient-specific biomechanical model for the prediction of lung motion from 4-D CT images. IEEE Trans Med Imaging 34(2):599–607CrossRefPubMed Fuerst B, Mansi T, Carnis F, Slzle M, Boettger T, Bayouth J, Navab N, Kamen A (2015) Patient-specific biomechanical model for the prediction of lung motion from 4-D CT images. IEEE Trans Med Imaging 34(2):599–607CrossRefPubMed
10.
Zurück zum Zitat Geiger A, Moosmann F, Car, Ö., Schuster B (2012) Automatic camera and range sensor calibration using a single shot. In: IEEE international conference on robotics and automation, pp 3936–3943 Geiger A, Moosmann F, Car, Ö., Schuster B (2012) Automatic camera and range sensor calibration using a single shot. In: IEEE international conference on robotics and automation, pp 3936–3943
11.
Zurück zum Zitat Gordon R, Bender R, Herman GT (1970) Algebraic reconstruction techniques (art) for three-dimensional electron microscopy and x-ray photography. J Theor Biol 29(3):471–481CrossRefPubMed Gordon R, Bender R, Herman GT (1970) Algebraic reconstruction techniques (art) for three-dimensional electron microscopy and x-ray photography. J Theor Biol 29(3):471–481CrossRefPubMed
12.
Zurück zum Zitat Hara AK, Paden RG, Silva AC, Kujak JL, Lawder HJ, Pavlicek W (2009) Iterative reconstruction technique for reducing body radiation dose at ct: feasibility study. Am J Roentgenol 193(3):764–771CrossRef Hara AK, Paden RG, Silva AC, Kujak JL, Lawder HJ, Pavlicek W (2009) Iterative reconstruction technique for reducing body radiation dose at ct: feasibility study. Am J Roentgenol 193(3):764–771CrossRef
13.
Zurück zum Zitat Hwang HS, Chung MJ, Lee JW, Shin SW, Lee KS (2010) C-arm cone-beam CT-guided percutaneous transthoracic lung biopsy: usefulness in evaluation of small pulmonary nodules. Am J Roentgenol 195(6):W400–W407CrossRef Hwang HS, Chung MJ, Lee JW, Shin SW, Lee KS (2010) C-arm cone-beam CT-guided percutaneous transthoracic lung biopsy: usefulness in evaluation of small pulmonary nodules. Am J Roentgenol 195(6):W400–W407CrossRef
14.
Zurück zum Zitat Kainz B, Grabner M, Rüther M (2008) Fast marker based c-arm pose estimation. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 652–659 Kainz B, Grabner M, Rüther M (2008) Fast marker based c-arm pose estimation. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 652–659
15.
Zurück zum Zitat Klein L (1990) Anesthetic complications in the horse. Vet Clin N Am Equine Pract 6(3):665–692CrossRef Klein L (1990) Anesthetic complications in the horse. Vet Clin N Am Equine Pract 6(3):665–692CrossRef
16.
Zurück zum Zitat Lange K, Carson R (1984) Em reconstruction algorithms for emission and transmission tomography. J Comput Assist Tomogr 8(2):306–316PubMed Lange K, Carson R (1984) Em reconstruction algorithms for emission and transmission tomography. J Comput Assist Tomogr 8(2):306–316PubMed
17.
Zurück zum Zitat Lee SC, Fuerst B, Fotouhi J, Fischer M, Osgood G, Navab N (2016) Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization. Int J Comput Assist Radiol Surg 11(6):967–975CrossRefPubMed Lee SC, Fuerst B, Fotouhi J, Fischer M, Osgood G, Navab N (2016) Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization. Int J Comput Assist Radiol Surg 11(6):967–975CrossRefPubMed
18.
Zurück zum Zitat Navab N, Mitschke M, Schütz O (1999) Medical image computing and computer-assisted intervention, pp 688–697 Navab N, Mitschke M, Schütz O (1999) Medical image computing and computer-assisted intervention, pp 688–697
19.
Zurück zum Zitat Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) KinectFusion: Real-time dense surface mapping and tracking. In: IEEE international symposium on mixed and augmented reality, pp 127–136 Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) KinectFusion: Real-time dense surface mapping and tracking. In: IEEE international symposium on mixed and augmented reality, pp 127–136
20.
Zurück zum Zitat Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) Kinectfusion: Real-time dense surface mapping and tracking. In: IEEE international symposium on mixed and augmented reality. IEEE, pp 127–136 Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) Kinectfusion: Real-time dense surface mapping and tracking. In: IEEE international symposium on mixed and augmented reality. IEEE, pp 127–136
21.
Zurück zum Zitat Oehler M, Buzug T (2007) Statistical image reconstruction for inconsistent CT projection data. Methods Inf Med 46(3):261–269PubMed Oehler M, Buzug T (2007) Statistical image reconstruction for inconsistent CT projection data. Methods Inf Med 46(3):261–269PubMed
22.
Zurück zum Zitat Orth RC, Wallace MJ, Kuo MD (2008) Technology assessment committee of the society of interventional radiology: C-arm cone-beam ct: general principles and technical considerations for use in interventional radiology. J Vasc Interv Radiol 19(6):814–820CrossRefPubMed Orth RC, Wallace MJ, Kuo MD (2008) Technology assessment committee of the society of interventional radiology: C-arm cone-beam ct: general principles and technical considerations for use in interventional radiology. J Vasc Interv Radiol 19(6):814–820CrossRefPubMed
23.
Zurück zum Zitat Otake Y, Armand M, Armiger RS, Kutzer MD, Basafa E, Kazanzides P, Taylor RH (2012) Intraoperative image-based multiview 2d/3d registration for image-guided orthopaedic surgery: incorporation of fiducial-based c-arm tracking and gpu-acceleration. IEEE Trans Med Imaging 31(4):948–962CrossRefPubMed Otake Y, Armand M, Armiger RS, Kutzer MD, Basafa E, Kazanzides P, Taylor RH (2012) Intraoperative image-based multiview 2d/3d registration for image-guided orthopaedic surgery: incorporation of fiducial-based c-arm tracking and gpu-acceleration. IEEE Trans Med Imaging 31(4):948–962CrossRefPubMed
24.
Zurück zum Zitat Ramamurthi K, Prince J (2003) Tomographic reconstruction for truncated cone beam data using prior CT information. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 134–141 Ramamurthi K, Prince J (2003) Tomographic reconstruction for truncated cone beam data using prior CT information. In: Medical image computing and computer-assisted intervention. Springer, Berlin, pp 134–141
25.
Zurück zum Zitat Rusu R, Blodow N, Beetz M (2009) Fast Point Feature Histograms for 3D registration. In: International conference on robotics and automation, pp 3212–3217 Rusu R, Blodow N, Beetz M (2009) Fast Point Feature Histograms for 3D registration. In: International conference on robotics and automation, pp 3212–3217
26.
Zurück zum Zitat Scherl H, Keck B, Kowarschik M, Hornegger J (2007) Fast GPU-based CT reconstruction using the common unified device architecture. In: Nuclear science symposium conference record, vol. 6. IEEE, pp 4464–4466 Scherl H, Keck B, Kowarschik M, Hornegger J (2007) Fast GPU-based CT reconstruction using the common unified device architecture. In: Nuclear science symposium conference record, vol. 6. IEEE, pp 4464–4466
27.
Zurück zum Zitat Sidky EY, Pan X (2008) Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization. Phys Med Biol 53(17):4777CrossRefPubMedPubMedCentral Sidky EY, Pan X (2008) Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization. Phys Med Biol 53(17):4777CrossRefPubMedPubMedCentral
28.
Zurück zum Zitat Smith R, Self M, Cheeseman P (1990) Estimating uncertain spatial relationships in robotics. In: Autonomous robot vehicles. Springer, Berlin, pp 167–193 Smith R, Self M, Cheeseman P (1990) Estimating uncertain spatial relationships in robotics. In: Autonomous robot vehicles. Springer, Berlin, pp 167–193
29.
Zurück zum Zitat Tam A, Mohamed A, Pfister M, Rohm E, Wallace MJ (2009) C-arm cone beam computed tomographic needle path overlay for fluoroscopic-guided placement of translumbar central venous catheters. Cardiovasc Interv Radiol 32(4):820–824CrossRef Tam A, Mohamed A, Pfister M, Rohm E, Wallace MJ (2009) C-arm cone beam computed tomographic needle path overlay for fluoroscopic-guided placement of translumbar central venous catheters. Cardiovasc Interv Radiol 32(4):820–824CrossRef
30.
Zurück zum Zitat Zhang Q, Hu YC, Liu F, Goodman K, Rosenzweig KE, Mageras GS (2010) Correction of motion artifacts in cone-beam ct using a patient-specific respiratory motion model. Med Phys 37(6):2901–2909CrossRefPubMedCentral Zhang Q, Hu YC, Liu F, Goodman K, Rosenzweig KE, Mageras GS (2010) Correction of motion artifacts in cone-beam ct using a patient-specific respiratory motion model. Med Phys 37(6):2901–2909CrossRefPubMedCentral
31.
Zurück zum Zitat Zhang Z (2000) A flexible new technique for camera calibration. Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef Zhang Z (2000) A flexible new technique for camera calibration. Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef
Metadaten
Titel
Can real-time RGBD enhance intraoperative Cone-Beam CT?
verfasst von
Javad Fotouhi
Bernhard Fuerst
Wolfgang Wein
Nassir Navab
Publikationsdatum
25.03.2017
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 7/2017
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1572-y

Weitere Artikel der Ausgabe 7/2017

International Journal of Computer Assisted Radiology and Surgery 7/2017 Zur Ausgabe