Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 4/2016

01-04-2016 | Original Article

X-ray and optical stereo-based 3D sensor fusion system for image-guided neurosurgery

Authors: Duk Nyeon Kim, You Seong Chae, Min Young Kim

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 4/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

In neurosurgery, an image-guided operation is performed to confirm that the surgical instruments reach the exact lesion position. Among the multiple imaging modalities, an X-ray fluoroscope mounted on C- or O-arm is widely used for monitoring the position of surgical instruments and the target position of the patient. However, frequently used fluoroscopy can result in relatively high radiation doses, particularly for complex interventional procedures. The proposed system can reduce radiation exposure and provide the accurate three-dimensional (3D) position information of surgical instruments and the target position.

Methods

X-ray and optical stereo vision systems have been proposed for the C- or O-arm. Two subsystems have same optical axis and are calibrated simultaneously. This provides easy augmentation of the camera image and the X-ray image. Further, the 3D measurement of both systems can be defined in a common coordinate space.

Results

The proposed dual stereoscopic imaging system is designed and implemented for mounting on an O-arm. The calibration error of the 3D coordinates of the optical stereo and X-ray stereo is within 0.1 mm in terms of the mean and the standard deviation. Further, image augmentation with the camera image and the X-ray image using an artificial skull phantom is achieved.

Conclusion

As the developed dual stereoscopic imaging system provides 3D coordinates of the point of interest in both optical images and fluoroscopic images, it can be used by surgeons to confirm the position of surgical instruments in a 3D space with minimum radiation exposure and to verify whether the instruments reach the surgical target observed in fluoroscopic images.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Tate PM, Lachine V, Fu L, Croitoru H, Sati M (2001) Performance and robustness of automatic fluoroscopic image calibration in a new computer assisted surgery system. MICCAI, LNCS 2208. Springer, Berlin, pp 1130–1136 Tate PM, Lachine V, Fu L, Croitoru H, Sati M (2001) Performance and robustness of automatic fluoroscopic image calibration in a new computer assisted surgery system. MICCAI, LNCS 2208. Springer, Berlin, pp 1130–1136
2.
go back to reference Livyatan H, Yaniv Z, Joskowicz L (2002) Robust automatic C-arm calibration for fluoroscopy-based navigation: a practical approach. MICCAI, Part II, LNCS 2489. Springer, Berlin, pp 60–68 Livyatan H, Yaniv Z, Joskowicz L (2002) Robust automatic C-arm calibration for fluoroscopy-based navigation: a practical approach. MICCAI, Part II, LNCS 2489. Springer, Berlin, pp 60–68
3.
go back to reference Tomkowiak MT, Speidel MA, Raval AN, Van Lysel MS (2011) Calibration-free device sizing using an inverse geometry X-ray system. Med Phys 38(1):283–293CrossRefPubMedPubMedCentral Tomkowiak MT, Speidel MA, Raval AN, Van Lysel MS (2011) Calibration-free device sizing using an inverse geometry X-ray system. Med Phys 38(1):283–293CrossRefPubMedPubMedCentral
4.
go back to reference Zbijewski W, Stayman JW (2009) Volumetric soft tissue brain imaging on xCAT, a mobile flat-panel X-ray CT system. In: Samei E, Hsieh J (eds) SPIE medical imaging 2009: physics of medical imaging, vol 7258, p 72582K Zbijewski W, Stayman JW (2009) Volumetric soft tissue brain imaging on xCAT, a mobile flat-panel X-ray CT system. In: Samei E, Hsieh J (eds) SPIE medical imaging 2009: physics of medical imaging, vol 7258, p 72582K
5.
go back to reference Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423CrossRefPubMed Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423CrossRefPubMed
6.
go back to reference Chen X, Wang L, Fallavollita P, Navab N (2012) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–38CrossRefPubMed Chen X, Wang L, Fallavollita P, Navab N (2012) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–38CrossRefPubMed
7.
go back to reference Cox DD, Papanastassiou AM, Oreper D, Andken BB, Dicarlo JJ (2008) High-resolution three-dimensional microelectrode brain mapping using stereo microfocal X-ray imaging. J Neurophysiol 100(5):2966–2976CrossRefPubMed Cox DD, Papanastassiou AM, Oreper D, Andken BB, Dicarlo JJ (2008) High-resolution three-dimensional microelectrode brain mapping using stereo microfocal X-ray imaging. J Neurophysiol 100(5):2966–2976CrossRefPubMed
8.
go back to reference Traub J, Heibel T, Dressel P, Heining SM, Graumann R, Navab N (2007) A multi-view opto-Xray imaging system. MICCAI, Part II, LNCS 4792. Springer, Berlin, pp 18–25 Traub J, Heibel T, Dressel P, Heining SM, Graumann R, Navab N (2007) A multi-view opto-Xray imaging system. MICCAI, Part II, LNCS 4792. Springer, Berlin, pp 18–25
9.
go back to reference Chae Y, Lee S, Oh H, Kim M (2013) Coordinates tracking and augmented reality system using bipolar X-ray fluoroscopy and stereo vision for image-guided neurosurgery. In: IEEE 13th international conference on control, automation and systems, pp 107–112 Chae Y, Lee S, Oh H, Kim M (2013) Coordinates tracking and augmented reality system using bipolar X-ray fluoroscopy and stereo vision for image-guided neurosurgery. In: IEEE 13th international conference on control, automation and systems, pp 107–112
10.
go back to reference Heikkila J (2000) Geometric camera calibration using circular control points. IEEE Trans Pattern Anal Mach Intell 22(10):1066–1077CrossRef Heikkila J (2000) Geometric camera calibration using circular control points. IEEE Trans Pattern Anal Mach Intell 22(10):1066–1077CrossRef
11.
go back to reference Hartley R, Zisserman A (2004) Multiple view geometry in computer vision, 2nd edn. Cambridge University Press, New YorkCrossRef Hartley R, Zisserman A (2004) Multiple view geometry in computer vision, 2nd edn. Cambridge University Press, New YorkCrossRef
12.
go back to reference Forsyth DA, Ponce J (2011) Computer vision: a modern approach, 2nd edn. Pearson, New Jersey Forsyth DA, Ponce J (2011) Computer vision: a modern approach, 2nd edn. Pearson, New Jersey
13.
go back to reference Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef
14.
go back to reference Yu W (2004) Image-based lens geometric distortion correction using minimization of average bicoherence index. Pattern Recogn 37(6):1175–1187CrossRef Yu W (2004) Image-based lens geometric distortion correction using minimization of average bicoherence index. Pattern Recogn 37(6):1175–1187CrossRef
15.
go back to reference Brown DC (1966) Decentering distortion of lenses. Photogramm Eng 32(3):444–462 Brown DC (1966) Decentering distortion of lenses. Photogramm Eng 32(3):444–462
16.
go back to reference Basu A, Licardie S (1995) Alternative models for fish-eye lenses. Pattern Recogn Lett 16(4):433–441CrossRef Basu A, Licardie S (1995) Alternative models for fish-eye lenses. Pattern Recogn Lett 16(4):433–441CrossRef
17.
go back to reference Beauchemin SS, Bajcsy R (2001) Modelling and removing radial and tangential distortions. Multi-image analysis, LNCS 2032. Springer, Berlin, pp 1–21 Beauchemin SS, Bajcsy R (2001) Modelling and removing radial and tangential distortions. Multi-image analysis, LNCS 2032. Springer, Berlin, pp 1–21
18.
go back to reference Ma L, Quan Y, Moore KL (2003) Flexible camera calibration using a new analytical radial undistortion formula with application to mobile robot localization. In: IEEE international symposium on intelligent control, pp 799–804 Ma L, Quan Y, Moore KL (2003) Flexible camera calibration using a new analytical radial undistortion formula with application to mobile robot localization. In: IEEE international symposium on intelligent control, pp 799–804
19.
go back to reference Mallon J, Whelan PF (2004) Precise radial un-distortion of images. In: IEEE 17th international conference on pattern recognition, pp 18–21 Mallon J, Whelan PF (2004) Precise radial un-distortion of images. In: IEEE 17th international conference on pattern recognition, pp 18–21
20.
go back to reference Shah S, Aggarwal J (1996) Intrinsic parameter calibration procedure for a (high distortion) fish-eye lens camera with distortion model and accuracy estimation. Pattern Recogn 29(11):1775–1788CrossRef Shah S, Aggarwal J (1996) Intrinsic parameter calibration procedure for a (high distortion) fish-eye lens camera with distortion model and accuracy estimation. Pattern Recogn 29(11):1775–1788CrossRef
21.
go back to reference Sturm P, Ramalingam S (2004) A generic concept for camera calibration. Computer vision-ECCV 2004, LNCS 3022. Springer, Berlin, pp 1–13CrossRef Sturm P, Ramalingam S (2004) A generic concept for camera calibration. Computer vision-ECCV 2004, LNCS 3022. Springer, Berlin, pp 1–13CrossRef
Metadata
Title
X-ray and optical stereo-based 3D sensor fusion system for image-guided neurosurgery
Authors
Duk Nyeon Kim
You Seong Chae
Min Young Kim
Publication date
01-04-2016
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 4/2016
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1290-2

Other articles of this Issue 4/2016

International Journal of Computer Assisted Radiology and Surgery 4/2016 Go to the issue

Premium Partner