Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 3/2014

01-05-2014 | Original Article

Co-registration of intra-operative brain surface photographs and pre-operative MR images

Authors: Benjamin Berkels, Ivan Cabrilo, Sven Haller, Martin Rumpf, Karl Schaller

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 3/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

   Brain shift, the change in configuration of the brain after opening the dura mater, is a significant problem for neuronavigation. Brain structures at intra-operative deformed positions must be matched with corresponding structures in the pre-operative 3D planning data. A method to co-register the cortical surface from intra-operative microscope images with pre-operative MRI-segmented data was developed and tested.

Methods

   Automated classification of sulci on MRI-extracted cortical surfaces was tested by comparison with user guided marking of prominent sulci on an intra-operative photography. A variational registration method with a fidelity energy for 3D deformations of the cortical surface in conjunction with a higher-order, linear elastic prior energy was used for the actual registration. The minimization of this energy was performed with a regularized gradient descent scheme using finite elements for spatial discretization. The sulcal classification method was tested on eight different clinical MRI data sets by comparison of the deformed MRI scans with intra-operative photographs of the brain surface.

Results

   User intervention was required for marking sulci on the photographs demonstrating the potential for incorporating an automatic classifier. The actual registration was validated first on an artificial testbed. The complete algorithm for the co-registration of actual clinical MRI data was successful for eight different patients.

Conclusions

   Pre-operative MRI scans can be registered to intra-operative brain surface photographs using a surface-to-surface registration method. This co-registration method has potential applications in neurosurgery, particularly during functional procedures.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Armijo L (1966) Minimization of functions having Lipschitz continuous first partial derivatives. Pac J Math 16(1):1–3CrossRef Armijo L (1966) Minimization of functions having Lipschitz continuous first partial derivatives. Pac J Math 16(1):1–3CrossRef
2.
go back to reference Bauer S, Berkels B, Ettl S, Arold O, Hornegger J, Rumpf M (2012) Marker-less reconstruction of dense 4-d surface motion fields using active laser triangulation from sparse measurements for respiratory motion management. In: Medical image computing and computer-assisted intervention (MICCAI 2012). Lecture notes in computer science, vol 7510, pp 414–421 Bauer S, Berkels B, Ettl S, Arold O, Hornegger J, Rumpf M (2012) Marker-less reconstruction of dense 4-d surface motion fields using active laser triangulation from sparse measurements for respiratory motion management. In: Medical image computing and computer-assisted intervention (MICCAI 2012). Lecture notes in computer science, vol 7510, pp 414–421
3.
go back to reference Berkels B, Kotowski M, Rumpf M, Schaller C (2011) Sulci detection in photos of the human cortex based on learned discriminative dictionaries. In: Scale space and variational methods in computer vision. Lecture notes in computer science Berkels B, Kotowski M, Rumpf M, Schaller C (2011) Sulci detection in photos of the human cortex based on learned discriminative dictionaries. In: Scale space and variational methods in computer vision. Lecture notes in computer science
4.
go back to reference Berkels B, Bauer S, Ettl S, Arold O, Hornegger J, Rumpf M (2013a) Joint surface reconstruction and 4-D deformation estimation from sparse data and prior knowledge for marker-less respiratory motion management. Med Phys (accepted) Berkels B, Bauer S, Ettl S, Arold O, Hornegger J, Rumpf M (2013a) Joint surface reconstruction and 4-D deformation estimation from sparse data and prior knowledge for marker-less respiratory motion management. Med Phys (accepted)
5.
go back to reference Berkels B, Cabrilo I, Haller S, Rumpf M, Schaller K (2013b) Co-registration of intra-operative photographs and pre-operative MR images. In: Bildverarbeitung für die Medizin 2013, Springer, pp 122–127 Berkels B, Cabrilo I, Haller S, Rumpf M, Schaller K (2013b) Co-registration of intra-operative photographs and pre-operative MR images. In: Bildverarbeitung für die Medizin 2013, Springer, pp 122–127
6.
go back to reference Burschka D, Li M, Ishiia M, Taylor RH, Hager GD (2005) Scale-invariant registration of monocular endoscopic images to ct-scans for sinus surgery. Med Image Anal 9(5):413–426PubMedCrossRef Burschka D, Li M, Ishiia M, Taylor RH, Hager GD (2005) Scale-invariant registration of monocular endoscopic images to ct-scans for sinus surgery. Med Image Anal 9(5):413–426PubMedCrossRef
7.
go back to reference Clarenz U, Rumpf M, Telea A (2004) Robust feature detection and local classification for surfaces based on moment analysis. IEEE Trans Vis Comput Graph 10(5):516–524PubMedCrossRef Clarenz U, Rumpf M, Telea A (2004) Robust feature detection and local classification for surfaces based on moment analysis. IEEE Trans Vis Comput Graph 10(5):516–524PubMedCrossRef
8.
go back to reference Clarkson MJ, Rueckert D, Hill DLG, Hawkes DJ (2001) Using photo-consistency to register 2D optical images of the human face to a 3D surface model. IEEE Trans Pattern Anal Mach Intell 23(11):1266–1280CrossRef Clarkson MJ, Rueckert D, Hill DLG, Hawkes DJ (2001) Using photo-consistency to register 2D optical images of the human face to a 3D surface model. IEEE Trans Pattern Anal Mach Intell 23(11):1266–1280CrossRef
9.
go back to reference Cyr CM, Kamal AF, Sebastian TB, Kimia BB (2000) 2D–3D registration based on shape matching. In: Proceedings of the IEEE workshop on mathematical methods in biomedical image analysis, pp 198–203 Cyr CM, Kamal AF, Sebastian TB, Kimia BB (2000) 2D–3D registration based on shape matching. In: Proceedings of the IEEE workshop on mathematical methods in biomedical image analysis, pp 198–203
10.
go back to reference Dalal SS, Edwards E, Kirsch HE, Barbaro NM, Knight RT, Nagarajan SS (2008) Localization of neurosurgically implanted electrodes via photograph-MRI-radiograph coregistration. J Neurosci Methods 174(1):106–115PubMedCentralPubMedCrossRef Dalal SS, Edwards E, Kirsch HE, Barbaro NM, Knight RT, Nagarajan SS (2008) Localization of neurosurgically implanted electrodes via photograph-MRI-radiograph coregistration. J Neurosci Methods 174(1):106–115PubMedCentralPubMedCrossRef
11.
go back to reference Fischla B, Serenob MI, Dalea AM (1999) Cortical surface-based analysis: II: Inflation, flattening, and a surface-based coordinate system. Neuroimage 9(2):195–207CrossRef Fischla B, Serenob MI, Dalea AM (1999) Cortical surface-based analysis: II: Inflation, flattening, and a surface-based coordinate system. Neuroimage 9(2):195–207CrossRef
12.
go back to reference Heldmann S, Papenberg N (2009) A variational approach for volume-to-slice registration. Scale space and variational methods in computer vision. Lecture notes in computer science, vol 5567, pp 624–635 Heldmann S, Papenberg N (2009) A variational approach for volume-to-slice registration. Scale space and variational methods in computer vision. Lecture notes in computer science, vol 5567, pp 624–635
13.
go back to reference Kuhnt D, Bauer MH, Nimsky C (2012) Brain shift compensation and neurosurgical image fusion using intraoperative MRI: current status and future challenges. Crit Rev Biomed Eng 40:175–185PubMedCrossRef Kuhnt D, Bauer MH, Nimsky C (2012) Brain shift compensation and neurosurgical image fusion using intraoperative MRI: current status and future challenges. Crit Rev Biomed Eng 40:175–185PubMedCrossRef
14.
go back to reference Mairal J, Bach F, Ponce J, Sapiro G, Zisserman A (2008) Discriminative learned dictionaries for local image analysis. In: IEEE computer society conference on computer vision and pattern recognition (CVPR), pp 1–8, doi:10.1109/CVPR.2008.4587652 Mairal J, Bach F, Ponce J, Sapiro G, Zisserman A (2008) Discriminative learned dictionaries for local image analysis. In: IEEE computer society conference on computer vision and pattern recognition (CVPR), pp 1–8, doi:10.​1109/​CVPR.​2008.​4587652
15.
go back to reference Markelja P, Tomaževiča D, Likara B, Pernuša F (2012) A review of 3D/2D registration methods for image-guided interventions. Med Image Anal 16(3):642–661CrossRef Markelja P, Tomaževiča D, Likara B, Pernuša F (2012) A review of 3D/2D registration methods for image-guided interventions. Med Image Anal 16(3):642–661CrossRef
16.
go back to reference Modersitzki J (2004) Numerical methods for image registration. Oxford University Press, Oxford Modersitzki J (2004) Numerical methods for image registration. Oxford University Press, Oxford
17.
go back to reference Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–639CrossRef Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–639CrossRef
18.
go back to reference Reinges MHT, Nguyen HH, Krings T, Hütter BO, Rohde V, Gilsbach JM (2004) Course of brain shift during microsurgical resection of supratentorial cerebral lesions: limits of conventional neuronavigation. Acta Neurochir (Wien) 146(4):369–377CrossRef Reinges MHT, Nguyen HH, Krings T, Hütter BO, Rohde V, Gilsbach JM (2004) Course of brain shift during microsurgical resection of supratentorial cerebral lesions: limits of conventional neuronavigation. Acta Neurochir (Wien) 146(4):369–377CrossRef
20.
go back to reference Sundaramoorthi G, Yezzi A, Mennucci A (2007) Sobolev active contours. Int J Comput Vis 73(3):345–366CrossRef Sundaramoorthi G, Yezzi A, Mennucci A (2007) Sobolev active contours. Int J Comput Vis 73(3):345–366CrossRef
21.
go back to reference Tharin S, Golby A (2007) Functional brain mapping and its applications to neurosurgery. Neurosurgery 60(4 Suppl 2):185–202PubMed Tharin S, Golby A (2007) Functional brain mapping and its applications to neurosurgery. Neurosurgery 60(4 Suppl 2):185–202PubMed
22.
go back to reference Wang A, Mirsattari SM, Parrent AG, Peters TM (2011) Fusion and visualization of intraoperative cortical images with preoperative models for epilepsy surgical planning and guidance. Comput Aided Surg 16(4):149–160PubMedCrossRef Wang A, Mirsattari SM, Parrent AG, Peters TM (2011) Fusion and visualization of intraoperative cortical images with preoperative models for epilepsy surgical planning and guidance. Comput Aided Surg 16(4):149–160PubMedCrossRef
Metadata
Title
Co-registration of intra-operative brain surface photographs and pre-operative MR images
Authors
Benjamin Berkels
Ivan Cabrilo
Sven Haller
Martin Rumpf
Karl Schaller
Publication date
01-05-2014
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 3/2014
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-014-0979-y

Other articles of this Issue 3/2014

International Journal of Computer Assisted Radiology and Surgery 3/2014 Go to the issue

Premium Partner