Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 6/2015

01.06.2015 | Original Article

Slice-to-volume deformable registration: efficient one-shot consensus between plane selection and in-plane deformation

verfasst von: Enzo Ferrante, Vivien Fecamp, Nikos Paragios

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 6/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

This paper introduces a novel decomposed graphical model to deal with slice-to-volume registration in the context of medical images and image-guided surgeries.

Methods

We present a new non-rigid slice-to-volume registration method whose main contribution is the ability to decouple the plane selection and the in-plane deformation parts of the transformation—through two distinct graphs—toward reducing the complexity of the model while being able to obtain simultaneously the solution for both of them. To this end, the plane selection process is expressed as a local graph-labeling problem endowed with planarity satisfaction constraints, which is then directly linked with the deformable part through the data registration likelihoods. The resulting model is modular with respect to the image metric, can cope with arbitrary in-plane regularization terms and inherits excellent properties in terms of computational efficiency.

Results

The proof of concept for the proposed formulation is done using cardiac MR sequences of a beating heart (an artificially generated 2D temporal sequence is extracted using real data with known ground truth) as well as multimodal brain images involving ultrasound and computed tomography images. We achieve state-of-the-art results while decreasing the computational time when we compare with another method based on similar techniques.

Conclusions

We confirm that graphical models and discrete optimization techniques are suitable to solve non-rigid slice-to-volume registration problems. Moreover, we show that decoupling the graphical model and labeling it using two lower-dimensional label spaces, we can achieve state-of-the-art results while substantially reducing the complexity of our method and moving the approach close to real clinical applications once considered in the context of modern parallel architectures.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Baker S, Scharstein D, Lewis J, Roth S, Black MJ, Szeliski R (2011) A database and evaluation methodology for optical flow. Int J Computer Vision 92(1):1–31CrossRef Baker S, Scharstein D, Lewis J, Roth S, Black MJ, Szeliski R (2011) A database and evaluation methodology for optical flow. Int J Computer Vision 92(1):1–31CrossRef
2.
Zurück zum Zitat Bardera A, Feixas M, Boada I, Sbert M (2006) High-dimensional normalized mutual information for image registration using random lines. In: Pluim J, Likar B, Gerritsen F (eds) Biomedical Image Registration, Lecture Notes in Computer Science, vol 4057, Springer, Berlin, Heidelberg, pp 264–271 Bardera A, Feixas M, Boada I, Sbert M (2006) High-dimensional normalized mutual information for image registration using random lines. In: Pluim J, Likar B, Gerritsen F (eds) Biomedical Image Registration, Lecture Notes in Computer Science, vol 4057, Springer, Berlin, Heidelberg, pp 264–271
3.
Zurück zum Zitat Birkfellner W, Figl M, Kettenbach J, Hummel J, Homolka P, Schernthaner R, Nau T, Bergmann H (2007) Rigid 2D/3D slice-to-volume registration and its application on fluoroscopic CT images. Med Phys 34(1):246. doi:10.1118/1.2401661 CrossRefPubMed Birkfellner W, Figl M, Kettenbach J, Hummel J, Homolka P, Schernthaner R, Nau T, Bergmann H (2007) Rigid 2D/3D slice-to-volume registration and its application on fluoroscopic CT images. Med Phys 34(1):246. doi:10.​1118/​1.​2401661 CrossRefPubMed
4.
Zurück zum Zitat Birkfellner W, Hummel J, Wilson E, Cleary K (2008) Tracking devices. In: Image-guided interventions, Springer, pp 23–44 Birkfellner W, Hummel J, Wilson E, Cleary K (2008) Tracking devices. In: Image-guided interventions, Springer, pp 23–44
5.
Zurück zum Zitat Chandler AG, Pinder RJ, Netsch T, Schnabel JA, Hawkes DJ, Hill DL, Razavi R (2008) Correction of misaligned slices in multi-slice MR cardiac examinations by using slice-to-volume registration. J Cardiovas Magn Reson 10:13CrossRef Chandler AG, Pinder RJ, Netsch T, Schnabel JA, Hawkes DJ, Hill DL, Razavi R (2008) Correction of misaligned slices in multi-slice MR cardiac examinations by using slice-to-volume registration. J Cardiovas Magn Reson 10:13CrossRef
6.
Zurück zum Zitat Dalvi R, Abugharbieh R (2008) Fast feature based multi slice to volume registration using phase congruency. In: Engineering in Medicine and Biology Society, 2008. EMBS 2008. 30th Annual International Conference of the IEEE, pp 5390–5393 Dalvi R, Abugharbieh R (2008) Fast feature based multi slice to volume registration using phase congruency. In: Engineering in Medicine and Biology Society, 2008. EMBS 2008. 30th Annual International Conference of the IEEE, pp 5390–5393
7.
Zurück zum Zitat Ferrante E, Paragios N (2013) Non-rigid 2d–3d medical image registration using Markov random fields. In: Medical Image Computing and Computer-Assisted Intervention-MICCAI 2013, Springer, pp 163–170 Ferrante E, Paragios N (2013) Non-rigid 2d–3d medical image registration using Markov random fields. In: Medical Image Computing and Computer-Assisted Intervention-MICCAI 2013, Springer, pp 163–170
8.
Zurück zum Zitat Fuerst B, Wein W, Muller M, Navab N (2014) Automatic ultrasound–MRI registration for neurosurgery using the 2d and 3d lc2 metric. Med Image Anal 18(8):1312–1319. Special Issue on the 2013 Conference on Medical Image Computing and Computer Assisted Intervention Fuerst B, Wein W, Muller M, Navab N (2014) Automatic ultrasound–MRI registration for neurosurgery using the 2d and 3d lc2 metric. Med Image Anal 18(8):1312–1319. Special Issue on the 2013 Conference on Medical Image Computing and Computer Assisted Intervention
9.
Zurück zum Zitat Geman S, Geman D (1984) Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. Pattern Anal Mach Intell IEEE Trans 6:721–741 Geman S, Geman D (1984) Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. Pattern Anal Mach Intell IEEE Trans 6:721–741
10.
Zurück zum Zitat Gill S, Abolmaesumi P, Vikal S, Mousavi P, Fichtinger G (2008) Intraoperative prostate tracking with slice-to-volume registration in MRI. In: Proceedings of the 20th International Conference of the Society for Medical Innovation and Technology, pp 154–158 Gill S, Abolmaesumi P, Vikal S, Mousavi P, Fichtinger G (2008) Intraoperative prostate tracking with slice-to-volume registration in MRI. In: Proceedings of the 20th International Conference of the Society for Medical Innovation and Technology, pp 154–158
12.
Zurück zum Zitat Kappes JH, Andres B, Hamprecht FA, Schnörr C, Nowozin S, Batra D, Kim S, Kausler BX, Lellmann J, Komodakis N, Rother C (2013) A comparative study of modern inference techniques for discrete energy minimization problem In: CVPR 2013 Kappes JH, Andres B, Hamprecht FA, Schnörr C, Nowozin S, Batra D, Kim S, Kausler BX, Lellmann J, Komodakis N, Rother C (2013) A comparative study of modern inference techniques for discrete energy minimization problem In: CVPR 2013
13.
Zurück zum Zitat Komodakis N (2011) Efficient training for pairwise or higher order crfs via dual decomposition. In: CVPR, pp 1841–1848 Komodakis N (2011) Efficient training for pairwise or higher order crfs via dual decomposition. In: CVPR, pp 1841–1848
14.
Zurück zum Zitat Komodakis N, Tziritas G, Paragios N (2007) Fast, approximately optimal solutions for single and dynamic mrfs. In: Computer vision and pattern recognition, 2007. CVPR’07. IEEE Conference on, pp 1–8 Komodakis N, Tziritas G, Paragios N (2007) Fast, approximately optimal solutions for single and dynamic mrfs. In: Computer vision and pattern recognition, 2007. CVPR’07. IEEE Conference on, pp 1–8
15.
Zurück zum Zitat Kotsas P, Dodd T (2011) A review of methods for 2d/3d registration. WASET Conference Paris, pp 14–16 Kotsas P, Dodd T (2011) A review of methods for 2d/3d registration. WASET Conference Paris, pp 14–16
16.
Zurück zum Zitat Lee K, Kwon D, Yun I, Lee S (2008) Deformable 3d volume registration using efficient mrfs model with decomposed nodes. In: British Machine Vision Conference, pp 1–10 Lee K, Kwon D, Yun I, Lee S (2008) Deformable 3d volume registration using efficient mrfs model with decomposed nodes. In: British Machine Vision Conference, pp 1–10
17.
Zurück zum Zitat Mahapatra D, Sun Y (2008) Nonrigid registration of dynamic renal mr images using a saliency based mrf model. Medical Image Computing and Computer-Assisted Intervention-MICCAI 2008, pp 771–779 Mahapatra D, Sun Y (2008) Nonrigid registration of dynamic renal mr images using a saliency based mrf model. Medical Image Computing and Computer-Assisted Intervention-MICCAI 2008, pp 771–779
18.
Zurück zum Zitat Markelj P, Tomaževič D, Likar B, Pernuš F (2012) A review of 3d/2d registration methods for image-guided interventions. Med Image Anal 16(3):642–661CrossRefPubMed Markelj P, Tomaževič D, Likar B, Pernuš F (2012) A review of 3d/2d registration methods for image-guided interventions. Med Image Anal 16(3):642–661CrossRefPubMed
20.
Zurück zum Zitat Mercier L, Del Maestro RF, Petrecca K, Araujo D, Haegelen C, Collins DL (2012) Online database of clinical mr and ultrasound images of brain tumors. Med Phys 39:3253CrossRefPubMed Mercier L, Del Maestro RF, Petrecca K, Araujo D, Haegelen C, Collins DL (2012) Online database of clinical mr and ultrasound images of brain tumors. Med Phys 39:3253CrossRefPubMed
21.
Zurück zum Zitat Osechinskiy S, Kruggel F (2010) Slice-to-volume nonrigid registration of histological sections to Mr images of the human brain. Anatomy Research International 2011. doi:10.1155/2011/287860 Osechinskiy S, Kruggel F (2010) Slice-to-volume nonrigid registration of histological sections to Mr images of the human brain. Anatomy Research International 2011. doi:10.​1155/​2011/​287860
22.
Zurück zum Zitat Penney G, Blackall J, Hayashi D, Sabharwal T, Adam A, Hawkes D (2001) Overview of an ultrasound to ct or mr registration system for use in thermal ablation of liver metastases. In: Proceedings of Medical Image Understanding and Analysis, Citeseer, vol 1, p 6568 Penney G, Blackall J, Hayashi D, Sabharwal T, Adam A, Hawkes D (2001) Overview of an ultrasound to ct or mr registration system for use in thermal ablation of liver metastases. In: Proceedings of Medical Image Understanding and Analysis, Citeseer, vol 1, p 6568
23.
Zurück zum Zitat San José Estépar R, Westin C, Vosburgh K (2009) Towards real time 2d to 3d registration for ultrasound-guided endoscopic and laparoscopic procedures. Int J Computer Assist Radiol Surg 4(6):549–560CrossRef San José Estépar R, Westin C, Vosburgh K (2009) Towards real time 2d to 3d registration for ultrasound-guided endoscopic and laparoscopic procedures. Int J Computer Assist Radiol Surg 4(6):549–560CrossRef
25.
Zurück zum Zitat Xu H, Lasso A, Fedorov A, Tuncali K, Tempany C, Fichtinger G (2014) Multi-slice-to-volume registration for mri-guided transperineal prostate biopsy. Int J Computer Assist Radiol Surg, pp 1–10 CARS. doi:10.1007/s11548-014-1108-7 Xu H, Lasso A, Fedorov A, Tuncali K, Tempany C, Fichtinger G (2014) Multi-slice-to-volume registration for mri-guided transperineal prostate biopsy. Int J Computer Assist Radiol Surg, pp 1–10 CARS. doi:10.​1007/​s11548-014-1108-7
Metadaten
Titel
Slice-to-volume deformable registration: efficient one-shot consensus between plane selection and in-plane deformation
verfasst von
Enzo Ferrante
Vivien Fecamp
Nikos Paragios
Publikationsdatum
01.06.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 6/2015
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1205-2

Weitere Artikel der Ausgabe 6/2015

International Journal of Computer Assisted Radiology and Surgery 6/2015 Zur Ausgabe