Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 12/2017

31-08-2017 | Original Article

Multimodal image registration based on binary gradient angle descriptor

Authors: Dongsheng Jiang, Yonghong Shi, Demin Yao, Yifeng Fan, Manning Wang, Zhijian Song

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 12/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

Multimodal image registration plays an important role in image-guided interventions/therapy and atlas building, and it is still a challenging task due to the complex intensity variations in different modalities.

Methods

The paper addresses the problem and proposes a simple, compact, fast and generally applicable modality-independent binary gradient angle descriptor (BGA) based on the rationale of gradient orientation alignment. The BGA can be easily calculated at each voxel by coding the quadrant in which a local gradient vector falls, and it has an extremely low computational complexity, requiring only three convolutions, two multiplication operations and two comparison operations. Meanwhile, the binarized encoding of the gradient orientation makes the BGA more resistant to image degradations compared with conventional gradient orientation methods. The BGA can extract similar feature descriptors for different modalities and enable the use of simple similarity measures, which makes it applicable within a wide range of optimization frameworks.

Results

The results for pairwise multimodal and monomodal registrations between various images (T1, T2, PD, T1c, Flair) consistently show that the BGA significantly outperforms localized mutual information. The experimental results also confirm that the BGA can be a reliable alternative to the sum of absolute difference in monomodal image registration. The BGA can also achieve an accuracy of \(1.41\pm 1.1~\hbox {mm}\), similar to that of the SSC, for the deformable registration of inhale and exhale CT scans. Specifically, for the highly challenging deformable registration of preoperative MRI and 3D intraoperative ultrasound images, the BGA achieves a similar registration accuracy of \(2.33\pm 1.2~\hbox {mm}\) compared with state-of-the-art approaches, with a computation time of 18.3 s per case.

Conclusions

The BGA improves the registration performance in terms of both accuracy and time efficiency. With further acceleration, the framework has the potential for application in time-sensitive clinical environments, such as for preoperative MRI and intraoperative US image registration for image-guided intervention.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Maybody M, Stevenson C, Solomon SB (2013) Overview of navigation systems in image-guided interventions. Tech Vasc Interv Radiol 16:136–143CrossRefPubMed Maybody M, Stevenson C, Solomon SB (2013) Overview of navigation systems in image-guided interventions. Tech Vasc Interv Radiol 16:136–143CrossRefPubMed
2.
go back to reference Liao R, Zhang L, Sun Y, Miao S, Chefd’Hotel C (2013) A review of recent advances in registration techniques applied to minimally invasive therapy. IEEE Trans Multimed 15:983–1000CrossRef Liao R, Zhang L, Sun Y, Miao S, Chefd’Hotel C (2013) A review of recent advances in registration techniques applied to minimally invasive therapy. IEEE Trans Multimed 15:983–1000CrossRef
3.
go back to reference Ewertsen C, Săftoiu A, Gruionu LG, Karstrup S, Nielsen MB (2013) Real-time image fusion involving diagnostic ultrasound. Am J Roentgenol 200:W249–W255CrossRef Ewertsen C, Săftoiu A, Gruionu LG, Karstrup S, Nielsen MB (2013) Real-time image fusion involving diagnostic ultrasound. Am J Roentgenol 200:W249–W255CrossRef
4.
5.
go back to reference Glocker B, Sotiras A, Komodakis N, Paragios N (2011) Deformable medical image registration: setting the state of the art with discrete methods. Annu Rev Biomed Eng 13:219–244CrossRefPubMed Glocker B, Sotiras A, Komodakis N, Paragios N (2011) Deformable medical image registration: setting the state of the art with discrete methods. Annu Rev Biomed Eng 13:219–244CrossRefPubMed
6.
go back to reference Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P (1997) Multimodality image registration by maximization of mutual information. IEEE Trans Med Imaging 16:187–198CrossRefPubMed Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P (1997) Multimodality image registration by maximization of mutual information. IEEE Trans Med Imaging 16:187–198CrossRefPubMed
7.
go back to reference Haber E, Modersitzki J (2005) Beyond mutual information: a simple and robust alternative. Bildverarbeitung für die Medizin 2005:350–354 Haber E, Modersitzki J (2005) Beyond mutual information: a simple and robust alternative. Bildverarbeitung für die Medizin 2005:350–354
8.
go back to reference De Nigris D, Collins DL, Arbel T (2012) Multi-modal image registration based on gradient orientations of minimal uncertainty. IEEE Trans Med Imaging 31:2343–2354CrossRefPubMed De Nigris D, Collins DL, Arbel T (2012) Multi-modal image registration based on gradient orientations of minimal uncertainty. IEEE Trans Med Imaging 31:2343–2354CrossRefPubMed
9.
go back to reference Heinrich M, Schnabel J, Gleeson F, Brady M, Jenkinson M (2010) Non-rigid multimodal medical image registration using optical flow and gradient orientation. In: Proceedings of medical image analysis and understanding, pp 141–145 Heinrich M, Schnabel J, Gleeson F, Brady M, Jenkinson M (2010) Non-rigid multimodal medical image registration using optical flow and gradient orientation. In: Proceedings of medical image analysis and understanding, pp 141–145
10.
go back to reference Heinrich MP, Jenkinson M, Gleeson FV, Brady SM, Schnabel JA (2011) Deformable multimodal registration with gradient orientation based on structure tensors. Ann Br Mach Vis Assoc 5:1–11 Heinrich MP, Jenkinson M, Gleeson FV, Brady SM, Schnabel JA (2011) Deformable multimodal registration with gradient orientation based on structure tensors. Ann Br Mach Vis Assoc 5:1–11
11.
go back to reference König L, Rühaak J (2014) A fast and accurate parallel algorithm for non-linear image registration using normalized gradient fields. In: 2014 IEEE 11th international symposium on biomedical imaging (ISBI). IEEE, pp 580–583 König L, Rühaak J (2014) A fast and accurate parallel algorithm for non-linear image registration using normalized gradient fields. In: 2014 IEEE 11th international symposium on biomedical imaging (ISBI). IEEE, pp 580–583
12.
go back to reference Wachinger C, Navab N (2012) Entropy and laplacian images: structural representations for multi-modal registration. Med Image Anal 16:1–17CrossRefPubMed Wachinger C, Navab N (2012) Entropy and laplacian images: structural representations for multi-modal registration. Med Image Anal 16:1–17CrossRefPubMed
13.
go back to reference Yang F, Ding M, Zhang X, Wu Y, Hu J (2013) Two phase non-rigid multi-modal image registration using Weber local descriptor-based similarity metrics and normalized mutual information. Sensors (Basel) 13:7599–7617CrossRef Yang F, Ding M, Zhang X, Wu Y, Hu J (2013) Two phase non-rigid multi-modal image registration using Weber local descriptor-based similarity metrics and normalized mutual information. Sensors (Basel) 13:7599–7617CrossRef
14.
go back to reference Piella Fenoy G (2014) Diffusion maps for multimodal registration. Sensors. 14(6):10563–10577 Piella Fenoy G (2014) Diffusion maps for multimodal registration. Sensors. 14(6):10563–10577
15.
go back to reference Heinrich MP, Jenkinson M, Bhushan M, Matin T, Gleeson FV, Brady SM, Schnabel JA (2012) MIND: modality independent neighbourhood descriptor for multi-modal deformable registration. Med Image Anal 16:1423–1435CrossRefPubMed Heinrich MP, Jenkinson M, Bhushan M, Matin T, Gleeson FV, Brady SM, Schnabel JA (2012) MIND: modality independent neighbourhood descriptor for multi-modal deformable registration. Med Image Anal 16:1423–1435CrossRefPubMed
16.
go back to reference Heinrich MP, Jenkinson M, Papież BW, Brady M, Schnabel JA (2013) Towards realtime multimodal fusion for image-guided interventions using self-similarities. In: Medical image computing and computer-assisted intervention–MICCAI 2013. Springer, pp 187–194 Heinrich MP, Jenkinson M, Papież BW, Brady M, Schnabel JA (2013) Towards realtime multimodal fusion for image-guided interventions using self-similarities. In: Medical image computing and computer-assisted intervention–MICCAI 2013. Springer, pp 187–194
17.
go back to reference Heinrich MP, Maier O, Handels H (2015) Multi-modal multi-Atlas segmentation using discrete optimisation and self-similarities. VISCERAL@ ISBI 2015 VISCERAL Anatomy3 Organ Segmentation Challenge 27 Heinrich MP, Maier O, Handels H (2015) Multi-modal multi-Atlas segmentation using discrete optimisation and self-similarities. VISCERAL@ ISBI 2015 VISCERAL Anatomy3 Organ Segmentation Challenge 27
18.
go back to reference Jiang D, Shi Y, Yao D, Wang M, Song Z (2016) miLBP: a robust and fast modality-independent 3D LBP for multimodal deformable registration. Int J Comput Assist Radiol 11:997–1005 Jiang D, Shi Y, Yao D, Wang M, Song Z (2016) miLBP: a robust and fast modality-independent 3D LBP for multimodal deformable registration. Int J Comput Assist Radiol 11:997–1005
19.
go back to reference Li Z, Mahapatra D, Tielbeek JA, Stoker J, van Vliet LJ, Vos FM (2016) Image registration based on autocorrelation of local structure. IEEE Trans Med Imaging 35:63–75CrossRefPubMed Li Z, Mahapatra D, Tielbeek JA, Stoker J, van Vliet LJ, Vos FM (2016) Image registration based on autocorrelation of local structure. IEEE Trans Med Imaging 35:63–75CrossRefPubMed
20.
go back to reference Toews M, Zöllei L, Wells III WM (2013) Feature-based alignment of volumetric multi-modal images. In: Information processing in medical imaging: proceedings of the... conference NIH Public Access, p 25 Toews M, Zöllei L, Wells III WM (2013) Feature-based alignment of volumetric multi-modal images. In: Information processing in medical imaging: proceedings of the... conference NIH Public Access, p 25
21.
go back to reference Haber E, Modersitzki J (2006) Intensity gradient based registration and fusion of multi-modal images. In: Medical image computing and computer-assisted intervention—MICCAI 2006. Springer, pp 726–733 Haber E, Modersitzki J (2006) Intensity gradient based registration and fusion of multi-modal images. In: Medical image computing and computer-assisted intervention—MICCAI 2006. Springer, pp 726–733
22.
go back to reference Heinrich MP, Jenkinson M, Brady M, Schnabel JA (2013) MRF-based deformable registration and ventilation estimation of lung CT. IEEE Trans Med Imaging 32:1239–1248CrossRefPubMed Heinrich MP, Jenkinson M, Brady M, Schnabel JA (2013) MRF-based deformable registration and ventilation estimation of lung CT. IEEE Trans Med Imaging 32:1239–1248CrossRefPubMed
23.
go back to reference Heinrich MP, Simpson IJA, Papież BW, Brady SM, Schnabel JA (2016) Deformable image registration by combining uncertainty estimates from supervoxel belief propagation. Med Image Anal 27:57–71CrossRefPubMed Heinrich MP, Simpson IJA, Papież BW, Brady SM, Schnabel JA (2016) Deformable image registration by combining uncertainty estimates from supervoxel belief propagation. Med Image Anal 27:57–71CrossRefPubMed
24.
go back to reference Castillo R, Castillo E, Guerra R, Johnson VE, McPhail T, Garg AK, Guerrero T (2009) A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets. Phys Med Biol 54:1849CrossRefPubMed Castillo R, Castillo E, Guerra R, Johnson VE, McPhail T, Garg AK, Guerrero T (2009) A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets. Phys Med Biol 54:1849CrossRefPubMed
25.
go back to reference Fuerst B, Wein W, Müller M, Navab N (2014) Automatic ultrasound—MRI registration for neurosurgery using the 2D and 3D LC\(^2\) Metric. Med Image Anal 18(8):1312–1319CrossRefPubMed Fuerst B, Wein W, Müller M, Navab N (2014) Automatic ultrasound—MRI registration for neurosurgery using the 2D and 3D LC\(^2\) Metric. Med Image Anal 18(8):1312–1319CrossRefPubMed
26.
go back to reference Rivaz H, Karimaghaloo Z, Collins DL (2014) Self-similarity weighted mutual information: a new nonrigid image registration metric. Med Image Anal 18:343–358CrossRefPubMed Rivaz H, Karimaghaloo Z, Collins DL (2014) Self-similarity weighted mutual information: a new nonrigid image registration metric. Med Image Anal 18:343–358CrossRefPubMed
27.
go back to reference Rivaz H, Karimaghaloo Z, Fonov VS, Collins DL (2014) Nonrigid registration of ultrasound and MRI using contextual conditioned mutual information. IEEE Trans Med Imaging 33(3):708–725CrossRefPubMed Rivaz H, Karimaghaloo Z, Fonov VS, Collins DL (2014) Nonrigid registration of ultrasound and MRI using contextual conditioned mutual information. IEEE Trans Med Imaging 33(3):708–725CrossRefPubMed
28.
go back to reference Avants BB, Epstein CL, Grossman M, Gee JC (2008) Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med Image Anal 12:26–41CrossRefPubMed Avants BB, Epstein CL, Grossman M, Gee JC (2008) Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med Image Anal 12:26–41CrossRefPubMed
29.
go back to reference Jiang D, Shi Y, Chen X, Wang M, Song Z (2016) Fast and robust multimodal image registration using a local derivative pattern. Med Phys 44(2):497–509CrossRef Jiang D, Shi Y, Chen X, Wang M, Song Z (2016) Fast and robust multimodal image registration using a local derivative pattern. Med Phys 44(2):497–509CrossRef
Metadata
Title
Multimodal image registration based on binary gradient angle descriptor
Authors
Dongsheng Jiang
Yonghong Shi
Demin Yao
Yifeng Fan
Manning Wang
Zhijian Song
Publication date
31-08-2017
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 12/2017
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1661-y

Other articles of this Issue 12/2017

International Journal of Computer Assisted Radiology and Surgery 12/2017 Go to the issue

Premium Partner