Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 4/2021

08-03-2021 | Review Article

Multimodal 3D ultrasound and CT in image-guided spinal surgery: public database and new registration algorithms

Authors: Nima Masoumi, Clyde J. Belasso, M. Omair Ahmad, Habib Benali, Yiming Xiao, Hassan Rivaz

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 4/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

Accurate multimodal registration of intraoperative ultrasound (US) and preoperative computed tomography (CT) is a challenging problem. Construction of public datasets of US and CT images can accelerate the development of such image registration techniques. This can help ensure the accuracy and safety of spinal surgeries using image-guided surgery systems where an image registration is employed. In addition, we present two algorithms to register US and CT images.

Methods

We present three different datasets of vertebrae with corresponding CT, US, and simulated US images. For each of the two latter datasets, we also provide 16 landmark pairs of matching structures between the CT and US images and performed fiducial registration to acquire a silver standard for assessing image registration. Besides, we proposed two patch-based rigid image registration algorithms, one based on normalized cross-correlation (NCC) and the other based on correlation ratio (CR) to register misaligned CT and US images.

Results

The CT and corresponding US images of the proposed database were pre-processed and misaligned with different error intervals, resulting in 6000 registration problems solved using both NCC and CR methods. Our results show that the methods were successful in aligning the pre-processed CT and US images by decreasing the warping index.

Conclusions

The database provides a resource for evaluating image registration techniques. The simulated data have two applications. First, they provide the gold standard ground-truth which is difficult to obtain with ex vivo and in vivo data for validating US-CT registration methods. Second, the simulated US images can be used to validate real-time US simulation methods. Besides, the proposed image registration techniques can be useful for developing methods in clinical application.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Gerard IJ, Kersten-Oertel M, Drouin S, Hall JA, Petrecca K, De Nigris D, Di Giovanni DA, Arbel T, Collins DL (2018) Combining intraoperative ultrasound brain shift correction and augmented reality visualizations: a pilot study of eight cases. J Med Imaging 5(2):021210CrossRef Gerard IJ, Kersten-Oertel M, Drouin S, Hall JA, Petrecca K, De Nigris D, Di Giovanni DA, Arbel T, Collins DL (2018) Combining intraoperative ultrasound brain shift correction and augmented reality visualizations: a pilot study of eight cases. J Med Imaging 5(2):021210CrossRef
2.
go back to reference Della Pepa GM, Sabatino G, Sturiale CL, Marchese E, Puca A, Olivi A, Albanese A (2018) Integration of real-time intraoperative contrast-enhanced ultrasound and color doppler ultrasound in the surgical treatment of spinal cord dural arteriovenous fistulas. World Neurosurg 112:138–142CrossRef Della Pepa GM, Sabatino G, Sturiale CL, Marchese E, Puca A, Olivi A, Albanese A (2018) Integration of real-time intraoperative contrast-enhanced ultrasound and color doppler ultrasound in the surgical treatment of spinal cord dural arteriovenous fistulas. World Neurosurg 112:138–142CrossRef
3.
go back to reference Ganau M, Syrmos N, Martin AR, Jiang F, Fehlings MG (2018) Intraoperative ultrasound in spine surgery: history, current applications, future developments. Quant Imaging Med Surg 8(3):261CrossRef Ganau M, Syrmos N, Martin AR, Jiang F, Fehlings MG (2018) Intraoperative ultrasound in spine surgery: history, current applications, future developments. Quant Imaging Med Surg 8(3):261CrossRef
4.
go back to reference Boursier J-F, Fournet A, Bassanino J, Manassero M, Bedu A-S, Leperlier D (2018) Ultrasonography is more accurate than percutaneous palpation for identifying targeted thoracolumbar intervertebral disc spaces in dogs. Vet Radiol Ultras 59:749–757 CrossRef Boursier J-F, Fournet A, Bassanino J, Manassero M, Bedu A-S, Leperlier D (2018) Ultrasonography is more accurate than percutaneous palpation for identifying targeted thoracolumbar intervertebral disc spaces in dogs. Vet Radiol Ultras 59:749–757 CrossRef
5.
go back to reference Wein W, Brunke S, Khamene A, Callstrom MR, Navab N (2008) Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 12(5):577–585CrossRef Wein W, Brunke S, Khamene A, Callstrom MR, Navab N (2008) Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 12(5):577–585CrossRef
6.
go back to reference Mattausch O, Goksel O (2018) Image-based reconstruction of tissue scatterers using beam steering for ultrasound simulation. IEEE Trans Med Imaging 37(3):767–780CrossRef Mattausch O, Goksel O (2018) Image-based reconstruction of tissue scatterers using beam steering for ultrasound simulation. IEEE Trans Med Imaging 37(3):767–780CrossRef
7.
go back to reference Tuzer M, Türkay R, Boyman M, Acar B (2018) Multi-ray medical ultrasound simulation without explicit speckle modelling. Int J Comput Assist Radiol Surg 13:1009–1017CrossRef Tuzer M, Türkay R, Boyman M, Acar B (2018) Multi-ray medical ultrasound simulation without explicit speckle modelling. Int J Comput Assist Radiol Surg 13:1009–1017CrossRef
8.
go back to reference Rubi P, Vera EF, Larrabide J, Calvo M, D’Amato J, Larrabide I (2017) Comparison of real-time ultrasound simulation models using abdominal CT images. In: 12th international symposium on medical information processing and analysis, vol 10160, p 1016009. International Society for Optics and Photonics Rubi P, Vera EF, Larrabide J, Calvo M, D’Amato J, Larrabide I (2017) Comparison of real-time ultrasound simulation models using abdominal CT images. In: 12th international symposium on medical information processing and analysis, vol 10160, p 1016009. International Society for Optics and Photonics
9.
go back to reference Burger B, Bettinghausen S, Radle M, Hesser J (2013) Real-time GPU-based ultrasound simulation using deformable mesh models. IEEE Trans Med Imaging 32(3):609–618CrossRef Burger B, Bettinghausen S, Radle M, Hesser J (2013) Real-time GPU-based ultrasound simulation using deformable mesh models. IEEE Trans Med Imaging 32(3):609–618CrossRef
10.
go back to reference Yan CX, Goulet B, Pelletier J, Chen SJS, Tampieri D, Collins DL (2011) Towards accurate, robust and practical ultrasound-CT registration of vertebrae for image-guided spine surgery. Int J Comput Assist Radiol Surg 6(4):523–537CrossRef Yan CX, Goulet B, Pelletier J, Chen SJS, Tampieri D, Collins DL (2011) Towards accurate, robust and practical ultrasound-CT registration of vertebrae for image-guided spine surgery. Int J Comput Assist Radiol Surg 6(4):523–537CrossRef
11.
go back to reference Koo TK, Kwok WE (2016) Hierarchical CT to ultrasound registration of the lumbar spine: a comparison with other registration methods. Ann Biomed Eng 44(10):2887–2900CrossRef Koo TK, Kwok WE (2016) Hierarchical CT to ultrasound registration of the lumbar spine: a comparison with other registration methods. Ann Biomed Eng 44(10):2887–2900CrossRef
12.
go back to reference Xiao Y, Fortin M, Unsgård G, Rivaz H, Reinertsen I (2017) Retrospective evaluation of cerebral tumors (resect): a clinical database of pre-operative MRI and intra-operative ultrasound in low-grade glioma surgeries. Med Phys 44(7):3875–3882CrossRef Xiao Y, Fortin M, Unsgård G, Rivaz H, Reinertsen I (2017) Retrospective evaluation of cerebral tumors (resect): a clinical database of pre-operative MRI and intra-operative ultrasound in low-grade glioma surgeries. Med Phys 44(7):3875–3882CrossRef
13.
go back to reference Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M (2013) The cancer imaging archive (TCIA): maintaining and operating a public information repository. J Digit Imaging 26(6):1045–1057CrossRef Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M (2013) The cancer imaging archive (TCIA): maintaining and operating a public information repository. J Digit Imaging 26(6):1045–1057CrossRef
15.
go back to reference Karamalis A, Wein W, Navab N (2010) Fast ultrasound image simulation using the westervelt equation. In: International conference on medical image computing and computer-assisted intervention. Springer, vol 13. pp 243–250 Karamalis A, Wein W, Navab N (2010) Fast ultrasound image simulation using the westervelt equation. In: International conference on medical image computing and computer-assisted intervention. Springer, vol 13. pp 243–250
16.
go back to reference Gill S, Abolmaesumi P, Fichtinger G, Boisvert J, Pichora D, Borshneck D (2012) Biomechanically constrained groupwise ultrasound to CT registration of the lumbar spine. Med Image Anal 16(3):662–674CrossRef Gill S, Abolmaesumi P, Fichtinger G, Boisvert J, Pichora D, Borshneck D (2012) Biomechanically constrained groupwise ultrasound to CT registration of the lumbar spine. Med Image Anal 16(3):662–674CrossRef
17.
go back to reference Jaros J, Rendell AP, Treeby BE (2016) Full-wave nonlinear ultrasound simulation on distributed clusters with applications in high-intensity focused ultrasound. Int J High Perform Comput Appl 30(2):137–155CrossRef Jaros J, Rendell AP, Treeby BE (2016) Full-wave nonlinear ultrasound simulation on distributed clusters with applications in high-intensity focused ultrasound. Int J High Perform Comput Appl 30(2):137–155CrossRef
18.
go back to reference Roche A, Malandain G, Pennec X, Ayache N (1998) The correlation ratio as a new similarity measure for multimodal image registration. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 1115–1124 Roche A, Malandain G, Pennec X, Ayache N (1998) The correlation ratio as a new similarity measure for multimodal image registration. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 1115–1124
19.
go back to reference Rivaz H, Chen SJS, Collins DL (2015) Automatic deformable MR-ultrasound registration for image-guided neurosurgery. IEEE Trans Med Imaging 34(2):366–380CrossRef Rivaz H, Chen SJS, Collins DL (2015) Automatic deformable MR-ultrasound registration for image-guided neurosurgery. IEEE Trans Med Imaging 34(2):366–380CrossRef
20.
go back to reference Masoumi N, Xiao Y, Rivaz H (2019) Arena: inter-modality affine registration using evolutionary strategy. Int J Comput Assist Radiol Surg 14(3):441–450CrossRef Masoumi N, Xiao Y, Rivaz H (2019) Arena: inter-modality affine registration using evolutionary strategy. Int J Comput Assist Radiol Surg 14(3):441–450CrossRef
21.
go back to reference Boyd S, Boyd SP, Vandenberghe L (2004) Convex optimization. Cambridge University Press, CambridgeCrossRef Boyd S, Boyd SP, Vandenberghe L (2004) Convex optimization. Cambridge University Press, CambridgeCrossRef
22.
go back to reference Kendall JL, Faragher JP (2007) Ultrasound-guided central venous access: a homemade phantom for simulation. Can J Emerg Med 9(5):371–373CrossRef Kendall JL, Faragher JP (2007) Ultrasound-guided central venous access: a homemade phantom for simulation. Can J Emerg Med 9(5):371–373CrossRef
23.
go back to reference Wilke HJ, Kettler A, Wenger KH, Claes LE (1997) Anatomy of the sheep spine and its comparison to the human spine. Anat Rec Off Publ Am Assoc Anat 247(4):542–555CrossRef Wilke HJ, Kettler A, Wenger KH, Claes LE (1997) Anatomy of the sheep spine and its comparison to the human spine. Anat Rec Off Publ Am Assoc Anat 247(4):542–555CrossRef
24.
go back to reference Jensen JA (1996) Field: a program for simulating ultrasound systems. In: 10th nordicbaltic conference on biomedical imaging, vol 4, supplement 1, part 1. Citeseer, pp 351–353 Jensen JA (1996) Field: a program for simulating ultrasound systems. In: 10th nordicbaltic conference on biomedical imaging, vol 4, supplement 1, part 1. Citeseer, pp 351–353
25.
go back to reference Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) Plus: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61(10):2527–2537CrossRef Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) Plus: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61(10):2527–2537CrossRef
26.
go back to reference Ungi T, Lasso A, Fichtinger G (2016) Open-source platforms for navigated image-guided interventions. Med Image Anal 33:181–186CrossRef Ungi T, Lasso A, Fichtinger G (2016) Open-source platforms for navigated image-guided interventions. Med Image Anal 33:181–186CrossRef
27.
go back to reference Brendel B, Rick SWA, Stockheim M, Ermert H (2002) Registration of 3d CT and ultrasound datasets of the spine using bone structures. Comput Aided Surg 7(3):146–155CrossRef Brendel B, Rick SWA, Stockheim M, Ermert H (2002) Registration of 3d CT and ultrasound datasets of the spine using bone structures. Comput Aided Surg 7(3):146–155CrossRef
Metadata
Title
Multimodal 3D ultrasound and CT in image-guided spinal surgery: public database and new registration algorithms
Authors
Nima Masoumi
Clyde J. Belasso
M. Omair Ahmad
Habib Benali
Yiming Xiao
Hassan Rivaz
Publication date
08-03-2021
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 4/2021
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-021-02323-2

Other articles of this Issue 4/2021

International Journal of Computer Assisted Radiology and Surgery 4/2021 Go to the issue

Premium Partner