Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 7/2023

10.05.2023 | Original Article

3D US-CT/MRI registration for percutaneous focal liver tumor ablations

verfasst von: Shuwei Xing, Joeana Cambranis Romero, Priyanka Roy, Derek W. Cool, David Tessier, Elvis C. S. Chen, Terry M. Peters, Aaron Fenster

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 7/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

US-guided percutaneous focal liver tumor ablations have been considered promising curative treatment techniques. To address cases with invisible or poorly visible tumors, registration of 3D US with CT or MRI is a critical step. By taking advantage of deep learning techniques to efficiently detect representative features in both modalities, we aim to develop a 3D US-CT/MRI registration approach for liver tumor ablations.

Methods

Facilitated by our nnUNet-based 3D US vessel segmentation approach, we propose a coarse-to-fine 3D US-CT/MRI image registration pipeline based on the liver vessel surface and centerlines. Then, phantom, healthy volunteer and patient studies are performed to demonstrate the effectiveness of our proposed registration approach.

Results

Our nnUNet-based vessel segmentation model achieved a Dice score of 0.69. In healthy volunteer study, 11 out of 12 3D US-MRI image pairs were successfully registered with an overall centerline distance of 4.03±2.68 mm. Two patient cases achieved target registration errors (TRE) of 4.16 mm and 5.22 mm.

Conclusion

We proposed a coarse-to-fine 3D US-CT/MRI registration pipeline based on nnUNet vessel segmentation models. Experiments based on healthy volunteers and patient trials demonstrated the effectiveness of our registration workflow. Our code and example data are publicly available in this repository.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Tani S, Tatli S, Hata N, Garcia-Rojas X, Olubiyi OI, Silverman SG, Tokuda J (2016) Three-dimensional quantitative assessment of ablation margins based on registration of pre-and post-procedural mri and distance map. Int J Comput Assist Radiol Surg 11(6):1133–1142CrossRefPubMedPubMedCentral Tani S, Tatli S, Hata N, Garcia-Rojas X, Olubiyi OI, Silverman SG, Tokuda J (2016) Three-dimensional quantitative assessment of ablation margins based on registration of pre-and post-procedural mri and distance map. Int J Comput Assist Radiol Surg 11(6):1133–1142CrossRefPubMedPubMedCentral
2.
Zurück zum Zitat Kim PN, Choi D, Rhim H, Rha SE, Hong HP, Lee J, Choi J-I, Kim JW, Seo JW, Lee EJ, Lim KH (2012) Planning ultrasound for percutaneous radiofrequency ablation to treat small (3 cm) hepatocellular carcinomas detected on computed tomography or magnetic resonance imaging: a multicenter prospective study to assess factors affecting ultrasound visibility. J Vasc Interv Radiol 23(5):627–634CrossRefPubMed Kim PN, Choi D, Rhim H, Rha SE, Hong HP, Lee J, Choi J-I, Kim JW, Seo JW, Lee EJ, Lim KH (2012) Planning ultrasound for percutaneous radiofrequency ablation to treat small (3 cm) hepatocellular carcinomas detected on computed tomography or magnetic resonance imaging: a multicenter prospective study to assess factors affecting ultrasound visibility. J Vasc Interv Radiol 23(5):627–634CrossRefPubMed
3.
Zurück zum Zitat Xing S, Romero JC, Cool DW, Mujoomdar A, Chen EC, Peters TM, Fenster A (2022) 3d us-based evaluation and optimization of tumor coverage for us-guided percutaneous liver thermal ablation. IEEE Trans Med Imaging Xing S, Romero JC, Cool DW, Mujoomdar A, Chen EC, Peters TM, Fenster A (2022) 3d us-based evaluation and optimization of tumor coverage for us-guided percutaneous liver thermal ablation. IEEE Trans Med Imaging
4.
Zurück zum Zitat Roche A, Pennec X, Malandain G, Ayache N (2001) Rigid registration of 3-d ultrasound with mr images: a new approach combining intensity and gradient information. IEEE Trans Med Imaging 20(10):1038–1049CrossRefPubMed Roche A, Pennec X, Malandain G, Ayache N (2001) Rigid registration of 3-d ultrasound with mr images: a new approach combining intensity and gradient information. IEEE Trans Med Imaging 20(10):1038–1049CrossRefPubMed
5.
Zurück zum Zitat Viola P, Wells WM III (1997) Alignment by maximization of mutual information. Int J Comput Vision 24(2):137–154CrossRef Viola P, Wells WM III (1997) Alignment by maximization of mutual information. Int J Comput Vision 24(2):137–154CrossRef
6.
Zurück zum Zitat Wein W, Brunke S, Khamene A, Callstrom MR, Navab N (2008) Automatic ct-ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 12(5):577–585CrossRefPubMed Wein W, Brunke S, Khamene A, Callstrom MR, Navab N (2008) Automatic ct-ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 12(5):577–585CrossRefPubMed
7.
Zurück zum Zitat Heinrich MP, Jenkinson M, Bhushan M, Matin T, Gleeson FV, Brady M, Schnabel JA (2012) Mind: Modality independent neighbourhood descriptor for multi-modal deformable registration. Med Image Anal 16(7):1423–1435CrossRefPubMed Heinrich MP, Jenkinson M, Bhushan M, Matin T, Gleeson FV, Brady M, Schnabel JA (2012) Mind: Modality independent neighbourhood descriptor for multi-modal deformable registration. Med Image Anal 16(7):1423–1435CrossRefPubMed
8.
Zurück zum Zitat Shechtman E, Irani M (2007) Matching local self-similarities across images and videos. In: 2007 IEEE conference on computer vision and pattern recognition, pp 1–8 . IEEE Shechtman E, Irani M (2007) Matching local self-similarities across images and videos. In: 2007 IEEE conference on computer vision and pattern recognition, pp 1–8 . IEEE
9.
Zurück zum Zitat Penney GP, Blackall JM, Hamady M, Sabharwal T, Adam A, Hawkes DJ (2004) Registration of freehand 3d ultrasound and magnetic resonance liver images. Med Image Anal 8(1):81–91CrossRefPubMed Penney GP, Blackall JM, Hamady M, Sabharwal T, Adam A, Hawkes DJ (2004) Registration of freehand 3d ultrasound and magnetic resonance liver images. Med Image Anal 8(1):81–91CrossRefPubMed
10.
Zurück zum Zitat Lange T, Papenberg N, Heldmann S, Modersitzki J, Fischer B, Lamecker H, Schlag PM (2009) 3d ultrasound-ct registration of the liver using combined landmark-intensity information. Int J Comput Assist Radiol Surg 4(1):79–88CrossRefPubMed Lange T, Papenberg N, Heldmann S, Modersitzki J, Fischer B, Lamecker H, Schlag PM (2009) 3d ultrasound-ct registration of the liver using combined landmark-intensity information. Int J Comput Assist Radiol Surg 4(1):79–88CrossRefPubMed
11.
Zurück zum Zitat Hering A, Hansen L, Mok TC, Chung AC, Siebert H, Häger S, Lange A, Kuckertz S, Heldmann S, Shao W, Vesal S, Rusu M, Sonn G, Estienne T, Vakalopoulou M, Han L, Huang Y, Yap P-T, Brudfors M, Balbastre Y, Joutard S, Modat M, Lifshitz G, Raviv D, Lv J, Li Q, Jaouen V, Visvikis D, Fourcade C, Rubeaux M, Pan W, Xu Z, Jian B, De Benetti F, Wodzinski M, Gunnarsson N, Sjölund J, Grzech D, Qiu H, Li Z, Thorley A, Duan J, Großbröhmer C, Hoopes A, Reinertsen I, Xiao Y, Landman B, Huo Y, Murphy K, Lessmann N, Van Ginneken B, Dalca AV, Heinrich MP (2022) Learn2reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning. IEEE Trans Med Imaging Hering A, Hansen L, Mok TC, Chung AC, Siebert H, Häger S, Lange A, Kuckertz S, Heldmann S, Shao W, Vesal S, Rusu M, Sonn G, Estienne T, Vakalopoulou M, Han L, Huang Y, Yap P-T, Brudfors M, Balbastre Y, Joutard S, Modat M, Lifshitz G, Raviv D, Lv J, Li Q, Jaouen V, Visvikis D, Fourcade C, Rubeaux M, Pan W, Xu Z, Jian B, De Benetti F, Wodzinski M, Gunnarsson N, Sjölund J, Grzech D, Qiu H, Li Z, Thorley A, Duan J, Großbröhmer C, Hoopes A, Reinertsen I, Xiao Y, Landman B, Huo Y, Murphy K, Lessmann N, Van Ginneken B, Dalca AV, Heinrich MP (2022) Learn2reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning. IEEE Trans Med Imaging
12.
Zurück zum Zitat Thomson BR, Smit JN, Ivashchenko OV, Kok NF, Kuhlmann KF, Ruers TJ, Fusaglia M (2020) Mr-to-us registration using multiclass segmentation of hepatic vasculature with a reduced 3d u-net. In: International conference on medical image computing and computer-assisted intervention, pp 275–284 Springer Thomson BR, Smit JN, Ivashchenko OV, Kok NF, Kuhlmann KF, Ruers TJ, Fusaglia M (2020) Mr-to-us registration using multiclass segmentation of hepatic vasculature with a reduced 3d u-net. In: International conference on medical image computing and computer-assisted intervention, pp 275–284 Springer
13.
Zurück zum Zitat Zeng Q, Mohammed S, Pang EH, Schneider C, Honarvar M, Lobo J, Hu C, Jago J, Ng G, Rohling R, Salcudean SE (2022) Learning-based us-mr liver image registration with spatial priors. In: International conference on medical image computing and computer-assisted intervention, pp 174–184 Springer Zeng Q, Mohammed S, Pang EH, Schneider C, Honarvar M, Lobo J, Hu C, Jago J, Ng G, Rohling R, Salcudean SE (2022) Learning-based us-mr liver image registration with spatial priors. In: International conference on medical image computing and computer-assisted intervention, pp 174–184 Springer
14.
Zurück zum Zitat Myronenko A, Song X (2010) Point set registration: coherent point drift. IEEE Trans Pattern Anal Mach Intell 32(12):2262–2275CrossRefPubMed Myronenko A, Song X (2010) Point set registration: coherent point drift. IEEE Trans Pattern Anal Mach Intell 32(12):2262–2275CrossRefPubMed
15.
Zurück zum Zitat Simpson AL, Antonelli M, Bakas S, Bilello M, Farahani K, Van Ginneken B, Kopp-Schneider A, Landman BA, Litjens G, Menze B, Ronneberger O, Summers RM, Bilic P, Christ PF, Do RK, Gollub M, Golia-Pernicka J, Heckers SH, Jarnagin WR, McHugo MK, Napel S, Vorontsov E, Maier-Hein L, Jorge Cardoso M (2019) A large annotated medical image dataset for the development and evaluation of segmentation algorithms. arXiv preprint arXiv:1902.09063 Simpson AL, Antonelli M, Bakas S, Bilello M, Farahani K, Van Ginneken B, Kopp-Schneider A, Landman BA, Litjens G, Menze B, Ronneberger O, Summers RM, Bilic P, Christ PF, Do RK, Gollub M, Golia-Pernicka J, Heckers SH, Jarnagin WR, McHugo MK, Napel S, Vorontsov E, Maier-Hein L, Jorge Cardoso M (2019) A large annotated medical image dataset for the development and evaluation of segmentation algorithms. arXiv preprint arXiv:​1902.​09063
16.
Zurück zum Zitat Hirose O (2020) A Bayesian formulation of coherent point drift. IEEE Trans Pattern Anal Mach Intell 43(7):2269–2286CrossRef Hirose O (2020) A Bayesian formulation of coherent point drift. IEEE Trans Pattern Anal Mach Intell 43(7):2269–2286CrossRef
17.
Zurück zum Zitat Laimer G, Schullian P, Jaschke N, Putzer D, Eberle G, Alzaga A, Odisio B, Bale R (2020) Minimal ablative margin (mam) assessment with image fusion: an independent predictor for local tumor progression in hepatocellular carcinoma after stereotactic radiofrequency ablation. Eur Radiol 30:2463–2472CrossRefPubMedPubMedCentral Laimer G, Schullian P, Jaschke N, Putzer D, Eberle G, Alzaga A, Odisio B, Bale R (2020) Minimal ablative margin (mam) assessment with image fusion: an independent predictor for local tumor progression in hepatocellular carcinoma after stereotactic radiofrequency ablation. Eur Radiol 30:2463–2472CrossRefPubMedPubMedCentral
18.
Zurück zum Zitat Shady W, Petre EN, Do KG, Gonen M, Yarmohammadi H, Brown KT, Kemeny NE, D’Angelica M, Kingham PT, Solomon SB, Sofocleous CT (2018) Percutaneous microwave versus radiofrequency ablation of colorectal liver metastases: ablation with clear margins (a0) provides the best local tumor control. J Vasc Interv Radiol 29(2):268–275CrossRefPubMed Shady W, Petre EN, Do KG, Gonen M, Yarmohammadi H, Brown KT, Kemeny NE, D’Angelica M, Kingham PT, Solomon SB, Sofocleous CT (2018) Percutaneous microwave versus radiofrequency ablation of colorectal liver metastases: ablation with clear margins (a0) provides the best local tumor control. J Vasc Interv Radiol 29(2):268–275CrossRefPubMed
19.
Zurück zum Zitat Hansen L, Heinrich MP (2021) Deep learning based geometric registration for medical images: How accurate can we get without visual features? In: International conference on information processing in medical imaging, pp 18–30 . Springer Hansen L, Heinrich MP (2021) Deep learning based geometric registration for medical images: How accurate can we get without visual features? In: International conference on information processing in medical imaging, pp 18–30 . Springer
20.
Zurück zum Zitat Antonsanti P-L, Benseghir T, Jugnon V, Ghosn M, Chassat P, Kaltenmark I, Glaunès J (2022) How to register a live onto a liver? partial matching in the space of varifolds. arXiv preprint arXiv:2204.05665 Antonsanti P-L, Benseghir T, Jugnon V, Ghosn M, Chassat P, Kaltenmark I, Glaunès J (2022) How to register a live onto a liver? partial matching in the space of varifolds. arXiv preprint arXiv:​2204.​05665
Metadaten
Titel
3D US-CT/MRI registration for percutaneous focal liver tumor ablations
verfasst von
Shuwei Xing
Joeana Cambranis Romero
Priyanka Roy
Derek W. Cool
David Tessier
Elvis C. S. Chen
Terry M. Peters
Aaron Fenster
Publikationsdatum
10.05.2023
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 7/2023
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-02915-0

Weitere Artikel der Ausgabe 7/2023

International Journal of Computer Assisted Radiology and Surgery 7/2023 Zur Ausgabe

Premium Partner