Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 11/2020

24.08.2020 | Original Article

Automatic segmentation of the carotid artery and internal jugular vein from 2D ultrasound images for 3D vascular reconstruction

verfasst von: Leah A. Groves, Blake VanBerlo, Natan Veinberg, Abdulrahman Alboog, Terry M. Peters, Elvis C. S. Chen

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 11/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

In the context of analyzing neck vascular morphology, this work formulates and compares Mask R-CNN and U-Net-based algorithms to automatically segment the carotid artery (CA) and internal jugular vein (IJV) from transverse neck ultrasound (US).

Methods

US scans of the neck vasculature were collected to produce a dataset of 2439 images and their respective manual segmentations. Fourfold cross-validation was employed to train and evaluate Mask RCNN and U-Net models. The U-Net algorithm includes a post-processing step that selects the largest connected segmentation for each class. A Mask R-CNN-based vascular reconstruction pipeline was validated by performing a surface-to-surface distance comparison between US and CT reconstructions from the same patient.

Results

The average CA and IJV Dice scores produced by the Mask R-CNN across the evaluation data from all four sets were \(0.90\pm 0.08\) and \(0.88\pm 0.14\). The average Dice scores produced by the post-processed U-Net were \(0.81\pm 0.21\) and \(0.71\pm 0.23\), for the CA and IJV, respectively. The reconstruction algorithm utilizing the Mask R-CNN was capable of producing accurate 3D reconstructions with majority of US reconstruction surface points being within 2 mm of the CT equivalent.

Conclusions

On average, the Mask R-CNN produced more accurate vascular segmentations compared to U-Net. The Mask R-CNN models were used to produce 3D reconstructed vasculature with a similar accuracy to that of a manually segmented CT scan. This implementation of the Mask R-CNN network enables automatic analysis of the neck vasculature and facilitates 3D vascular reconstruction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abdulla W (2017) Mask R-CNN for object detection and instance segmentation on Keras and Tensorflow Abdulla W (2017) Mask R-CNN for object detection and instance segmentation on Keras and Tensorflow
2.
Zurück zum Zitat Ameri G, Baxter JSH, Bainbridge D, Peters TM, Chen ECS (2018) Mixed reality ultrasound guidance system: a case study in system development and a cautionary tale. Int J Comput Assist Radiol Surg 13(4):495–505CrossRefPubMed Ameri G, Baxter JSH, Bainbridge D, Peters TM, Chen ECS (2018) Mixed reality ultrasound guidance system: a case study in system development and a cautionary tale. Int J Comput Assist Radiol Surg 13(4):495–505CrossRefPubMed
3.
Zurück zum Zitat Besl PJ, McKay ND (1992) Method for registration of 3-d shapes. In: Sensor fusion IV: control paradigms and data structures, vol 1611. International Society for Optics and Photonics, pp 586–606 Besl PJ, McKay ND (1992) Method for registration of 3-d shapes. In: Sensor fusion IV: control paradigms and data structures, vol 1611. International Society for Optics and Photonics, pp 586–606
4.
Zurück zum Zitat Chao A, Lai CH, Chan KC, Yeh CC, Yeh HM, Fan SZ, Sun WZ (2014) Performance of central venous catheterization by medical students: a retrospective study of students’ logbooks. BMC Med Educ 14(1):168CrossRefPubMedPubMedCentral Chao A, Lai CH, Chan KC, Yeh CC, Yeh HM, Fan SZ, Sun WZ (2014) Performance of central venous catheterization by medical students: a retrospective study of students’ logbooks. BMC Med Educ 14(1):168CrossRefPubMedPubMedCentral
5.
Zurück zum Zitat Chen ECS, Peters TM, Ma B (2016) Guided ultrasound calibration: where, how, and how many calibration fiducials. Int J Comput Assist Radiol Surg 11(6):889–898CrossRefPubMed Chen ECS, Peters TM, Ma B (2016) Guided ultrasound calibration: where, how, and how many calibration fiducials. Int J Comput Assist Radiol Surg 11(6):889–898CrossRefPubMed
6.
Zurück zum Zitat Couteaux V, Si-Mohamed S, Nempont O, Lefevre T, Popoff A, Pizaine G, Villain N, Bloch I, Cotten A, Boussel L (2019) Automatic knee meniscus tear detection and orientation classification with Mask-RCNN. Diagn Interv Imaging 100(4):235–242CrossRefPubMed Couteaux V, Si-Mohamed S, Nempont O, Lefevre T, Popoff A, Pizaine G, Villain N, Bloch I, Cotten A, Boussel L (2019) Automatic knee meniscus tear detection and orientation classification with Mask-RCNN. Diagn Interv Imaging 100(4):235–242CrossRefPubMed
7.
Zurück zum Zitat Dai Z, Carver E, Liu C, Lee J, Feldman A, Zong W, Pantelic M, Elshaikh M, Wen N (2020) Segmentation of the prostatic gland and the intraprostatic lesions on multiparametic MRI using Mask R-CNN. Adv Radiat Oncol 5:473–481 Dai Z, Carver E, Liu C, Lee J, Feldman A, Zong W, Pantelic M, Elshaikh M, Wen N (2020) Segmentation of the prostatic gland and the intraprostatic lesions on multiparametic MRI using Mask R-CNN. Adv Radiat Oncol 5:473–481
8.
Zurück zum Zitat Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision 2015 (ICCV 2015), pp 1440–1448 Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision 2015 (ICCV 2015), pp 1440–1448
9.
Zurück zum Zitat Gordon AC, Saliken John C, Johns D, Owen Richardand Gray RR (1998) US-guided puncture of the internal jugular vein: complications and anatomic considerations. J Vasc Interv Radiol 9(2):333–338CrossRefPubMed Gordon AC, Saliken John C, Johns D, Owen Richardand Gray RR (1998) US-guided puncture of the internal jugular vein: complications and anatomic considerations. J Vasc Interv Radiol 9(2):333–338CrossRefPubMed
10.
Zurück zum Zitat Groves L, Li N, Peters TM, Chen ECS (2019) Towards a mixed-reality first person point of view needle navigation system. In: Essert C, Zhou S, Yap PT, Khan A, Shen D, Liu T, Peters TM, LH Staib (eds) Medical image computing and computer assisted intervention (MICCAI 2019). Springer, Berlin, pp 245–253 Groves L, Li N, Peters TM, Chen ECS (2019) Towards a mixed-reality first person point of view needle navigation system. In: Essert C, Zhou S, Yap PT, Khan A, Shen D, Liu T, Peters TM, LH Staib (eds) Medical image computing and computer assisted intervention (MICCAI 2019). Springer, Berlin, pp 245–253
11.
Zurück zum Zitat He K, Gkioxari G, Dollár P, Girshick R (2017) Mask R-CNN. In: 2017 IEEE international conference on computer vision (ICCV), pp 2980–2988 He K, Gkioxari G, Dollár P, Girshick R (2017) Mask R-CNN. In: 2017 IEEE international conference on computer vision (ICCV), pp 2980–2988
12.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778
13.
Zurück zum Zitat Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61(10):2527–2537CrossRefPubMedPubMedCentral Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61(10):2527–2537CrossRefPubMedPubMedCentral
14.
Zurück zum Zitat Liu J, Li P (2018) A Mask R-CNN model with improved region proposal network for medical ultrasound image. In: Huang DS, Jo KH, Zhang XL (eds) Intelligent computing theories and application. Springer, Berlin, pp 26–33CrossRef Liu J, Li P (2018) A Mask R-CNN model with improved region proposal network for medical ultrasound image. In: Huang DS, Jo KH, Zhang XL (eds) Intelligent computing theories and application. Springer, Berlin, pp 26–33CrossRef
15.
Zurück zum Zitat Lo A, Oehley M, Bartlett A, Adams D, Blyth P, Al-Ali S (2006) Anatomical variations of the common carotid artery bifurcation. ANZ J Surg 76(11):970–972CrossRefPubMed Lo A, Oehley M, Bartlett A, Adams D, Blyth P, Al-Ali S (2006) Anatomical variations of the common carotid artery bifurcation. ANZ J Surg 76(11):970–972CrossRefPubMed
16.
Zurück zum Zitat Merritt RL, Hachadorian ME, Michaels K, Zevallos E, Mhayamaguru KM, Closser Z, Derr C (2018) The effect of head rotation on the relative vascular anatomy of the neck: implications for central venous access. J Emerg Trauma Shock 11(3):193–196PubMedPubMedCentral Merritt RL, Hachadorian ME, Michaels K, Zevallos E, Mhayamaguru KM, Closser Z, Derr C (2018) The effect of head rotation on the relative vascular anatomy of the neck: implications for central venous access. J Emerg Trauma Shock 11(3):193–196PubMedPubMedCentral
17.
Zurück zum Zitat Niessen WJ, Bouma CJ, Vincken KL, Viergever MA (2000) Error metrics for quantitative evaluation of medical image segmentation. In: Klette R, Stiehl HS, Viergever MA, Vincken KL (eds) Performance characterization in computer vision. Springer, Berlin, pp 275–284 Niessen WJ, Bouma CJ, Vincken KL, Viergever MA (2000) Error metrics for quantitative evaluation of medical image segmentation. In: Klette R, Stiehl HS, Viergever MA, Vincken KL (eds) Performance characterization in computer vision. Springer, Berlin, pp 275–284
18.
Zurück zum Zitat Prechelt L (2012) Early stopping—but when? In: Neural networks: tricks of the trade, 2nd ed. Springer, Berlin, pp 53–67 Prechelt L (2012) Early stopping—but when? In: Neural networks: tricks of the trade, 2nd ed. Springer, Berlin, pp 53–67
19.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in neural information processing systems, Curran Associates, Inc., pp 91–99 Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in neural information processing systems, Curran Associates, Inc., pp 91–99
20.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 9351. Springer, Berlin, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 9351. Springer, Berlin, pp 234–241
21.
Zurück zum Zitat Saugel B, Scheeren TWL, Teboul JL (2017) Ultrasound-guided central venous catheter placement: a structured review and recommendations for clinical practice. Crit Care 21(1):225CrossRefPubMedPubMedCentral Saugel B, Scheeren TWL, Teboul JL (2017) Ultrasound-guided central venous catheter placement: a structured review and recommendations for clinical practice. Crit Care 21(1):225CrossRefPubMedPubMedCentral
22.
23.
Zurück zum Zitat Turba UC, Uflacker R, Hannegan C, Selby JB (2005) Anatomic relationship of the internaljugular vein and the common carotid artery applied to percutaneous transjugular procedures. CardioVasc Interv Radiol 28(3):303–306CrossRef Turba UC, Uflacker R, Hannegan C, Selby JB (2005) Anatomic relationship of the internaljugular vein and the common carotid artery applied to percutaneous transjugular procedures. CardioVasc Interv Radiol 28(3):303–306CrossRef
24.
Zurück zum Zitat Ukwatta E, Awad J, Buchanan D, Parraga G, Fenster A (2012) Three-dimensional semi-automated segmentation of carotid atherosclerosis from three-dimensional ultrasound images. In: Medical imaging 2012: computer-aided diagnosis, vol 8315, p 83150O. International Society for Optics and Photonics Ukwatta E, Awad J, Buchanan D, Parraga G, Fenster A (2012) Three-dimensional semi-automated segmentation of carotid atherosclerosis from three-dimensional ultrasound images. In: Medical imaging 2012: computer-aided diagnosis, vol 8315, p 83150O. International Society for Optics and Photonics
25.
Zurück zum Zitat Wang W, Liao X, Chen ECS, Moore J, Baxter JSH, Peters Terry M, Bainbridge D (2019) The effects of positioning on the volume/location of the internal jugular vein using 2-dimensional tracked ultrasound. J Cardiothor Vasc Anesth 34:920–925 Wang W, Liao X, Chen ECS, Moore J, Baxter JSH, Peters Terry M, Bainbridge D (2019) The effects of positioning on the volume/location of the internal jugular vein using 2-dimensional tracked ultrasound. J Cardiothor Vasc Anesth 34:920–925
27.
Zurück zum Zitat Xie M, Li Y, Xue Y, Shafritz R, Rahimi SA, Ady JW, Roshan UW (2019) Vessel lumen segmentation in internal carotid artery ultrasounds with deep convolutional neural networks. In: 2019 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 2393–2398 Xie M, Li Y, Xue Y, Shafritz R, Rahimi SA, Ady JW, Roshan UW (2019) Vessel lumen segmentation in internal carotid artery ultrasounds with deep convolutional neural networks. In: 2019 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 2393–2398
28.
Zurück zum Zitat Zhou R, Fenster A, Xia Y, Spence JD, Ding M (2019) Deep learning-based carotid media-adventitia and lumen-intima boundary segmentation from three-dimensional ultrasound images. Med Phys 46(7):mp.13581CrossRef Zhou R, Fenster A, Xia Y, Spence JD, Ding M (2019) Deep learning-based carotid media-adventitia and lumen-intima boundary segmentation from three-dimensional ultrasound images. Med Phys 46(7):mp.13581CrossRef
Metadaten
Titel
Automatic segmentation of the carotid artery and internal jugular vein from 2D ultrasound images for 3D vascular reconstruction
verfasst von
Leah A. Groves
Blake VanBerlo
Natan Veinberg
Abdulrahman Alboog
Terry M. Peters
Elvis C. S. Chen
Publikationsdatum
24.08.2020
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 11/2020
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-020-02248-2

Weitere Artikel der Ausgabe 11/2020

International Journal of Computer Assisted Radiology and Surgery 11/2020 Zur Ausgabe

Premium Partner