Skip to main content
Top
Published in: Medical & Biological Engineering & Computing 3/2024

30-11-2023 | Original Article

SCAN: sequence-based context-aware association network for hepatic vessel segmentation

Authors: Yinghong Zhou, Yu Zheng, Yinfeng Tian, Youfang Bai, Nian Cai, Ping Wang

Published in: Medical & Biological Engineering & Computing | Issue 3/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Accurate segmentation of hepatic vessel is significant for the surgeons to design the preoperative planning of liver surgery. In this paper, a sequence-based context-aware association network (SCAN) is designed for hepatic vessel segmentation, in which three schemes are incorporated to simultaneously extract the 2D features of hepatic vessels and capture the correlations between adjacent CT slices. The two schemes of slice-level attention module and graph association module are designed to bridge feature gaps between the encoder and the decoder in the low- and high-dimensional spaces. The region-edge constrained loss is designed to well optimize the proposed SCAN, which integrates cross-entropy loss, dice loss, and edge-constrained loss. Experimental results indicate that the proposed SCAN is superior to several existing deep learning frameworks, in terms of 0.845 DSC, 0.856 precision, 0.866 sensitivity, and 0.861 F1-score.

Graphical Abstract

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Anwanwan D, Singh SK, Singh S et al (2020) Challenges in liver cancer and possible treatment approaches [J]. Biochimica et Biophysica Acta (BBA)-Reviews on Cancer 1873(1):188314 Anwanwan D, Singh SK, Singh S et al (2020) Challenges in liver cancer and possible treatment approaches [J]. Biochimica et Biophysica Acta (BBA)-Reviews on Cancer 1873(1):188314
2.
go back to reference Schumann C, Bieberstein J, Braunewell S et al (2012) Visualization support for the planning of hepatic needle placement [J]. Int J Comput-Assist Radiol Surg 7(2):191–197CrossRefPubMed Schumann C, Bieberstein J, Braunewell S et al (2012) Visualization support for the planning of hepatic needle placement [J]. Int J Comput-Assist Radiol Surg 7(2):191–197CrossRefPubMed
3.
go back to reference Selle D, Preim B, Schenk A et al (2002) Analysis of vasculature for liver surgical planning [J]. IEEE Trans Med Imaging 21(11):1344–1357CrossRefPubMed Selle D, Preim B, Schenk A et al (2002) Analysis of vasculature for liver surgical planning [J]. IEEE Trans Med Imaging 21(11):1344–1357CrossRefPubMed
4.
go back to reference Lafortune M, Madore F, Patriquin H et al (1991) Segmental anatomy of the liver: a sonographic approach to the Couinaud nomenclature [J]. Radiology 181(2):443–448CrossRefPubMed Lafortune M, Madore F, Patriquin H et al (1991) Segmental anatomy of the liver: a sonographic approach to the Couinaud nomenclature [J]. Radiology 181(2):443–448CrossRefPubMed
5.
go back to reference Sboarina A, Foroni RI, Minicozzi A et al (2010) Software for hepatic vessel classification: feasibility study for virtual surgery [J]. Int J Comput Assist Radiol Surg 5(1):39–48CrossRefPubMed Sboarina A, Foroni RI, Minicozzi A et al (2010) Software for hepatic vessel classification: feasibility study for virtual surgery [J]. Int J Comput Assist Radiol Surg 5(1):39–48CrossRefPubMed
6.
go back to reference Lebre MA, Vacavant A, Grand-Brochier M et al (2019) Automatic segmentation methods for liver and hepatic vessels from CT and MRI volumes, applied to the Couinaud scheme [J]. Comput Biol Med 110:42–51CrossRefPubMed Lebre MA, Vacavant A, Grand-Brochier M et al (2019) Automatic segmentation methods for liver and hepatic vessels from CT and MRI volumes, applied to the Couinaud scheme [J]. Comput Biol Med 110:42–51CrossRefPubMed
7.
go back to reference Zhang L, Zhang Y (2016) Big data analysis by infinite deep neural networks [J]. J Comput Res Dev 53(1):68–79 Zhang L, Zhang Y (2016) Big data analysis by infinite deep neural networks [J]. J Comput Res Dev 53(1):68–79
9.
go back to reference Sun X, Fang H, Yang Y et al (2021) Robust retinal vessel segmentation from a data augmentation perspective [C]//International Workshop on Ophthalmic Medical Image Analysis. Springer, Cham, pp 189–198 Sun X, Fang H, Yang Y et al (2021) Robust retinal vessel segmentation from a data augmentation perspective [C]//International Workshop on Ophthalmic Medical Image Analysis. Springer, Cham, pp 189–198
10.
go back to reference Bano S, Vasconcelos F, Shepherd LM et al (2020) Deep placental vessel segmentation for fetoscopic mosaicking [C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham 763–773 Bano S, Vasconcelos F, Shepherd LM et al (2020) Deep placental vessel segmentation for fetoscopic mosaicking [C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham 763–773
11.
go back to reference Zhou S, Li N, Zhang B et al (2019) Statistical intensity-and shape-modeling to automate cerebrovascular segmentation from TOF-MRA data. International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, pp 164–172 Zhou S, Li N, Zhang B et al (2019) Statistical intensity-and shape-modeling to automate cerebrovascular segmentation from TOF-MRA data. International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, pp 164–172
12.
go back to reference Zhao G, Liang K, Pan C, Zhang F, Wu X, Hu X, Yu Y (2022) Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation. IEEE Trans Med Imaging 42(1):183–195CrossRefPubMed Zhao G, Liang K, Pan C, Zhang F, Wu X, Hu X, Yu Y (2022) Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation. IEEE Trans Med Imaging 42(1):183–195CrossRefPubMed
13.
go back to reference Affane A, Lebre MA, Mittal U et al (2020) Literature review of deep learning models for liver vessels reconstruction [C]//2020 Tenth International Conference on Image Processing Theory, Tools and Applications (IPTA). IEEE 1–6 Affane A, Lebre MA, Mittal U et al (2020) Literature review of deep learning models for liver vessels reconstruction [C]//2020 Tenth International Conference on Image Processing Theory, Tools and Applications (IPTA). IEEE 1–6
14.
go back to reference Frericks BB, Caldarone FC, Nashan B et al (2004) 3D CT modeling of hepatic vessel architecture and volume calculation in living donated liver transplantation [J]. Eur Radiol 14(2):326–333CrossRefPubMed Frericks BB, Caldarone FC, Nashan B et al (2004) 3D CT modeling of hepatic vessel architecture and volume calculation in living donated liver transplantation [J]. Eur Radiol 14(2):326–333CrossRefPubMed
15.
go back to reference Lu S, Huang H, Liang P et al (2017) Hepatic vessel segmentation using variational level set combined with non-local robust statistics [J]. Magn Reson Imaging 36:180–186CrossRefPubMed Lu S, Huang H, Liang P et al (2017) Hepatic vessel segmentation using variational level set combined with non-local robust statistics [J]. Magn Reson Imaging 36:180–186CrossRefPubMed
16.
go back to reference Kitrungrotsakul T, Han XH, Iwamoto Y et al (2019) VesselNet: a deep convolutional neural network with multi pathways for robust hepatic vessel segmentation [J]. Comput Med Imaging Graph 75:74–83CrossRefPubMed Kitrungrotsakul T, Han XH, Iwamoto Y et al (2019) VesselNet: a deep convolutional neural network with multi pathways for robust hepatic vessel segmentation [J]. Comput Med Imaging Graph 75:74–83CrossRefPubMed
17.
go back to reference Huang Q, Sun J, Ding H et al (2018) Robust liver vessel extraction using 3D U-Net with variant dice loss function [J]. Comput Biol Med 101:153–162CrossRefPubMed Huang Q, Sun J, Ding H et al (2018) Robust liver vessel extraction using 3D U-Net with variant dice loss function [J]. Comput Biol Med 101:153–162CrossRefPubMed
18.
go back to reference Yan Q, Wang B, Zhang W et al (2021) Attention-guided deep neural network with multi-scale feature fusion for liver vessel segmentation [J]. IEEE J Biomed Health Inform 25(7):2629–2642CrossRefPubMed Yan Q, Wang B, Zhang W et al (2021) Attention-guided deep neural network with multi-scale feature fusion for liver vessel segmentation [J]. IEEE J Biomed Health Inform 25(7):2629–2642CrossRefPubMed
19.
go back to reference Zhang D, Liu S, Chaganti S et al (2020) Graph attention network based pruning for reconstructing 3D liver vessel morphology from contrasted CT images [J]. arXiv preprint arXiv:2003.07999 Zhang D, Liu S, Chaganti S et al (2020) Graph attention network based pruning for reconstructing 3D liver vessel morphology from contrasted CT images [J]. arXiv preprint arXiv:2003.07999
21.
go back to reference Wu M, Qian Y, Liao X et al (2021) Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention [J]. arXiv preprint arXiv:2111.03368 Wu M, Qian Y, Liao X et al (2021) Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention [J]. arXiv preprint arXiv:2111.03368
22.
go back to reference Isensee F, Jäger PF, Kohl SAA et al (2019) Automated design of deep learning methods for biomedical image segmentation [J]. arXiv preprint arXiv:1904.08128 Isensee F, Jäger PF, Kohl SAA et al (2019) Automated design of deep learning methods for biomedical image segmentation [J]. arXiv preprint arXiv:1904.08128
23.
go back to reference Yi-de M, Qing L, Zhi-Bai Q (2004) Automated image segmentation using improved PCNN model based on cross-entropy [C]//Proceedings of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004. IEEE 743–746 Yi-de M, Qing L, Zhi-Bai Q (2004) Automated image segmentation using improved PCNN model based on cross-entropy [C]//Proceedings of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004. IEEE 743–746
24.
go back to reference Milletari F, Navab N, Ahmadi SA (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation [C]//2016 Fourth International Conference on 3D Vision (3DV). IEEE 565–571 Milletari F, Navab N, Ahmadi SA (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation [C]//2016 Fourth International Conference on 3D Vision (3DV). IEEE 565–571
25.
go back to reference Karimi D, Salcudean SE (2019) Reducing the Hausdorff distance in medical image segmentation with convolutional neural networks [J]. IEEE Trans Med Imaging 39(2):499–513CrossRefPubMed Karimi D, Salcudean SE (2019) Reducing the Hausdorff distance in medical image segmentation with convolutional neural networks [J]. IEEE Trans Med Imaging 39(2):499–513CrossRefPubMed
26.
go back to reference Scarselli F, Gori M, Ah Chung Tsoi, Hagenbuchner M, Monfardini G (2009) The graph neural network model. IEEE TNNLS 20(1):61–80 Scarselli F, Gori M, Ah Chung Tsoi, Hagenbuchner M, Monfardini G (2009) The graph neural network model. IEEE TNNLS 20(1):61–80
27.
go back to reference Rockafellar RT, Wets RJB (2009). Variational analysis, vol 317. Springer Science & Business Media Rockafellar RT, Wets RJB (2009). Variational analysis, vol 317. Springer Science & Business Media
28.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation [C]//International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, Cham 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation [C]//International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, Cham 234–241
29.
go back to reference Oktay O, Schlemper J, Folgoc LL et al (2018) Attention U-Net: learning where to look for the pancreas [J]. arXiv preprint arXiv:1804.03999 Oktay O, Schlemper J, Folgoc LL et al (2018) Attention U-Net: learning where to look for the pancreas [J]. arXiv preprint arXiv:1804.03999
30.
go back to reference Woo S, Park J, Lee JY et al (2018) CBAM: convolutional block attention module [C]//Proceedings of the European conference on computer vision (ECCV). 3–19 Woo S, Park J, Lee JY et al (2018) CBAM: convolutional block attention module [C]//Proceedings of the European conference on computer vision (ECCV). 3–19
31.
go back to reference Park J, Woo S, Lee JY et al (2018) BAM: bottleneck attention module [J]. arKiv preprint arKiv :1807.06514 Park J, Woo S, Lee JY et al (2018) BAM: bottleneck attention module [J]. arKiv preprint arKiv :1807.06514
32.
go back to reference Beck D, Haffari G, Cohn T (2018) Graph-to-sequence learning using gated graph neural networks. arXiv preprint arXiv:1806.09835 Beck D, Haffari G, Cohn T (2018) Graph-to-sequence learning using gated graph neural networks. arXiv preprint arXiv:1806.09835
33.
go back to reference Ballas N, Yao L, Pal C, Courville A (2015) Delving deeper into convolutional networks for learning video representations. arXiv preprint arXiv:1511.06432 Ballas N, Yao L, Pal C, Courville A (2015) Delving deeper into convolutional networks for learning video representations. arXiv preprint arXiv:1511.06432
34.
go back to reference Su J, Liu Z, Zhang J et al (2021) DV-Net: accurate liver vessel segmentation via dense connection model with D-BCE loss function [J]. Knowl-Based Syst 232:107471CrossRef Su J, Liu Z, Zhang J et al (2021) DV-Net: accurate liver vessel segmentation via dense connection model with D-BCE loss function [J]. Knowl-Based Syst 232:107471CrossRef
35.
go back to reference Yushkevich P A, Gao Y, Gerig G (2016) ITK-SNAP: an interactive tool for semi-automatic segmentation of multi-modality biomedical images [C]//2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE 3342–3345 Yushkevich P A, Gao Y, Gerig G (2016) ITK-SNAP: an interactive tool for semi-automatic segmentation of multi-modality biomedical images [C]//2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE 3342–3345
36.
go back to reference Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Chintala S (2019) Pytorch: An imperative style, high-performance deep learning library. Adv Neural Inf Process Syst 32 Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Chintala S (2019) Pytorch: An imperative style, high-performance deep learning library. Adv Neural Inf Process Syst 32
37.
go back to reference Çiçek Ö, Abdulkadir A, Lienkamp SS et al (2016) 3D U-Net: learning dense volumetric segmentation from sparse annotation [C]//International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, Cham 424–432 Çiçek Ö, Abdulkadir A, Lienkamp SS et al (2016) 3D U-Net: learning dense volumetric segmentation from sparse annotation [C]//International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, Cham 424–432
38.
go back to reference Cao H, Wang Y, Chen J et al (2021) Swin-unet: Unet-like pure transformer for medical image segmentation [J]. arXiv preprint arXiv:2105.05537 Cao H, Wang Y, Chen J et al (2021) Swin-unet: Unet-like pure transformer for medical image segmentation [J]. arXiv preprint arXiv:2105.05537
Metadata
Title
SCAN: sequence-based context-aware association network for hepatic vessel segmentation
Authors
Yinghong Zhou
Yu Zheng
Yinfeng Tian
Youfang Bai
Nian Cai
Ping Wang
Publication date
30-11-2023
Publisher
Springer Berlin Heidelberg
Published in
Medical & Biological Engineering & Computing / Issue 3/2024
Print ISSN: 0140-0118
Electronic ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-023-02975-z

Other articles of this Issue 3/2024

Medical & Biological Engineering & Computing 3/2024 Go to the issue

Premium Partner