Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 4/2021

22-03-2021 | Original Article

Lightweight pyramid network with spatial attention mechanism for accurate retinal vessel segmentation

Authors: Tengfei Tan, Zhilun Wang, Hongwei Du, Jinzhang Xu, Bensheng Qiu

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 4/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

The morphological characteristics of retinal vessels are vital for the early diagnosis of pathological diseases such as diabetes and hypertension. However, the low contrast and complex morphology pose a challenge to automatic retinal vessel segmentation. To extract precise semantic features, more convolution and pooling operations are adopted, but some structural information is potentially ignored.

Methods

In the paper, we propose a novel lightweight pyramid network (LPN) fusing multi-scale features with spatial attention mechanism to preserve the structure information of retinal vessels. The pyramid hierarchy model is constructed to generate multi-scale representations, and its semantic features are strengthened with the introduction of the attention mechanism. The combination of multi-scale features contributes to its accurate prediction.

Results

The LPN is evaluated on benchmark datasets DRIVE, STARE and CHASE, and the results indicate its state-of-the-art performance (e.g., ACC of 97.09\(\%\)/97.49\(\%\)/97.48\(\%\), AUC of 98.79\(\%\)/99.01\(\%\)/98.91\(\%\) on the DRIVE, STARE and CHASE datasets, respectively). The robustness and generalization ability of the LPN are further proved in cross-training experiment.

Conclusion

The visualization experiment reveals the semantic gap between various scales of the pyramid and verifies the effectiveness of the attention mechanism, which provide a potential basis for the pyramid hierarchy model in multi-scale vessel segmentation task. Furthermore, the number of model parameters is greatly reduced.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wong TY, Klein R, Klein BE, Tielsch JM, Hubbard L, Nieto F (2001) Retinal microvascular abnormalities and their relationship with hypertension, cardiovascular disease, and mortality. Surv phthal 46(1):59–80CrossRef Wong TY, Klein R, Klein BE, Tielsch JM, Hubbard L, Nieto F (2001) Retinal microvascular abnormalities and their relationship with hypertension, cardiovascular disease, and mortality. Surv phthal 46(1):59–80CrossRef
2.
go back to reference Nguyen TT, Wong TY (2009) Retinal vascular changes and diabetic retinopathy. Current Diabet Rep 9(4):277–283CrossRef Nguyen TT, Wong TY (2009) Retinal vascular changes and diabetic retinopathy. Current Diabet Rep 9(4):277–283CrossRef
4.
go back to reference Martínez-Pérez ME, Hughes AD, Stanton AV, Thom SA, Bharath AA, Parker KH (1999) Retinal blood vessel segmentation by means of scale-space analysis and region growing. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI’99, pp 90–97 Martínez-Pérez ME, Hughes AD, Stanton AV, Thom SA, Bharath AA, Parker KH (1999) Retinal blood vessel segmentation by means of scale-space analysis and region growing. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI’99, pp 90–97
5.
go back to reference Al-Diri B, Hunter A, Steel D (2009) An active contour model for segmenting and measuring retinal vessels. IEEE Trans Med Imag 28(9):1488–1497CrossRef Al-Diri B, Hunter A, Steel D (2009) An active contour model for segmenting and measuring retinal vessels. IEEE Trans Med Imag 28(9):1488–1497CrossRef
6.
go back to reference Mendonca AM, Campilho A (2006) Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction. IEEE Trans Med Imag 25(9):1200–1213CrossRef Mendonca AM, Campilho A (2006) Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction. IEEE Trans Med Imag 25(9):1200–1213CrossRef
7.
go back to reference Lupascu CA, Tegolo D, Trucco E (2010) Fabc: Retinal vessel segmentation using adaboost. IEEE Trans Inf Technol Biomed 14(5):1267–1274PubMedCrossRef Lupascu CA, Tegolo D, Trucco E (2010) Fabc: Retinal vessel segmentation using adaboost. IEEE Trans Inf Technol Biomed 14(5):1267–1274PubMedCrossRef
8.
go back to reference Orlando JI, Blaschko M (2014) Learning fully-connected crfs for blood vessel segmentation in retinal images. Med Image Comput Comput Assist Intervent ICCAI 2014:634–641 Orlando JI, Blaschko M (2014) Learning fully-connected crfs for blood vessel segmentation in retinal images. Med Image Comput Comput Assist Intervent ICCAI 2014:634–641
9.
go back to reference Liskowski P, Krawiec K (2016) Segmenting retinal blood vessels with deep neural networks. IEEE Trans Med Imag 35(11):2369–2380CrossRef Liskowski P, Krawiec K (2016) Segmenting retinal blood vessels with deep neural networks. IEEE Trans Med Imag 35(11):2369–2380CrossRef
10.
go back to reference Li Q, Feng B, Xie L, Liang P, Zhang H, Wang T (2016) A cross-modality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imag 35(1):109–118CrossRef Li Q, Feng B, Xie L, Liang P, Zhang H, Wang T (2016) A cross-modality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imag 35(1):109–118CrossRef
11.
go back to reference Fu H, Xu Y, Lin S, Kee Wong DW, Liu J (2016) Deepvessel: Retinal vessel segmentation via deep learning and conditional random field. Med Image Comput Comput Assist Intervent ICCAI 2016:132–139 Fu H, Xu Y, Lin S, Kee Wong DW, Liu J (2016) Deepvessel: Retinal vessel segmentation via deep learning and conditional random field. Med Image Comput Comput Assist Intervent ICCAI 2016:132–139
12.
go back to reference Wu Y, Xia Y, Song Y, Zhang D, Liu D, Zhang C, Cai W (2019) Vessel-net: Retinal vessel segmentation under multi-path supervision. Med Image Comput Comput Assist Intervent ICCAI 2019:264–272 Wu Y, Xia Y, Song Y, Zhang D, Liu D, Zhang C, Cai W (2019) Vessel-net: Retinal vessel segmentation under multi-path supervision. Med Image Comput Comput Assist Intervent ICCAI 2019:264–272
13.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. Med Image Comput Comput Assist Intervent ICCAI 2015:234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. Med Image Comput Comput Assist Intervent ICCAI 2015:234–241
14.
go back to reference Zhang S, Fu H, Yan Y, Zhang Y, Wu Q, Yang M, Tan M, Xu Y (2019) Attention guided network for retinal image segmentation. Med Image Comput Comput Assist Intervent ICCAI 2019:797–805 Zhang S, Fu H, Yan Y, Zhang Y, Wu Q, Yang M, Tan M, Xu Y (2019) Attention guided network for retinal image segmentation. Med Image Comput Comput Assist Intervent ICCAI 2019:797–805
18.
go back to reference Wang W, Zhong J, Wu H, Wen Z, Qin J (2020) Rvseg-net: An efficient feature pyramid cascade network for retinal vessel segmentation. In: Medical Image Computing and Computer Assisted Intervention—MICCAI 2020 Wang W, Zhong J, Wu H, Wen Z, Qin J (2020) Rvseg-net: An efficient feature pyramid cascade network for retinal vessel segmentation. In: Medical Image Computing and Computer Assisted Intervention—MICCAI 2020
19.
go back to reference Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: Single shot multibox detector. ECCV 2016:21–37 Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: Single shot multibox detector. ECCV 2016:21–37
20.
go back to reference Lin T, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. CVPR 2017:936–944 Lin T, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. CVPR 2017:936–944
21.
go back to reference Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: CVPR 2017:2261–2269 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: CVPR 2017:2261–2269
22.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. CVPR 2016:770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. CVPR 2016:770–778
23.
go back to reference Staal J, Abramoff MD, Niemeijer M, Viergever MA, van Ginneken B (2004) Ridge-based vessel segmentation in color images of the retina. IEEE Trans Med Imag 23(4):501–509CrossRef Staal J, Abramoff MD, Niemeijer M, Viergever MA, van Ginneken B (2004) Ridge-based vessel segmentation in color images of the retina. IEEE Trans Med Imag 23(4):501–509CrossRef
24.
go back to reference Hoover AD, Kouznetsova V, Goldbaum M (2000) Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans Med Imag 19(3):203–210CrossRef Hoover AD, Kouznetsova V, Goldbaum M (2000) Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans Med Imag 19(3):203–210CrossRef
25.
go back to reference Owen CG, Rudnicka AR, Mullen R, Barman SA, Monekosso D, Whincup PH, Ng J, Paterson C (2009) Measuring retinal vessel tortuosity in 10-year-old children: validation of the computer-assisted image analysis of the retina (caiar) program. Invest Ophthal Visual Sci 50(5):2004–2010CrossRef Owen CG, Rudnicka AR, Mullen R, Barman SA, Monekosso D, Whincup PH, Ng J, Paterson C (2009) Measuring retinal vessel tortuosity in 10-year-old children: validation of the computer-assisted image analysis of the retina (caiar) program. Invest Ophthal Visual Sci 50(5):2004–2010CrossRef
26.
go back to reference Setiawan AW, Mengko TR, Santoso OS, Suksmono AB (2013) Color retinal image enhancement using clahe. In: International Conference on ICT for Smart Society, pp 1–3 Setiawan AW, Mengko TR, Santoso OS, Suksmono AB (2013) Color retinal image enhancement using clahe. In: International Conference on ICT for Smart Society, pp 1–3
27.
go back to reference Wu Y, Xia Y, Song Y, Zhang Y, Cai W (2018) Multiscale network followed network model for retinal vessel segmentation. Med Image Comput Comput Assist Intervent MICCAI 2018:119–126 Wu Y, Xia Y, Song Y, Zhang Y, Cai W (2018) Multiscale network followed network model for retinal vessel segmentation. Med Image Comput Comput Assist Intervent MICCAI 2018:119–126
28.
go back to reference Tharwat A (2020) Classification assessment methods. Appl Comput Inf Tharwat A (2020) Classification assessment methods. Appl Comput Inf
29.
go back to reference Yan Z, Yang X, Cheng K (2018) Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation. IEEE Trans Biomed Eng 65(9):1912–1923PubMedCrossRef Yan Z, Yang X, Cheng K (2018) Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation. IEEE Trans Biomed Eng 65(9):1912–1923PubMedCrossRef
30.
go back to reference Fraz MM, Remagnino P, Hoppe A, Uyyanonvara B, Rudnicka AR, Owen CG, Barman SA (2012) An ensemble classification-based approach applied to retinal blood vessel segmentation. IEEE Trans Biomed Eng 59(9):2538–2548PubMedCrossRef Fraz MM, Remagnino P, Hoppe A, Uyyanonvara B, Rudnicka AR, Owen CG, Barman SA (2012) An ensemble classification-based approach applied to retinal blood vessel segmentation. IEEE Trans Biomed Eng 59(9):2538–2548PubMedCrossRef
Metadata
Title
Lightweight pyramid network with spatial attention mechanism for accurate retinal vessel segmentation
Authors
Tengfei Tan
Zhilun Wang
Hongwei Du
Jinzhang Xu
Bensheng Qiu
Publication date
22-03-2021
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 4/2021
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-021-02344-x

Other articles of this Issue 4/2021

International Journal of Computer Assisted Radiology and Surgery 4/2021 Go to the issue

Premium Partner