Skip to main content
Top
Published in: The Journal of Supercomputing 1/2023

02-07-2022

Ejection Fraction estimation using deep semantic segmentation neural network

Authors: Md. Golam Rabiul Alam, Abde Musavvir Khan, Myesha Farid Shejuty, Syed Ibna Zubayear, Md. Nafis Shariar, Meteb Altaf, Mohammad Mehedi Hassan, Salman A. AlQahtani, Ahmed Alsanad

Published in: The Journal of Supercomputing | Issue 1/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The Ejection Fraction value denotes how much blood is pumped out of the heart to different parts of the body. It is a routine clinical procedure in heart function assessment, where the left ventricle of the heart has to be manually outlined by doctors in clinical settings to measure the Ejection Fraction value which is time-consuming and highly varies by the observer. Most of the state-of-the-art automated Ejection Fraction estimation methods applied statistical or neural network models to generic and expensive clinical procedures like 3D ultrasound, MRI, and CT imaging. However, 2D echocardiography is a specialized diagnosis method that is inexpensive and routinely used in clinical settings to diagnose heart diseases. This paper proposed an automated Ejection Fraction estimation system from 2D echocardiography images using deep semantic segmentation neural networks. Two parallel pipelines of deep semantic segmentation neural network models have been proposed for efficient left ventricle (LV) segmentation in its systolic (contracted) and diastolic (expanded) states. The three different semantic segmentation neural networks, namely UNet, ResUNet, and Deep ResUNet, have been implemented in those parallel pipelines, and the performance of the proposed model has been studied on a standard 2D echocardiography data set. The most accurate model among the three achieved a Dice score of 82.1% and 86.5% in LV segmentation on end systole and end diastole states, respectively. The Ejection Fraction value is then determined by applying the volume measurement formula to the output of the left ventricle segmentation network. Therefore, the proposed automated Ejection Fraction system can be used in clinical settings to remove the eyeball estimation practice and reduce the inter-observer variability problem.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ahmed WS (2020) The impact of filter size and number of filters on classification accuracy in CNN. In 2020 International Conference on Computer Science and Software Engineering (CSASE), pp. 88–93. IEEE Ahmed WS (2020) The impact of filter size and number of filters on classification accuracy in CNN. In 2020 International Conference on Computer Science and Software Engineering (CSASE), pp. 88–93. IEEE
2.
go back to reference Md Alam GR, Abedin SF, Al Ameen M, Hong CS (2016) Web of objects based ambient assisted living framework for emergency psychiatric state prediction. Sensors 16(9):1431CrossRef Md Alam GR, Abedin SF, Al Ameen M, Hong CS (2016) Web of objects based ambient assisted living framework for emergency psychiatric state prediction. Sensors 16(9):1431CrossRef
3.
go back to reference Md Alam GR, Abedin SF, Il Moon S, Talukder A, Hong CS (2019) Healthcare IoT-based affective state mining using a deep convolutional neural network. IEEE Access 7:75189–75202CrossRef Md Alam GR, Abedin SF, Il Moon S, Talukder A, Hong CS (2019) Healthcare IoT-based affective state mining using a deep convolutional neural network. IEEE Access 7:75189–75202CrossRef
5.
go back to reference Barry-Straume J, Tschannen A, Engels DW, Fine E (2018) An evaluation of training size impact on validation accuracy for optimized convolutional neural networks. SMU Data Sci Rev 1(4):12 Barry-Straume J, Tschannen A, Engels DW, Fine E (2018) An evaluation of training size impact on validation accuracy for optimized convolutional neural networks. SMU Data Sci Rev 1(4):12
7.
go back to reference Bernard O, Bosch JG, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea O, Bernier M et al (2015) Standardized evaluation system for left ventricular segmentation algorithms in 3d echocardiography. IEEE Trans Med Imag 35(4):967–977CrossRef Bernard O, Bosch JG, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea O, Bernier M et al (2015) Standardized evaluation system for left ventricular segmentation algorithms in 3d echocardiography. IEEE Trans Med Imag 35(4):967–977CrossRef
8.
go back to reference Bernard O, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea OC, Galli E, Geleijnse M et al. (2014) Challenge on endocardial three-dimensional ultrasound segmentation (cetus). In: Proceedings MICCAI Challenge on Echocardiographic Three-Dimensional Ultrasound Segmentation (CETUS), pp 1–8 Bernard O, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea OC, Galli E, Geleijnse M et al. (2014) Challenge on endocardial three-dimensional ultrasound segmentation (cetus). In: Proceedings MICCAI Challenge on Echocardiographic Three-Dimensional Ultrasound Segmentation (CETUS), pp 1–8
9.
go back to reference Birsan T, Tiba D (2005) One hundred years since the introduction of the set distance by dimitrie pompeiu. In: IFIP Conference on System Modeling and Optimization. Springer, pp 35–39 Birsan T, Tiba D (2005) One hundred years since the introduction of the set distance by dimitrie pompeiu. In: IFIP Conference on System Modeling and Optimization. Springer, pp 35–39
10.
go back to reference Burçak KC, Baykan ÖK, Uğuz H (2021) A new deep convolutional neural network model for classifying breast cancer histopathological images and the hyperparameter optimisation of the proposed model. J Supercomput 77(1):973–989 Burçak KC, Baykan ÖK, Uğuz H (2021) A new deep convolutional neural network model for classifying breast cancer histopathological images and the hyperparameter optimisation of the proposed model. J Supercomput 77(1):973–989
12.
go back to reference Carneiro G, Nascimento J, Freitas A (2012) The segmentation of the left ventricle of the heart from ultrasound data using deep learning architectures and derivative-based search methods. IEEE Trans Image Process 21:968–982MathSciNetCrossRefMATH Carneiro G, Nascimento J, Freitas A (2012) The segmentation of the left ventricle of the heart from ultrasound data using deep learning architectures and derivative-based search methods. IEEE Trans Image Process 21:968–982MathSciNetCrossRefMATH
13.
go back to reference Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef
14.
go back to reference Chu Z, Tian T, Feng R, Wang L (2019) Sea-land segmentation with res-unet and fully connected crf. In: IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium, pp. 3840–3843. IEEE Chu Z, Tian T, Feng R, Wang L (2019) Sea-land segmentation with res-unet and fully connected crf. In: IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium, pp. 3840–3843. IEEE
15.
go back to reference Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3d u-net: learning dense volumetric segmentation from sparse annotation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, pp 424–432 Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3d u-net: learning dense volumetric segmentation from sparse annotation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, pp 424–432
16.
go back to reference Diakogiannis FI, Waldner F, Caccetta P, Wu C (2020) Resunet-a: a deep learning framework for semantic segmentation of remotely sensed data. ISPRS J Photogramm Remote Sens 162:94–114CrossRef Diakogiannis FI, Waldner F, Caccetta P, Wu C (2020) Resunet-a: a deep learning framework for semantic segmentation of remotely sensed data. ISPRS J Photogramm Remote Sens 162:94–114CrossRef
18.
go back to reference Drozdzal M, Vorontsov E, Chartrand G, Kadoury S, Pal C (2016) The importance of skip connections in biomedical image segmentation. In: Deep learning and data labeling for medical applications. Springer, pp 179–187 Drozdzal M, Vorontsov E, Chartrand G, Kadoury S, Pal C (2016) The importance of skip connections in biomedical image segmentation. In: Deep learning and data labeling for medical applications. Springer, pp 179–187
19.
go back to reference Eelbode T, Bertels J, Berman M, Vandermeulen D, Maes F, Bisschops R, Blaschko MB (2020) Optimization for medical image segmentation: theory and practice when evaluating with dice score or jaccard index. IEEE Trans Med Imag 39(11):3679–3690CrossRef Eelbode T, Bertels J, Berman M, Vandermeulen D, Maes F, Bisschops R, Blaschko MB (2020) Optimization for medical image segmentation: theory and practice when evaluating with dice score or jaccard index. IEEE Trans Med Imag 39(11):3679–3690CrossRef
20.
go back to reference Garcia-Garcia A, Orts-Escolano S, Oprea S, Villena-Martinez V, Garcia-Rodriguez J (2017) A review on deep learning techniques applied to semantic segmentation. arXiv:1704.06857 Garcia-Garcia A, Orts-Escolano S, Oprea S, Villena-Martinez V, Garcia-Rodriguez J (2017) A review on deep learning techniques applied to semantic segmentation. arXiv:​1704.​06857
21.
go back to reference He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE Conference on Computer vVision and Pattern Recognition, pp 5353–5360 He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE Conference on Computer vVision and Pattern Recognition, pp 5353–5360
22.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778
24.
go back to reference Jiang M, Spence JD, Chiu B (2020) Segmentation of 3d ultrasound carotid vessel wall using u-net and segmentation average network. In: 2020 42nd annual international conference of the IEEE engineering in medicine & biology society (EMBC). IEEE, pp 2043–2046 Jiang M, Spence JD, Chiu B (2020) Segmentation of 3d ultrasound carotid vessel wall using u-net and segmentation average network. In: 2020 42nd annual international conference of the IEEE engineering in medicine & biology society (EMBC). IEEE, pp 2043–2046
25.
go back to reference Jifara W, Jiang F, Rho S, Cheng M, Liu S (2019) Medical image denoising using convolutional neural network: a residual learning approach. J Supercomput 75(2):704–718CrossRef Jifara W, Jiang F, Rho S, Cheng M, Liu S (2019) Medical image denoising using convolutional neural network: a residual learning approach. J Supercomput 75(2):704–718CrossRef
26.
go back to reference Jo J, Jeong S, Kang P (2020) Benchmarking gpu-accelerated edge devices. In: 2020 IEEE international conference on big data and smart computing (BigComp), pp 117–120. IEEE Jo J, Jeong S, Kang P (2020) Benchmarking gpu-accelerated edge devices. In: 2020 IEEE international conference on big data and smart computing (BigComp), pp 117–120. IEEE
27.
go back to reference Kadry S, Rajinikanth V, Taniar D, Damaševičius R, Valencia XPB (2021) Automated segmentation of leukocyte from hematological images-a study using various cnn schemes. J Supercomput, pp 1–21 Kadry S, Rajinikanth V, Taniar D, Damaševičius R, Valencia XPB (2021) Automated segmentation of leukocyte from hematological images-a study using various cnn schemes. J Supercomput, pp 1–21
28.
go back to reference Kosaraju A, Goyal A, Grigorova Y, Makaryus AN (2020) Left ventricular ejection fraction.[updated 2020 may 5]. StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing Kosaraju A, Goyal A, Grigorova Y, Makaryus AN (2020) Left ventricular ejection fraction.[updated 2020 may 5]. StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing
29.
go back to reference Krishnaswamy D, Hareendranathan AR, Suwatanaviroj T, Becher H, Noga M, Punithakumar K (2018) A semi-automated method for measurement of left ventricular volumes in 3d echocardiography. IEEE Access 6:16336–16344CrossRef Krishnaswamy D, Hareendranathan AR, Suwatanaviroj T, Becher H, Noga M, Punithakumar K (2018) A semi-automated method for measurement of left ventricular volumes in 3d echocardiography. IEEE Access 6:16336–16344CrossRef
30.
go back to reference Lan Y, Zhang X (2020) Real-time ultrasound image despeckling using mixed-attention mechanism based residual unet. IEEE Access 8:195327–195340CrossRef Lan Y, Zhang X (2020) Real-time ultrasound image despeckling using mixed-attention mechanism based residual unet. IEEE Access 8:195327–195340CrossRef
31.
go back to reference Lebenberg J, Buvat I, Lalande A, Clarysse P, Casta C, Cochet A, Constantinidés C, Cousty J, De Cesare A, Jehan-Besson S et al (2012) Nonsupervised ranking of different segmentation approaches: application to the estimation of the left ventricular ejection fraction from cardiac cine mri sequences. IEEE Trans Med Imag 31(8):1651–1660CrossRef Lebenberg J, Buvat I, Lalande A, Clarysse P, Casta C, Cochet A, Constantinidés C, Cousty J, De Cesare A, Jehan-Besson S et al (2012) Nonsupervised ranking of different segmentation approaches: application to the estimation of the left ventricular ejection fraction from cardiac cine mri sequences. IEEE Trans Med Imag 31(8):1651–1660CrossRef
32.
go back to reference Liu Y-H, Sandoval V, Sinusas AJ (2013) Potential impact of hybrid czt spect/ct imaging on estimation accuracy of left ventricular volumes and ejection fraction: a phantom study. In: 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (2013 NSS/MIC), pp 1–5. IEEE Liu Y-H, Sandoval V, Sinusas AJ (2013) Potential impact of hybrid czt spect/ct imaging on estimation accuracy of left ventricular volumes and ejection fraction: a phantom study. In: 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (2013 NSS/MIC), pp 1–5. IEEE
33.
go back to reference Oktay O, Ferrante E, Kamnitsas K, Heinrich M, Bai W, Caballero J, Cook SA, De Marvao A, Dawes T, O’Regan DP et al (2017) Anatomically constrained neural networks (acnns): application to cardiac image enhancement and segmentation. IEEE Trans Med Imag 37(2):384–395CrossRef Oktay O, Ferrante E, Kamnitsas K, Heinrich M, Bai W, Caballero J, Cook SA, De Marvao A, Dawes T, O’Regan DP et al (2017) Anatomically constrained neural networks (acnns): application to cardiac image enhancement and segmentation. IEEE Trans Med Imag 37(2):384–395CrossRef
34.
go back to reference Pombo JF, Troy BL, Russell ROJR (1971) Left ventricular volumes and ejection fraction by echocardiography. Circulation 43(4):480–490CrossRef Pombo JF, Troy BL, Russell ROJR (1971) Left ventricular volumes and ejection fraction by echocardiography. Circulation 43(4):480–490CrossRef
35.
go back to reference Ray V, Goyal A (2015) Image based sub-second fast fully automatic complete cardiac cycle left ventricle segmentation in multi frame cardiac mri images using pixel clustering and labelling. In: 2015 Eighth International Conference on Contemporary Computing (IC3), pp 248–252. IEEE Ray V, Goyal A (2015) Image based sub-second fast fully automatic complete cardiac cycle left ventricle segmentation in multi frame cardiac mri images using pixel clustering and labelling. In: 2015 Eighth International Conference on Contemporary Computing (IC3), pp 248–252. IEEE
36.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, pp 234–241
37.
go back to reference Rucklidge WJ (1997) Efficiently locating objects using the hausdorff distance. Int J Comput Vis 24(3):251–270CrossRef Rucklidge WJ (1997) Efficiently locating objects using the hausdorff distance. Int J Comput Vis 24(3):251–270CrossRef
38.
go back to reference Shen Y, Zhang H, Fan Y, Lee AP, Xu L (2021) Smart health of ultrasound telemedicine based on deeply represented semantic segmentation. IEEE Internet Things J 8(23):16770–16778CrossRef Shen Y, Zhang H, Fan Y, Lee AP, Xu L (2021) Smart health of ultrasound telemedicine based on deeply represented semantic segmentation. IEEE Internet Things J 8(23):16770–16778CrossRef
39.
go back to reference Shi S, Wang Q, Xu P, Chu X (2016) Benchmarking state-of-the-art deep learning software tools. In: 2016 7th International Conference on Cloud Computing and Big Data (CCBD). IEEE, pp 99–104 Shi S, Wang Q, Xu P, Chu X (2016) Benchmarking state-of-the-art deep learning software tools. In: 2016 7th International Conference on Cloud Computing and Big Data (CCBD). IEEE, pp 99–104
40.
go back to reference Smistad E, Østvik A et al. (2017) 2d left ventricle segmentation using deep learning. In: 2017 IEEE International Ultrasonics Symposium (IUS), pp 1–4. IEEE Smistad E, Østvik A et al. (2017) 2d left ventricle segmentation using deep learning. In: 2017 IEEE International Ultrasonics Symposium (IUS), pp 1–4. IEEE
41.
go back to reference Smistad E, Østvik A, Salte IM, Melichova D, Nguyen TM, Haugaa K, Brunvand H, Edvardsen T, Leclerc S, Bernard O et al (2020) Real-time automatic ejection fraction and foreshortening detection using deep learning. IEEE Trans Ultrasonics Ferroelectr Freq Control 67(12):2595–2604CrossRef Smistad E, Østvik A, Salte IM, Melichova D, Nguyen TM, Haugaa K, Brunvand H, Edvardsen T, Leclerc S, Bernard O et al (2020) Real-time automatic ejection fraction and foreshortening detection using deep learning. IEEE Trans Ultrasonics Ferroelectr Freq Control 67(12):2595–2604CrossRef
42.
go back to reference Uchida S, Ide S, Iwana BK, Zhu A (2016) A further step to perfect accuracy by training cnn with larger data. In: 2016 15th international conference on frontiers in handwriting recognition (ICFHR). IEEE, pp 405–410 Uchida S, Ide S, Iwana BK, Zhu A (2016) A further step to perfect accuracy by training cnn with larger data. In: 2016 15th international conference on frontiers in handwriting recognition (ICFHR). IEEE, pp 405–410
43.
go back to reference Wang J, Lv P, Wang H, Shi C (2021) Sar-u-net: squeeze-and-excitation block and atrous spatial pyramid pooling based residual u-net for automatic liver ct segmentation. arXiv:2103.06419 Wang J, Lv P, Wang H, Shi C (2021) Sar-u-net: squeeze-and-excitation block and atrous spatial pyramid pooling based residual u-net for automatic liver ct segmentation. arXiv:​2103.​06419
44.
Metadata
Title
Ejection Fraction estimation using deep semantic segmentation neural network
Authors
Md. Golam Rabiul Alam
Abde Musavvir Khan
Myesha Farid Shejuty
Syed Ibna Zubayear
Md. Nafis Shariar
Meteb Altaf
Mohammad Mehedi Hassan
Salman A. AlQahtani
Ahmed Alsanad
Publication date
02-07-2022
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 1/2023
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-022-04642-w

Other articles of this Issue 1/2023

The Journal of Supercomputing 1/2023 Go to the issue

Premium Partner