Skip to main content
Erschienen in: The Journal of Supercomputing 1/2023

02.07.2022

Ejection Fraction estimation using deep semantic segmentation neural network

verfasst von: Md. Golam Rabiul Alam, Abde Musavvir Khan, Myesha Farid Shejuty, Syed Ibna Zubayear, Md. Nafis Shariar, Meteb Altaf, Mohammad Mehedi Hassan, Salman A. AlQahtani, Ahmed Alsanad

Erschienen in: The Journal of Supercomputing | Ausgabe 1/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The Ejection Fraction value denotes how much blood is pumped out of the heart to different parts of the body. It is a routine clinical procedure in heart function assessment, where the left ventricle of the heart has to be manually outlined by doctors in clinical settings to measure the Ejection Fraction value which is time-consuming and highly varies by the observer. Most of the state-of-the-art automated Ejection Fraction estimation methods applied statistical or neural network models to generic and expensive clinical procedures like 3D ultrasound, MRI, and CT imaging. However, 2D echocardiography is a specialized diagnosis method that is inexpensive and routinely used in clinical settings to diagnose heart diseases. This paper proposed an automated Ejection Fraction estimation system from 2D echocardiography images using deep semantic segmentation neural networks. Two parallel pipelines of deep semantic segmentation neural network models have been proposed for efficient left ventricle (LV) segmentation in its systolic (contracted) and diastolic (expanded) states. The three different semantic segmentation neural networks, namely UNet, ResUNet, and Deep ResUNet, have been implemented in those parallel pipelines, and the performance of the proposed model has been studied on a standard 2D echocardiography data set. The most accurate model among the three achieved a Dice score of 82.1% and 86.5% in LV segmentation on end systole and end diastole states, respectively. The Ejection Fraction value is then determined by applying the volume measurement formula to the output of the left ventricle segmentation network. Therefore, the proposed automated Ejection Fraction system can be used in clinical settings to remove the eyeball estimation practice and reduce the inter-observer variability problem.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ahmed WS (2020) The impact of filter size and number of filters on classification accuracy in CNN. In 2020 International Conference on Computer Science and Software Engineering (CSASE), pp. 88–93. IEEE Ahmed WS (2020) The impact of filter size and number of filters on classification accuracy in CNN. In 2020 International Conference on Computer Science and Software Engineering (CSASE), pp. 88–93. IEEE
2.
Zurück zum Zitat Md Alam GR, Abedin SF, Al Ameen M, Hong CS (2016) Web of objects based ambient assisted living framework for emergency psychiatric state prediction. Sensors 16(9):1431CrossRef Md Alam GR, Abedin SF, Al Ameen M, Hong CS (2016) Web of objects based ambient assisted living framework for emergency psychiatric state prediction. Sensors 16(9):1431CrossRef
3.
Zurück zum Zitat Md Alam GR, Abedin SF, Il Moon S, Talukder A, Hong CS (2019) Healthcare IoT-based affective state mining using a deep convolutional neural network. IEEE Access 7:75189–75202CrossRef Md Alam GR, Abedin SF, Il Moon S, Talukder A, Hong CS (2019) Healthcare IoT-based affective state mining using a deep convolutional neural network. IEEE Access 7:75189–75202CrossRef
5.
Zurück zum Zitat Barry-Straume J, Tschannen A, Engels DW, Fine E (2018) An evaluation of training size impact on validation accuracy for optimized convolutional neural networks. SMU Data Sci Rev 1(4):12 Barry-Straume J, Tschannen A, Engels DW, Fine E (2018) An evaluation of training size impact on validation accuracy for optimized convolutional neural networks. SMU Data Sci Rev 1(4):12
6.
7.
Zurück zum Zitat Bernard O, Bosch JG, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea O, Bernier M et al (2015) Standardized evaluation system for left ventricular segmentation algorithms in 3d echocardiography. IEEE Trans Med Imag 35(4):967–977CrossRef Bernard O, Bosch JG, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea O, Bernier M et al (2015) Standardized evaluation system for left ventricular segmentation algorithms in 3d echocardiography. IEEE Trans Med Imag 35(4):967–977CrossRef
8.
Zurück zum Zitat Bernard O, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea OC, Galli E, Geleijnse M et al. (2014) Challenge on endocardial three-dimensional ultrasound segmentation (cetus). In: Proceedings MICCAI Challenge on Echocardiographic Three-Dimensional Ultrasound Segmentation (CETUS), pp 1–8 Bernard O, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea OC, Galli E, Geleijnse M et al. (2014) Challenge on endocardial three-dimensional ultrasound segmentation (cetus). In: Proceedings MICCAI Challenge on Echocardiographic Three-Dimensional Ultrasound Segmentation (CETUS), pp 1–8
9.
Zurück zum Zitat Birsan T, Tiba D (2005) One hundred years since the introduction of the set distance by dimitrie pompeiu. In: IFIP Conference on System Modeling and Optimization. Springer, pp 35–39 Birsan T, Tiba D (2005) One hundred years since the introduction of the set distance by dimitrie pompeiu. In: IFIP Conference on System Modeling and Optimization. Springer, pp 35–39
10.
Zurück zum Zitat Burçak KC, Baykan ÖK, Uğuz H (2021) A new deep convolutional neural network model for classifying breast cancer histopathological images and the hyperparameter optimisation of the proposed model. J Supercomput 77(1):973–989 Burçak KC, Baykan ÖK, Uğuz H (2021) A new deep convolutional neural network model for classifying breast cancer histopathological images and the hyperparameter optimisation of the proposed model. J Supercomput 77(1):973–989
12.
Zurück zum Zitat Carneiro G, Nascimento J, Freitas A (2012) The segmentation of the left ventricle of the heart from ultrasound data using deep learning architectures and derivative-based search methods. IEEE Trans Image Process 21:968–982MathSciNetCrossRefMATH Carneiro G, Nascimento J, Freitas A (2012) The segmentation of the left ventricle of the heart from ultrasound data using deep learning architectures and derivative-based search methods. IEEE Trans Image Process 21:968–982MathSciNetCrossRefMATH
13.
Zurück zum Zitat Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef
14.
Zurück zum Zitat Chu Z, Tian T, Feng R, Wang L (2019) Sea-land segmentation with res-unet and fully connected crf. In: IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium, pp. 3840–3843. IEEE Chu Z, Tian T, Feng R, Wang L (2019) Sea-land segmentation with res-unet and fully connected crf. In: IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium, pp. 3840–3843. IEEE
15.
Zurück zum Zitat Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3d u-net: learning dense volumetric segmentation from sparse annotation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, pp 424–432 Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3d u-net: learning dense volumetric segmentation from sparse annotation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, pp 424–432
16.
Zurück zum Zitat Diakogiannis FI, Waldner F, Caccetta P, Wu C (2020) Resunet-a: a deep learning framework for semantic segmentation of remotely sensed data. ISPRS J Photogramm Remote Sens 162:94–114CrossRef Diakogiannis FI, Waldner F, Caccetta P, Wu C (2020) Resunet-a: a deep learning framework for semantic segmentation of remotely sensed data. ISPRS J Photogramm Remote Sens 162:94–114CrossRef
18.
Zurück zum Zitat Drozdzal M, Vorontsov E, Chartrand G, Kadoury S, Pal C (2016) The importance of skip connections in biomedical image segmentation. In: Deep learning and data labeling for medical applications. Springer, pp 179–187 Drozdzal M, Vorontsov E, Chartrand G, Kadoury S, Pal C (2016) The importance of skip connections in biomedical image segmentation. In: Deep learning and data labeling for medical applications. Springer, pp 179–187
19.
Zurück zum Zitat Eelbode T, Bertels J, Berman M, Vandermeulen D, Maes F, Bisschops R, Blaschko MB (2020) Optimization for medical image segmentation: theory and practice when evaluating with dice score or jaccard index. IEEE Trans Med Imag 39(11):3679–3690CrossRef Eelbode T, Bertels J, Berman M, Vandermeulen D, Maes F, Bisschops R, Blaschko MB (2020) Optimization for medical image segmentation: theory and practice when evaluating with dice score or jaccard index. IEEE Trans Med Imag 39(11):3679–3690CrossRef
20.
Zurück zum Zitat Garcia-Garcia A, Orts-Escolano S, Oprea S, Villena-Martinez V, Garcia-Rodriguez J (2017) A review on deep learning techniques applied to semantic segmentation. arXiv:1704.06857 Garcia-Garcia A, Orts-Escolano S, Oprea S, Villena-Martinez V, Garcia-Rodriguez J (2017) A review on deep learning techniques applied to semantic segmentation. arXiv:​1704.​06857
21.
Zurück zum Zitat He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE Conference on Computer vVision and Pattern Recognition, pp 5353–5360 He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE Conference on Computer vVision and Pattern Recognition, pp 5353–5360
22.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778
24.
Zurück zum Zitat Jiang M, Spence JD, Chiu B (2020) Segmentation of 3d ultrasound carotid vessel wall using u-net and segmentation average network. In: 2020 42nd annual international conference of the IEEE engineering in medicine & biology society (EMBC). IEEE, pp 2043–2046 Jiang M, Spence JD, Chiu B (2020) Segmentation of 3d ultrasound carotid vessel wall using u-net and segmentation average network. In: 2020 42nd annual international conference of the IEEE engineering in medicine & biology society (EMBC). IEEE, pp 2043–2046
25.
Zurück zum Zitat Jifara W, Jiang F, Rho S, Cheng M, Liu S (2019) Medical image denoising using convolutional neural network: a residual learning approach. J Supercomput 75(2):704–718CrossRef Jifara W, Jiang F, Rho S, Cheng M, Liu S (2019) Medical image denoising using convolutional neural network: a residual learning approach. J Supercomput 75(2):704–718CrossRef
26.
Zurück zum Zitat Jo J, Jeong S, Kang P (2020) Benchmarking gpu-accelerated edge devices. In: 2020 IEEE international conference on big data and smart computing (BigComp), pp 117–120. IEEE Jo J, Jeong S, Kang P (2020) Benchmarking gpu-accelerated edge devices. In: 2020 IEEE international conference on big data and smart computing (BigComp), pp 117–120. IEEE
27.
Zurück zum Zitat Kadry S, Rajinikanth V, Taniar D, Damaševičius R, Valencia XPB (2021) Automated segmentation of leukocyte from hematological images-a study using various cnn schemes. J Supercomput, pp 1–21 Kadry S, Rajinikanth V, Taniar D, Damaševičius R, Valencia XPB (2021) Automated segmentation of leukocyte from hematological images-a study using various cnn schemes. J Supercomput, pp 1–21
28.
Zurück zum Zitat Kosaraju A, Goyal A, Grigorova Y, Makaryus AN (2020) Left ventricular ejection fraction.[updated 2020 may 5]. StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing Kosaraju A, Goyal A, Grigorova Y, Makaryus AN (2020) Left ventricular ejection fraction.[updated 2020 may 5]. StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing
29.
Zurück zum Zitat Krishnaswamy D, Hareendranathan AR, Suwatanaviroj T, Becher H, Noga M, Punithakumar K (2018) A semi-automated method for measurement of left ventricular volumes in 3d echocardiography. IEEE Access 6:16336–16344CrossRef Krishnaswamy D, Hareendranathan AR, Suwatanaviroj T, Becher H, Noga M, Punithakumar K (2018) A semi-automated method for measurement of left ventricular volumes in 3d echocardiography. IEEE Access 6:16336–16344CrossRef
30.
Zurück zum Zitat Lan Y, Zhang X (2020) Real-time ultrasound image despeckling using mixed-attention mechanism based residual unet. IEEE Access 8:195327–195340CrossRef Lan Y, Zhang X (2020) Real-time ultrasound image despeckling using mixed-attention mechanism based residual unet. IEEE Access 8:195327–195340CrossRef
31.
Zurück zum Zitat Lebenberg J, Buvat I, Lalande A, Clarysse P, Casta C, Cochet A, Constantinidés C, Cousty J, De Cesare A, Jehan-Besson S et al (2012) Nonsupervised ranking of different segmentation approaches: application to the estimation of the left ventricular ejection fraction from cardiac cine mri sequences. IEEE Trans Med Imag 31(8):1651–1660CrossRef Lebenberg J, Buvat I, Lalande A, Clarysse P, Casta C, Cochet A, Constantinidés C, Cousty J, De Cesare A, Jehan-Besson S et al (2012) Nonsupervised ranking of different segmentation approaches: application to the estimation of the left ventricular ejection fraction from cardiac cine mri sequences. IEEE Trans Med Imag 31(8):1651–1660CrossRef
32.
Zurück zum Zitat Liu Y-H, Sandoval V, Sinusas AJ (2013) Potential impact of hybrid czt spect/ct imaging on estimation accuracy of left ventricular volumes and ejection fraction: a phantom study. In: 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (2013 NSS/MIC), pp 1–5. IEEE Liu Y-H, Sandoval V, Sinusas AJ (2013) Potential impact of hybrid czt spect/ct imaging on estimation accuracy of left ventricular volumes and ejection fraction: a phantom study. In: 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (2013 NSS/MIC), pp 1–5. IEEE
33.
Zurück zum Zitat Oktay O, Ferrante E, Kamnitsas K, Heinrich M, Bai W, Caballero J, Cook SA, De Marvao A, Dawes T, O’Regan DP et al (2017) Anatomically constrained neural networks (acnns): application to cardiac image enhancement and segmentation. IEEE Trans Med Imag 37(2):384–395CrossRef Oktay O, Ferrante E, Kamnitsas K, Heinrich M, Bai W, Caballero J, Cook SA, De Marvao A, Dawes T, O’Regan DP et al (2017) Anatomically constrained neural networks (acnns): application to cardiac image enhancement and segmentation. IEEE Trans Med Imag 37(2):384–395CrossRef
34.
Zurück zum Zitat Pombo JF, Troy BL, Russell ROJR (1971) Left ventricular volumes and ejection fraction by echocardiography. Circulation 43(4):480–490CrossRef Pombo JF, Troy BL, Russell ROJR (1971) Left ventricular volumes and ejection fraction by echocardiography. Circulation 43(4):480–490CrossRef
35.
Zurück zum Zitat Ray V, Goyal A (2015) Image based sub-second fast fully automatic complete cardiac cycle left ventricle segmentation in multi frame cardiac mri images using pixel clustering and labelling. In: 2015 Eighth International Conference on Contemporary Computing (IC3), pp 248–252. IEEE Ray V, Goyal A (2015) Image based sub-second fast fully automatic complete cardiac cycle left ventricle segmentation in multi frame cardiac mri images using pixel clustering and labelling. In: 2015 Eighth International Conference on Contemporary Computing (IC3), pp 248–252. IEEE
36.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, pp 234–241
37.
Zurück zum Zitat Rucklidge WJ (1997) Efficiently locating objects using the hausdorff distance. Int J Comput Vis 24(3):251–270CrossRef Rucklidge WJ (1997) Efficiently locating objects using the hausdorff distance. Int J Comput Vis 24(3):251–270CrossRef
38.
Zurück zum Zitat Shen Y, Zhang H, Fan Y, Lee AP, Xu L (2021) Smart health of ultrasound telemedicine based on deeply represented semantic segmentation. IEEE Internet Things J 8(23):16770–16778CrossRef Shen Y, Zhang H, Fan Y, Lee AP, Xu L (2021) Smart health of ultrasound telemedicine based on deeply represented semantic segmentation. IEEE Internet Things J 8(23):16770–16778CrossRef
39.
Zurück zum Zitat Shi S, Wang Q, Xu P, Chu X (2016) Benchmarking state-of-the-art deep learning software tools. In: 2016 7th International Conference on Cloud Computing and Big Data (CCBD). IEEE, pp 99–104 Shi S, Wang Q, Xu P, Chu X (2016) Benchmarking state-of-the-art deep learning software tools. In: 2016 7th International Conference on Cloud Computing and Big Data (CCBD). IEEE, pp 99–104
40.
Zurück zum Zitat Smistad E, Østvik A et al. (2017) 2d left ventricle segmentation using deep learning. In: 2017 IEEE International Ultrasonics Symposium (IUS), pp 1–4. IEEE Smistad E, Østvik A et al. (2017) 2d left ventricle segmentation using deep learning. In: 2017 IEEE International Ultrasonics Symposium (IUS), pp 1–4. IEEE
41.
Zurück zum Zitat Smistad E, Østvik A, Salte IM, Melichova D, Nguyen TM, Haugaa K, Brunvand H, Edvardsen T, Leclerc S, Bernard O et al (2020) Real-time automatic ejection fraction and foreshortening detection using deep learning. IEEE Trans Ultrasonics Ferroelectr Freq Control 67(12):2595–2604CrossRef Smistad E, Østvik A, Salte IM, Melichova D, Nguyen TM, Haugaa K, Brunvand H, Edvardsen T, Leclerc S, Bernard O et al (2020) Real-time automatic ejection fraction and foreshortening detection using deep learning. IEEE Trans Ultrasonics Ferroelectr Freq Control 67(12):2595–2604CrossRef
42.
Zurück zum Zitat Uchida S, Ide S, Iwana BK, Zhu A (2016) A further step to perfect accuracy by training cnn with larger data. In: 2016 15th international conference on frontiers in handwriting recognition (ICFHR). IEEE, pp 405–410 Uchida S, Ide S, Iwana BK, Zhu A (2016) A further step to perfect accuracy by training cnn with larger data. In: 2016 15th international conference on frontiers in handwriting recognition (ICFHR). IEEE, pp 405–410
43.
Zurück zum Zitat Wang J, Lv P, Wang H, Shi C (2021) Sar-u-net: squeeze-and-excitation block and atrous spatial pyramid pooling based residual u-net for automatic liver ct segmentation. arXiv:2103.06419 Wang J, Lv P, Wang H, Shi C (2021) Sar-u-net: squeeze-and-excitation block and atrous spatial pyramid pooling based residual u-net for automatic liver ct segmentation. arXiv:​2103.​06419
44.
Zurück zum Zitat Zhang Y, Mehta S, Caspi A (2021) Rethinking semantic segmentation evaluation for explainability and model selection. arXiv:2101.08418 Zhang Y, Mehta S, Caspi A (2021) Rethinking semantic segmentation evaluation for explainability and model selection. arXiv:​2101.​08418
Metadaten
Titel
Ejection Fraction estimation using deep semantic segmentation neural network
verfasst von
Md. Golam Rabiul Alam
Abde Musavvir Khan
Myesha Farid Shejuty
Syed Ibna Zubayear
Md. Nafis Shariar
Meteb Altaf
Mohammad Mehedi Hassan
Salman A. AlQahtani
Ahmed Alsanad
Publikationsdatum
02.07.2022
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 1/2023
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-022-04642-w

Weitere Artikel der Ausgabe 1/2023

The Journal of Supercomputing 1/2023 Zur Ausgabe

Premium Partner