Skip to main content

2021 | OriginalPaper | Buchkapitel

Data Augmentation for a Deep Learning Framework for Ventricular Septal Defect Ultrasound Image Classification

verfasst von : Shih-Hsin Chen, I-Hsin Tai, Yi-Hui Chen, Ken-Pen Weng, Kai-Sheng Hsieh

Erschienen in: Pattern Recognition. ICPR International Workshops and Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Congenital heart diseases (CHD) can be detected through ultrasound imaging. Although ultrasound can be used for immediate diagnosis, doctors require considerable time to read dynamic clips; typically, physicians must continuously examine disease data from beating heart images. Most importantly, this type of diagnosis relies heavily on the expertise and experience of the diagnosing physician. This study established an ultrasound image classification with deep learning algorithms to overcome the challenges involved in CHD diagnosis. We detected the most common CHD, namely the first, second, and fourth types of ventricular septal defect (VSD). We improved the performance levels of well-known deep learning algorithms (InceptionV3, ResNet, and DenseNet). Because algorithm optimization and overfitting problems can influence the performance of deep learning algorithms, we studied some optimizer algorithms and early-stopping strategies. To enhance the solution quality, we used data augmentation methods for solving this classification problem. The selected approach was further compared with Google AutoML, which applies structure search for quality prediction. Our results revealed that the proposed deep learning algorithm was able to recognize most types of VSD. However, one type of VSD remains unconquered and warrants more advanced techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Avendi, M., Kheradvar, A., Jafarkhani, H.: A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac mri. Med. Image Anal. 30, 108–119 (2016)CrossRef Avendi, M., Kheradvar, A., Jafarkhani, H.: A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac mri. Med. Image Anal. 30, 108–119 (2016)CrossRef
2.
Zurück zum Zitat Bridge, C.P., Ioannou, C., Noble, J.A.: Automated annotation and quantitative description of ultrasound videos of the fetal heart. Med. Image Anal. 36, 147–161 (2017)CrossRef Bridge, C.P., Ioannou, C., Noble, J.A.: Automated annotation and quantitative description of ultrasound videos of the fetal heart. Med. Image Anal. 36, 147–161 (2017)CrossRef
3.
Zurück zum Zitat Carneiro, G., Nascimento, J.C.: Combining multiple dynamic models and deep learning architectures for tracking the left ventricle endocardium in ultrasound data. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2592–2607 (2013)CrossRef Carneiro, G., Nascimento, J.C.: Combining multiple dynamic models and deep learning architectures for tracking the left ventricle endocardium in ultrasound data. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2592–2607 (2013)CrossRef
4.
Zurück zum Zitat Carneiro, G., Nascimento, J.C., Freitas, A.: The segmentation of the left ventricle of the heart from ultrasound data using deep learning architectures and derivative-based search methods. IEEE Trans. Image Process. 21(3), 968–982 (2012)MathSciNetCrossRef Carneiro, G., Nascimento, J.C., Freitas, A.: The segmentation of the left ventricle of the heart from ultrasound data using deep learning architectures and derivative-based search methods. IEEE Trans. Image Process. 21(3), 968–982 (2012)MathSciNetCrossRef
5.
Zurück zum Zitat Carvalho, J., et al.: Isuog practice guidelines (updated): sonographic screening examination of the fetal heart. Ultrasound Obstet. Gynecol. 41(3), 348–359 (2013)CrossRef Carvalho, J., et al.: Isuog practice guidelines (updated): sonographic screening examination of the fetal heart. Ultrasound Obstet. Gynecol. 41(3), 348–359 (2013)CrossRef
6.
Zurück zum Zitat Chen, H., Zheng, Y., Park, J.-H., Heng, P.-A., Zhou, S.K.: Iterative multi-domain regularized deep learning for anatomical structure detection and segmentation from ultrasound images. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 487–495. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_56CrossRef Chen, H., Zheng, Y., Park, J.-H., Heng, P.-A., Zhou, S.K.: Iterative multi-domain regularized deep learning for anatomical structure detection and segmentation from ultrasound images. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 487–495. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-46723-8_​56CrossRef
7.
Zurück zum Zitat Gao, H., Liu, Z., van der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017) Gao, H., Liu, Z., van der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
8.
Zurück zum Zitat Ghesu, F.C., et al.: Marginal space deep learning: efficient architecture for volumetric image parsing. IEEE Trans. Med. Imag. 35(5), 1217–1228 (2016)CrossRef Ghesu, F.C., et al.: Marginal space deep learning: efficient architecture for volumetric image parsing. IEEE Trans. Med. Imag. 35(5), 1217–1228 (2016)CrossRef
9.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034 (2015) He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034 (2015)
10.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
11.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, vol. 25, pp. 1097–1105. Curran Associates, Inc. (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, vol. 25, pp. 1097–1105. Curran Associates, Inc. (2012)
12.
Zurück zum Zitat LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)CrossRef LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)CrossRef
13.
Zurück zum Zitat Moradi, M., Guo, Y., Gur, Y., Negahdar, M., Syeda-Mahmood, T.: A cross-modality neural network transform for semi-automatic medical image annotation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 300–307. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_35CrossRef Moradi, M., Guo, Y., Gur, Y., Negahdar, M., Syeda-Mahmood, T.: A cross-modality neural network transform for semi-automatic medical image annotation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 300–307. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-46723-8_​35CrossRef
14.
Zurück zum Zitat Nascimento, J.C., Carneiro, G.: Multi-atlas segmentation using manifold learning with deep belief networks. In: 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), pp. 867–871 IEEE (2016) Nascimento, J.C., Carneiro, G.: Multi-atlas segmentation using manifold learning with deep belief networks. In: 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), pp. 867–871 IEEE (2016)
15.
Zurück zum Zitat Pézard, P., et al.: Influence of ultrasonographers training on prenatal diagnosis of congenital heart diseases: a 12-year population-based study. Prenat Diagn. 28(11), 1016–1022 (2008)CrossRef Pézard, P., et al.: Influence of ultrasonographers training on prenatal diagnosis of congenital heart diseases: a 12-year population-based study. Prenat Diagn. 28(11), 1016–1022 (2008)CrossRef
16.
Zurück zum Zitat Poudel, R.P.K., Lamata, P., Montana, G.: Recurrent fully convolutional neural networks for multi-slice MRI cardiac segmentation. In: Zuluaga, M.A., Bhatia, K., Kainz, B., Moghari, M.H., Pace, D.F. (eds.) RAMBO/HVSMR -2016. LNCS, vol. 10129, pp. 83–94. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-52280-7_8CrossRef Poudel, R.P.K., Lamata, P., Montana, G.: Recurrent fully convolutional neural networks for multi-slice MRI cardiac segmentation. In: Zuluaga, M.A., Bhatia, K., Kainz, B., Moghari, M.H., Pace, D.F. (eds.) RAMBO/HVSMR -2016. LNCS, vol. 10129, pp. 83–94. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-52280-7_​8CrossRef
17.
Zurück zum Zitat Sundaresan, V., Bridge, C.P., Ioannou, C., Noble, J.A.: Automated characterization of the fetal heart in ultrasound images using fully convolutional neural networks. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 671–674. IEEE (2017) Sundaresan, V., Bridge, C.P., Ioannou, C., Noble, J.A.: Automated characterization of the fetal heart in ultrasound images using fully convolutional neural networks. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 671–674. IEEE (2017)
18.
Zurück zum Zitat Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015) Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
19.
Zurück zum Zitat Wu, M.H., Chen, H.C., Lu, C.W., Wang, J.K., Huang, S.C., Huang, S.K.: Prevalence of congenital heart disease at live birth in Taiwan. J. Pediatrics 156(5), 782–785 (2010)CrossRef Wu, M.H., Chen, H.C., Lu, C.W., Wang, J.K., Huang, S.C., Huang, S.K.: Prevalence of congenital heart disease at live birth in Taiwan. J. Pediatrics 156(5), 782–785 (2010)CrossRef
20.
Zurück zum Zitat Yeh, S.J., et al.: National database study of survival of pediatric congenital heart disease patients in Taiwan. J. Formos. Med. Assoc. 114(2), 159–163 (2015)CrossRef Yeh, S.J., et al.: National database study of survival of pediatric congenital heart disease patients in Taiwan. J. Formos. Med. Assoc. 114(2), 159–163 (2015)CrossRef
Metadaten
Titel
Data Augmentation for a Deep Learning Framework for Ventricular Septal Defect Ultrasound Image Classification
verfasst von
Shih-Hsin Chen
I-Hsin Tai
Yi-Hui Chen
Ken-Pen Weng
Kai-Sheng Hsieh
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-68799-1_22

Premium Partner