Skip to main content
Top

2018 | OriginalPaper | Chapter

Combining Deep Learning and Shape Priors for Bi-Ventricular Segmentation of Volumetric Cardiac Magnetic Resonance Images

Authors : Jinming Duan, Jo Schlemper, Wenjia Bai, Timothy J. W. Dawes, Ghalib Bello, Carlo Biffi, Georgia Doumou, Antonio De Marvao, Declan P. O’Regan, Daniel Rueckert

Published in: Shape in Medical Imaging

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we combine a network-based method with image registration to develop a shape-based bi-ventricular segmentation tool for short-axis cardiac magnetic resonance (CMR) volumetric images. The method first employs a fully convolutional network (FCN) to learn the segmentation task from manually labelled ground truth CMR volumes. However, due to the presence of image artefacts in the training dataset, the resulting FCN segmentation results are often imperfect. As such, we propose a second step to refine the FCN segmentation. This step involves performing a non-rigid registration with multiple high-resolution bi-ventricular atlases, allowing the explicit shape priors to be inferred. We validate the proposed approach on 1831 healthy subjects and 200 subjects with pulmonary hypertension. Numerical experiments on the two datasets demonstrate that our approach is capable of producing accurate, high-resolution and anatomically smooth bi-ventricular models, despite the artefacts in the input CMR volumes.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ripley, D., Musa, T., Dobson, L., Plein, S., Greenwood, J.: Cardiovascular magnetic resonance imaging: what the general cardiologist should know. Heart (2016). Heartjnl-2015 Ripley, D., Musa, T., Dobson, L., Plein, S., Greenwood, J.: Cardiovascular magnetic resonance imaging: what the general cardiologist should know. Heart (2016). Heartjnl-2015
2.
go back to reference Bai, W., Shi, W., Ledig, C., Rueckert, D.: Multi-atlas segmentation with augmented features for cardiac MR images. Med. Image Anal. 19(1), 98–109 (2015)CrossRef Bai, W., Shi, W., Ledig, C., Rueckert, D.: Multi-atlas segmentation with augmented features for cardiac MR images. Med. Image Anal. 19(1), 98–109 (2015)CrossRef
3.
4.
go back to reference Ngo, T., Lu, Z., Carneiro, G.: Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance. Med. Image Anal. 35, 159–171 (2017)CrossRef Ngo, T., Lu, Z., Carneiro, G.: Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance. Med. Image Anal. 35, 159–171 (2017)CrossRef
5.
go back to reference Patravali, J., Jain, S., Chilamkurthy, S.: 2D–3D fully convolutional neural networks for cardiac MR segmentation. arXiv:1707.09813 (2017) Patravali, J., Jain, S., Chilamkurthy, S.: 2D–3D fully convolutional neural networks for cardiac MR segmentation. arXiv:​1707.​09813 (2017)
6.
go back to reference Baumgartner, C., Koch, L., Pollefeys, M., Konukoglu, E.: An exploration of 2D and 3D deep learning techniques for cardiac MR image segmentation. arXiv:1709.04496 (2017) Baumgartner, C., Koch, L., Pollefeys, M., Konukoglu, E.: An exploration of 2D and 3D deep learning techniques for cardiac MR image segmentation. arXiv:​1709.​04496 (2017)
7.
go back to reference Isensee, F., Jaeger, P., Full, P., Wolf, I., Engelhardt, S., Maier-Hein, K.: Automatic cardiac disease assessment on cine-MRI via time-series segmentation and domain specific features. arXiv:1707.00587 (2017) Isensee, F., Jaeger, P., Full, P., Wolf, I., Engelhardt, S., Maier-Hein, K.: Automatic cardiac disease assessment on cine-MRI via time-series segmentation and domain specific features. arXiv:​1707.​00587 (2017)
8.
go back to reference Zheng, Q., Delingette, H., Duchateau, N., Ayache, N.: 3D consistent & robust segmentation of cardiac images by deep learning with spatial propagation. IEEE Trans. Med. Imaging (2018) Zheng, Q., Delingette, H., Duchateau, N., Ayache, N.: 3D consistent & robust segmentation of cardiac images by deep learning with spatial propagation. IEEE Trans. Med. Imaging (2018)
11.
go back to reference Duan, J., et al.: Deep nested level sets: fully automated segmentation of cardiac MR images in patients with pulmonary hypertension. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11073, pp. 595–603. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00937-3_68CrossRef Duan, J., et al.: Deep nested level sets: fully automated segmentation of cardiac MR images in patients with pulmonary hypertension. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11073, pp. 595–603. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-030-00937-3_​68CrossRef
12.
go back to reference Petersen, S., et al.: UK biobank’s cardiovascular magnetic resonance protocol. J. Cardiovasc. Magn. Reson 18(1), 8 (2015)CrossRef Petersen, S., et al.: UK biobank’s cardiovascular magnetic resonance protocol. J. Cardiovasc. Magn. Reson 18(1), 8 (2015)CrossRef
14.
go back to reference Rueckert, D., Sonoda, L., Hayes, C., Hill, D., Leach, M., Hawkes, D.: Nonrigid registration using free-form deformations: application to breast MR images. IEEE Trans. Med. Imaging 18(8), 712–721 (1999)CrossRef Rueckert, D., Sonoda, L., Hayes, C., Hill, D., Leach, M., Hawkes, D.: Nonrigid registration using free-form deformations: application to breast MR images. IEEE Trans. Med. Imaging 18(8), 712–721 (1999)CrossRef
15.
go back to reference Frangi, A., Rueckert, D., Schnabel, J., Niessen, W.: Automatic construction of multiple-object three-dimensional statistical shape models: application to cardiac modeling. IEEE Trans. Med. Imaging 21(9), 1151–1166 (2002)CrossRef Frangi, A., Rueckert, D., Schnabel, J., Niessen, W.: Automatic construction of multiple-object three-dimensional statistical shape models: application to cardiac modeling. IEEE Trans. Med. Imaging 21(9), 1151–1166 (2002)CrossRef
16.
go back to reference De Marvao, A., et al.: Population-based studies of myocardial hypertrophy: high resolution cardiovascular magnetic resonance atlases improve statistical power. J. Cardiovasc. Magn. Reson 16(1), 16 (2014)CrossRef De Marvao, A., et al.: Population-based studies of myocardial hypertrophy: high resolution cardiovascular magnetic resonance atlases improve statistical power. J. Cardiovasc. Magn. Reson 16(1), 16 (2014)CrossRef
Metadata
Title
Combining Deep Learning and Shape Priors for Bi-Ventricular Segmentation of Volumetric Cardiac Magnetic Resonance Images
Authors
Jinming Duan
Jo Schlemper
Wenjia Bai
Timothy J. W. Dawes
Ghalib Bello
Carlo Biffi
Georgia Doumou
Antonio De Marvao
Declan P. O’Regan
Daniel Rueckert
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-04747-4_24

Premium Partner