Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 4/2020

26.02.2020 | Original Article

Segmentation and visualization of left atrium through a unified deep learning framework

verfasst von: Xiuquan Du, Susu Yin, Renjun Tang, Yueguo Liu, Yuhui Song, Yanping Zhang, Heng Liu, Shuo Li

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Left atrium segmentation and visualization serve as a fundamental and crucial role in clinical analysis and understanding of atrial fibrillation. However, most of the existing methods are directly transmitting information, which may cause redundant information to be passed to affect segmentation performance. Moreover, they did not further consider atrial visualization after segmentation, which leads to a lack of understanding of the essential atrial anatomy.

Methods

We propose a novel unified deep learning framework for left atrium segmentation and visualization simultaneously. At first, a novel dual-path module is used to enhance the expressiveness of cardiac image representation. Then a multi-scale context-aware module is designed to effectively handle complex appearance and shape variations of the left atrium and associated pulmonary veins. The generated multi-scale features are feed to gated bidirectional message passing module to remove irrelevant information and extract discriminative features. Finally, the features after message passing are efficiently combined via a deep supervision mechanism to produce the final segmentation result and reconstruct 3D volumes.

Results

Our approach primarily against the 2018 left atrium segmentation challenge dataset, which consists of 100 3D gadolinium-enhanced magnetic resonance images. Our method achieves an average dice of 0.936 in segmenting the left atrium via fivefold cross-validation, which outperforms state-of-the-art methods.

Conclusions

The performance demonstrates the effectiveness and advantages of our network for the left atrium segmentation and visualization. Therefore, our proposed network could potentially improve the clinical diagnosis and treatment of atrial fibrillation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Peng P, Lekadir K, Gooya A, Shao L, Petersen SE, Frangi AF (2016) A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging. Magma 29(2):155–195CrossRef Peng P, Lekadir K, Gooya A, Shao L, Petersen SE, Frangi AF (2016) A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging. Magma 29(2):155–195CrossRef
2.
Zurück zum Zitat Christopher MG, Nazem A, Amit P, Eugene K, Patricia R, Kavitha D, Brent W, Josh C, Alexis H, Ravi R (2014) Atrial fibrillation ablation outcome is predicted by left atrial remodeling on MRI. Circ Arrhythm Electrophysiol 7(1):23CrossRef Christopher MG, Nazem A, Amit P, Eugene K, Patricia R, Kavitha D, Brent W, Josh C, Alexis H, Ravi R (2014) Atrial fibrillation ablation outcome is predicted by left atrial remodeling on MRI. Circ Arrhythm Electrophysiol 7(1):23CrossRef
3.
Zurück zum Zitat Zhao J, Butters TD, Zhang H, Pullan AJ, Legrice IJ, Sands GB, Smaill BH (2012) An image-based model of atrial muscular architecture: effects of structural anisotropy on electrical activation. Circ Arrhythm Electrophysiol 5(2):361–370CrossRef Zhao J, Butters TD, Zhang H, Pullan AJ, Legrice IJ, Sands GB, Smaill BH (2012) An image-based model of atrial muscular architecture: effects of structural anisotropy on electrical activation. Circ Arrhythm Electrophysiol 5(2):361–370CrossRef
4.
Zurück zum Zitat Zhuang X, Rhode KS, Razavi R, Hawkes DJ, Ourselin S (2010) A registration-based propagation framework for automatic whole heart segmentation of cardiac MRI. IEEE Trans Med Imaging 29(9):1612–1625CrossRef Zhuang X, Rhode KS, Razavi R, Hawkes DJ, Ourselin S (2010) A registration-based propagation framework for automatic whole heart segmentation of cardiac MRI. IEEE Trans Med Imaging 29(9):1612–1625CrossRef
5.
Zurück zum Zitat Zheng Y, Yang D, John M, Comaniciu D (2014) Multi-part modeling and segmentation of left atrium in C-arm CT for image-guided ablation of atrial fibrillation. IEEE Trans Med Imaging 33(2):318–331CrossRef Zheng Y, Yang D, John M, Comaniciu D (2014) Multi-part modeling and segmentation of left atrium in C-arm CT for image-guided ablation of atrial fibrillation. IEEE Trans Med Imaging 33(2):318–331CrossRef
6.
Zurück zum Zitat Tobongomez C, Geers AJ, Peters J, Weese J, Pinto K, Karim R, Ammar M, Daoudi A, Margeta J, Sandoval Z (2015) Benchmark for algorithms segmenting the left atrium from 3D CT and MRI datasets. IEEE Trans Med Imaging 34(7):1460–1473CrossRef Tobongomez C, Geers AJ, Peters J, Weese J, Pinto K, Karim R, Ammar M, Daoudi A, Margeta J, Sandoval Z (2015) Benchmark for algorithms segmenting the left atrium from 3D CT and MRI datasets. IEEE Trans Med Imaging 34(7):1460–1473CrossRef
7.
Zurück zum Zitat Zhu L, Gao Y, Yezzi AJ, Tannenbaum AR (2013) Automatic segmentation of the left atrium from MR images via variational region growing with a moments-based shape prior. IEEE Trans Image Process 22(12):5111–5122CrossRef Zhu L, Gao Y, Yezzi AJ, Tannenbaum AR (2013) Automatic segmentation of the left atrium from MR images via variational region growing with a moments-based shape prior. IEEE Trans Image Process 22(12):5111–5122CrossRef
8.
Zurück zum Zitat Tao Q, Ipek EG, Shahzad R, Berendsen FF, Nazarian S, Der Geest RJV (2016) Fully automatic segmentation of left atrium and pulmonary veins in late gadolinium-enhanced MRI: towards objective atrial scar assessment. J Magn Reson Imaging 44(2):346–354CrossRef Tao Q, Ipek EG, Shahzad R, Berendsen FF, Nazarian S, Der Geest RJV (2016) Fully automatic segmentation of left atrium and pulmonary veins in late gadolinium-enhanced MRI: towards objective atrial scar assessment. J Magn Reson Imaging 44(2):346–354CrossRef
9.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 9351. Springer, Cham, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 9351. Springer, Cham, pp 234–241
10.
Zurück zum Zitat Milletari F, Navab N, Ahmadi S (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: International conference on 3D vision. pp 565–571 Milletari F, Navab N, Ahmadi S (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: International conference on 3D vision. pp 565–571
12.
Zurück zum Zitat Yang X, Bian C, Yu L, Ni D, Heng P-A (2017) Hybrid loss guided convolutional networks for whole heart parsing. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 215–223 Yang X, Bian C, Yu L, Ni D, Heng P-A (2017) Hybrid loss guided convolutional networks for whole heart parsing. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 215–223
13.
Zurück zum Zitat Yang X, Wang N, Wang Y, Wang X, Nezafat R, Ni D, Heng P (2018) Combating uncertainty with novel losses for automatic left atrium segmentation. In: International workshop on statistical atlases and computational models of the heart, pp 246–254 Yang X, Wang N, Wang Y, Wang X, Nezafat R, Ni D, Heng P (2018) Combating uncertainty with novel losses for automatic left atrium segmentation. In: International workshop on statistical atlases and computational models of the heart, pp 246–254
14.
Zurück zum Zitat Vesal S, Ravikumar N, Maier AK (2018) Dilated convolutions in neural networks for left atrial segmentation in 3D gadolinium enhanced-MRI. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 319–328 Vesal S, Ravikumar N, Maier AK (2018) Dilated convolutions in neural networks for left atrial segmentation in 3D gadolinium enhanced-MRI. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 319–328
15.
Zurück zum Zitat Chen C, Bai W, Rueckert D (2018) Multi-task learning for left atrialsegmentation on GE-MRI. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 292–301 Chen C, Bai W, Rueckert D (2018) Multi-task learning for left atrialsegmentation on GE-MRI. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 292–301
16.
Zurück zum Zitat Mortazi A, Karim R, Rhode KS, Burt J, Bagci U (2017) Cardiac-NET: Segmentation of left atrium and proximal pulmonary veins from MRI using multi-view CNN. In: Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 10434, pp 377–385 Mortazi A, Karim R, Rhode KS, Burt J, Bagci U (2017) Cardiac-NET: Segmentation of left atrium and proximal pulmonary veins from MRI using multi-view CNN. In: Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 10434, pp 377–385
17.
Zurück zum Zitat Chen J, Yang G, Gao Z, Ni H, Angelini ED, Mohiaddin RH, Wong T, Zhang Y, Du X, Zhang H (2018) Multiview two-task recursive attention model for left atrium and atrial scars segmentation. Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 11071. Springer, Cham, pp 455–463 Chen J, Yang G, Gao Z, Ni H, Angelini ED, Mohiaddin RH, Wong T, Zhang Y, Du X, Zhang H (2018) Multiview two-task recursive attention model for left atrium and atrial scars segmentation. Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 11071. Springer, Cham, pp 455–463
18.
Zurück zum Zitat Bian C, Yang X, Ma J, Zheng S, Liu Y, Nezafat R, Heng P, Zheng Y (2018) Pyramid network with online hard example mining for accurate left atrium segmentation. international workshop on statistical atlases and computational models of the heart. Lecture notes in computer science, vol 11395. Springer, Cham, pp 237–245 Bian C, Yang X, Ma J, Zheng S, Liu Y, Nezafat R, Heng P, Zheng Y (2018) Pyramid network with online hard example mining for accurate left atrium segmentation. international workshop on statistical atlases and computational models of the heart. Lecture notes in computer science, vol 11395. Springer, Cham, pp 237–245
19.
Zurück zum Zitat Li D, Chen X, Zhang Z, Huang K (2017) Learning deep context-aware features over body and latent parts for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 384–393 Li D, Chen X, Zhang Z, Huang K (2017) Learning deep context-aware features over body and latent parts for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 384–393
20.
Zurück zum Zitat Zeng X, Ouyang W, Yang B, Yan J, Wang X (2016) Gated Bi-directional CNN for Object Detection. In: European conference on computer vision. pp 354–369 Zeng X, Ouyang W, Yang B, Yan J, Wang X (2016) Gated Bi-directional CNN for Object Detection. In: European conference on computer vision. pp 354–369
21.
Zurück zum Zitat Liu T, Yuan Z, Sun J, Wang J, Zheng N, Tang X, Shum H (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367CrossRef Liu T, Yuan Z, Sun J, Wang J, Zheng N, Tang X, Shum H (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367CrossRef
22.
Zurück zum Zitat Wang Z, Liu C, Cheng D, Wang L, Yang X, Cheng K (2018) Automated detection of clinically significant prostate cancer in mp-MRI images based on an end-to-end deep neural network. IEEE Trans Med Imaging 37(5):1127–1139CrossRef Wang Z, Liu C, Cheng D, Wang L, Yang X, Cheng K (2018) Automated detection of clinically significant prostate cancer in mp-MRI images based on an end-to-end deep neural network. IEEE Trans Med Imaging 37(5):1127–1139CrossRef
23.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on Imagenet classification. In: International conference on computer vision. pp 1026–1034 He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on Imagenet classification. In: International conference on computer vision. pp 1026–1034
24.
Zurück zum Zitat Huttenlocher DP, Klanderman GA, Rucklidge W (1993) Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell 15(9):850–863CrossRef Huttenlocher DP, Klanderman GA, Rucklidge W (1993) Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell 15(9):850–863CrossRef
25.
Zurück zum Zitat Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6230–6239 Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6230–6239
26.
27.
Zurück zum Zitat Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: a deep convolutional encoder–decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495CrossRef Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: a deep convolutional encoder–decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495CrossRef
Metadaten
Titel
Segmentation and visualization of left atrium through a unified deep learning framework
verfasst von
Xiuquan Du
Susu Yin
Renjun Tang
Yueguo Liu
Yuhui Song
Yanping Zhang
Heng Liu
Shuo Li
Publikationsdatum
26.02.2020
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 4/2020
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-020-02128-9

Weitere Artikel der Ausgabe 4/2020

International Journal of Computer Assisted Radiology and Surgery 4/2020 Zur Ausgabe