Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 7/2018

19.03.2018 | Original Article

Automatic bladder segmentation from CT images using deep CNN and 3D fully connected CRF-RNN

verfasst von: Xuanang Xu, Fugen Zhou, Bo Liu

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 7/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Automatic approach for bladder segmentation from computed tomography (CT) images is highly desirable in clinical practice. It is a challenging task since the bladder usually suffers large variations of appearance and low soft-tissue contrast in CT images. In this study, we present a deep learning-based approach which involves a convolutional neural network (CNN) and a 3D fully connected conditional random fields recurrent neural network (CRF-RNN) to perform accurate bladder segmentation. We also propose a novel preprocessing method, called dual-channel preprocessing, to further advance the segmentation performance of our approach.

Methods

The presented approach works as following: first, we apply our proposed preprocessing method on the input CT image and obtain a dual-channel image which consists of the CT image and an enhanced bladder density map. Second, we exploit a CNN to predict a coarse voxel-wise bladder score map on this dual-channel image. Finally, a 3D fully connected CRF-RNN refines the coarse bladder score map and produce final fine-localized segmentation result.

Results

We compare our approach to the state-of-the-art V-net on a clinical dataset. Results show that our approach achieves superior segmentation accuracy, outperforming the V-net by a significant margin. The Dice Similarity Coefficient of our approach (92.24%) is 8.12% higher than that of the V-net. Moreover, the bladder probability maps performed by our approach present sharper boundaries and more accurate localizations compared with that of the V-net.

Conclusion

Our approach achieves higher segmentation accuracy than the state-of-the-art method on clinical data. Both the dual-channel processing and the 3D fully connected CRF-RNN contribute to this improvement. The united deep network composed of the CNN and 3D CRF-RNN also outperforms a system where the CRF model acts as a post-processing method disconnected from the CNN.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
2.
3.
Zurück zum Zitat Haas B, Coradi T, Scholz M, Kunz P, Huber M, Oppitz U, André L, Lengkeek V, Huyskens D, van Esch A, Reddick R (2008) Automatic segmentation of thoracic and pelvic CT images for radiotherapy planning using implicit anatomic knowledge and organ-specific segmentation strategies. Phys Med Biol 53(6):1751–1771. https://doi.org/10.1088/0031-9155/53/6/017 CrossRefPubMed Haas B, Coradi T, Scholz M, Kunz P, Huber M, Oppitz U, André L, Lengkeek V, Huyskens D, van Esch A, Reddick R (2008) Automatic segmentation of thoracic and pelvic CT images for radiotherapy planning using implicit anatomic knowledge and organ-specific segmentation strategies. Phys Med Biol 53(6):1751–1771. https://​doi.​org/​10.​1088/​0031-9155/​53/​6/​017 CrossRefPubMed
4.
Zurück zum Zitat Zheng S , Jayasumana S, Romera-Paredes B, Vineet V, Su Z, Du D, Huang C, Torr PHS (2015) Conditional random fields as recurrent neural networks. In: Proceedings of the IEEE international conference on computer vision, pp 1529–1537. https://doi.org/10.1109/ICCV.2015.179 Zheng S , Jayasumana S, Romera-Paredes B, Vineet V, Su Z, Du D, Huang C, Torr PHS (2015) Conditional random fields as recurrent neural networks. In: Proceedings of the IEEE international conference on computer vision, pp 1529–1537. https://​doi.​org/​10.​1109/​ICCV.​2015.​179
6.
Zurück zum Zitat Cirean DC, Giusti A, Gambardella LM, Schmidhuber J (2012) Deep Neural networks segment neuronal membranes in electron microscopy images. In: Advances in neural information processing systems, pp 2852–2860 Cirean DC, Giusti A, Gambardella LM, Schmidhuber J (2012) Deep Neural networks segment neuronal membranes in electron microscopy images. In: Advances in neural information processing systems, pp 2852–2860
7.
Zurück zum Zitat Roth HR, Le L, Amal F, Shin H-C, Liu J, Turkbey E, Summers RM (2015) DeepOrgan: multi-level deep convolutional networks for automated pancreas segmentation. In: International conference on medical image computing and computer-assisted intervention, pp 556–564. https://doi.org/10.1007/978-3-319-24553-9_68 Roth HR, Le L, Amal F, Shin H-C, Liu J, Turkbey E, Summers RM (2015) DeepOrgan: multi-level deep convolutional networks for automated pancreas segmentation. In: International conference on medical image computing and computer-assisted intervention, pp 556–564. https://​doi.​org/​10.​1007/​978-3-319-24553-9_​68
8.
Zurück zum Zitat Han X (2017) Automatic liver lesion segmentation using a deep convolutional neural network method. arXiv preprint. arXiv:1704.07239. Accessed 24 Apr 2017 Han X (2017) Automatic liver lesion segmentation using a deep convolutional neural network method. arXiv preprint. arXiv:​1704.​07239. Accessed 24 Apr 2017
9.
Zurück zum Zitat Zhou Y, Xie L, Shen W, Fishman E, Yuille A (2016) Pancreas segmentation in abdominal CT scan: a coarse-to-fine approach. arXiv preprint. arXiv:1612.08230. Accessed 25 Dec 2016 Zhou Y, Xie L, Shen W, Fishman E, Yuille A (2016) Pancreas segmentation in abdominal CT scan: a coarse-to-fine approach. arXiv preprint. arXiv:​1612.​08230. Accessed 25 Dec 2016
11.
Zurück zum Zitat Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M (2013) Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In: International conference on medical image computing and computer-assisted intervention, pp 246–253. https://doi.org/10.1007/978-3-642-40763-5_31 Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M (2013) Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In: International conference on medical image computing and computer-assisted intervention, pp 246–253. https://​doi.​org/​10.​1007/​978-3-642-40763-5_​31
12.
Zurück zum Zitat Roth HR, Lu L, Seff A, Cherry KM, Hoffman J, Wang S, Liu J, Turkbey E, Summers RM (2014) A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. In: International conference on medical image computing and computer-assisted intervention, pp 520–527. https://doi.org/10.1007/978-3-319-10404-1_65 Roth HR, Lu L, Seff A, Cherry KM, Hoffman J, Wang S, Liu J, Turkbey E, Summers RM (2014) A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. In: International conference on medical image computing and computer-assisted intervention, pp 520–527. https://​doi.​org/​10.​1007/​978-3-319-10404-1_​65
15.
18.
Zurück zum Zitat Yu L, Yang X, Chen H, Qin J, Heng P-A (2017) Volumetric ConvNets with mixed residual connections for automated prostate segmentation from 3D MR images. In: Thirty-first AAAI conference on artificial intelligence Yu L, Yang X, Chen H, Qin J, Heng P-A (2017) Volumetric ConvNets with mixed residual connections for automated prostate segmentation from 3D MR images. In: Thirty-first AAAI conference on artificial intelligence
19.
Zurück zum Zitat Christ PF, Ettlinger F, Grün F, Elshaer MEA, Lipkova J, Schlecht S, Ahmaddy F, Tatavarty S, Bickel M, Bilic P, Remper M, Hofmann F, D’Anastasi M, Ahmadi S-A, Kaissis G, Holch J, Sommer W, Braren R, Heinemann V, Menze B (2017) Automatic liver and tumor segmentation of CT and MRI volumes using cascaded fully convolutional neural networks. arXiv preprint. arxiv:1702.05970. Accessed 20 Feb 2017 Christ PF, Ettlinger F, Grün F, Elshaer MEA, Lipkova J, Schlecht S, Ahmaddy F, Tatavarty S, Bickel M, Bilic P, Remper M, Hofmann F, D’Anastasi M, Ahmadi S-A, Kaissis G, Holch J, Sommer W, Braren R, Heinemann V, Menze B (2017) Automatic liver and tumor segmentation of CT and MRI volumes using cascaded fully convolutional neural networks. arXiv preprint. arxiv:​1702.​05970. Accessed 20 Feb 2017
20.
Zurück zum Zitat Roth HR, Oda H, Hayashi Y, Oda M, Shimizu N, Fujiwara M, Misawa K, Mori K (2017) Hierarchical 3D fully convolutional networks for multi-organ segmentation. arXiv preprint. arXiv:1704.06382. Accessed 21 Apr 2017 Roth HR, Oda H, Hayashi Y, Oda M, Shimizu N, Fujiwara M, Misawa K, Mori K (2017) Hierarchical 3D fully convolutional networks for multi-organ segmentation. arXiv preprint. arXiv:​1704.​06382. Accessed 21 Apr 2017
25.
Zurück zum Zitat Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint. arXiv:1502.03167. Accessed 11 Feb 2015 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint. arXiv:​1502.​03167. Accessed 11 Feb 2015
27.
Zurück zum Zitat Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the ACM international conference on multimedia, pp 675–678. https://doi.org/10.1145/2647868.2654889 Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the ACM international conference on multimedia, pp 675–678. https://​doi.​org/​10.​1145/​2647868.​2654889
Metadaten
Titel
Automatic bladder segmentation from CT images using deep CNN and 3D fully connected CRF-RNN
verfasst von
Xuanang Xu
Fugen Zhou
Bo Liu
Publikationsdatum
19.03.2018
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 7/2018
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-1733-7

Weitere Artikel der Ausgabe 7/2018

International Journal of Computer Assisted Radiology and Surgery 7/2018 Zur Ausgabe