Abstract
This chapter focuses on modern deep learning techniques that are proposed for automatically recognizing and segmenting multiple organ regions on three-dimensional (3D) computed tomography (CT) images. CT images are widely used to visualize 3D anatomical structures composed of multiple organ regions inside the human body in clinical medicine. Automatic recognition and segmentation of multiple organs on CT images is a fundamental processing step of computer-aided diagnosis, surgery, and radiation therapy systems, which aim to achieve precision and personalized medicines. In this chapter, we introduce our recent works on addressing the issue of multiple organ segmentation on 3D CT images by using deep learning, a completely novel approach, instead of conventional segmentation methods originated from traditional digital image processing techniques. We evaluated and compared the segmentation performances of two different deep learning approaches based on 2D- and 3D deep convolutional neural networks (CNNs) without and with a pre-processing step. A conventional method based on a probabilistic atlas algorithm, which presented the best performance within the conventional approaches, was also adopted as a baseline for performance comparison. A dataset containing 240 CT scans of different portions of human bodies was used for training the CNNs and validating the segmentation performance of the learning results. A maximum number of 17 types of organ regions in each CT scan were segmented automatically and validated with the human annotations by using ratio of intersection over union (IoU) as the criterion. Our experimental results showed that the IoUs of the segmentation results had a mean value of 79% and 67% by averaging 17 types of organs that were segmented by the proposed 3D and 2D deep CNNs, respectively. All results using the deep learning approaches showed better accuracy and robustness than the conventional segmentation method that used the probabilistic atlas algorithm. The effectiveness and usefulness of deep learning approaches were demonstrated for multiple organ segmentation on 3D CT images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Doi K (2007) Computer-aided diagnosis in medical imaging: historical review, current status, and future potential. Comput Med Imaging Graph 31:198–211
Pham DL, Xu C, Prince JL (2000) Current methods in medical image segmentation. Biomed Eng 2:315–333
Heimann T, Meinzer HP (2009) Statistical shape models for 3D medical image segmentation: a review. Med Image Anal 13(4):543–563
Xu Y, Xu C, Kuang X, Wang H, Chang EIC, Huang W, Fan Y (2016) 3D-SIFT-Flow for atlas-based CT liver image segmentation. Med Phys 43(5):2229–2241
Lay N, Birkbeck N, Zhang J, Zhou SK (2013) Rapid multi-organ segmentation using context integration and discriminative models. Proc IPMI 7917:450–462
Wolz R, Chu C, Misawa K, Fujiwara M, Mori K, Rueckert D (2013) Automated abdominal multi-organ segmentation with subject-specific atlas generation. IEEE Trans Med Imaging 32(9):1723–1730
Okada T, Linguraru MG, Hori M, Summers RM, Tomiyama N, Sato Y (2015) Abdominal multi-organ segmentation from CT images using conditional shape-location and unsupervised intensity priors. Med Image Anal 26(1):1–18
Sun K, Udupa JK, Odhner D, Tong Y, Zhao L, Torigian DA (2016) Automatic thoracic anatomy segmentation on CT images using hierarchical fuzzy models and registration. Med Phys 43(4):1882–1896
Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. Proc CVPR:3431–3440
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. Proc CVPR:770–778
Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298
Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp 234–241
Milletari F, Navab N, Ahmadi S-A (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. arXiv:1606.04797
Roth HR, Farag A, Lu L, Turkbey EB, Summers RM (2015) Deep convolutional networks for pancreas segmentation in CT imaging. Proc SPIE 9413:94131G-1–94131G-8
Cha KH, Hadjiiski L, Samala RK, Chan HP, Caoili EM, Cohan RH (2016) Urinary bladder segmentation in CT urography using deep-learning convolutional neural network and level sets. Med Phys 43(4):1882–1896
Zhou X, Takayama R, Wang S, Hara T, Fujita H (2017) Deep learning of the sectional appearances of 3D CT images for anatomical structure segmentation based on an FCN voting method. Med Phys 44(10):5221–5233
Zhou X, Yamada K, Kojima T, Takayama R, Wang S, Zhou XX, Hara T, Fujita H (2018) Performance evaluation of 2D and 3D deep learning approaches for automatic segmentation of multiple organs on CT images. In: Proceedings of the SPIE Medical Imaging 2018: Computer-aided diagnosis, 105752C
Zhou X, Ito T, Takayama R, Wang S, Hara T, Fujita H (2016) Three-dimensional CT image segmentation by combining 2D fully convolutional network with 3D majority voting. In: Proceedings of the Workshop on the 2nd Deep Learning in Medical Image Analysis (DLMIA) in MICCAI 2016, LNCS 10008, pp 111–120
Zhou X, Takayama R, Wang S, Zhou X, Hara T, Fujita H (2017) Automated segmentation of 3D anatomical structures on CT images by using a deep convolutional network based on end-to-end learning approach. In: Proceedings of the SPIE Medical Imaging 2017: Image Processing, vol 10133, p 1013324
Zhou X, Ito T, Takayama R, Wang S, Hara T, Fujita H (2016) First trial and evaluation of anatomical structure segmentations in 3D CT images based only on deep learning. Brief Article. Med Image Inf Sci 33(3):69–74
Zhou X, Morita S, Zhou XX, Chen H, Hara T, Yokoyama R, Kanematsu M, Hoshi H, Fujita H (2015) Automatic anatomy partitioning of the torso region on CT images by using multiple organ localizations with a group-wise calibration technique. In: Hadjiiski LM, Tourassi GD (eds) Proceedings of the SPIE Medical Imaging 2015: Computer-Aided Diagnosis, vol 9414, pp 94143K-1– 94143K-6
Kingma DP, Ba JL (2015) ADAM: a method for stochastic optimization. In: Proceedings of the ICLR 2015
Watanabe H, Shimizu A, Ueno J, Umetsu S, Nawano S, Kobatake H (2013) Semi-automated organ segmentation using 3-dimensional medical imagery through sparse representation. Trans Jpn Soc Med Biol Eng 51(5):300–312
Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: International Conference on Artificial Intelligence and Statistics
He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. arXiv preprint arXiv:1502.01852
Ioffe S, Szegedy C, Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167
Acknowledgments
The author would like to thank all the members of the Fujita Laboratory in Gifu University, for their collaboration. We especially thank Dr. Okada of Tsukuba University for providing binary code and Dr. Roth of Nagoya University for giving advice on 3D deep CNN. We would like to thank all the members of the “Computational Anatomy” research project [22], especially Dr. Ueno of Tokushima University, for providing the CT image database. This research was supported in part by a Grant-in-Aid for Scientific Research on Innovative Areas (Grant No. 26108005), and in part by a Grant-in-Aid for Scientific Research (C26330134), MEXT, Japan.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Zhou, X. (2020). Automatic Segmentation of Multiple Organs on 3D CT Images by Using Deep Learning Approaches. In: Lee, G., Fujita, H. (eds) Deep Learning in Medical Image Analysis . Advances in Experimental Medicine and Biology, vol 1213. Springer, Cham. https://doi.org/10.1007/978-3-030-33128-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-33128-3_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33127-6
Online ISBN: 978-3-030-33128-3
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)