Skip to main content
Top

2019 | OriginalPaper | Chapter

Abdominal Organs Segmentation Based on Multi-path Fully Convolutional Network and Random Forests

Authors : Yangzi Yang, Huiyan Jiang, Yenwei Chen

Published in: Intelligent Interactive Multimedia Systems and Services

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Fully convolutional network has predicted multiple class dense outputs in CT image labels and obtained significant improvements in segmentation tasks. In this paper, we present a joint multi-path fully convolutional network (MFCN) with random forests (RF) architecture for abdominal organs segmentation automatically. First, in coarse segmentation step, three FCNs are trained respectively with three orthogonal directions which consider contextual and spatial information of fusion layers adequately. In classification step, using features extracted from different layers of network and normalizing them to mean value as supervoxel representation to train RF. This allows the computation of supervoxel at each orientation achieve high efficiency. Finally, we aggregate the results of MFCN and RF on voxel-wise and perform conditional random fields (CRF) focuses on smoothing borders of fine segmentation regions. We exceeds the state-of-the-art methods and get achievable DSC values for our work is 90.1%, 88.4%, 88.0%, 88.6% represent liver, right and left kidney, spleen respectively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ling, H., Zhou, S.K., Zheng, Y., et al.: Hierarchical, learning-based automatic liver segmentation. In: Computer Vision and Pattern Recognition 2008. CVPR, pp. 1–8. IEEE (2008) Ling, H., Zhou, S.K., Zheng, Y., et al.: Hierarchical, learning-based automatic liver segmentation. In: Computer Vision and Pattern Recognition 2008. CVPR, pp. 1–8. IEEE (2008)
2.
go back to reference Kitrungrotsakul, T., Han, X.H., Iwamoto, Y., et al.: Robust hepatic vessel segmentation using multi deep convolution networks, In: Proceedings of SPIE, vol. 10137, Medical Imaging 2017, Florida, USA (2017) Kitrungrotsakul, T., Han, X.H., Iwamoto, Y., et al.: Robust hepatic vessel segmentation using multi deep convolution networks, In: Proceedings of SPIE, vol. 10137, Medical Imaging 2017, Florida, USA (2017)
3.
go back to reference Foruzan, A.H., Chen, Y.W., Zoroofi, R.A., et al.: Segmentation of liver in low-contrast images using k-means clustering and geodesic active contour algorithms. IEICE Trans. Inf. Syst. 96(4), 798–807 (2013)CrossRef Foruzan, A.H., Chen, Y.W., Zoroofi, R.A., et al.: Segmentation of liver in low-contrast images using k-means clustering and geodesic active contour algorithms. IEICE Trans. Inf. Syst. 96(4), 798–807 (2013)CrossRef
4.
go back to reference Xu, Z., Li, B., Panda, S., et al.: Shape-constrained multi-atlas segmentation of spleen in CT. In: Proceedings of SPIE–the International Society for Optical Engineering, vol. 9034, p. 903446. NIH Public Access (2014) Xu, Z., Li, B., Panda, S., et al.: Shape-constrained multi-atlas segmentation of spleen in CT. In: Proceedings of SPIE–the International Society for Optical Engineering, vol. 9034, p. 903446. NIH Public Access (2014)
5.
go back to reference Okada, T., Linguraru, M.G., Yoshida, Y., et al.: Abdominal multi-organ segmentation of CT images based on hierarchical spatial modeling of organ interrelations. In: International MICCAI Workshop on Computational and Clinical Challenges in Abdominal Imaging, pp. 173–180. Springer, Heidelberg (2011) Okada, T., Linguraru, M.G., Yoshida, Y., et al.: Abdominal multi-organ segmentation of CT images based on hierarchical spatial modeling of organ interrelations. In: International MICCAI Workshop on Computational and Clinical Challenges in Abdominal Imaging, pp. 173–180. Springer, Heidelberg (2011)
6.
go back to reference Glocker, B., Pauly, O., Konukoglu, E., et al.: Joint classification-regression forests for spatially structured multi-object segmentation. In: Computer Vision–ECCV 2012, pp. 870–881 (2012)CrossRef Glocker, B., Pauly, O., Konukoglu, E., et al.: Joint classification-regression forests for spatially structured multi-object segmentation. In: Computer Vision–ECCV 2012, pp. 870–881 (2012)CrossRef
7.
go back to reference Liu, X., Linguraru, M.G., Yao, J., et al.: Organ pose distribution model and an MAP framework for automated abdominal multi-organ localization. In: International Workshop on Medical Imaging and Virtual Reality, pp. 393–402. Springer, Heidelberg (2010) Liu, X., Linguraru, M.G., Yao, J., et al.: Organ pose distribution model and an MAP framework for automated abdominal multi-organ localization. In: International Workshop on Medical Imaging and Virtual Reality, pp. 393–402. Springer, Heidelberg (2010)
8.
go back to reference Shimizu, A., Ohno, R., Ikegami, T., et al.: Segmentation of multiple organs in non-contrast 3D abdominal CT images. Int. J. Comput. Assist. Radiol. Surg. 2(3–4), 135–142 (2007)CrossRef Shimizu, A., Ohno, R., Ikegami, T., et al.: Segmentation of multiple organs in non-contrast 3D abdominal CT images. Int. J. Comput. Assist. Radiol. Surg. 2(3–4), 135–142 (2007)CrossRef
9.
go back to reference Roth, H.R., Lu, L., Farag, A., et al.: Deeporgan: multi-level deep convolutional networks for automated pancreas segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 556–564. Springer, Heidelberg (2015) Roth, H.R., Lu, L., Farag, A., et al.: Deeporgan: multi-level deep convolutional networks for automated pancreas segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 556–564. Springer, Heidelberg (2015)
10.
go back to reference Zhou, X., Ito, T., Takayama, R., et al.: First trial and evaluation of anatomical structure segmentations in 3D CT images based only on deep learning. Med. Imaging Inf. Sci. 33(3), 69–74 (2016) Zhou, X., Ito, T., Takayama, R., et al.: First trial and evaluation of anatomical structure segmentations in 3D CT images based only on deep learning. Med. Imaging Inf. Sci. 33(3), 69–74 (2016)
11.
go back to reference Dou, Q., Chen, H., Jin, Y., et al.: 3D deeply supervised network for automatic liver segmentation from CT volumes. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 149–157. Springer, Heidelberg (2016)CrossRef Dou, Q., Chen, H., Jin, Y., et al.: 3D deeply supervised network for automatic liver segmentation from CT volumes. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 149–157. Springer, Heidelberg (2016)CrossRef
12.
go back to reference Sharif Razavian, A., Azizpour, H., Sullivan, J., et al.: CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 806–813 (2014) Sharif Razavian, A., Azizpour, H., Sullivan, J., et al.: CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 806–813 (2014)
13.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
14.
go back to reference Socher, R., Huval, B., Bath, B., et al.: Convolutional-recursive deep learning for 3D object classification. In: Advances in Neural Information Processing Systems, pp. 656–664 (2012) Socher, R., Huval, B., Bath, B., et al.: Convolutional-recursive deep learning for 3D object classification. In: Advances in Neural Information Processing Systems, pp. 656–664 (2012)
15.
go back to reference Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
16.
go back to reference Ganin, Y., Lempitsky, V.: N^ 4-fields: neural network nearest neighbor fields for image transforms. In: Asian Conference on Computer Vision, pp. 536–551. Springer, Cham (2014) Ganin, Y., Lempitsky, V.: N^ 4-fields: neural network nearest neighbor fields for image transforms. In: Asian Conference on Computer Vision, pp. 536–551. Springer, Cham (2014)
17.
go back to reference Pinheiro, P., Collobert, R.: Recurrent convolutional neural networks for scene labeling. In: International Conference on Machine Learning, pp. 82–90 (2014) Pinheiro, P., Collobert, R.: Recurrent convolutional neural networks for scene labeling. In: International Conference on Machine Learning, pp. 82–90 (2014)
18.
go back to reference Ben-Cohen, A., Diamant, I., Klang, E., et al.: Fully convolutional network for liver segmentation and lesions detection. In: International Workshop on Large-Scale Annotation of Biomedical Data and Expert Label Synthesis, pp. 77–85. Springer, Heidelberg (2016) Ben-Cohen, A., Diamant, I., Klang, E., et al.: Fully convolutional network for liver segmentation and lesions detection. In: International Workshop on Large-Scale Annotation of Biomedical Data and Expert Label Synthesis, pp. 77–85. Springer, Heidelberg (2016)
19.
go back to reference Lafferty, J.D., McCallum, A., Pereira, F.C.N.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Eighteenth International Conference on Machine Learning, pp. 282–289. Morgan Kaufmann Publishers Inc. (2001) Lafferty, J.D., McCallum, A., Pereira, F.C.N.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Eighteenth International Conference on Machine Learning, pp. 282–289. Morgan Kaufmann Publishers Inc. (2001)
20.
go back to reference Krähenbühl, P., Koltun, V.: Efficient inference in fully connected CRFs with gaussian edge potentials. In: Advances in Neural Information Processing Systems, pp. 109–117 (2011) Krähenbühl, P., Koltun, V.: Efficient inference in fully connected CRFs with gaussian edge potentials. In: Advances in Neural Information Processing Systems, pp. 109–117 (2011)
21.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. Computer Science (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. Computer Science (2014)
22.
go back to reference Yang, Y., Jiang, H., Sun, Q.: A multiorgan segmentation model for CT volumes via full convolution-deconvolution network. Biomed. Res. Int. 2017, 6941306 (2017) Yang, Y., Jiang, H., Sun, Q.: A multiorgan segmentation model for CT volumes via full convolution-deconvolution network. Biomed. Res. Int. 2017, 6941306 (2017)
23.
go back to reference Achanta, R., Shaji, A., Smith, K., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef Achanta, R., Shaji, A., Smith, K., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef
24.
go back to reference Prasoon, A., Petersen, K., Igel, C., et al.: Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 246–253. Springer, Heidelberg (2013)CrossRef Prasoon, A., Petersen, K., Igel, C., et al.: Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 246–253. Springer, Heidelberg (2013)CrossRef
25.
go back to reference Pereira, S., Pinto, A., Alves, V., et al.: Deep convolutional neural networks for the segmentation of gliomas in multi-sequence MRI. In: International Workshop on Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, pp. 131–143. Springer, Cham (2015)CrossRef Pereira, S., Pinto, A., Alves, V., et al.: Deep convolutional neural networks for the segmentation of gliomas in multi-sequence MRI. In: International Workshop on Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, pp. 131–143. Springer, Cham (2015)CrossRef
Metadata
Title
Abdominal Organs Segmentation Based on Multi-path Fully Convolutional Network and Random Forests
Authors
Yangzi Yang
Huiyan Jiang
Yenwei Chen
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-319-92231-7_21

Premium Partner