Skip to main content
Top

2020 | OriginalPaper | Chapter

Automatic Liver and Spleen Segmentation with CT Images Using Multi-channel U-net Deep Learning Approach

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The detection and evaluation of the shape of liver from abdominal computed tomography (CT) images are fundamental tasks in computer-assisted liver surgery planning such as radiation therapy. The contour of spleen is also a significant factor highly related to liver diseases. However, automatic and accurate liver segmentation still remains many challenges to be solve, such as ambiguous boundaries, heterogeneous appearances and highly varied shapes of the liver and spleen. To address these difficulties, we developed an automatic segmentation model based on multi-channel U-net network. Some preprocessing steps were done to elevate the performance first. Also, an approximate liver and spleen map was generated by calculating the gradient of CT images. The area which have high possibility to be liver and spleen would be select as the training set to make sure the balance of data. Then, a deep learning U-net structure was applied for the processed training data. Finally, some post-processing methods, which include k-means clustering and morphology algorithms, would be applied in our protocol. The results indicated that a high structure similarity index (SSIM) and dice score coefficient of liver and spleen segmentation model can be achieved, which were 0.9731 and 0.9508 respectively, demonstrating the potential clinical applicability of the proposed approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Gulshan, V., Peng, L., Coram, M., Stumpe, M.C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., Kim, R., Raman, R., Nelson, P.C., Mega, J.L., Webster, D.R.: Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. J. Am. Medd. Assoc. 316, 2402–2410 (2016). https://doi.org/10.1001/jama.2016.17216CrossRef Gulshan, V., Peng, L., Coram, M., Stumpe, M.C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., Kim, R., Raman, R., Nelson, P.C., Mega, J.L., Webster, D.R.: Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. J. Am. Medd. Assoc. 316, 2402–2410 (2016). https://​doi.​org/​10.​1001/​jama.​2016.​17216CrossRef
3.
go back to reference Cerrolaza, J.J., Reyes, M., Summers, R.M., Gonzalez-Ballester, M.A., Linguraru, M.G.: Automatic multi-resolution shape modeling of multi-organ structures. Med. Image Anal. 25(1), 11–21 (2015)CrossRef Cerrolaza, J.J., Reyes, M., Summers, R.M., Gonzalez-Ballester, M.A., Linguraru, M.G.: Automatic multi-resolution shape modeling of multi-organ structures. Med. Image Anal. 25(1), 11–21 (2015)CrossRef
4.
go back to reference Okada, T., Linguraru, M.G., Hori, M., Summers, R.M., Tomiyama, N., Sato, Y.: Abdominal multi-organ segmentation from CT images using conditional shape location and unsupervised intensity priors. Med. Image Anal. 26(1), 118 (2015)CrossRef Okada, T., Linguraru, M.G., Hori, M., Summers, R.M., Tomiyama, N., Sato, Y.: Abdominal multi-organ segmentation from CT images using conditional shape location and unsupervised intensity priors. Med. Image Anal. 26(1), 118 (2015)CrossRef
5.
go back to reference Rohlfing, T., Brandt, R., Menzel, R., Maurer, C.R.: Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains. NeuroImage 21(4), 1428–1442 (2004)CrossRef Rohlfing, T., Brandt, R., Menzel, R., Maurer, C.R.: Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains. NeuroImage 21(4), 1428–1442 (2004)CrossRef
6.
go back to reference Wang, H., Pouch, A., Takabe, M., Jackson, B., Gorman, J., Gorman, R., Yushkevich, P.A.: Multi-atlas segmentation with robust label transfer and label fusion. In: Information processing in medical imaging: proceedings of the Conference on Information Processing in Medical Imaging, vol. 23, p. 548, NIH Public Access (2013) Wang, H., Pouch, A., Takabe, M., Jackson, B., Gorman, J., Gorman, R., Yushkevich, P.A.: Multi-atlas segmentation with robust label transfer and label fusion. In: Information processing in medical imaging: proceedings of the Conference on Information Processing in Medical Imaging, vol. 23, p. 548, NIH Public Access (2013)
7.
go back to reference Iglesias, J.E., Sabuncu, M.R.: Multi-atlas segmentation of biomedical images: a survey. Med. Image Anal. 24(1), 205–219 (2015)CrossRef Iglesias, J.E., Sabuncu, M.R.: Multi-atlas segmentation of biomedical images: a survey. Med. Image Anal. 24(1), 205–219 (2015)CrossRef
8.
go back to reference Tong, T., Wolz, R., Wang, Z., Gao, Q., Misawa, K., Fujiwara, M., Mori, K., Hajnal, J.V., Rueckert, D.: Discriminative dictionary learning for abdominal multi-organ segmentation. Med. Image Anal. 23(1), 92104 (2015)CrossRef Tong, T., Wolz, R., Wang, Z., Gao, Q., Misawa, K., Fujiwara, M., Mori, K., Hajnal, J.V., Rueckert, D.: Discriminative dictionary learning for abdominal multi-organ segmentation. Med. Image Anal. 23(1), 92104 (2015)CrossRef
9.
go back to reference Oda, M., Shimizu, N., Karasawa, K., Nimura, Y., Kitasaka, T., Misawa, K., Fujiwara, M., Rueckert, D., Mori, K.: Regression forest-based atlas localization and direction specific atlas generation for pancreas segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 556–563. Springer (2016) Oda, M., Shimizu, N., Karasawa, K., Nimura, Y., Kitasaka, T., Misawa, K., Fujiwara, M., Rueckert, D., Mori, K.: Regression forest-based atlas localization and direction specific atlas generation for pancreas segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 556–563. Springer (2016)
10.
go back to reference Kamnitsas, K., Ledig, C., Newcombe, V.F., Simpson, J.P., Kane, A.D., Menon, D.K., Rueckert, D., Glocker, B.: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal. 36, 6178 (2017)CrossRef Kamnitsas, K., Ledig, C., Newcombe, V.F., Simpson, J.P., Kane, A.D., Menon, D.K., Rueckert, D., Glocker, B.: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal. 36, 6178 (2017)CrossRef
11.
go back to reference Zhou, X., Ito, T., Takayama, R., Wang, S., Hara, T., Fujita, H.: Three dimensional CT image segmentation by combining 2D fully convolutional network with 3D majority voting. In: International Workshop on Large-Scale Annotation of Biomedical Data and Expert Label Synthesis, pp. 111–120. Springer (2016) Zhou, X., Ito, T., Takayama, R., Wang, S., Hara, T., Fujita, H.: Three dimensional CT image segmentation by combining 2D fully convolutional network with 3D majority voting. In: International Workshop on Large-Scale Annotation of Biomedical Data and Expert Label Synthesis, pp. 111–120. Springer (2016)
12.
go back to reference Milletari, F., Navab, N., Ahmadi, S.-A.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 2016 Fourth International Conference on in 3D Vision (3DV), pp. 565–571. IEEE (2016) Milletari, F., Navab, N., Ahmadi, S.-A.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 2016 Fourth International Conference on in 3D Vision (3DV), pp. 565–571. IEEE (2016)
13.
go back to reference Roth, H.R., Lu, L., Farag, A., Shin, H.-C., Liu, J., Turkbey, E.B., Summers, R.M.: DeepOrgan: multi-level deep convolutional networks for automated pancreas segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 556–564. Springer (2015) Roth, H.R., Lu, L., Farag, A., Shin, H.-C., Liu, J., Turkbey, E.B., Summers, R.M.: DeepOrgan: multi-level deep convolutional networks for automated pancreas segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 556–564. Springer (2015)
14.
go back to reference Zhou, Y., Xie, L., Shen, W., Fishman, E., Yuille, A.: Pancreas segmentation in abdominal CT scan: A coarse-to-fine approach. arXiv preprint arXiv:1612.08230 (2016) Zhou, Y., Xie, L., Shen, W., Fishman, E., Yuille, A.: Pancreas segmentation in abdominal CT scan: A coarse-to-fine approach. arXiv preprint arXiv:​1612.​08230 (2016)
15.
go back to reference Christ, P.F., Elshaer, M.E.A., Ettlinger, F., Tatavarty, S., Bickel, M., Bilic, P., Rempfler, M., Armbruster, M., Hofmann, F., Danastasi, M., et al.: Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields. In: MICCAI, pp. 415–423. Springer (2016) Christ, P.F., Elshaer, M.E.A., Ettlinger, F., Tatavarty, S., Bickel, M., Bilic, P., Rempfler, M., Armbruster, M., Hofmann, F., Danastasi, M., et al.: Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields. In: MICCAI, pp. 415–423. Springer (2016)
16.
go back to reference Alberdi, E., Povyakalo, A.A., Strigini, L., Ayton, P.: Computer aided detection: risks and benefits for radiologists’ decisions. In: Handbook of Medical Image Perception and Techniques, pp. 1–26 (2009) Alberdi, E., Povyakalo, A.A., Strigini, L., Ayton, P.: Computer aided detection: risks and benefits for radiologists’ decisions. In: Handbook of Medical Image Perception and Techniques, pp. 1–26 (2009)
17.
go back to reference Li, C., Wang, X.: A likelihood and local constraint level set model for liver tumor segmentation from CT volumes. IEEE Trans. Biomed. Eng. 60, 2967–2977 (2013)CrossRef Li, C., Wang, X.: A likelihood and local constraint level set model for liver tumor segmentation from CT volumes. IEEE Trans. Biomed. Eng. 60, 2967–2977 (2013)CrossRef
18.
go back to reference Milletari, F., Navab, N., Ahmadi, S.A.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 2016 Fourth International Conference on 3D Vision (3DV), pp. 565–571. IEEE (2016) Milletari, F., Navab, N., Ahmadi, S.A.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 2016 Fourth International Conference on 3D Vision (3DV), pp. 565–571. IEEE (2016)
19.
go back to reference Crum, W., Camara, O., Hill, D.: Generalized overlap measures for evaluation and validation in medical image analysis. IEEE TMI 25(11), 1451–1461 (2006) Crum, W., Camara, O., Hill, D.: Generalized overlap measures for evaluation and validation in medical image analysis. IEEE TMI 25(11), 1451–1461 (2006)
20.
go back to reference Salehi, S.S.M., Erdogmus, D., Gholipour, A.: Tversky loss function for image segmentation using 3D fully convolutional deep networks Salehi, S.S.M., Erdogmus, D., Gholipour, A.: Tversky loss function for image segmentation using 3D fully convolutional deep networks
Metadata
Title
Automatic Liver and Spleen Segmentation with CT Images Using Multi-channel U-net Deep Learning Approach
Authors
Ting-Yu Su
Yu-Hua Fang
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-30636-6_5