Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 7/2022

15.03.2022 | Original Article

Improving segmentation and classification of renal tumors in small sample 3D CT images using transfer learning with convolutional neural networks

verfasst von: Xi-Liang Zhu, Hong-Bin Shen, Haitao Sun, Li-Xia Duan, Ying-Ying Xu

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 7/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Computed tomography (CT) images can display internal organs of patients and are particularly suitable for preoperative surgical diagnoses. The increasing demands for computer-aided systems in recent years have facilitated the development of many automated algorithms, especially deep convolutional neural networks, to segment organs and tumors or identify diseases from CT images. However, performances of some systems are highly affected by the amount of training data, while the sizes of medical image data sets, especially three-dimensional (3D) data sets, are usually small. This condition limits the application of deep learning.

Methods

In this study, given a practical clinical data set that has 3D CT images of 20 patients with renal carcinoma, we designed a pipeline employing transfer learning to alleviate the detrimental effect of the small sample size. A dual-channel fine segmentation network (FS-Net) was constructed to segment kidney and tumor regions, with 210 publicly available 3D images from a competition employed during the training phase. We also built discriminative classifiers to classify the benign and malignant tumors based on the segmented regions, where both handcrafted and deep features were tested.

Results

Our experimental results showed that the Dice values of segmented kidney and tumor regions were 0.9662 and 0.7685, respectively, which were better than those of state-of-the-art methods. The classification model using radiomics features can classify most of the tumors correctly.

Conclusions

The designed FS-Net was demonstrated to be more effective than simply fine-tuning on the practical small size data set given that the model can borrow knowledge from large auxiliary data without diluting the signal in primary data. For the small data set, radiomics features outperformed deep features in the classification of benign and malignant tumors. This work highlights the importance of architecture design in transfer learning, and the proposed pipeline is anticipated to provide a reference and inspiration for small data analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
5.
Zurück zum Zitat Furumoto H, Shimada Y, Imai K, Maehara S, Maeda J, Hagiwara M, Okano T, Masuno R, Kakihana M, Kajiwara N, Ohira T, Ikeda N (2018) Prognostic impact of the integration of volumetric quantification of the solid part of the tumor on 3DCT and FDG-PET imaging in clinical stage IA adenocarcinoma of the lung. Lung Cancer 121:91–96. https://doi.org/10.1016/j.lungcan.2018.05.001CrossRefPubMed Furumoto H, Shimada Y, Imai K, Maehara S, Maeda J, Hagiwara M, Okano T, Masuno R, Kakihana M, Kajiwara N, Ohira T, Ikeda N (2018) Prognostic impact of the integration of volumetric quantification of the solid part of the tumor on 3DCT and FDG-PET imaging in clinical stage IA adenocarcinoma of the lung. Lung Cancer 121:91–96. https://​doi.​org/​10.​1016/​j.​lungcan.​2018.​05.​001CrossRefPubMed
8.
Zurück zum Zitat Yang G, Li G, Pan T, Kong Y, Wu J, Shu H, Luo L, Dillenseger JL, Coatrieux JL, Tang L, Zhu X (2018) Automatic segmentation of kidney and renal tumor in CT images based on 3D fully convolutional neural network with pyramid pooling module. In: Proceedings—international conference on pattern recognition. IEEE, pp 3790–3795. https://doi.org/10.1109/ICPR.2018.8545143. Yang G, Li G, Pan T, Kong Y, Wu J, Shu H, Luo L, Dillenseger JL, Coatrieux JL, Tang L, Zhu X (2018) Automatic segmentation of kidney and renal tumor in CT images based on 3D fully convolutional neural network with pyramid pooling module. In: Proceedings—international conference on pattern recognition. IEEE, pp 3790–3795. https://​doi.​org/​10.​1109/​ICPR.​2018.​8545143.
10.
Zurück zum Zitat Heller N, Sathianathen N, Kalapara A, Walczak E, Moore K, Kaluzniak H, Rosenberg J, Blake P, Rengel Z, Oestreich M, Dean J, Tradewell M, Shah A, Tejpaul R, Edgerton Z, Peterson M, Raza S, Regmi S, Papanikolopoulos N, Weight C (2019) The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomes. arXiv preprint arXiv:1904.00445 Heller N, Sathianathen N, Kalapara A, Walczak E, Moore K, Kaluzniak H, Rosenberg J, Blake P, Rengel Z, Oestreich M, Dean J, Tradewell M, Shah A, Tejpaul R, Edgerton Z, Peterson M, Raza S, Regmi S, Papanikolopoulos N, Weight C (2019) The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomes. arXiv preprint arXiv:1904.00445
11.
Zurück zum Zitat Heller N, Isensee F, Maier-Hein KH, Hou X, Xie C, Li F, Nan Y, Mu G, Lin Z, Han M, Yao G, Gao Y, Zhang Y, Wang Y, Hou F, Yang J, Xiong G, Tian J, Zhong C, Ma J, Rickman J, Dean J, Stai B, Tejpaul R, Oestreich M, Blake P, Kaluzniak H, Raza S, Rosenberg J, Moore K, Walczak E, Rengel Z, Edgerton Z, Vasdev R, Peterson M, McSweeney S, Peterson S, Kalapara A, Sathianathen N, Papanikolopoulos N, Weight C (2021) The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: results of the KiTS19 challenge. Med Image Anal 67:101821. https://doi.org/10.1016/j.media.2020.101821CrossRefPubMed Heller N, Isensee F, Maier-Hein KH, Hou X, Xie C, Li F, Nan Y, Mu G, Lin Z, Han M, Yao G, Gao Y, Zhang Y, Wang Y, Hou F, Yang J, Xiong G, Tian J, Zhong C, Ma J, Rickman J, Dean J, Stai B, Tejpaul R, Oestreich M, Blake P, Kaluzniak H, Raza S, Rosenberg J, Moore K, Walczak E, Rengel Z, Edgerton Z, Vasdev R, Peterson M, McSweeney S, Peterson S, Kalapara A, Sathianathen N, Papanikolopoulos N, Weight C (2021) The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: results of the KiTS19 challenge. Med Image Anal 67:101821. https://​doi.​org/​10.​1016/​j.​media.​2020.​101821CrossRefPubMed
12.
Zurück zum Zitat Chen S, Ma K, Zheng Y (2019) Med3D: transfer learning for 3D medical image analysis. arXiv preprint arXiv:1904.00625 Chen S, Ma K, Zheng Y (2019) Med3D: transfer learning for 3D medical image analysis. arXiv preprint arXiv:1904.00625
18.
Zurück zum Zitat Escanilla NS, Hellerstein L, Kleiman R, Kuang Z, Shull J, Page D (2019) Recursive feature elimination by sensitivity testing. In: Proceedings—17th IEEE international conference on machine learning and applications, ICMLA 2018. pp 40–47. https://doi.org/10.1109/ICMLA.2018.00014 Escanilla NS, Hellerstein L, Kleiman R, Kuang Z, Shull J, Page D (2019) Recursive feature elimination by sensitivity testing. In: Proceedings—17th IEEE international conference on machine learning and applications, ICMLA 2018. pp 40–47. https://​doi.​org/​10.​1109/​ICMLA.​2018.​00014
19.
Zurück zum Zitat Jin X, Xu A, Bie R, Guo P (2006) Machine learning techniques and chi-square feature selection for cancer classification using SAGE gene expression profiles. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer, pp 106–115. https://doi.org/10.1007/11691730_11 Jin X, Xu A, Bie R, Guo P (2006) Machine learning techniques and chi-square feature selection for cancer classification using SAGE gene expression profiles. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer, pp 106–115. https://​doi.​org/​10.​1007/​11691730_​11
22.
Zurück zum Zitat van der Maaten L, Hinton G (2008) Viualizing data using t-SNE. J Mach Learn Res 9:2579–2605 van der Maaten L, Hinton G (2008) Viualizing data using t-SNE. J Mach Learn Res 9:2579–2605
Metadaten
Titel
Improving segmentation and classification of renal tumors in small sample 3D CT images using transfer learning with convolutional neural networks
verfasst von
Xi-Liang Zhu
Hong-Bin Shen
Haitao Sun
Li-Xia Duan
Ying-Ying Xu
Publikationsdatum
15.03.2022
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 7/2022
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-022-02587-2

Weitere Artikel der Ausgabe 7/2022

International Journal of Computer Assisted Radiology and Surgery 7/2022 Zur Ausgabe

Premium Partner