Skip to main content
Erschienen in: Neural Processing Letters 7/2023

05.04.2023

Automatic Head-and-Neck Tumor Segmentation in MRI via an End-to-End Adversarial Network

verfasst von: PinLi Yang, XingChen Peng, JiangHong Xiao, Xi Wu, JiLiu Zhou, Yan Wang

Erschienen in: Neural Processing Letters | Ausgabe 7/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Among head-and-neck tumors, nasopharyngeal carcinoma (NPC) is the most common type which accounts for high mortality. In the clinical treatment of NPC, magnetic resonance imaging (MRI) has been the primacy method to assess the local and intracranial infiltration of NPC. Due to the time-consuming and labor-intensive nature of NPC in MRI segmentation process, it is desirable to design an accurate and automatic tumor segmentation method. In light of this, we propose a novel end-to-end adversarial network, named as Dense-SegNet based Generative Adversarial Networks (DS-GANs), for NPC segmentation. First, to solve the problem of edge blurring of NPC in MRI images, we propose a hybrid U-shape architecture which integrates the advantages of SegNet and U-net, and the hybrid architecture is named as SU-net. Second, enlightened by the great success of densely connected convolutional networks, we introduce the dense blocks structure to replace the convolution and deconvolution blocks in the proposed SU-net, thus minimizing the number of training parameters while achieving higher performance. The improved composite architecture is referred as DSU-net and employed as the generator network. Third, the traditional adversarial network outputting a single true/false may not match our tumor segmentation task, we introduce a multiscale adversarial network to distinguish both global and local features between the segmented result and the ground truth. Finally, we propose to use a hybrid loss function that utilizes both the multiscale adversarial loss and the Dice loss to train the entire network for better segmentation performance. The effectiveness of the proposed method is evaluated through an in-house NPC dataset of MRI images and better segmentation results are obtained compared with the state-of-the-art segmentation methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lo KW, To KF, Huang DP (2004) Focus on nasopharyngeal carcinoma. Cancer Cell 5(5):423–428CrossRef Lo KW, To KF, Huang DP (2004) Focus on nasopharyngeal carcinoma. Cancer Cell 5(5):423–428CrossRef
2.
Zurück zum Zitat Chang ET, Liu Z, Hildesheim A, Liu Q, Ye W (2017) Active and passive smoking and risk of nasopharyngeal carcinoma: a population-based case-control study in southern china. Am J Epidemiol 185(12):1–9CrossRef Chang ET, Liu Z, Hildesheim A, Liu Q, Ye W (2017) Active and passive smoking and risk of nasopharyngeal carcinoma: a population-based case-control study in southern china. Am J Epidemiol 185(12):1–9CrossRef
3.
Zurück zum Zitat Mornet S, Vasseur S, Grasset F, Duguet E (2004) Magnetic nanoparticle design for medical diagnosis and therapy. J Mater Chem 14(14):2161–2175CrossRef Mornet S, Vasseur S, Grasset F, Duguet E (2004) Magnetic nanoparticle design for medical diagnosis and therapy. J Mater Chem 14(14):2161–2175CrossRef
4.
Zurück zum Zitat Zu C, Wang Z, Zhang D, Liang P, Shi Y, Shen D, Wu G (2017) Robust multi-atlas label propagation by deep sparse representation. Pattern Recogn 63:511–517CrossRef Zu C, Wang Z, Zhang D, Liang P, Shi Y, Shen D, Wu G (2017) Robust multi-atlas label propagation by deep sparse representation. Pattern Recogn 63:511–517CrossRef
5.
Zurück zum Zitat Peng PJ, Lv BJ, Wang ZH, Liao H, Liu YM, Lin Z et al (2017) Multi-institutional prospective study of nedaplatin plus s-1 chemotherapy in recurrent and metastatic nasopharyngeal carcinoma patients after failure of platinum-containing regimens. Ther Adv Med Oncol 9(2):68–74CrossRef Peng PJ, Lv BJ, Wang ZH, Liao H, Liu YM, Lin Z et al (2017) Multi-institutional prospective study of nedaplatin plus s-1 chemotherapy in recurrent and metastatic nasopharyngeal carcinoma patients after failure of platinum-containing regimens. Ther Adv Med Oncol 9(2):68–74CrossRef
6.
Zurück zum Zitat Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for scene segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495CrossRef Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for scene segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495CrossRef
7.
Zurück zum Zitat Huang YH, Feng QJ (2018) Segmentation of brain tumor on magnetic resonance images using 3d full-convolutional densely connected convolutional networks. J South Med Univ 38(6):661–668 Huang YH, Feng QJ (2018) Segmentation of brain tumor on magnetic resonance images using 3d full-convolutional densely connected convolutional networks. J South Med Univ 38(6):661–668
8.
Zurück zum Zitat Gubern-Merida A, Kallenberg M, Mann RM, Marti R, Karssemeijer N (2015) Breast segmentation and density estimation in breast MRI: a fully automatic framework. IEEE J Biomed Health Inform 19(1):349–357CrossRef Gubern-Merida A, Kallenberg M, Mann RM, Marti R, Karssemeijer N (2015) Breast segmentation and density estimation in breast MRI: a fully automatic framework. IEEE J Biomed Health Inform 19(1):349–357CrossRef
9.
Zurück zum Zitat Marsousi M, Plataniotis K, Stergiopoulos S (2017) An automated approach for kidney segmentation in three-dimensional ultrasound images. IEEE J Biomed Health Inform 21:1079–1094CrossRef Marsousi M, Plataniotis K, Stergiopoulos S (2017) An automated approach for kidney segmentation in three-dimensional ultrasound images. IEEE J Biomed Health Inform 21:1079–1094CrossRef
10.
Zurück zum Zitat Roy S, He Q, Sweeney E, Carass A, Reich DS, Prince JL, Pham DL (2015) Subject-specific sparse dictionary learning for atlas-based brain MRI segmentation. IEEE J Biomed Health Inform 19(5):1598–1609CrossRef Roy S, He Q, Sweeney E, Carass A, Reich DS, Prince JL, Pham DL (2015) Subject-specific sparse dictionary learning for atlas-based brain MRI segmentation. IEEE J Biomed Health Inform 19(5):1598–1609CrossRef
11.
Zurück zum Zitat Song Y, He L, Zhou F, Chen S, Ni D, Lei B, Wang T (2017) Segmentation, splitting, and classification of overlapping bacteria in microscope images for automatic bacterial vaginosis diagnosis. IEEE J Biomed Health Inform 21:1095–1104CrossRef Song Y, He L, Zhou F, Chen S, Ni D, Lei B, Wang T (2017) Segmentation, splitting, and classification of overlapping bacteria in microscope images for automatic bacterial vaginosis diagnosis. IEEE J Biomed Health Inform 21:1095–1104CrossRef
12.
Zurück zum Zitat Zhou J, Tian Q, Chong V, Xiong W, Huang W, Wang Z (2011) Segmentation of skull base tumors from MRI using a hybrid support vector machine-based method. In: International workshop on machine learning in medical imaging, pp 134–141 Zhou J, Tian Q, Chong V, Xiong W, Huang W, Wang Z (2011) Segmentation of skull base tumors from MRI using a hybrid support vector machine-based method. In: International workshop on machine learning in medical imaging, pp 134–141
13.
Zurück zum Zitat Huang W, Chan KL, Zhou J (2013) Region-based nasopharyngeal carcinoma lesion segmentation from MRI using clustering- and classification-based methods with learning. J Digit Imaging 26(3):472–482CrossRef Huang W, Chan KL, Zhou J (2013) Region-based nasopharyngeal carcinoma lesion segmentation from MRI using clustering- and classification-based methods with learning. J Digit Imaging 26(3):472–482CrossRef
14.
Zurück zum Zitat Geng Q, Zhou Z, Cao X (2018) Survey of recent progress in semantic image segmentation with CNNs. Sci China 61(05):107–124MathSciNet Geng Q, Zhou Z, Cao X (2018) Survey of recent progress in semantic image segmentation with CNNs. Sci China 61(05):107–124MathSciNet
15.
Zurück zum Zitat Zhang Z, Pang Y (2020) CGNet: cross-guidance network for semantic segmentation. Sci China Inf Sci 63(2):1–16CrossRef Zhang Z, Pang Y (2020) CGNet: cross-guidance network for semantic segmentation. Sci China Inf Sci 63(2):1–16CrossRef
16.
Zurück zum Zitat Wang K, Zhan B, Zu C, Wu X, Zhou J, Zhou L, Wang Y (2022) Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning. Med Image Anal 79:102447CrossRef Wang K, Zhan B, Zu C, Wu X, Zhou J, Zhou L, Wang Y (2022) Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning. Med Image Anal 79:102447CrossRef
17.
Zurück zum Zitat Tang P, Yang P, Nie D, Wu X, Zhou J, Wang Y (2022) Unified medical image segmentation by learning from uncertainty in an end-to-end manner. Knowl-Based Syst 241:108215CrossRef Tang P, Yang P, Nie D, Wu X, Zhou J, Wang Y (2022) Unified medical image segmentation by learning from uncertainty in an end-to-end manner. Knowl-Based Syst 241:108215CrossRef
18.
Zurück zum Zitat Hu L, Li J, Peng X, Xiao J, Zhan B, Zu C, Wang Y (2022) Semi-supervised NPC segmentation with uncertainty and attention guided consistency. Knowl-Based Syst 239:108021CrossRef Hu L, Li J, Peng X, Xiao J, Zhan B, Zu C, Wang Y (2022) Semi-supervised NPC segmentation with uncertainty and attention guided consistency. Knowl-Based Syst 239:108021CrossRef
19.
Zurück zum Zitat Sun Y, Yang H, Zhou J, Wang Y (2022) ISSMF: integrated semantic and spatial information of multi-level features for automatic segmentation in prenatal ultrasound images. Artif Intell Med 125:102254CrossRef Sun Y, Yang H, Zhou J, Wang Y (2022) ISSMF: integrated semantic and spatial information of multi-level features for automatic segmentation in prenatal ultrasound images. Artif Intell Med 125:102254CrossRef
20.
Zurück zum Zitat Wang K, Wang Y, Zhan B, Yang Y, Zu C, Wu X, Zhou L (2022) An efficient semisupervised framework with multitask and curriculum learning for medical image segmentation. Int J Neural Syst 32(9):2250043CrossRef Wang K, Wang Y, Zhan B, Yang Y, Zu C, Wu X, Zhou L (2022) An efficient semisupervised framework with multitask and curriculum learning for medical image segmentation. Int J Neural Syst 32(9):2250043CrossRef
21.
Zurück zum Zitat Jiang H, Ma H, Qian W, Gao M, Li Y (2017) An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Informat 22(4):1227–1237CrossRef Jiang H, Ma H, Qian W, Gao M, Li Y (2017) An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Informat 22(4):1227–1237CrossRef
22.
Zurück zum Zitat Lekadir K, Galimzianova A, Betriu À, del Mar Vila M, Igual L, Rubin DL et al (2017) A Convolutional neural network for automatic characterization of plaque composition in carotid ultrasound. IEEE J Biomed Health Informat 21(1):48–55CrossRef Lekadir K, Galimzianova A, Betriu À, del Mar Vila M, Igual L, Rubin DL et al (2017) A Convolutional neural network for automatic characterization of plaque composition in carotid ultrasound. IEEE J Biomed Health Informat 21(1):48–55CrossRef
23.
Zurück zum Zitat Kamnitsas K, Ledig C, Newcombe VF, Simpson JP, Kane AD, Menon DK et al (2017) Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78CrossRef Kamnitsas K, Ledig C, Newcombe VF, Simpson JP, Kane AD, Menon DK et al (2017) Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78CrossRef
24.
Zurück zum Zitat Milletari F, Ahmadi SA, Kroll C, Plate A, Rozanski V, Maiostre J et al (2017) Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound. Comput Vis Image Understand 164:92–102CrossRef Milletari F, Ahmadi SA, Kroll C, Plate A, Rozanski V, Maiostre J et al (2017) Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound. Comput Vis Image Understand 164:92–102CrossRef
25.
Zurück zum Zitat Cha KH, Hadjiiski L, Samala RK, Chan HP, Caoili EM, Cohan RH (2016) Urinary bladder segmentation in CT urography using deep-learning convolutional neural network and level sets. Med Phys 43(4):1882–1896CrossRef Cha KH, Hadjiiski L, Samala RK, Chan HP, Caoili EM, Cohan RH (2016) Urinary bladder segmentation in CT urography using deep-learning convolutional neural network and level sets. Med Phys 43(4):1882–1896CrossRef
26.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer
27.
Zurück zum Zitat Milletari F, Navab N, Ahmadi SA (2016). V-net: fully convolutional neural networks for volumetric medical image segmentation. In: 3D Vision (3DV), 2016 4th international conference on (pp. 565–571). IEEE Milletari F, Navab N, Ahmadi SA (2016). V-net: fully convolutional neural networks for volumetric medical image segmentation. In: 3D Vision (3DV), 2016 4th international conference on (pp. 565–571). IEEE
28.
Zurück zum Zitat Kuo M, Xinyuan C, Ye Z, Tao Z, Jianrong D, Junlin Y et al (2017) Deep deconvolutional neural network for target segmentation of nasopharyngeal cancer in planning computed tomography images. Front Oncol 7:315CrossRef Kuo M, Xinyuan C, Ye Z, Tao Z, Jianrong D, Junlin Y et al (2017) Deep deconvolutional neural network for target segmentation of nasopharyngeal cancer in planning computed tomography images. Front Oncol 7:315CrossRef
29.
Zurück zum Zitat Wang Y, Zhao L, Song Z, Wang M (2018). Organ at risk segmentation in head and neck CT images by using a two-stage segmentation framework based on 3d u-net. IEEE Access. Wang Y, Zhao L, Song Z, Wang M (2018). Organ at risk segmentation in head and neck CT images by using a two-stage segmentation framework based on 3d u-net. IEEE Access.
31.
Zurück zum Zitat Eelbode T, Bertels J, Berman M et al (2020) Optimization for medical image segmentation: theory and practice when evaluating with dice score or Jaccard index. IEEE Trans Med Imaging 39(11):3679–3690CrossRef Eelbode T, Bertels J, Berman M et al (2020) Optimization for medical image segmentation: theory and practice when evaluating with dice score or Jaccard index. IEEE Trans Med Imaging 39(11):3679–3690CrossRef
32.
Zurück zum Zitat Oksuz I, Clough JR, Ruijsink B et al (2020) Deep learning based detection and correction of cardiac mr motion artefacts during reconstruction for high-quality segmentation. IEEE Trans Med Imaging 39(12):4001–4010CrossRef Oksuz I, Clough JR, Ruijsink B et al (2020) Deep learning based detection and correction of cardiac mr motion artefacts during reconstruction for high-quality segmentation. IEEE Trans Med Imaging 39(12):4001–4010CrossRef
33.
Zurück zum Zitat Ma Z, Wu X, Sun S, et al (2018) A discriminative learning based approach for automated nasopharyngeal carcinoma segmentation leveraging multi-modality similarity metric learning. In: 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018). IEEE. Ma Z, Wu X, Sun S, et al (2018) A discriminative learning based approach for automated nasopharyngeal carcinoma segmentation leveraging multi-modality similarity metric learning. In: 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018). IEEE.
34.
Zurück zum Zitat Goodfellow IJ, Pouget-Abadie J, Mirza M, Bing X, Warde-Farley D, Ozair S, et al (2014) Generative adversarial nets. In: International conference on neural information processing systems Goodfellow IJ, Pouget-Abadie J, Mirza M, Bing X, Warde-Farley D, Ozair S, et al (2014) Generative adversarial nets. In: International conference on neural information processing systems
35.
Zurück zum Zitat Yi X, Walia E, Babyn P (2019) Generative adversarial network in medical imaging: a review. Med Image Anal 58:101552CrossRef Yi X, Walia E, Babyn P (2019) Generative adversarial network in medical imaging: a review. Med Image Anal 58:101552CrossRef
36.
Zurück zum Zitat Bodla N, Hua G, Chellappa R (2018) Semi-supervised FusedGAN for conditional image generation. Bodla N, Hua G, Chellappa R (2018) Semi-supervised FusedGAN for conditional image generation.
37.
Zurück zum Zitat Zhang B, Ouyang F, Gu D, Dong Y, Lu Z, Mo X et al (2017) Advanced nasopharyngeal carcinoma: pre-treatment prediction of progression based on multi-parametric MRI radiomics. Oncotarget 8(42):72457–72465CrossRef Zhang B, Ouyang F, Gu D, Dong Y, Lu Z, Mo X et al (2017) Advanced nasopharyngeal carcinoma: pre-treatment prediction of progression based on multi-parametric MRI radiomics. Oncotarget 8(42):72457–72465CrossRef
38.
Zurück zum Zitat Vardhana M, Arunkumar N, Lasrado S, Abdulhay E, Ramirez-Gonzalez G (2018) Convolutional neural network for bio-medical image segmentation with hardware acceleration. Cognit Syst Res 50(AUG):10–14CrossRef Vardhana M, Arunkumar N, Lasrado S, Abdulhay E, Ramirez-Gonzalez G (2018) Convolutional neural network for bio-medical image segmentation with hardware acceleration. Cognit Syst Res 50(AUG):10–14CrossRef
39.
Zurück zum Zitat Bi L, Kim J, Kumar A, Fulham M, Feng D (2017) Stacked fully convolutional networks with multi-channel learning: application to medical image segmentation. Vis Comp 33(6–8):1061–1071CrossRef Bi L, Kim J, Kumar A, Fulham M, Feng D (2017) Stacked fully convolutional networks with multi-channel learning: application to medical image segmentation. Vis Comp 33(6–8):1061–1071CrossRef
40.
Zurück zum Zitat Creswell A, White T, Dumoulin V, Arulkumaran K, Sengupta B, Bharath AA (2017) Generative adversarial networks: an overview. IEEE Signal Process Mag 35(1):53–65CrossRef Creswell A, White T, Dumoulin V, Arulkumaran K, Sengupta B, Bharath AA (2017) Generative adversarial networks: an overview. IEEE Signal Process Mag 35(1):53–65CrossRef
41.
Zurück zum Zitat Wang KF, Gou C, Duan YJ, Lin YL, Wang FY (2017) Generative adversarial networks: the state of the art and beyond. Zidonghua Xuebao/Acta Automatica Sinica 43(3):321–332 Wang KF, Gou C, Duan YJ, Lin YL, Wang FY (2017) Generative adversarial networks: the state of the art and beyond. Zidonghua Xuebao/Acta Automatica Sinica 43(3):321–332
42.
Zurück zum Zitat Xue Y, Xu T, Zhang H et al (2018) SegAN: adversarial network with multi-scale L1 loss for medical image segmentation. Neuroinform 16:383–392CrossRef Xue Y, Xu T, Zhang H et al (2018) SegAN: adversarial network with multi-scale L1 loss for medical image segmentation. Neuroinform 16:383–392CrossRef
43.
Zurück zum Zitat Tang XL, Du YM, Liu YW, Li JX, Ma YW (2018) Image recognition with conditional deep convolutional generative adversarial networks. Zidonghua Xuebao/Acta Automatica Sinica 44(5):855–864 Tang XL, Du YM, Liu YW, Li JX, Ma YW (2018) Image recognition with conditional deep convolutional generative adversarial networks. Zidonghua Xuebao/Acta Automatica Sinica 44(5):855–864
44.
Zurück zum Zitat Yuan Y, Qin W, Guo X, Buyyounouski M, Hancock S, Han B, Xing L (2019) Prostate segmentation with encoder-decoder densely connected convolutional network (Ed-Densenet). In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pp 434–437. IEEE Yuan Y, Qin W, Guo X, Buyyounouski M, Hancock S, Han B, Xing L (2019) Prostate segmentation with encoder-decoder densely connected convolutional network (Ed-Densenet). In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pp 434–437. IEEE
45.
Zurück zum Zitat Ghamisi P, Yokoya N (2018) Img2dsm: height simulation from single imagery using conditional generative adversarial net. IEEE Geosci Remote Sens Lett 15(5):794–798CrossRef Ghamisi P, Yokoya N (2018) Img2dsm: height simulation from single imagery using conditional generative adversarial net. IEEE Geosci Remote Sens Lett 15(5):794–798CrossRef
Metadaten
Titel
Automatic Head-and-Neck Tumor Segmentation in MRI via an End-to-End Adversarial Network
verfasst von
PinLi Yang
XingChen Peng
JiangHong Xiao
Xi Wu
JiLiu Zhou
Yan Wang
Publikationsdatum
05.04.2023
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 7/2023
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-023-11232-1

Weitere Artikel der Ausgabe 7/2023

Neural Processing Letters 7/2023 Zur Ausgabe

Neuer Inhalt