Skip to main content
Top
Published in: Neural Processing Letters 3/2023

20-09-2022

Saliency Transfer Learning and Central-Cropping Network for Prostate Cancer Classification

Authors: Guokai Zhang, Mengpei Jia, Lin Gao, Jihao Luo, Aijun Zhang, Yongyong Chen, Peipei Shan, Binghui Zhao

Published in: Neural Processing Letters | Issue 3/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Classifying the malignancy of prostate lesions from MRI images is crucial in diagnosing prostate cancer at the early stage. In clinical examination, radiologists usually focus on the most salient and distinctive regions to diagnose. However, in many state-of-the-art CNN based methods, the conventional convolution operation extracts the features equally importantly, which leads to an excessive feature learning process on the uninterested regions. To address this challenge, we propose a saliency transfer learning network that allows the model to focus on the salient and influential regions automatically. Moreover, a pyramid central-crop pooling scheme is employed to extract the multi-scale, centric-visual, and salient features from different layers. To validate the effectiveness of the proposed model, extensive experiments are conducted on prostate cancer and non-cancer MRI dataset, the experimental results demonstrate that our proposed model could gain competitive performance (Accuracy 94.9%, Sensitivity 96.7%, Specificity 93.5%, AUC 0.989) on this classification task.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Prates C, Sousa S, Oliveira C, Ikram S (2011) Prostate metastatic bone cancer in an Egyptian Ptolemaic mummy, a proposed radiological diagnosis. Int J Paleopathol 1(2):98–103CrossRef Prates C, Sousa S, Oliveira C, Ikram S (2011) Prostate metastatic bone cancer in an Egyptian Ptolemaic mummy, a proposed radiological diagnosis. Int J Paleopathol 1(2):98–103CrossRef
2.
go back to reference Siegel RL, Miller KD, Fedewa SA, Ahnen DJ, Meester RG, Barzi A, Jemal A (2017) Colorectal cancer statistics, 2017. CA Cancer J Clin 67(3):177–193CrossRef Siegel RL, Miller KD, Fedewa SA, Ahnen DJ, Meester RG, Barzi A, Jemal A (2017) Colorectal cancer statistics, 2017. CA Cancer J Clin 67(3):177–193CrossRef
3.
go back to reference Zhang G, Shen X, Zhang Y, Luo Y, Luo J, Zhu D, Yang H, Wang W, Zhao B, Lu J (2021) Cross-modal prostate cancer segmentation via self-attention distillation. IEEE J Biomed Health Inform Zhang G, Shen X, Zhang Y, Luo Y, Luo J, Zhu D, Yang H, Wang W, Zhao B, Lu J (2021) Cross-modal prostate cancer segmentation via self-attention distillation. IEEE J Biomed Health Inform
4.
go back to reference Jemal A, Siegel R, Ward E, Hao Y, Xu J, Thun M et al (2009) Cancer statistics. Ca Cancer J Clin 59(4):225–249CrossRef Jemal A, Siegel R, Ward E, Hao Y, Xu J, Thun M et al (2009) Cancer statistics. Ca Cancer J Clin 59(4):225–249CrossRef
5.
go back to reference Yuan Y, Qin W, Buyyounouski M, Ibragimov B, Hancock S, Han B, Xing L (2019) Prostate cancer classification with multiparametric MRI transfer learning model. Med Phys 46(2):756–765CrossRef Yuan Y, Qin W, Buyyounouski M, Ibragimov B, Hancock S, Han B, Xing L (2019) Prostate cancer classification with multiparametric MRI transfer learning model. Med Phys 46(2):756–765CrossRef
6.
go back to reference Fehr D, Veeraraghavan H, Wibmer A, Gondo T, Matsumoto K, Vargas HA, Sala E, Hricak H, Deasy JO (2015) Automatic classification of prostate cancer Gleason scores from multiparametric magnetic resonance images. Proc Natl Acad Sci 112(46):E6265–E6273CrossRef Fehr D, Veeraraghavan H, Wibmer A, Gondo T, Matsumoto K, Vargas HA, Sala E, Hricak H, Deasy JO (2015) Automatic classification of prostate cancer Gleason scores from multiparametric magnetic resonance images. Proc Natl Acad Sci 112(46):E6265–E6273CrossRef
7.
go back to reference de Rooij M, Hamoen EH, Fütterer JJ, Barentsz JO, Rovers MM (2014) Accuracy of multiparametric MRI for prostate cancer detection: a meta-analysis. Am J Roentgenol 202(2):343–351CrossRef de Rooij M, Hamoen EH, Fütterer JJ, Barentsz JO, Rovers MM (2014) Accuracy of multiparametric MRI for prostate cancer detection: a meta-analysis. Am J Roentgenol 202(2):343–351CrossRef
8.
go back to reference Nketiah G, Elschot M, Kim E, Teruel JR, Scheenen TW, Bathen TF, Selnæs KM (2017) T2-weighted MRI-derived textural features reflect prostate cancer aggressiveness: preliminary results. Eur Radiol 27(7):3050–3059CrossRef Nketiah G, Elschot M, Kim E, Teruel JR, Scheenen TW, Bathen TF, Selnæs KM (2017) T2-weighted MRI-derived textural features reflect prostate cancer aggressiveness: preliminary results. Eur Radiol 27(7):3050–3059CrossRef
9.
go back to reference Huang X, Chen M, Liu P (2019) Recognition of transrectal ultrasound prostate image based on HOG-LBP. In: 2019 IEEE 13th international conference on anti-counterfeiting, security, and identification (ASID). IEEE, pp 183–187 Huang X, Chen M, Liu P (2019) Recognition of transrectal ultrasound prostate image based on HOG-LBP. In: 2019 IEEE 13th international conference on anti-counterfeiting, security, and identification (ASID). IEEE, pp 183–187
10.
go back to reference Farooq MT, Shaukat A, Akram U, Waqas O, Ahmad M (2017) Automatic Gleason grading of prostate cancer using gabor filter and local binary patterns. In: 2017 40th international conference on telecommunications and signal processing (TSP). IEEE, pp 642–645 Farooq MT, Shaukat A, Akram U, Waqas O, Ahmad M (2017) Automatic Gleason grading of prostate cancer using gabor filter and local binary patterns. In: 2017 40th international conference on telecommunications and signal processing (TSP). IEEE, pp 642–645
11.
go back to reference Viswanath SE, Chirra PV, Yim MC, Rofsky NM, Purysko AS, Rosen MA, Bloch BN, Madabhushi A (2019) Comparing radiomic classifiers and classifier ensembles for detection of peripheral zone prostate tumors on t2-weighted MRI: a multi-site study. BMC Med Imaging 19(1):1–12CrossRef Viswanath SE, Chirra PV, Yim MC, Rofsky NM, Purysko AS, Rosen MA, Bloch BN, Madabhushi A (2019) Comparing radiomic classifiers and classifier ensembles for detection of peripheral zone prostate tumors on t2-weighted MRI: a multi-site study. BMC Med Imaging 19(1):1–12CrossRef
12.
go back to reference Wibmer A, Hricak H, Gondo T, Matsumoto K, Veeraraghavan H, Fehr D, Zheng J, Goldman D, Moskowitz C, Fine SW et al (2015) Haralick texture analysis of prostate MRI: utility for differentiating non-cancerous prostate from prostate cancer and differentiating prostate cancers with different Gleason scores. Eur Radiol 25(10):2840–2850CrossRef Wibmer A, Hricak H, Gondo T, Matsumoto K, Veeraraghavan H, Fehr D, Zheng J, Goldman D, Moskowitz C, Fine SW et al (2015) Haralick texture analysis of prostate MRI: utility for differentiating non-cancerous prostate from prostate cancer and differentiating prostate cancers with different Gleason scores. Eur Radiol 25(10):2840–2850CrossRef
13.
go back to reference Le MH, Chen J, Wang L, Wang Z, Liu W, Cheng K-TT, Yang X (2017) Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks. Phys Med Biol 62(16):6497CrossRef Le MH, Chen J, Wang L, Wang Z, Liu W, Cheng K-TT, Yang X (2017) Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks. Phys Med Biol 62(16):6497CrossRef
14.
go back to reference Yang X, Liu C, Wang Z, Yang J, Le Min H, Wang L, Cheng K-TT (2017) Co-trained convolutional neural networks for automated detection of prostate cancer in multi-parametric MRI. Med Image Anal 42:212–227CrossRef Yang X, Liu C, Wang Z, Yang J, Le Min H, Wang L, Cheng K-TT (2017) Co-trained convolutional neural networks for automated detection of prostate cancer in multi-parametric MRI. Med Image Anal 42:212–227CrossRef
15.
go back to reference Wang Z, Liu C, Cheng D, Wang L, Yang X, Cheng K-T (2018) Automated detection of clinically significant prostate cancer in MP-MRI images based on an end-to-end deep neural network. IEEE Trans Med Imaging 37(5):1127–1139CrossRef Wang Z, Liu C, Cheng D, Wang L, Yang X, Cheng K-T (2018) Automated detection of clinically significant prostate cancer in MP-MRI images based on an end-to-end deep neural network. IEEE Trans Med Imaging 37(5):1127–1139CrossRef
16.
go back to reference Reda I, Khalil A, Elmogy M, Abou El-Fetouh A, Shalaby A, Abou El-Ghar M, Elmaghraby A, Ghazal M, El-Baz A (2018) Deep learning role in early diagnosis of prostate cancer. Technol Cancer Res Treat 17:1533034618775530CrossRef Reda I, Khalil A, Elmogy M, Abou El-Fetouh A, Shalaby A, Abou El-Ghar M, Elmaghraby A, Ghazal M, El-Baz A (2018) Deep learning role in early diagnosis of prostate cancer. Technol Cancer Res Treat 17:1533034618775530CrossRef
17.
go back to reference Lapa P, Gonçalves I, Rundo L, Castelli M (2019) Semantic learning machine improves the CNN-based detection of prostate cancer in non-contrast-enhanced MRI. In: Proceedings of the genetic and evolutionary computation conference companion, pp 1837–1845 Lapa P, Gonçalves I, Rundo L, Castelli M (2019) Semantic learning machine improves the CNN-based detection of prostate cancer in non-contrast-enhanced MRI. In: Proceedings of the genetic and evolutionary computation conference companion, pp 1837–1845
18.
go back to reference Song Y, Zhang Y-D, Yan X, Liu H, Zhou M, Hu B, Yang G (2018) Computer-aided diagnosis of prostate cancer using a deep convolutional neural network from multiparametric MRI. J Magn Reson Imaging 48(6):1570–1577CrossRef Song Y, Zhang Y-D, Yan X, Liu H, Zhou M, Hu B, Yang G (2018) Computer-aided diagnosis of prostate cancer using a deep convolutional neural network from multiparametric MRI. J Magn Reson Imaging 48(6):1570–1577CrossRef
19.
go back to reference Zhong X, Cao R, Shakeri S, Scalzo F, Lee Y, Enzmann DR, Wu HH, Raman SS, Sung K (2019) Deep transfer learning-based prostate cancer classification using 3 tesla multi-parametric MRI. Abdominal Radiol 44(6):2030–2039CrossRef Zhong X, Cao R, Shakeri S, Scalzo F, Lee Y, Enzmann DR, Wu HH, Raman SS, Sung K (2019) Deep transfer learning-based prostate cancer classification using 3 tesla multi-parametric MRI. Abdominal Radiol 44(6):2030–2039CrossRef
20.
go back to reference Abraham B, Nair MS (2018) Computer-aided classification of prostate cancer grade groups from MRI images using texture features and stacked sparse autoencoder. Comput Med Imaging Graph 69:60–68CrossRef Abraham B, Nair MS (2018) Computer-aided classification of prostate cancer grade groups from MRI images using texture features and stacked sparse autoencoder. Comput Med Imaging Graph 69:60–68CrossRef
21.
go back to reference Abraham B, Nair MS (2019) Computer-aided grading of prostate cancer from MRI images using convolutional neural networks. J Intell Fuzzy Syst 36(3):2015–2024CrossRef Abraham B, Nair MS (2019) Computer-aided grading of prostate cancer from MRI images using convolutional neural networks. J Intell Fuzzy Syst 36(3):2015–2024CrossRef
22.
go back to reference Fakoor R, Ladhak F, Nazi A, Huber M (2013) Using deep learning to enhance cancer diagnosis and classification. In: Proceedings of the international conference on machine learning, vol 28. ACM, New York Fakoor R, Ladhak F, Nazi A, Huber M (2013) Using deep learning to enhance cancer diagnosis and classification. In: Proceedings of the international conference on machine learning, vol 28. ACM, New York
23.
go back to reference Wang X, Yang W, Weinreb J, Han J, Li Q, Kong X, Yan Y, Ke Z, Luo B, Liu T et al (2017) Searching for prostate cancer by fully automated magnetic resonance imaging classification: deep learning versus non-deep learning. Sci Rep 7(1):1–8 Wang X, Yang W, Weinreb J, Han J, Li Q, Kong X, Yan Y, Ke Z, Luo B, Liu T et al (2017) Searching for prostate cancer by fully automated magnetic resonance imaging classification: deep learning versus non-deep learning. Sci Rep 7(1):1–8
24.
go back to reference Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298CrossRef Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298CrossRef
25.
go back to reference Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Liang J (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imaging 35(5):1299–1312CrossRef Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Liang J (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imaging 35(5):1299–1312CrossRef
26.
go back to reference Liu S, Zheng H, Feng Y, Li W (2017) Prostate cancer diagnosis using deep learning with 3d multiparametric MRI. In: Medical imaging 2017: computer-aided diagnosis, vol 10134. International Society for Optics and Photonics, p 1013428 Liu S, Zheng H, Feng Y, Li W (2017) Prostate cancer diagnosis using deep learning with 3d multiparametric MRI. In: Medical imaging 2017: computer-aided diagnosis, vol 10134. International Society for Optics and Photonics, p 1013428
28.
go back to reference Chen L, Zhang H, Xiao J, Nie L, Shao J, Liu W, Chua T-S (2017) SCA-CNN: spatial and channel-wise attention in convolutional networks for image captioning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5659–5667 Chen L, Zhang H, Xiao J, Nie L, Shao J, Liu W, Chua T-S (2017) SCA-CNN: spatial and channel-wise attention in convolutional networks for image captioning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5659–5667
29.
go back to reference Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259CrossRef Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259CrossRef
30.
go back to reference Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2117–2125 Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2117–2125
31.
go back to reference Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2881–2890 Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2881–2890
33.
go back to reference Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
34.
go back to reference Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708
35.
go back to reference Gao S, Cheng M-M, Zhao K, Zhang X-Y, Yang M-H, Torr PH (2019) Res2net: a new multi-scale backbone architecture. IEEE Trans Pattern Anal Mach Intell 43:652–662CrossRef Gao S, Cheng M-M, Zhao K, Zhang X-Y, Yang M-H, Torr PH (2019) Res2net: a new multi-scale backbone architecture. IEEE Trans Pattern Anal Mach Intell 43:652–662CrossRef
36.
go back to reference Li X, Wang W, Hu X, Yang J (2019) Selective kernel networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 510–519 Li X, Wang W, Hu X, Yang J (2019) Selective kernel networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 510–519
37.
go back to reference Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, Wang X, Tang X (2017) Residual attention network for image classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3156–3164 Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, Wang X, Tang X (2017) Residual attention network for image classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3156–3164
38.
go back to reference Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141 Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141
Metadata
Title
Saliency Transfer Learning and Central-Cropping Network for Prostate Cancer Classification
Authors
Guokai Zhang
Mengpei Jia
Lin Gao
Jihao Luo
Aijun Zhang
Yongyong Chen
Peipei Shan
Binghui Zhao
Publication date
20-09-2022
Publisher
Springer US
Published in
Neural Processing Letters / Issue 3/2023
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-022-10999-z

Other articles of this Issue 3/2023

Neural Processing Letters 3/2023 Go to the issue