Skip to main content
Top
Published in: Evolutionary Intelligence 3/2022

24-01-2021 | Research Paper

Sub-classification of invasive and non-invasive cancer from magnification independent histopathological images using hybrid neural networks

Authors: Sumit Kumar, Shallu Sharma

Published in: Evolutionary Intelligence | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Histopathology plays a crucial role in helping clinicians to manage patient’s health effectively. To improve diagnostic accuracy from histopathology, this study evaluates the potential of the pre-trained deep-learning-based model on a large dataset for discrimination among sub-classes of breast cancer. A hybrid model is proposed by combining the pre-trained model (Xception and VGG16) along with conventional machine learning classifier to achieve highest accuracies in the classification of breast cancer without considering the magnification factor of the histopathological images. Real-time data augmentation is also applied to the dataset in order to reduce the problem of overfitting. The performance of developed hybrid models is compared for achieving the highest classification accuracies with an optimum running time. It has been found that VGG16 acquires an accuracy, precision, recall, f-score, area under the receiver operating characteristic (AUC), average precision score of 78.67%, 0.76, 0.75, 0.75, 0.86, 0.60 with a running time of 39.72 min when used in conjunction with logistic regression which is further enhanced by the Xception model to 82.45%, 0.83, 0.82, 0.82, 0.90, 0.70 with a running time of 36.57 min. The most optimum performance of the Xception model suggests that it can be utilized as an automated system for the early diagnosis of breast cancer.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aamir M, Nawi NM, Wahid F, Mahdin HJ (2020) A deep contractive autoencoder for solving multiclass classification problems. Evol Intell 1:1–15 Aamir M, Nawi NM, Wahid F, Mahdin HJ (2020) A deep contractive autoencoder for solving multiclass classification problems. Evol Intell 1:1–15
2.
go back to reference Xie J, Liu R, Luttrell J IV, Zhang CJ (2019) Deep learning based analysis of histopathological images of breast cancer. Front Genet 10:80CrossRef Xie J, Liu R, Luttrell J IV, Zhang CJ (2019) Deep learning based analysis of histopathological images of breast cancer. Front Genet 10:80CrossRef
3.
go back to reference Han Z, Wei B, Zheng Y, Yin Y, Li K, Li SJ (2017) Breast cancer multi-classification from histopathological images with structured deep learning model. Sci Rep 7(1):1–10CrossRef Han Z, Wei B, Zheng Y, Yin Y, Li K, Li SJ (2017) Breast cancer multi-classification from histopathological images with structured deep learning model. Sci Rep 7(1):1–10CrossRef
4.
go back to reference Sharma S, Mehra R (2020) Conventional machine learning and deep learning approach for multi-classification of breast cancer histopathology images—a comparative insight. J Digit Imag 1:1–23 Sharma S, Mehra R (2020) Conventional machine learning and deep learning approach for multi-classification of breast cancer histopathology images—a comparative insight. J Digit Imag 1:1–23
5.
go back to reference Bayramoglu N, Kannala J, Heikkilä J (2016) Deep learning for magnification independent breast cancer histopathology image classification. In: 23rd International conference on pattern recognition (ICPR). IEEE. Bayramoglu N, Kannala J, Heikkilä J (2016) Deep learning for magnification independent breast cancer histopathology image classification. In: 23rd International conference on pattern recognition (ICPR). IEEE.
6.
go back to reference Peikari M, Gangeh MJ, Zubovits J, Clarke G, Martel AL (2016) Triaging diagnostically relevant regions from pathology whole slides of breast cancer: a texture based approach. IEEE Trans Med Imaging 35(1):307–315CrossRef Peikari M, Gangeh MJ, Zubovits J, Clarke G, Martel AL (2016) Triaging diagnostically relevant regions from pathology whole slides of breast cancer: a texture based approach. IEEE Trans Med Imaging 35(1):307–315CrossRef
7.
go back to reference Sharma S, Mehra R (2018) Breast cancer histology images classification: training from scratch or transfer learning? ICT Express 4(4):247–254CrossRef Sharma S, Mehra R (2018) Breast cancer histology images classification: training from scratch or transfer learning? ICT Express 4(4):247–254CrossRef
8.
go back to reference Man R, Yang P, Xu BJ (2020) Classification of breast cancer histopathological images using discriminative patches screened by generative adversarial networks. IEEE Access 8:155362–155377CrossRef Man R, Yang P, Xu BJ (2020) Classification of breast cancer histopathological images using discriminative patches screened by generative adversarial networks. IEEE Access 8:155362–155377CrossRef
9.
go back to reference Spanhol FA, Oliveira LS, Petitjean C, Heutte L (2016) A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng 63(7):1455–1462CrossRef Spanhol FA, Oliveira LS, Petitjean C, Heutte L (2016) A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng 63(7):1455–1462CrossRef
10.
go back to reference Naresh A, Venkata Krishna P (2020) An efficient approach for sentiment analysis using machine learning algorithm. Evol Intell Naresh A, Venkata Krishna P (2020) An efficient approach for sentiment analysis using machine learning algorithm. Evol Intell
11.
go back to reference Shi Y, Suk H-I, Gao Y, Lee S-W, Shen DJ, Systems L (2019) Leveraging coupled interaction for multimodal Alzheimer's disease diagnosis. IEEE Trans Neural Netw Shi Y, Suk H-I, Gao Y, Lee S-W, Shen DJ, Systems L (2019) Leveraging coupled interaction for multimodal Alzheimer's disease diagnosis. IEEE Trans Neural Netw
12.
go back to reference Zhou T, Liu M, Thung K-H, Shen DJ (2019) Latent representation learning for Alzheimer’s disease diagnosis with incomplete multi-modality neuroimaging and genetic data. IEEE Trans Med Imaging 38(10):2411–2422CrossRef Zhou T, Liu M, Thung K-H, Shen DJ (2019) Latent representation learning for Alzheimer’s disease diagnosis with incomplete multi-modality neuroimaging and genetic data. IEEE Trans Med Imaging 38(10):2411–2422CrossRef
13.
go back to reference Sharma S, Mehra R (2019) Effect of layer-wise fine-tuning in magnification-dependent classification of breast cancer histopathological image. Vis Comput 1:1–15 Sharma S, Mehra R (2019) Effect of layer-wise fine-tuning in magnification-dependent classification of breast cancer histopathological image. Vis Comput 1:1–15
14.
go back to reference Spanhol FA, Oliveira LS, Petitjean C, Heutte L (eds) (2016) Breast cancer histopathological image classification using convolutional neural networks. In: IEEE international joint conference on neural networks (IJCNN) Spanhol FA, Oliveira LS, Petitjean C, Heutte L (eds) (2016) Breast cancer histopathological image classification using convolutional neural networks. In: IEEE international joint conference on neural networks (IJCNN)
15.
go back to reference Sharma S, Mehra R, Kumar S (2020) Optimised CNN in conjunction with efficient pooling strategy for the multi‐classification of breast cancer. IET Image Process 1–11 Sharma S, Mehra R, Kumar S (2020) Optimised CNN in conjunction with efficient pooling strategy for the multi‐classification of breast cancer. IET Image Process 1–11
16.
go back to reference An F-P, Liu Z-W (2019) Medical image segmentation algorithm based on feedback mechanism CNN. Contrast media and molecular imaging An F-P, Liu Z-W (2019) Medical image segmentation algorithm based on feedback mechanism CNN. Contrast media and molecular imaging
17.
go back to reference Bellver Bueno M (2017) Detection-aided medical image segmentation using deep learning: Universitat Politècnica de Catalunya Bellver Bueno M (2017) Detection-aided medical image segmentation using deep learning: Universitat Politècnica de Catalunya
18.
go back to reference Zhou T, Ruan S, Canu S (2019) A review: deep learning for medical image segmentation using multi-modality fusion. Array 1:100004CrossRef Zhou T, Ruan S, Canu S (2019) A review: deep learning for medical image segmentation using multi-modality fusion. Array 1:100004CrossRef
19.
go back to reference Khan MA, Khan MA, Ahmed F, Mittal M, Goyal LM, Hemanth DJ (2020) Gastrointestinal diseases segmentation and classification based on duo-deep architectures. Pattern Recognit Lett 131:193–204CrossRef Khan MA, Khan MA, Ahmed F, Mittal M, Goyal LM, Hemanth DJ (2020) Gastrointestinal diseases segmentation and classification based on duo-deep architectures. Pattern Recognit Lett 131:193–204CrossRef
20.
go back to reference Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I et al (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imag 35(5):1285–1298CrossRef Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I et al (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imag 35(5):1285–1298CrossRef
21.
go back to reference Sirinukunwattana K, SeA R, Tsang Y-W, Snead DR, Cree IA, Rajpoot NM (2016) Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imag 35(5):1196–1206CrossRef Sirinukunwattana K, SeA R, Tsang Y-W, Snead DR, Cree IA, Rajpoot NM (2016) Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imag 35(5):1196–1206CrossRef
22.
go back to reference Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J et al (2016) Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imag 35(1):119–130CrossRef Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J et al (2016) Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imag 35(1):119–130CrossRef
23.
go back to reference Tobore I, Li J, Yuhang L, Al-Handarish Y, Kandwal A, Nie Z et al (2019) Deep learning intervention for health care challenges: some biomedical domain considerations. JMIR mHealth uHealth 7(8):e11966CrossRef Tobore I, Li J, Yuhang L, Al-Handarish Y, Kandwal A, Nie Z et al (2019) Deep learning intervention for health care challenges: some biomedical domain considerations. JMIR mHealth uHealth 7(8):e11966CrossRef
24.
go back to reference Das K, Karri SPK, Roy AG, Chatterjee J, Sheet D (eds) (2017). Classifying histopathology whole-slides using fusion of decisions from deep convolutional network on a collection of random multi-views at multi-magnification. In: IEEE 14th international symposium on biomedical imaging (ISBI 2017) Das K, Karri SPK, Roy AG, Chatterjee J, Sheet D (eds) (2017). Classifying histopathology whole-slides using fusion of decisions from deep convolutional network on a collection of random multi-views at multi-magnification. In: IEEE 14th international symposium on biomedical imaging (ISBI 2017)
25.
go back to reference Nanglia P, Kumar S, Mahajan AN, Singh P, Rathee DJ (2020) A hybrid algorithm for lung cancer classification using SVM and neural networks. ICT Express Nanglia P, Kumar S, Mahajan AN, Singh P, Rathee DJ (2020) A hybrid algorithm for lung cancer classification using SVM and neural networks. ICT Express
26.
go back to reference Nanglia P, Mahajan AN, Rathee DS, Kumar SJIJoME, (2020) Informatics: lung cancer classification using feed forward back propagation neural network for CT images. Int J Med Eng Inf 12(5):447–456 Nanglia P, Mahajan AN, Rathee DS, Kumar SJIJoME, (2020) Informatics: lung cancer classification using feed forward back propagation neural network for CT images. Int J Med Eng Inf 12(5):447–456
27.
go back to reference Nanglia P, Kumar S, Rathi D, Singh P (2018) Comparative investigation of different feature extraction techniques for lung cancer detection system. In: International conference on advanced informatics for computing research. Springer, Berlin Nanglia P, Kumar S, Rathi D, Singh P (2018) Comparative investigation of different feature extraction techniques for lung cancer detection system. In: International conference on advanced informatics for computing research. Springer, Berlin
28.
go back to reference Aresta G, Araújo T, Kwok S, Chennamsetty SS, Safwan M, Alex V et al (2019) Bach: grand challenge on breast cancer histology images. Med Image Anal 56:122–139CrossRef Aresta G, Araújo T, Kwok S, Chennamsetty SS, Safwan M, Alex V et al (2019) Bach: grand challenge on breast cancer histology images. Med Image Anal 56:122–139CrossRef
29.
go back to reference Akbar S, Peikari M, Salama S, Nofech-Mozes S, Martel A (2017) Transitioning between convolutional and fully connected layers in neural networks: deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Berlin, pp 143–150 Akbar S, Peikari M, Salama S, Nofech-Mozes S, Martel A (2017) Transitioning between convolutional and fully connected layers in neural networks: deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Berlin, pp 143–150
30.
go back to reference Gupta V, Bhavsar A (eds) (2017) An integrated multi-scale model for breast cancer histopathological image classification with joint colour-texture features.In: International conference on computer analysis of images and patterns. Springer, Berlin Gupta V, Bhavsar A (eds) (2017) An integrated multi-scale model for breast cancer histopathological image classification with joint colour-texture features.In: International conference on computer analysis of images and patterns. Springer, Berlin
31.
go back to reference Zhi W, Yueng HWF, Chen Z, Zandavi SM, Lu Z, Chung YY (eds) Using transfer learning with convolutional neural networks to diagnose breast cancer from histopathological images. In: International conference on neural information processing. Springer, Berlin Zhi W, Yueng HWF, Chen Z, Zandavi SM, Lu Z, Chung YY (eds) Using transfer learning with convolutional neural networks to diagnose breast cancer from histopathological images. In: International conference on neural information processing. Springer, Berlin
32.
go back to reference Khan MA, Kadry S, Alhaisoni M, Nam Y, Zhang Y, Rajinikanth V et al (2020) Computer-aided gastrointestinal diseases analysis from wireless capsule endoscopy: a framework of best features selection. IEEE Access 8:132850–132859CrossRef Khan MA, Kadry S, Alhaisoni M, Nam Y, Zhang Y, Rajinikanth V et al (2020) Computer-aided gastrointestinal diseases analysis from wireless capsule endoscopy: a framework of best features selection. IEEE Access 8:132850–132859CrossRef
33.
go back to reference Majid A, Khan MA, Yasmin M, Rehman A, Yousafzai A, Tariq UJ et al (2020) Classification of stomach infections: a paradigm of convolutional neural network along with classical features fusion and selection. Microsc Res Tech 83(5):562–576CrossRef Majid A, Khan MA, Yasmin M, Rehman A, Yousafzai A, Tariq UJ et al (2020) Classification of stomach infections: a paradigm of convolutional neural network along with classical features fusion and selection. Microsc Res Tech 83(5):562–576CrossRef
34.
go back to reference Rashid M, Khan MA, Alhaisoni M, Wang S-H, Naqvi SR, Rehman A et al (2020) A sustainable deep learning framework for object recognition using multi-layers deep features fusion and selection. Sustainablity 12(12):5037CrossRef Rashid M, Khan MA, Alhaisoni M, Wang S-H, Naqvi SR, Rehman A et al (2020) A sustainable deep learning framework for object recognition using multi-layers deep features fusion and selection. Sustainablity 12(12):5037CrossRef
35.
go back to reference Khan MA, Sharif M, Akram T, Bukhari SAC, Nayak RSJPRL (2020) Developed Newton-Raphson based deep features selection framework for skin lesion recognition. Pattern Recognit Lett 129:293–303CrossRef Khan MA, Sharif M, Akram T, Bukhari SAC, Nayak RSJPRL (2020) Developed Newton-Raphson based deep features selection framework for skin lesion recognition. Pattern Recognit Lett 129:293–303CrossRef
36.
go back to reference Rehman A, Khan MA, Mehmood Z, Saba T, Sardaraz M, Rashid MJ et al (2020) Microscopic melanoma detection and classification: a framework of pixel-based fusion and multilevel features reduction. Microsc Res Tech 83(4):410–423CrossRef Rehman A, Khan MA, Mehmood Z, Saba T, Sardaraz M, Rashid MJ et al (2020) Microscopic melanoma detection and classification: a framework of pixel-based fusion and multilevel features reduction. Microsc Res Tech 83(4):410–423CrossRef
37.
go back to reference Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6(1):60CrossRef Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6(1):60CrossRef
38.
go back to reference Bar Y, Diamant I, Wolf L, Greenspan H (eds) (2015) Deep learning with non-medical training used for chest pathology identification. Medical imaging 2015: computer-aided diagnosis; 2015: international society for optics and photonics Bar Y, Diamant I, Wolf L, Greenspan H (eds) (2015) Deep learning with non-medical training used for chest pathology identification. Medical imaging 2015: computer-aided diagnosis; 2015: international society for optics and photonics
39.
go back to reference Gurcan MN, Boucheron LE, Can A, Madabhushi A, Rajpoot NM, Yener B (2009) Histopathological image analysis: a review. IEEE Rev Biomed Eng 2:147–171CrossRef Gurcan MN, Boucheron LE, Can A, Madabhushi A, Rajpoot NM, Yener B (2009) Histopathological image analysis: a review. IEEE Rev Biomed Eng 2:147–171CrossRef
40.
go back to reference Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB et al (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imag 35(5):1299–1312CrossRef Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB et al (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imag 35(5):1299–1312CrossRef
41.
go back to reference Bosch A, Zisserman A, Muñoz X, editors. Scene classification via pLSA. In: European conference on computer vision. Springer, Berlin. Bosch A, Zisserman A, Muñoz X, editors. Scene classification via pLSA. In: European conference on computer vision. Springer, Berlin.
42.
go back to reference Liao S, Law MW, Chung AC (2009) Dominant local binary patterns for texture classification. IEEE Trans Image Process 18(5):1107–1118MathSciNetMATHCrossRef Liao S, Law MW, Chung AC (2009) Dominant local binary patterns for texture classification. IEEE Trans Image Process 18(5):1107–1118MathSciNetMATHCrossRef
43.
go back to reference Spanhol FA, Oliveira LS, Cavalin PR, Petitjean C, Heutte L (eds) (2017) Deep features for breast cancer histopathological image classification. In: IEEE international conference on systems, man, and cybernetics (SMC). IEEE. Spanhol FA, Oliveira LS, Cavalin PR, Petitjean C, Heutte L (eds) (2017) Deep features for breast cancer histopathological image classification. In: IEEE international conference on systems, man, and cybernetics (SMC). IEEE.
44.
go back to reference Chollet F (ed) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition Chollet F (ed) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Metadata
Title
Sub-classification of invasive and non-invasive cancer from magnification independent histopathological images using hybrid neural networks
Authors
Sumit Kumar
Shallu Sharma
Publication date
24-01-2021
Publisher
Springer Berlin Heidelberg
Published in
Evolutionary Intelligence / Issue 3/2022
Print ISSN: 1864-5909
Electronic ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-021-00564-3

Other articles of this Issue 3/2022

Evolutionary Intelligence 3/2022 Go to the issue

Premium Partner