Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 2/2022

11-08-2021 | Research Article-Computer Engineering and Computer Science

Deep Transfer Learning Based Unified Framework for COVID19 Classification and Infection Detection from Chest X-Ray Images

Authors: Sankar Ganesh Sundaram, Saleh Abdullah Aloyuni, Raed Abdullah Alharbi, Tariq Alqahtani, Mohamed Yacin Sikkandar, Chidambaram Subbiah

Published in: Arabian Journal for Science and Engineering | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The presentation of the COVID19 has endangered several million lives worldwide causing thousands of deaths every day. Evolution of COVID19 as a pandemic calls for automated solutions for initial screening and treatment management. In addition to the thermal scanning mechanisms, findings from chest X-ray imaging examinations are reliable predictors in COVID19 detection, long-term monitoring and severity evaluation. This paper presents a novel deep transfer learning based framework for COVID19 detection and segmentation of infections from chest X-ray images. It is realized as a two-stage cascaded framework with classifier and segmentation subnetwork models. The classifier is modeled as a fine-tuned residual SqueezeNet network, and the segmentation network is implemented as a fine-tuned SegNet semantic segmentation network. The segmentation task is enhanced with a bioinspired Gaussian Mixture Model-based super pixel segmentation. This framework is trained and tested with two public datasets for binary and multiclass classifications and infection segmentation. It achieves accuracies of 99.69% and 99.48% for binary and three class classifications, and a mean accuracy of 83.437% for segmentation. Experimental results and comparative evaluations demonstrate the superiority of this unified model and signify potential extensions for biomarker definition and severity quantization.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Pereira, R.M.; Bertolini, D.; Teixeira, L.O.; Silla Jr, C.N.; Costa, Y.M.: COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios. Comput. Methods Programs Biomed. 194, 105532 (2020)CrossRef Pereira, R.M.; Bertolini, D.; Teixeira, L.O.; Silla Jr, C.N.; Costa, Y.M.: COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios. Comput. Methods Programs Biomed. 194, 105532 (2020)CrossRef
2.
go back to reference Wong, H.Y.F.; Lam, H.Y.S.; Fong, A.H.T.; Leung, S.T.; Chin, T.W.Y.; Lo, C.S.Y.; Lui, M.M.S.; Lee, J.C.Y.; Chiu, K.W.H.; Chung, T.; Lee, E.Y.P.: Frequency and distribution of chest radiographic findings in COVID-19 positive patients. Radiology 296, 201160 (2020)CrossRef Wong, H.Y.F.; Lam, H.Y.S.; Fong, A.H.T.; Leung, S.T.; Chin, T.W.Y.; Lo, C.S.Y.; Lui, M.M.S.; Lee, J.C.Y.; Chiu, K.W.H.; Chung, T.; Lee, E.Y.P.: Frequency and distribution of chest radiographic findings in COVID-19 positive patients. Radiology 296, 201160 (2020)CrossRef
3.
go back to reference Choi, H.; Qi, X.; Yoon, S.H.; Park, S.J.; Lee, K.H.; Kim, J.Y., et al.: Extension of coronavirus disease 2019 (COVID-19) on chest CT and implications for chest radiograph interpretation. Radiol. Cardiothorac. Imaging 2(2), e200107 (2020)CrossRef Choi, H.; Qi, X.; Yoon, S.H.; Park, S.J.; Lee, K.H.; Kim, J.Y., et al.: Extension of coronavirus disease 2019 (COVID-19) on chest CT and implications for chest radiograph interpretation. Radiol. Cardiothorac. Imaging 2(2), e200107 (2020)CrossRef
4.
go back to reference Rubin, G.D.; Ryerson, C.J.; Haramati, L.B.; Sverzellati, N.; Kanne, J.P.; Raoof, S.: The role of chest imaging in patient management during the COVID-19 pndemic: a multinational consensus statement from the Fleischner society. Radiology 296, 172–180 (2020)CrossRef Rubin, G.D.; Ryerson, C.J.; Haramati, L.B.; Sverzellati, N.; Kanne, J.P.; Raoof, S.: The role of chest imaging in patient management during the COVID-19 pndemic: a multinational consensus statement from the Fleischner society. Radiology 296, 172–180 (2020)CrossRef
5.
go back to reference Gaál, G.; Maga, B.; Lukács, A.: Attention U-net based adversarial architectures for chest X-ray lung segmentation (2020). arXiv:2003.10304 Gaál, G.; Maga, B.; Lukács, A.: Attention U-net based adversarial architectures for chest X-ray lung segmentation (2020). arXiv:​2003.​10304
6.
go back to reference Ban, Z.; Liu, J.; Cao, L.: Superpixel segmentation using Gaussian mixture model. IEEE Trans. Image Process. 27(8), 4105–4117 (2018)MathSciNetCrossRef Ban, Z.; Liu, J.; Cao, L.: Superpixel segmentation using Gaussian mixture model. IEEE Trans. Image Process. 27(8), 4105–4117 (2018)MathSciNetCrossRef
7.
go back to reference Yang, X.S.; Deb, S.: Search via Lévy flights. In: 2009 World Congress on Nature and Biologically Inspired Computing (NaBIC), pp. 210–214. IEEE (2009)CrossRef Yang, X.S.; Deb, S.: Search via Lévy flights. In: 2009 World Congress on Nature and Biologically Inspired Computing (NaBIC), pp. 210–214. IEEE (2009)CrossRef
8.
go back to reference Iandola, F.N.; Han, S.; Moskewicz, M.W.; Ashraf, K.; Dally, W.J.; Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size (2016). arXiv:1602.07360 Iandola, F.N.; Han, S.; Moskewicz, M.W.; Ashraf, K.; Dally, W.J.; Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size (2016). arXiv:​1602.​07360
9.
go back to reference Badrinarayanan, V.; Kendall, A.; Cipolla, R.: Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef Badrinarayanan, V.; Kendall, A.; Cipolla, R.: Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef
10.
go back to reference Liu, X.; Deng, Z.; Yang, Y.: Recent progress in semantic image segmentation. Artif. Intell. Rev. 52(2), 1089–1106 (2019)CrossRef Liu, X.; Deng, Z.; Yang, Y.: Recent progress in semantic image segmentation. Artif. Intell. Rev. 52(2), 1089–1106 (2019)CrossRef
11.
go back to reference Sufian, A.; Ghosh, A.; Sadiq, A.S.; Smarandache, F.: A survey on deep transfer learning to edge computing for mitigating the COVID-19 pandemic. J. Syst. Archit. 108, 101830 (2020)CrossRef Sufian, A.; Ghosh, A.; Sadiq, A.S.; Smarandache, F.: A survey on deep transfer learning to edge computing for mitigating the COVID-19 pandemic. J. Syst. Archit. 108, 101830 (2020)CrossRef
12.
go back to reference Mei, X.; Lee, H.C.; Diao, K.Y.; Huang, M.; Lin, B.; Liu, C., et al.: Artificial intelligence–enabled rapid diagnosis of patients with COVID-19. Nat. Med. 26(8), 1224–1228 (2020)CrossRef Mei, X.; Lee, H.C.; Diao, K.Y.; Huang, M.; Lin, B.; Liu, C., et al.: Artificial intelligence–enabled rapid diagnosis of patients with COVID-19. Nat. Med. 26(8), 1224–1228 (2020)CrossRef
13.
go back to reference Zhang, K.; Liu, X.; Shen, J.; Li, Z.; Sang, Y.; Wu, X., et al.: Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography. Cell 181(6), 1423–1433 (2020)CrossRef Zhang, K.; Liu, X.; Shen, J.; Li, Z.; Sang, Y.; Wu, X., et al.: Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography. Cell 181(6), 1423–1433 (2020)CrossRef
14.
go back to reference Wang, L.; Lin, Z.Q.; Wong, A.: COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest radiography images. Sci. Rep. 10(1), 1–12 (2020)CrossRef Wang, L.; Lin, Z.Q.; Wong, A.: COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest radiography images. Sci. Rep. 10(1), 1–12 (2020)CrossRef
15.
go back to reference Pandit, M.K.; Banday, S.A.: SARS n-CoV2–19 detection from chest x-ray images using deep neural networks. Int. J. Pervasive Comput. Commun. 16, 419–427 (2020)CrossRef Pandit, M.K.; Banday, S.A.: SARS n-CoV2–19 detection from chest x-ray images using deep neural networks. Int. J. Pervasive Comput. Commun. 16, 419–427 (2020)CrossRef
16.
go back to reference Maghdid, H.S.; Asaad, A.T.; Ghafoor, K.Z.; Sadiq, A.S.; Mirjalili, S.; Khan, M.K.: Diagnosing COVID-19 pneumonia from X-ray and CT images using deep learning and transfer learning algorithms. In: Multimodal Image Exploitation and Learning 2021, vol. 11734, pp. 117340E. International Society for Optics and Photonics (2021) Maghdid, H.S.; Asaad, A.T.; Ghafoor, K.Z.; Sadiq, A.S.; Mirjalili, S.; Khan, M.K.: Diagnosing COVID-19 pneumonia from X-ray and CT images using deep learning and transfer learning algorithms. In: Multimodal Image Exploitation and Learning 2021, vol. 11734, pp. 117340E. International Society for Optics and Photonics (2021)
17.
go back to reference Krizhevsky, A.; Sutskever, I.; Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Adv. Neural. Inf. Process. Syst. 25, 1097–1105 (2012) Krizhevsky, A.; Sutskever, I.; Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Adv. Neural. Inf. Process. Syst. 25, 1097–1105 (2012)
18.
go back to reference Alafif, T.; Tehame, A.M.; Bajaba, S.; Barnawi, A.; Zia, S.: Machine and deep learning towards COVID-19 diagnosis and treatment: survey, challenges, and future directions. Int. J. Environ. Res. Public Health 18(3), 1117 (2021)CrossRef Alafif, T.; Tehame, A.M.; Bajaba, S.; Barnawi, A.; Zia, S.: Machine and deep learning towards COVID-19 diagnosis and treatment: survey, challenges, and future directions. Int. J. Environ. Res. Public Health 18(3), 1117 (2021)CrossRef
19.
go back to reference Salehi, S.; Abedi, A.; Balakrishnan, S.; Gholamrezanezhad, A.: Coronavirus disease 2019 (COVID-19): a systematic review of imaging findings in 919 patients. Am. J. Roentgenol. 215, 1–7 (2020)CrossRef Salehi, S.; Abedi, A.; Balakrishnan, S.; Gholamrezanezhad, A.: Coronavirus disease 2019 (COVID-19): a systematic review of imaging findings in 919 patients. Am. J. Roentgenol. 215, 1–7 (2020)CrossRef
20.
go back to reference Apostolopoulos, I.D.; Mpesiana, T.A.: Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Phys. Eng. Sci. Med. 43, 1 (2020)CrossRef Apostolopoulos, I.D.; Mpesiana, T.A.: Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Phys. Eng. Sci. Med. 43, 1 (2020)CrossRef
21.
go back to reference Apostolopoulos, I.; Aznaouridis, S.; Tzani, M.: Extracting possibly representative COVID-19 biomarkers from X-ray images with deep learning approach and image data related to pulmonary diseases (2020). arXiv:2004.00338 Apostolopoulos, I.; Aznaouridis, S.; Tzani, M.: Extracting possibly representative COVID-19 biomarkers from X-ray images with deep learning approach and image data related to pulmonary diseases (2020). arXiv:​2004.​00338
22.
23.
go back to reference Hemdan, E.E.D.; Shouman, M.A.; Karar, M.E.: Covidx-net: a framework of deep learning classifiers to diagnose COVID-19 in X-ray images (2020). arXiv:2003.11055 Hemdan, E.E.D.; Shouman, M.A.; Karar, M.E.: Covidx-net: a framework of deep learning classifiers to diagnose COVID-19 in X-ray images (2020). arXiv:​2003.​11055
26.
go back to reference Hinton, G.E.; Sabour, S.; Frosst, N.: Matrix capsules with EM routing. In: International Conference on Learning Representations (2018) Hinton, G.E.; Sabour, S.; Frosst, N.: Matrix capsules with EM routing. In: International Conference on Learning Representations (2018)
27.
go back to reference Afshar, P.; Heidarian, S.; Naderkhani, F.; Oikonomou, A.; Plataniotis, K.N.; Mohammadi, A.: Covid-caps: a capsule network-based framework for identification of COVID-19 cases from x-ray images. Pattern Recogn. Lett. 138, 638–643 (2020)CrossRef Afshar, P.; Heidarian, S.; Naderkhani, F.; Oikonomou, A.; Plataniotis, K.N.; Mohammadi, A.: Covid-caps: a capsule network-based framework for identification of COVID-19 cases from x-ray images. Pattern Recogn. Lett. 138, 638–643 (2020)CrossRef
28.
go back to reference Ucar, F.; Korkmaz, D.: COVIDiagnosis-Net: deep Bayes-SqueezeNet based diagnostic of the coronavirus disease 2019 (COVID-19) from X-ray images. Medical Hypotheses, 109761 (2020) Ucar, F.; Korkmaz, D.: COVIDiagnosis-Net: deep Bayes-SqueezeNet based diagnostic of the coronavirus disease 2019 (COVID-19) from X-ray images. Medical Hypotheses, 109761 (2020)
29.
go back to reference Li, X.; Zhu, D.: Covid-xpert: an AI powered population screening of COVID-19 cases using chest radiography images (2020). arXiv:2004.03042 Li, X.; Zhu, D.: Covid-xpert: an AI powered population screening of COVID-19 cases using chest radiography images (2020). arXiv:​2004.​03042
30.
go back to reference Chowdhury, M.E.; Rahman, T.; Khandakar, A.; Mazhar, R.; Kadir, M.A.; Mahbub, Z.B.; et al.: Can AI help in screening viral and COVID-19 pneumonia? IEEE Access 8, 132665–132676 (2020)CrossRef Chowdhury, M.E.; Rahman, T.; Khandakar, A.; Mazhar, R.; Kadir, M.A.; Mahbub, Z.B.; et al.: Can AI help in screening viral and COVID-19 pneumonia? IEEE Access 8, 132665–132676 (2020)CrossRef
31.
go back to reference Alom, M.Z.; Rahman, M.M.; Nasrin, M.S.; Taha, T.M.; Asari, V.K.: COVID_MTNet: COVID-19 detection with multi-task deep learning approaches (2020). arXiv:2004.03747 Alom, M.Z.; Rahman, M.M.; Nasrin, M.S.; Taha, T.M.; Asari, V.K.: COVID_MTNet: COVID-19 detection with multi-task deep learning approaches (2020). arXiv:​2004.​03747
32.
go back to reference Alom, M.Z.; Aspiras, T.; Taha, T.M.; Asari, V.K.: Skin cancer segmentation and classification with NABLA-N and inception recurrent residual convolutional networks (2019). arXiv:1904.11126 Alom, M.Z.; Aspiras, T.; Taha, T.M.; Asari, V.K.: Skin cancer segmentation and classification with NABLA-N and inception recurrent residual convolutional networks (2019). arXiv:​1904.​11126
33.
go back to reference El-bana, S.; Al-Kabbany, A.; Sharkas, M.: A multi-task pipeline with specialized streams for classification and segmentation of infection manifestations in covid-19 scans. PeerJ Comput. Sci. 6, e303 (2020)CrossRef El-bana, S.; Al-Kabbany, A.; Sharkas, M.: A multi-task pipeline with specialized streams for classification and segmentation of infection manifestations in covid-19 scans. PeerJ Comput. Sci. 6, e303 (2020)CrossRef
34.
go back to reference Tang, H.; Sun, N.; Li, Y.: Segmentation model of the opacity regions in the chest X-rays of the Covid-19 patients in the us rural areas and the application to the disease severity. medRxiv (2020) Tang, H.; Sun, N.; Li, Y.: Segmentation model of the opacity regions in the chest X-rays of the Covid-19 patients in the us rural areas and the application to the disease severity. medRxiv (2020)
36.
go back to reference Chambers, J.M.; Mallows, C.L.; Stuck, B.W.: A method for simulating stable random variables. J. Am. Stat. Assoc. 71(354), 340–344 (1976)MathSciNetCrossRef Chambers, J.M.; Mallows, C.L.; Stuck, B.W.: A method for simulating stable random variables. J. Am. Stat. Assoc. 71(354), 340–344 (1976)MathSciNetCrossRef
37.
go back to reference Kapur, J.N.; Sahoo, P.K.; Wong, A.K.: A new method for gray-level picture thresholding using the entropy of the histogram. Comput. Vis. Graph. Image Process. 29(3), 273–285 (1985)CrossRef Kapur, J.N.; Sahoo, P.K.; Wong, A.K.: A new method for gray-level picture thresholding using the entropy of the histogram. Comput. Vis. Graph. Image Process. 29(3), 273–285 (1985)CrossRef
38.
go back to reference Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; Fei-Fei, L.: ImageNet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)CrossRef Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; Fei-Fei, L.: ImageNet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)CrossRef
39.
go back to reference Selvaraju, R.R.; Cogswell, M.; Das, A.; Vedantam, R.; Parikh, D.; Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017) Selvaraju, R.R.; Cogswell, M.; Das, A.; Vedantam, R.; Parikh, D.; Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
Metadata
Title
Deep Transfer Learning Based Unified Framework for COVID19 Classification and Infection Detection from Chest X-Ray Images
Authors
Sankar Ganesh Sundaram
Saleh Abdullah Aloyuni
Raed Abdullah Alharbi
Tariq Alqahtani
Mohamed Yacin Sikkandar
Chidambaram Subbiah
Publication date
11-08-2021
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 2/2022
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-05958-0

Other articles of this Issue 2/2022

Arabian Journal for Science and Engineering 2/2022 Go to the issue

Research Article-Computer Engineering and Computer Science

UAV Communications with Machine Learning: Challenges, Applications and Open Issues

Research Article-Computer Engineering and Computer Science

Hand Gesture Recognition from 2D Images by Using Convolutional Capsule Neural Networks

Premium Partners