Top

International Journal of Computer Assisted Radiology and Surgery

Published in:

16-11-2020 | Original Article

Automated detection of COVID-19 using ensemble of transfer learning with deep convolutional neural network based on CT scans

Authors: Parisa gifani, Ahmad Shalbaf, Majid Vafaeezadeh

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 1/2021

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Purpose

COVID-19 has infected millions of people worldwide. One of the most important hurdles in controlling the spread of this disease is the inefficiency and lack of medical tests. Computed tomography (CT) scans are promising in providing accurate and fast detection of COVID-19. However, determining COVID-19 requires highly trained radiologists and suffers from inter-observer variability. To remedy these limitations, this paper introduces an automatic methodology based on an ensemble of deep transfer learning for the detection of COVID-19.

Methods

A total of 15 pre-trained convolutional neural networks (CNNs) architectures: EfficientNets(B0-B5), NasNetLarge, NasNetMobile, InceptionV3, ResNet-50, SeResnet 50, Xception, DenseNet121, ResNext50 and Inception_resnet_v2 are used and then fine-tuned on the target task. After that, we built an ensemble method based on majority voting of the best combination of deep transfer learning outputs to further improve the recognition performance. We have used a publicly available dataset of CT scans, which consists of 349 CT scans labeled as being positive for COVID-19 and 397 negative COVID-19 CT scans that are normal or contain other types of lung diseases.

Results

The experimental results indicate that the majority voting of 5 deep transfer learning architecture with EfficientNetB0, EfficientNetB3, EfficientNetB5, Inception_resnet_v2, and Xception has the higher results than the individual transfer learning structure and among the other models based on precision (0.857), recall (0.854) and accuracy (0.85) metrics in diagnosing COVID-19 from CT scans.

Conclusion

Our study based on an ensemble deep transfer learning system with different pre-trained CNNs architectures can work well on a publicly available dataset of CT images for the diagnosis of COVID-19 based on CT scans.

previous article Patch-based classification of gallbladder wall vascularity from laparoscopic images using deep learning

next article Interactive editing of virtual chordae tendineae for the simulation of the mitral valve in a decision support system

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

https://coronavirus.1point3acres.com/en/world

Bernheim A, Mei X, Huang M, Yang Y, Fayad ZA, Zhang N, Diao K, Lin B, Zhu X, Li K, Li S, Shan H, Jacobi A, Chung M (2020) Chest ct findings in coronavirus disease-19 (covid-19): relationship to duration of infection. Radiology 295(3):200463CrossRef

Chuanqi T, Fuchun S, Tao K, Wenchang Z, Chao Y, Chunfang L (2018) A survey on deep transfer learning. In: The 27th international conference on artificial neural networks (ICANN 2018). Lecture Notes in Computer Science. Springer

Litjens G, Kooi T, Ehteshami Bejnordi B, Arindra Adiyoso Setio A, Ciompi F, Ghafoorian M, van der Laak JAWM, Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRef

Janowczyk A, Madabhushi A (2016) Deep learning for digital pathology image analysis: a comprehensive tutorial with selected use cases. J Pathol Inform 7:29CrossRef

Greenspan H, van Ginneken B, Summers RM (2016) Guest editorial deep learning in medical imaging: overview and future promise of an exciting new technique. IEEE Trans Med Imaging 35(5):1153–1159CrossRef

Poplin R, Varadarajan AV, Blumer K, Liu Y, McConnell MV, Corrado GS, Peng L, Webster DR (2018) Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat Biomed Eng 2:158–164CrossRef

Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542:115–118CrossRef

Chouhan V, Singh SK, Khamparia A, Gupta D, Tiwari P, Moreira C, Damaˇseviˇcius R, de Albuquerque VHC (2020) A novel transfer learning based approach for pneumonia detection in chest x-ray images. Appl Sci 10(2):559CrossRef

10.

Huynh BQ, Li H, Giger ML (2016) Digital mammographic tumor classification using transfer learning from deep convolutional neural networks. J Med Imaging 3(3):034501CrossRef

11.

Litjens G, Ciompi F, Wolterink JM, de Vos BD, Leiner T, Teuwen J, Išgum I (2019) State-of-the-art deep learning in cardiovascular image analysis. JACC Cardiovasc Imaging 12(8):1549–1565CrossRef

12.

De Fauw J, Ledsam JR, Ronneberger O (2018) Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat Med 24:1342–1350CrossRef

13.

Chea P, Mandell JC (2019) Current applications and future directions of deep learning in musculoskeletal radiology. Skeletal Radiol 4:1–5

14.

Litjens G, SánchezTimofeeva CIN, Hermsen M, Nagtegaal I, Kovacs I, van de Kaa CH, Bult P, van Ginneken B, van der Laak J (2016) Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep 6:26286CrossRef

15.

Ke Q, Zhang J, Wei W, Połap D, WoźniakKośmider ML, Damaševĭcius R (2019) A neuro-heuristic approach for recognition of lung diseases from X-ray images. Expert Syst Appl 126:218–232CrossRef

16.

Chandra TB, Verma K, Singh BK, Jain D, Netam SS (2020) Automatic detection of tuberculosis related abnormalities in Chest X-ray images using hierarchical feature extraction scheme. Expert Syst Appl 158(5):113514CrossRef

17.

Gupta N, Gupta D, Khanna A, Rebouças PP, Filho VH, de Albuquerque C (2019) Evolutionary algorithms for automatic lung disease detection. Measurement 140:590–608CrossRef

18.

Bermejo-Peláez D, Ash SY, Washko GR, Estépar RSJ, Ledesma-Carbayo MJ (2020) Classification of interstitial lung abnormality patterns with an ensemble of deep convolutional neural networks. Sci Rep 10:338CrossRef

19.

Xiaowei X, Xiangao J, Chunlian M, Peng D, Xukun L, Shuangzhi L, Liang Y, Yanfei C, Junwei S, Guanjing L, Yongtao L, Hong Z, Kaijin X, Lingxiang R, Wei W (2020) Deep learning system to screen coronavirus disease 2019 pneumonia. arXiv:2002.09334

20.

Xinggang W, Xianbo D, Qing F, Qiang Z, Jiapei F, Hui M, Wenyu L, Chuansheng Z (2020) A weakly-supervised framework for COVID-19 classification and lesion localization from chest CT. In: IEEE Transactions on Medical Imaging

21.

Shuai W, Bo K, Jinlu M, Xianjun Z, Mingming X, Jia G, Mengjiao C, Jingyi Y, Yaodong L, Xiangfei M, Bo X (2020) A deep learning algorithm using ct images to screen for corona virus disease (covid-19). medRxiv

22.

Shan F, Gao Y, Wang J, Shi W, Shi N, Han M, Xue Z, Shen D, Shi Y (2020) Lung infection quantification of covid-19 in ct images with deep learning. arXiv preprint arXiv:2003.04655

23.

Jun C, Lianlian W, Jun Z, Liang Z, Dexin G, Yilin Z, Shan H, Yonggui W, Xiao H, Biqing Z, Kuo Z, Huiling W, Zehua D, Youming X, Yijie Z, Xi C, Lilei Y, Honggang Y (2020) Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective study. medRxiv

24.

Xingyi Y, Xuehai H, Jinyu Z, Yichen Z, Shanghang Z, Pengtao X (2020) COVID-CT-Dataset: a CT scan dataset about COVID-19. arXiv:2003.13865

25.

Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90CrossRef

26.

Nima T, Jae YS, Suryakanth RG, Todd Hurst R, Christopher BK, Michael BG, Jianming L (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imaging 35(5):1299–1312CrossRef

27.

Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: CVPR

28.

Tan M, Le QV (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In: arXiv preprint arXiv:1905.11946

29.

Zoph B, Vasudevan V, Shlens J, Le QV (2017) Learning transferable architectures for scalable image recognition. arXiv preprint arXiv:1707.07012

30.

Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2818–2826

31.

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778

32.

Hu J, Shen L, Sun G (2017) Squeeze -and -excitation networks. arXiv:1709.01507

33.

Chollet F (2016) Xception: deep learning with depthwise separable convolutions. arXiv preprint arXiv:1610.02357

34.

Huang G, Liu Z, van der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: IEEE conference on computer vision and pattern recognition (CVPR)

35.

Saining X, Ross G, Piotr D, Zhuowen T, Kaiming H (2017) Aggregated residual transformations for deep neural networks. In: The IEEE conference on computer vision and pattern recognition (CVPR). 1492–1500

36.

Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. arXiv:1602.07261. 4278–4284

Title: Automated detection of COVID-19 using ensemble of transfer learning with deep convolutional neural network based on CT scans
Authors: Parisa gifani
Ahmad Shalbaf
Majid Vafaeezadeh
Publication date: 16-11-2020
Publisher: Springer International Publishing
Published in: International Journal of Computer Assisted Radiology and Surgery / Issue 1/2021
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI: https://doi.org/10.1007/s11548-020-02286-w

Springer Professional

Abstract

Purpose

Methods

Results

Conclusion

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 1/2021

Real-time mapping of a whole heart chamber using a novel sparse ultrasonic catheter array

Development and evaluation of a prototype detector for an intraoperative laparoscopic coincidence imaging system with PET tracers

4D deep learning for real-time volumetric optical coherence elastography

Preliminary study on mechanical characteristics of maxillofacial soft and hard tissues for virtual surgery

A generative model of hyperelastic strain energy density functions for multiple tissue brain deformation

Patch-based classification of gallbladder wall vascularity from laparoscopic images using deep learning

Premium Partner