Skip to main content

2022 | OriginalPaper | Buchkapitel

Swin Transformer for COVID-19 Infection Percentage Estimation from CT-Scans

verfasst von : Suman Chaudhary, Wanting Yang, Yan Qiang

Erschienen in: Image Analysis and Processing. ICIAP 2022 Workshops

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Coronavirus disease 2019 (COVID-19) is an infectious disease that has spread globally, disrupting the health care system and claiming millions of lives worldwide. Because of the high number of Covid-19 infections, it has been challenging for medical professionals to manage this crisis. Estimating the Covid-19 percentage can help medical staff categorize patients by severity and prioritize accordingly. With this approach, the intensive care unit (ICU) can free up resuscitation beds for the critical cases and provide other treatments for less severe cases to efficiently manage the healthcare system during a crisis. In this paper, we present a transformer-based method to estimate covid-19 infection percentage for monitoring the evolution of the patient state from computed tomography scans (CT-scans). We used a particular Transformer architecture called Swin Transformer as a backbone network to extract the feature from the CT slice and pass it through multi-layer perceptron (MLP) to obtain covid-19 infection percentage. We evaluated our approach on the covid-19 infection percentage estimation challenge dataset, annotated by two expert radiologists. The experimental results show that the proposed method achieves promising performance with a mean absolute error (MAE) of 4.5042, Pearson correlation coefficient (PC) of 0.9490, root mean square error (RMSE) of 8.0964 on the given Val set leaderboard and a MAE of 3.5569, PC of 0.8547 and RMSE of 7.5102 on the given Test set Leaderboard. These promising results demonstrate the high potential of Swin Transformer architecture for this image regression task of covid-19 infection percentage estimation from CT-scans. The source code of this project can be found at: https://​github.​com/​suman560/​Covid-19-infection-percentage-estimation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: CNR-IEMN: a deep learning based approach to recognise Covid-19 from CT-scan. In: 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2021, pp. 8568–8572. IEEE (2021) Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: CNR-IEMN: a deep learning based approach to recognise Covid-19 from CT-scan. In: 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2021, pp. 8568–8572. IEEE (2021)
3.
Zurück zum Zitat Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: Recognition of Covid-19 from CT scans using two-stage deep-learning-based approach: CNR-IEMN. Sensors 21(17), 5878 (2021)CrossRef Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: Recognition of Covid-19 from CT scans using two-stage deep-learning-based approach: CNR-IEMN. Sensors 21(17), 5878 (2021)CrossRef
4.
Zurück zum Zitat Bougourzi, F., Distante, C., Ouafi, A., Dornaika, F., Hadid, A., Taleb-Ahmed, A.: Per-Covid-19: a benchmark dataset for Covid-19 percentage estimation from CT-scans. J. Imaging 7(9), 189 (2021)CrossRef Bougourzi, F., Distante, C., Ouafi, A., Dornaika, F., Hadid, A., Taleb-Ahmed, A.: Per-Covid-19: a benchmark dataset for Covid-19 percentage estimation from CT-scans. J. Imaging 7(9), 189 (2021)CrossRef
6.
Zurück zum Zitat Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020) Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:​2010.​11929 (2020)
7.
Zurück zum Zitat Fan, D.P., et al.: Inf-Net: automatic Covid-19 lung infection segmentation from CT images. IEEE Trans. Med. Imaging 39(8), 2626–2637 (2020)CrossRef Fan, D.P., et al.: Inf-Net: automatic Covid-19 lung infection segmentation from CT images. IEEE Trans. Med. Imaging 39(8), 2626–2637 (2020)CrossRef
8.
Zurück zum Zitat Goceri, E., Goceri, N.: Deep learning in medical image analysis: recent advances and future trends (2017) Goceri, E., Goceri, N.: Deep learning in medical image analysis: recent advances and future trends (2017)
9.
Zurück zum Zitat Jalaber, C., Lapotre, T., Morcet-Delattre, T., Ribet, F., Jouneau, S., Lederlin, M.: Chest CT in Covid-19 pneumonia: a review of current knowledge. Diagn. Interv. Imaging 101(7–8), 431–437 (2020)CrossRef Jalaber, C., Lapotre, T., Morcet-Delattre, T., Ribet, F., Jouneau, S., Lederlin, M.: Chest CT in Covid-19 pneumonia: a review of current knowledge. Diagn. Interv. Imaging 101(7–8), 431–437 (2020)CrossRef
10.
Zurück zum Zitat Kucirka, L.M., Lauer, S.A., Laeyendecker, O., Boon, D., Lessler, J.: Variation in false-negative rate of reverse transcriptase polymerase chain reaction-based SARS-CoV-2 tests by time since exposure. Ann. Intern. Med. 173(4), 262–267 (2020)CrossRef Kucirka, L.M., Lauer, S.A., Laeyendecker, O., Boon, D., Lessler, J.: Variation in false-negative rate of reverse transcriptase polymerase chain reaction-based SARS-CoV-2 tests by time since exposure. Ann. Intern. Med. 173(4), 262–267 (2020)CrossRef
11.
Zurück zum Zitat Lacerda, P., Barros, B., Albuquerque, C., Conci, A.: Hyperparameter optimization for Covid-19 pneumonia diagnosis based on chest CT. Sensors 21(6), 2174 (2021)CrossRef Lacerda, P., Barros, B., Albuquerque, C., Conci, A.: Hyperparameter optimization for Covid-19 pneumonia diagnosis based on chest CT. Sensors 21(6), 2174 (2021)CrossRef
12.
Zurück zum Zitat Lassau, N., et al.: Integrating deep learning CT-scan model, biological and clinical variables to predict severity of Covid-19 patients. Nat. Commun. 12(1), 1–11 (2021)CrossRef Lassau, N., et al.: Integrating deep learning CT-scan model, biological and clinical variables to predict severity of Covid-19 patients. Nat. Commun. 12(1), 1–11 (2021)CrossRef
13.
Zurück zum Zitat Lei, J., Li, J., Li, X., Qi, X.: CT imaging of the 2019 novel coronavirus (2019-nCoV) pneumonia. Radiology 295(1), 18 (2020)CrossRef Lei, J., Li, J., Li, X., Qi, X.: CT imaging of the 2019 novel coronavirus (2019-nCoV) pneumonia. Radiology 295(1), 18 (2020)CrossRef
14.
Zurück zum Zitat Litjens, G.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)CrossRef Litjens, G.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)CrossRef
15.
16.
Zurück zum Zitat Paszke, A., et al.: PyTorch: an imperative style, high-performance deep learning library. Adv. Neural. Inf. Process. Syst. 32, 8026–8037 (2019) Paszke, A., et al.: PyTorch: an imperative style, high-performance deep learning library. Adv. Neural. Inf. Process. Syst. 32, 8026–8037 (2019)
17.
Zurück zum Zitat Stefano, A., Comelli, A.: Customized efficient neural network for Covid-19 infected region identification in CT images. J. Imaging 7(8), 131 (2021)CrossRef Stefano, A., Comelli, A.: Customized efficient neural network for Covid-19 infected region identification in CT images. J. Imaging 7(8), 131 (2021)CrossRef
18.
Zurück zum Zitat Vaishya, R., Javaid, M., Khan, I.H., Haleem, A.: Artificial intelligence (AI) applications for Covid-19 pandemic. Diab. Metab. Syndr. Clin. Res. Rev. 14(4), 337–339 (2020) Vaishya, R., Javaid, M., Khan, I.H., Haleem, A.: Artificial intelligence (AI) applications for Covid-19 pandemic. Diab. Metab. Syndr. Clin. Res. Rev. 14(4), 337–339 (2020)
19.
Zurück zum Zitat Vantaggiato, E., Paladini, E., Bougourzi, F., Distante, C., Hadid, A., Taleb-Ahmed, A.: Covid-19 recognition using ensemble-CNNs in two new chest X-ray databases. Sensors 21(5), 1742 (2021)CrossRef Vantaggiato, E., Paladini, E., Bougourzi, F., Distante, C., Hadid, A., Taleb-Ahmed, A.: Covid-19 recognition using ensemble-CNNs in two new chest X-ray databases. Sensors 21(5), 1742 (2021)CrossRef
20.
Zurück zum Zitat Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017) Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)
21.
Zurück zum Zitat Voulodimos, A., Doulamis, N., Doulamis, A., Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. 2018, 1–14 (2018) Voulodimos, A., Doulamis, N., Doulamis, A., Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. 2018, 1–14 (2018)
22.
Zurück zum Zitat Voulodimos, A., Protopapadakis, E., Katsamenis, I., Doulamis, A., Doulamis, N.: A few-shot U-Net deep learning model for Covid-19 infected area segmentation in CT images. Sensors 21(6), 2215 (2021)CrossRef Voulodimos, A., Protopapadakis, E., Katsamenis, I., Doulamis, A., Doulamis, N.: A few-shot U-Net deep learning model for Covid-19 infected area segmentation in CT images. Sensors 21(6), 2215 (2021)CrossRef
23.
Zurück zum Zitat Wang, G., et al.: A deep-learning pipeline for the diagnosis and discrimination of viral, non-viral and Covid-19 pneumonia from chest X-ray images. Nat. Biomed. Eng. 5(6), 509–521 (2021)CrossRef Wang, G., et al.: A deep-learning pipeline for the diagnosis and discrimination of viral, non-viral and Covid-19 pneumonia from chest X-ray images. Nat. Biomed. Eng. 5(6), 509–521 (2021)CrossRef
24.
Zurück zum Zitat Wang, L., Lin, Z.Q., Wong, A.: Covid-Net: a tailored deep convolutional neural network design for detection of Covid-19 cases from chest X-ray images. Sci. Rep. 10(1), 1–12 (2020) Wang, L., Lin, Z.Q., Wong, A.: Covid-Net: a tailored deep convolutional neural network design for detection of Covid-19 cases from chest X-ray images. Sci. Rep. 10(1), 1–12 (2020)
25.
Zurück zum Zitat Wang, X., et al.: A weakly-supervised framework for Covid-19 classification and lesion localization from chest CT. IEEE Trans. Med. Imaging 39(8), 2615–2625 (2020)CrossRef Wang, X., et al.: A weakly-supervised framework for Covid-19 classification and lesion localization from chest CT. IEEE Trans. Med. Imaging 39(8), 2615–2625 (2020)CrossRef
27.
Zurück zum Zitat Zhao, X., et al.: D2A U-Net: automatic segmentation of Covid-19 lesions from CT slices with dilated convolution and dual attention mechanism. arXiv preprint arXiv:2102.05210 (2021) Zhao, X., et al.: D2A U-Net: automatic segmentation of Covid-19 lesions from CT slices with dilated convolution and dual attention mechanism. arXiv preprint arXiv:​2102.​05210 (2021)
Metadaten
Titel
Swin Transformer for COVID-19 Infection Percentage Estimation from CT-Scans
verfasst von
Suman Chaudhary
Wanting Yang
Yan Qiang
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-031-13324-4_44

Premium Partner