Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 2/2022

12-09-2021 | Research Article-Computer Engineering and Computer Science

Diagnosis of Pediatric Pneumonia with Ensemble of Deep Convolutional Neural Networks in Chest X-Ray Images

Authors: Enes Ayan, Bergen Karabulut, Halil Murat Ünver

Published in: Arabian Journal for Science and Engineering | Issue 2/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Pneumonia is a fatal disease that appears in the lungs and is caused by viral or bacterial infection. Diagnosis of pneumonia in chest X-ray images can be difficult and error-prone because of its similarity with other infections in the lungs. The aim of this study is to develop a computer-aided pneumonia detection system to facilitate the diagnosis decision process. Therefore, a convolutional neural network (CNN) ensemble method was proposed for the automatic diagnosis of pneumonia which is seen in children. In this context, seven well-known CNN models (VGG-16, VGG-19, ResNet-50, Inception-V3, Xception, MobileNet, and SqueezeNet) pre-trained on the ImageNet dataset were trained with the appropriate transfer learning and fine-tuning strategies on the chest X-ray dataset. Among the seven different models, the three most successful ones were selected for the ensemble method. The final results were obtained by combining the predictions of CNN models with the ensemble method during the test. In addition, a CNN model was trained from scratch, and the results of this model were compared with the proposed ensemble method. The proposed ensemble method achieved remarkable results with an AUC of 95.21 and a sensitivity of 97.76 on the test data. Also, the proposed ensemble method achieved classification accuracy of 90.71 in chest X-ray images as normal, viral pneumonia, and bacterial pneumonia.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wardlaw, T.M.; Johansson, E.W.; Hodge, M.J.: Pneumonia: The Forgotten Killer of Children. Unicef (2006) Wardlaw, T.M.; Johansson, E.W.; Hodge, M.J.: Pneumonia: The Forgotten Killer of Children. Unicef (2006)
2.
go back to reference You, D.; Jones, G.; Wardlaw, T.: Levels & Trends in Child Mortality: Report 2011. Estimates Developed by the UN Inter-Agency Group for Child Mortality Estimation. United Nations Children’s Fund, New York (2011) You, D.; Jones, G.; Wardlaw, T.: Levels & Trends in Child Mortality: Report 2011. Estimates Developed by the UN Inter-Agency Group for Child Mortality Estimation. United Nations Children’s Fund, New York (2011)
3.
go back to reference Hug, L.; Sharrow, D.; Zhong, K.; You, D.; Unicef;Organization, W.H.; Group, W.B.: Levels & Trends in Child Mortality: Report 2018, Estimates Developed by the the UN Inter-agency Group for Child Mortality Estimation. United Nations Children's Fund (2018) Hug, L.; Sharrow, D.; Zhong, K.; You, D.; Unicef;Organization, W.H.; Group, W.B.: Levels & Trends in Child Mortality: Report 2018, Estimates Developed by the the UN Inter-agency Group for Child Mortality Estimation. United Nations Children's Fund (2018)
4.
go back to reference McAllister, D.A.; Liu, L.; Shi, T.; Chu, Y.; Reed, C.; Burrows, J.; Adeloye, D.; Rudan, I.; Black, R.E.; Campbell, H.: Global, regional, and national estimates of pneumonia morbidity and mortality in children younger than 5 years between 2000 and 2015: a systematic analysis. Lancet Glob Health. 7, e47–e57 (2019)CrossRef McAllister, D.A.; Liu, L.; Shi, T.; Chu, Y.; Reed, C.; Burrows, J.; Adeloye, D.; Rudan, I.; Black, R.E.; Campbell, H.: Global, regional, and national estimates of pneumonia morbidity and mortality in children younger than 5 years between 2000 and 2015: a systematic analysis. Lancet Glob Health. 7, e47–e57 (2019)CrossRef
5.
go back to reference WHO: Priority diseases and reasons for inclusion. In: Chapter 6. 22-Pneumonia (2014) WHO: Priority diseases and reasons for inclusion. In: Chapter 6. 22-Pneumonia (2014)
6.
go back to reference Drake, D.E.; Cohen, A.; Cohn, J.: National hospital antibiotic timing measures for pneumonia and antibiotic overuse. Qual Manag Health Care. 16, 113–122 (2007)CrossRef Drake, D.E.; Cohen, A.; Cohn, J.: National hospital antibiotic timing measures for pneumonia and antibiotic overuse. Qual Manag Health Care. 16, 113–122 (2007)CrossRef
7.
go back to reference WHO: Standardization of Interpretation of Chest Radiographs for the Diagnosis of Pneumonia in Children. World Health Organization, Geneva (2001). WHO: Standardization of Interpretation of Chest Radiographs for the Diagnosis of Pneumonia in Children. World Health Organization, Geneva (2001).
8.
go back to reference Ker, J.; Wang, L.; Rao, J.; Lim, T.: Deep learning applications in medical image analysis. IEEE Access. 6, 9375–9389 (2017)CrossRef Ker, J.; Wang, L.; Rao, J.; Lim, T.: Deep learning applications in medical image analysis. IEEE Access. 6, 9375–9389 (2017)CrossRef
9.
go back to reference Neuman, M.I.; Lee, E.Y.; Bixby, S.; Diperna, S.; Hellinger, J.; Markowitz, R.; Servaes, S.; Monuteaux, M.C.; Shah, S.S.: Variability in the interpretation of chest radiographs for the diagnosis of pneumonia in children. J. Hosp. Med. 7, 294–298 (2012)CrossRef Neuman, M.I.; Lee, E.Y.; Bixby, S.; Diperna, S.; Hellinger, J.; Markowitz, R.; Servaes, S.; Monuteaux, M.C.; Shah, S.S.: Variability in the interpretation of chest radiographs for the diagnosis of pneumonia in children. J. Hosp. Med. 7, 294–298 (2012)CrossRef
10.
go back to reference Loey, M.; Smarandache, F.; M Khalifa, N.E.: Within the Lack of Chest COVID-19 X-ray dataset: a novel detection model based on GAN and deep transfer learning. Symmetry. 12, 651 (2020) Loey, M.; Smarandache, F.; M Khalifa, N.E.: Within the Lack of Chest COVID-19 X-ray dataset: a novel detection model based on GAN and deep transfer learning. Symmetry. 12, 651 (2020)
11.
go back to reference Shen, D.; Wu, G.; Suk, H.-I.: Deep learning in medical image analysis. Annu Rev Biomed Eng. 19, 221–248 (2017)CrossRef Shen, D.; Wu, G.; Suk, H.-I.: Deep learning in medical image analysis. Annu Rev Biomed Eng. 19, 221–248 (2017)CrossRef
12.
go back to reference Grewal, M.; Srivastava, M.M.; Kumar, P.; Varadarajan, S.: Radnet: radiologist level accuracy using deep learning for hemorrhage detection in ct scans. In: IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 281–284: IEEE (2018) Grewal, M.; Srivastava, M.M.; Kumar, P.; Varadarajan, S.: Radnet: radiologist level accuracy using deep learning for hemorrhage detection in ct scans. In: IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 281–284: IEEE (2018)
13.
go back to reference Mazurowski, M.A.; Buda, M.; Saha, A.; Bashir, M.R.: Deep learning in radiology: An overview of the concepts and a survey of the state of the art with focus on MRI. J. Magn. Reson Imaging. 49, 939–954 (2019)CrossRef Mazurowski, M.A.; Buda, M.; Saha, A.; Bashir, M.R.: Deep learning in radiology: An overview of the concepts and a survey of the state of the art with focus on MRI. J. Magn. Reson Imaging. 49, 939–954 (2019)CrossRef
14.
go back to reference Ünver, H.M.; Ayan, E.: Skin lesion segmentation in dermoscopic images with combination of YOLO and grabcut algorithm. Diagnostics. 9, 72 (2019)CrossRef Ünver, H.M.; Ayan, E.: Skin lesion segmentation in dermoscopic images with combination of YOLO and grabcut algorithm. Diagnostics. 9, 72 (2019)CrossRef
15.
go back to reference Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; Thrun, S.: Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115 (2017)CrossRef Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; Thrun, S.: Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115 (2017)CrossRef
16.
go back to reference Gulshan, V.; Peng, L.; Coram, M.; Stumpe, M.C.; Wu, D.; Narayanaswamy, A.; Venugopalan, S.; Widner, K.; Madams, T.; Cuadros, J.: Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402–2410 (2016)CrossRef Gulshan, V.; Peng, L.; Coram, M.; Stumpe, M.C.; Wu, D.; Narayanaswamy, A.; Venugopalan, S.; Widner, K.; Madams, T.; Cuadros, J.: Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402–2410 (2016)CrossRef
17.
go back to reference Huang, P.; Park, S.; Yan, R.; Lee, J.; Chu, L.C.; Lin, C.T.; Hussien, A.; Rathmell, J.; Thomas, B.; Chen, C.: Added value of computer-aided CT image features for early lung cancer diagnosis with small pulmonary nodules: a matched case-control study. Radiology 286, 286–295 (2017)CrossRef Huang, P.; Park, S.; Yan, R.; Lee, J.; Chu, L.C.; Lin, C.T.; Hussien, A.; Rathmell, J.; Thomas, B.; Chen, C.: Added value of computer-aided CT image features for early lung cancer diagnosis with small pulmonary nodules: a matched case-control study. Radiology 286, 286–295 (2017)CrossRef
19.
go back to reference Lakhani, P.; Sundaram, B.: Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284, 574–582 (2017)CrossRef Lakhani, P.; Sundaram, B.: Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284, 574–582 (2017)CrossRef
21.
go back to reference He, K.; Zhang, X.; Ren, S.; Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K.; Zhang, X.; Ren, S.; Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
22.
go back to reference Szegedy, C.; Vanhoucke, V.; Ioffe, S.; Shlens, J.; Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016) Szegedy, C.; Vanhoucke, V.; Ioffe, S.; Shlens, J.; Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016)
23.
go back to reference Howard, A.G.; Zhu, M.; Chen, B.; Kalenichenko, D.; Wang, W.; Weyand, T.; Andreetto, M.; Adam, H.: Mobilenets: efficient convolutional neural networks for mobile vision applications (2017). arXiv preprint https://arxiv.org/abs/1704.04861) Howard, A.G.; Zhu, M.; Chen, B.; Kalenichenko, D.; Wang, W.; Weyand, T.; Andreetto, M.; Adam, H.: Mobilenets: efficient convolutional neural networks for mobile vision applications (2017). arXiv preprint https://​arxiv.​org/​abs/​1704.​04861)
25.
go back to reference Chollet, F.: Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017) Chollet, F.: Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
26.
go back to reference Rajpurkar, P.; Irvin, J.; Zhu, K.; Yang, B.; Mehta, H.; Duan, T.; Ding, D.; Bagul, A.; Langlotz, C.; Shpanskaya, K.: Chexnet: Radiologist-level pneumonia detection on chest x-rays with deep learning (2017). arXiv preprint https://arxiv.org/abs/1711.05225 Rajpurkar, P.; Irvin, J.; Zhu, K.; Yang, B.; Mehta, H.; Duan, T.; Ding, D.; Bagul, A.; Langlotz, C.; Shpanskaya, K.: Chexnet: Radiologist-level pneumonia detection on chest x-rays with deep learning (2017). arXiv preprint https://​arxiv.​org/​abs/​1711.​05225
27.
go back to reference Kermany, D.S.; Goldbaum, M.; Cai, W.; Valentim, C.C.; Liang, H.; Baxter, S.L.; McKeown, A.; Yang, G.; Wu, X.; Yan, F.: Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell. 172, 1122–1131. e9 (2018) Kermany, D.S.; Goldbaum, M.; Cai, W.; Valentim, C.C.; Liang, H.; Baxter, S.L.; McKeown, A.; Yang, G.; Wu, X.; Yan, F.: Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell. 172, 1122–1131. e9 (2018)
28.
go back to reference Rajaraman, S.; Candemir, S.; Kim, I.; Thoma, G.; Antani, S.: Visualization and interpretation of convolutional neural network predictions in detecting pneumonia in pediatric chest radiographs. Appl Sci. 8, 1715 (2018)CrossRef Rajaraman, S.; Candemir, S.; Kim, I.; Thoma, G.; Antani, S.: Visualization and interpretation of convolutional neural network predictions in detecting pneumonia in pediatric chest radiographs. Appl Sci. 8, 1715 (2018)CrossRef
29.
go back to reference Stephen, O.; Sain, M.; Maduh, U.J.; Jeong, D.-U.: An efficient deep learning approach to pneumonia classification in healthcare. J. Healthc Eng. 2019 (2019) Stephen, O.; Sain, M.; Maduh, U.J.; Jeong, D.-U.: An efficient deep learning approach to pneumonia classification in healthcare. J. Healthc Eng. 2019 (2019)
30.
go back to reference Liang, G.; Zheng, L.: A transfer learning method with deep residual network for pediatric pneumonia diagnosis. Comput. Method Prog. Bio.104964 (2019) Liang, G.; Zheng, L.: A transfer learning method with deep residual network for pediatric pneumonia diagnosis. Comput. Method Prog. Bio.104964 (2019)
31.
go back to reference Siddiqi, R.: Automated pneumonia diagnosis using a customized sequential convolutional neural network. In: Proceedings of the 2019 3rd International Conference on Deep Learning Technologies, pp. 64–70 (2019) Siddiqi, R.: Automated pneumonia diagnosis using a customized sequential convolutional neural network. In: Proceedings of the 2019 3rd International Conference on Deep Learning Technologies, pp. 64–70 (2019)
32.
go back to reference Chouhan, V.; Singh, S.K.; Khamparia, A.; Gupta, D.; Tiwari, P.; Moreira, C.; Damaševičius, R.; de Albuquerque, V.H.C.: A novel transfer learning based approach for pneumonia detection in chest X-ray images. Appl Sci. 10, 559 (2020)CrossRef Chouhan, V.; Singh, S.K.; Khamparia, A.; Gupta, D.; Tiwari, P.; Moreira, C.; Damaševičius, R.; de Albuquerque, V.H.C.: A novel transfer learning based approach for pneumonia detection in chest X-ray images. Appl Sci. 10, 559 (2020)CrossRef
33.
go back to reference Gu, X.; Pan, L.; Liang, H.; Yang, R.: Classification of bacterial and viral childhood pneumonia using deep learning in chest radiography. In Proceedings of the 3rd International Conference on Multimedia and Image Processing, pp. 88–93 (2018) Gu, X.; Pan, L.; Liang, H.; Yang, R.: Classification of bacterial and viral childhood pneumonia using deep learning in chest radiography. In Proceedings of the 3rd International Conference on Multimedia and Image Processing, pp. 88–93 (2018)
34.
go back to reference Rahman, T.; Chowdhury, M.E.; Khandakar, A.; Islam, K.R.; Islam, K.F.; Mahbub, Z.B.; Kadir, M.A.; Kashem, S.: Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray. Appl Sci. 10, 3233 (2020)CrossRef Rahman, T.; Chowdhury, M.E.; Khandakar, A.; Islam, K.R.; Islam, K.F.; Mahbub, Z.B.; Kadir, M.A.; Kashem, S.: Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray. Appl Sci. 10, 3233 (2020)CrossRef
35.
go back to reference Toğaçar, M.; Ergen, B.; Cömert, Z.; Özyurt, F.: A deep feature learning model for pneumonia detection applying a combination of mRMR feature selection and machine learning models. IRBM. 41, 212–222 (2020)CrossRef Toğaçar, M.; Ergen, B.; Cömert, Z.; Özyurt, F.: A deep feature learning model for pneumonia detection applying a combination of mRMR feature selection and machine learning models. IRBM. 41, 212–222 (2020)CrossRef
36.
go back to reference Mittal, A.; Kumar, D.; Mittal, M.; Saba, T.; Abunadi, I.; Rehman, A.; Roy, S.: Detecting pneumonia using convolutions and dynamic capsule routing for chest X-ray Images. Sensors. 20, 1068 (2020)CrossRef Mittal, A.; Kumar, D.; Mittal, M.; Saba, T.; Abunadi, I.; Rehman, A.; Roy, S.: Detecting pneumonia using convolutions and dynamic capsule routing for chest X-ray Images. Sensors. 20, 1068 (2020)CrossRef
37.
go back to reference Kermany, D.; Goldbaum, M.: Labeled optical coherence tomography (OCT) and Chest X-Ray images for classification. Mendeley Data. 2 (2018) Kermany, D.; Goldbaum, M.: Labeled optical coherence tomography (OCT) and Chest X-Ray images for classification. Mendeley Data. 2 (2018)
38.
go back to reference Shorten, C.; Khoshgoftaar, T.M.: A survey on image data augmentation for deep learning. J. Big Data. 6, 60 (2019)CrossRef Shorten, C.; Khoshgoftaar, T.M.: A survey on image data augmentation for deep learning. J. Big Data. 6, 60 (2019)CrossRef
39.
go back to reference Ayan, E.; Ünver, H.M.: Data augmentation importance for classification of skin lesions via deep learning. In: Electric Electronics, Computer Science, Biomedical Engineerings' Meeting (EBBT), IEEE, pp. 1–4 (2018) Ayan, E.; Ünver, H.M.: Data augmentation importance for classification of skin lesions via deep learning. In: Electric Electronics, Computer Science, Biomedical Engineerings' Meeting (EBBT), IEEE, pp. 1–4 (2018)
41.
go back to reference Weiss, K.; Khoshgoftaar, T.M.; Wang, D.: A survey of transfer learning. J. Big Data. 3, 9 (2016)CrossRef Weiss, K.; Khoshgoftaar, T.M.; Wang, D.: A survey of transfer learning. J. Big Data. 3, 9 (2016)CrossRef
42.
go back to reference Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, IEEE (2009) Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, IEEE (2009)
43.
go back to reference Voulodimos, A.; Doulamis, N.; Doulamis, A.; Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intel. Neurosci. 2018, 14 (2018) Voulodimos, A.; Doulamis, N.; Doulamis, A.; Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intel. Neurosci. 2018, 14 (2018)
44.
go back to reference Rawat, W.; Wang, Z.: Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput. 29, 2352–2449 (2017)MathSciNetCrossRef Rawat, W.; Wang, Z.: Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput. 29, 2352–2449 (2017)MathSciNetCrossRef
45.
go back to reference Yosinski, J.;Clune, J.;Bengio, Y., and Lipson, H.: How transferable are features in deep neural networks? In: Advances in Neural Information Processing Systems, pp. 3320–3328 (2014) Yosinski, J.;Clune, J.;Bengio, Y., and Lipson, H.: How transferable are features in deep neural networks? In: Advances in Neural Information Processing Systems, pp. 3320–3328 (2014)
47.
go back to reference Hu, J.;Shen, L.; Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018) Hu, J.;Shen, L.; Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
48.
go back to reference Harangi, B.: Skin lesion classification with ensembles of deep convolutional neural networks. J. Biomed. Inform. 86, 25–32 (2018)CrossRef Harangi, B.: Skin lesion classification with ensembles of deep convolutional neural networks. J. Biomed. Inform. 86, 25–32 (2018)CrossRef
Metadata
Title
Diagnosis of Pediatric Pneumonia with Ensemble of Deep Convolutional Neural Networks in Chest X-Ray Images
Authors
Enes Ayan
Bergen Karabulut
Halil Murat Ünver
Publication date
12-09-2021
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 2/2022
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-06127-z

Other articles of this Issue 2/2022

Arabian Journal for Science and Engineering 2/2022 Go to the issue

Research Article-Computer Engineering and Computer Science

Entity-Context and Relation-Context Combined Knowledge Graph Embeddings

Research Article-Computer Engineering and Computer Science

A Novel Approach to Printed Arabic Optical Character Recognition

Premium Partners