Skip to main content
SpringerLink
Log in

DFU_QUTNet: diabetic foot ulcer classification using novel deep convolutional neural network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Diabetic Foot Ulcer (DFU) is the main complication of Diabetes, which, if not properly treated, may lead to amputation. One of the approaches of DFU treatment depends on the attentiveness of clinicians and patients. This treatment approach has drawbacks such as the high cost of the diagnosis as well as the length of treatment. Although this approach gives powerful results, the need for a remote, cost-effective, and convenient DFU diagnosis approach is urgent. In this paper, we introduce a new dataset of 754-ft images which contain healthy skin and skin with a diabetic ulcer from different patients. A novel Deep Convolutional Neural Network, DFU_QUTNet, is also proposed for the automatic classification of normal skin (healthy skin) class versus abnormal skin (DFU) class. Stacking more layers to a traditional Convolutional Neural Network to make it very deep does not lead to better performance, instead leading to worse performance due to the gradient. Therefore, our proposed DFU_QUTNet network is designed based on the idea of increasing the width of the network while keeping the depth compared to the state-of-the-art networks. Our network has been proven to be very beneficial for gradient propagation, as the error can be back-propagated through multiple paths. It also helps to combine different levels of features at each step of the network. Features extracted by DFU_QUTNet network are used to train Support Vector Machine (SVM) and K-Nearest Neighbors (KNN) classifiers. For the sake of comparison, we have fine-tuned then re-trained and tested three pre-trained deep learning networks (GoogleNet, VGG16, and AlexNet) for the same task. The proposed DFU_QUTNet network outperformed the state-of-the-art CNN networks by achieving the F1-score of 94.5%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Al-Zubaidi L (2016) Deep learning based nuclei detection for quantitative histopathology image analysis (Doctoral dissertation, University of Missouri--Columbia)

  2. Alzubaidi L., Al-Shamma O., FadhelM.A., Farhan L., Zhang J. (2020) Classification of Red Blood Cells in Sickle Cell Anemia Using Deep Convolutionalrk. In: Abraham A., Cherukuri A., Melin P., Gandhi N. (eds) Intelligent Systems Design and Applications. ISDA 2018 2018. Advances in IntelligentSystems and Computing, vol 940. Springer, Cham

  3. Armstrong DG, Lavery LA, Harkless LB (1998) Validation of a diabetic wound classification system: the contribution of depth, infection, and ischemia to risk of amputation. Diabetes Care 21(5):855 859

    Article  Google Scholar 

  4. Bakator M, Radosav D (2018) Deep learning and medical diagnosis: a review of literature. Multimodal Technologies and Interaction 2(3):47

    Article  Google Scholar 

  5. Boulton AJ, Vileikyte L, Ragnarson-Tennvall G, Apelqvist J (2005) The global burden of diabetic foot disease. Lancet 366(9498):1719–1724

    Article  Google Scholar 

  6. Bowling FL, King L, Paterson JA, Hu J, Lipsky BA, Matthews DR, Boulton AJ (2011) Remote assessment of diabetic foot ulcers 11 using a novel wound imaging system. Wound Repair Regen 19(1):25–30

    Article  Google Scholar 

  7. Cavanagh P, Attinger C, Abbas Z, Bal A, Rojas N, Xu Z-R (2012) Cost of treating diabetic foot ulcers in five different countries. Diabetes / Metabolism Research and Reviews 28(S1):107–111

    Article  Google Scholar 

  8. Cheng PM, Malhi HS (2017) Transfer learning with convolutional neural networks for classification of abdominal ultrasound images. J Digit Imaging:234–243

  9. Clemensen J, Larsen SB, Kirkevold M, Ejskjaer N (2008) Treatment of diabetic foot ulcers in the home: video consultations as an alternative to outpatient hospital care. Int J Telemed Appl 2008:1

    Google Scholar 

  10. Dahl GE, Sainath TN, Hinton GE (2013) Improving deep neural networks for LVCSR using rectified linear units and dropout. In: 2013 IEEE international conference on acoustics, speech and signal processing (pp. 8609–8613). IEEE

  11. Deng Y, Manjunath BS (2001) Unsupervised segmentation of colortexture regions in images and video. IEEE Trans Pattern Anal Mach Intell 23(8):800–810

    Article  Google Scholar 

  12. El-Gayar O, Timsina P, Nawar N, Eid W (2013) A systematic review of it for diabetes self-management: are we there yet? Int J Med Inform 82(8):637–652

    Article  Google Scholar 

  13. Foltynski P, Wojcicki JM, Ladyzynski P, Migalska-Musial K, Rosinski G, Krzymien J, Karnafel W (2011) Monitoring of diabetic foot syndrome treatment: some new perspectives. Artif Organs 35(2):176–182

    Google Scholar 

  14. Fraiwan L, AlKhodari M, Ninan J, Mustafa B, Saleh A, Ghazal M (2017) Diabetic foot ulcer mobile detection system using smart phone thermal camera: a feasibility study. Biomed Eng Online 16(1):117

    Article  Google Scholar 

  15. Fraiwan L, Ninan J, Al-Khodari M (2018) Mobile application for ulcer detection. The Open Biomedical Engineering Journal 12:16

    Article  Google Scholar 

  16. Franc S, Daoudi A, Mounier S, Bou cherie B, Laroye H, Peschard C, Dardari D, Juy O, Requeda E, Canipel L et al (2011) Telemedicine: what more is needed for its integration in everyday life? Diabetes Metab 37:S71–S77

    Article  Google Scholar 

  17. Geng L, Yan T, Xiao Z, Xi J, Li Y (2017) Hatching eggs classification based on deep learning. Multimed Tools Appl:1–12

  18. Gibiansky A (2018) Convolutional neural networks. http://andrew.gibiansky.com/blog/machine-learning / convolutional- neural-networks/. Accessed 26 December 2018

  19. Goyal M, Reeves ND, Davison AK, Rajbhandari S, Spragg J, Yap MH (2018) Dfunet: convolutional neural networks for diabetic foot ulcer classification. IEEE Transactions on Emerging Topics in Computational Intelligence

  20. Goyal M, Yap MH, Reeves ND, Rajbhandari S, Spragg J (2017) Fully convolutional networks for diabetic foot ulcer segmentation. In: 2017 IEEE international conference on systems, man, and cybernetics (SMC) (pp. 618–623). IEEE

  21. Hazenberg CE, van Netten JJ, van Baal SG, Bus SA, Bus S (2014) Assessment of signs of foot infection in diabetes patients using photographic foot imaging and infrared thermography. Diabetes Technol Ther 16(6):370–377

    Article  Google Scholar 

  22. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778)

  23. Hermans MH (2010) Wounds and ulcers: back to the old nomenclature. Wounds 22(11):289–293

    Google Scholar 

  24. Huang J, Li B, Zhu J, Chen J (2017) Age classification with deep learning face representation. Multimed Tools Appl:20231–20247

  25. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700–4708)

  26. Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167

  27. Jegede O, Ferens K, Griffith B, Podaima B (2015) A smart shoe to prevent and manage diabetic foot diseases. In: Int’l Conf. Health informatics and medical systems (pp. 47–54)

  28. Kolesnik M, Fexa A (2006) How robust is the SVM wound segmentation? In: Proceedings of the 7th Nordic Signal Processing Symposium-NORSIG 2006 (pp. 50–53). IEEE.

  29. Koushik J (2016) Understanding convolutional neural networks. arXiv preprint arXiv:1605.09081

  30. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (pp. 1097–1105)

  31. Lavery LA, Armstrong DG, Harkless LB (1996) Classification of diabetic foot wounds. J Foot Ankle Surg 35(6):528–531

    Article  Google Scholar 

  32. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436

    Article  Google Scholar 

  33. Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88

    Article  Google Scholar 

  34. Liu C, van Netten JJ, van Baal JG, Bus SA, van der Heijden F (2015) Automatic detection of diabetic foot complications with infrared thermography by asymmetric analysis. J Biomed Opt 20(2):26003

    Article  Google Scholar 

  35. Lu H, Li Y, Uemura T, Ge Z, Xu X, He L, Kim H (2018) FDCNet: filtering deep convolutional network for marine organism classification. Multimed Tools Appl 77(17):21847–21860

    Article  Google Scholar 

  36. Nair LR (2019) RetoNet: a deep learning architecture for automated retinal ailment detection. Multimed Tools Appl:1–10

  37. Nawaz W, Ahmed S, Tahir A, Khan HA (2018) Classification of breast Cancer histology images using ALEXNET. In: International conference image analysis and recognition. Springer, Cham, pp 869–876

    Chapter  Google Scholar 

  38. Ram Avrahami MD, Jonathan Rosenblum DPM, Michael Gazes DPM, Sean Rosenblum DPM (2015) The effect of combined ultrasound and electric field stimulation on wound healing in chronic ulcerations. Wounds 27(7):199–208

    Google Scholar 

  39. Ravishankar H, Sudhakar P, Venkataramani R, Thiruvenkadam S, Annangi P, Babu N, Vaidya V (2016) Understanding the mechanisms of deep transfer learning for medical images. In: Deep learning and data labeling for medical applications. Springer, Cham, pp 188–196

    Chapter  Google Scholar 

  40. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Berg AC (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252

    Article  MathSciNet  Google Scholar 

  41. Sainath TN, Mohamed AR, Kingsbury B, Ramabhadran B (2013) Deep convolutional neural networks for LVCSR. In: 2013 IEEE international conference on acoustics, speech and signal processing (pp. 8614–8618). IEEE

  42. Salamon J, Bello JP (2017) Deep convolutional neural networks and data augmentation for environmental sound classification. IEEE Signal Processing Letters 24(3):279–283

    Article  Google Scholar 

  43. Sert M, Boyacı E (2019) Sketch recognition using transfer learning. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-018-7067-1

  44. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  45. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research 15(1):1929–1958

    MathSciNet  MATH  Google Scholar 

  46. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1–9)

  47. Vedaldi A, Lenc K (2015) Matconvnet: convolutional neural networks for matlab. In: Proceedings of the 23rd ACM international conference on multimedia (pp. 689–692). ACM

  48. Veredas FJ, Luque-Baena RM, Martín-Santos FJ, Morilla-Herrera JC, Morente L (2015) Wound image evaluation with machine learning. Neurocomputing 164:1–11

    Article  Google Scholar 

  49. Veredas F, Mesa H, Morente L (2010) Binary tissue classification on wound images with neural networks and bayesian classifiers. IEEE Trans Med Imaging 29(2):410–427

    Article  Google Scholar 

  50. Vesal S, Ravikumar N, Davari A, Ellmann S, Maier A (2018) Classification of breast cancer histology images using transfer learning. In: International conference image analysis and recognition. Springer, Cham, pp 812–819

    Chapter  Google Scholar 

  51. Vijayalakshmi A, Rajesh Kanna B (2019) Deep learning approach to detect malaria from microscopic images. Multimedia Tools Application:1–21

  52. Vilcahuaman L, Harba R, Canals R, Zequera M, Wilches C, Arista M, Torres L, Arbanil H (2015) Automatic analysis of plantar foot thermal images in at-risk type II diabetes by using an infrared camera. IFMBE Proc 51:228–231

    Article  Google Scholar 

  53. Wang L, Pedersen PC, Agu E, Strong DM, Tulu B (2017) Area determination of diabetic foot ulcer images using a cascaded two-stage SVM-based classification. IEEE Trans Biomed Eng 64(9):2098–2109

    Article  Google Scholar 

  54. Wang J, Perez L (2017) The effectiveness of data augmentation in image classification using deep learning. Convolutional Neural Networks Vis. Recognit.

  55. Wild S, Roglic G, Green A, Sicree R, King H (2004) Global prevalence of diabetes estimates for the year 2000 and projections for 2030. Diabetes Care 27(5):1047–1053

    Article  Google Scholar 

  56. World Health Organization (2016) Global report on diabetes. http://www.who.int/diabetes/global-report/en Accessed 6 Feb. 2009

  57. Yu Y, Lin H, Meng J, Wei X, Guo H, Zhao Z (2017) Deep transfer learning for modality classification of medical images. Information 8(3):91

    Article  Google Scholar 

  58. Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision. Springer, pp 818–833

  59. Zhang G, Hsu C-HR, Lai H, Zheng X (2018) Deep learning based feature representation for automated skin histopathological image annotation. Multimed Tools Appl 77(8):9849–9869

    Article  Google Scholar 

  60. Zhu X, Li Z, Zhang X-Y, Li P, Xue Z, Wang L (2018) Deep convolutional representations and kernel extreme learning machines for image classification. Multimed Tools Appl:1–20

Download references

Author information

Authors and Affiliations

  1. Faculty of Science & Engineering, Queensland University of Technology, Brisbane, Australia

    Laith Alzubaidi & Jinglan Zhang

  2. University of Information Technology and Communications, Baghdad, Iraq

    Laith Alzubaidi, Mohammed A. Fadhel & Omran Al-Shamma

  3. Muthanna University, Muthanna, Iraq

    Sameer R. Oleiwi

Authors
  1. Laith Alzubaidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed A. Fadhel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sameer R. Oleiwi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Omran Al-Shamma
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jinglan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Laith Alzubaidi.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alzubaidi, L., Fadhel, M.A., Oleiwi, S.R. et al. DFU_QUTNet: diabetic foot ulcer classification using novel deep convolutional neural network. Multimed Tools Appl 79, 15655–15677 (2020). https://doi.org/10.1007/s11042-019-07820-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-07820-w

Keywords

Search

Navigation