Skip to main content
Erschienen in: Arabian Journal for Science and Engineering 10/2021

07.04.2021 | Research Article-Electrical Engineering

A Dermoscopic Skin Lesion Classification Technique Using YOLO-CNN and Traditional Feature Model

verfasst von: Ruban Nersisson, Tharun J. Iyer, Alex Noel Joseph Raj, Vijayarajan Rajangam

Erschienen in: Arabian Journal for Science and Engineering | Ausgabe 10/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Skin cancer is one of the most deadly diseases around the world, wherein one of the three cancers is skin cancer. Early detection of skin cancer is paramount for better treatment planning. This paper investigates a Convolutional Neural Network (CNN), specifically, You Only Look Once (YOLO), to extract features from the skin lesions. The features, obtained from the CNN, are concatenated with traditional features like texture and colour features extracted from the lesion region of the input images. Later, the concatenated features are fed to a Fully Connected Network, which is trained with the specific ground truths to achieve higher classification accuracy. The proposed method improves the detection and classification of skin lesions when compared with other models and YOLO without traditional features. The performance measures of the fusion network are able to achieve the accuracy of 94%, precision of 0.85, recall of 0.88, and area under the curve of 0.95.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Baldwin, L.; Dunn, J.: Global controversies and advances in skin cancer. Asian Pac. J. Cancer Prev. 14(4), 2155–2157 (2013)CrossRef Baldwin, L.; Dunn, J.: Global controversies and advances in skin cancer. Asian Pac. J. Cancer Prev. 14(4), 2155–2157 (2013)CrossRef
2.
Zurück zum Zitat Pfeifer, G.P.; Besaratinia, A.: UV wavelength-dependent DNA damage and human non-melanoma and melanoma skin cancer. Photochem. Photobiol. Sci. 11(1), 90–97 (2012)CrossRef Pfeifer, G.P.; Besaratinia, A.: UV wavelength-dependent DNA damage and human non-melanoma and melanoma skin cancer. Photochem. Photobiol. Sci. 11(1), 90–97 (2012)CrossRef
3.
Zurück zum Zitat Craythorne, E.; Al-Niami, F.: Skin cancer. Medicine 45(7), 431–434 (2017)CrossRef Craythorne, E.; Al-Niami, F.: Skin cancer. Medicine 45(7), 431–434 (2017)CrossRef
4.
Zurück zum Zitat Tracey, E.H.; Vij, A.: Updates in melanoma. Dermatol. Clin. 37(1), 73–82 (2019)CrossRef Tracey, E.H.; Vij, A.: Updates in melanoma. Dermatol. Clin. 37(1), 73–82 (2019)CrossRef
5.
Zurück zum Zitat Jerant, A.F.; Johnson, J.T.; Sheridan, C.D.; Caffrey, T.J.: Early detection and treatment of skin cancer. Am. Fam. Phys. 62(2), 357–368 (2000) Jerant, A.F.; Johnson, J.T.; Sheridan, C.D.; Caffrey, T.J.: Early detection and treatment of skin cancer. Am. Fam. Phys. 62(2), 357–368 (2000)
6.
Zurück zum Zitat Sreelatha, T.; Subramanyam, M.V.; Prasad, M.N.G.: Early detection of skin cancer using melanoma segmentation technique. J. Med. Syst. 43(7), 190 (2019)CrossRef Sreelatha, T.; Subramanyam, M.V.; Prasad, M.N.G.: Early detection of skin cancer using melanoma segmentation technique. J. Med. Syst. 43(7), 190 (2019)CrossRef
7.
Zurück zum Zitat Massone, C.; Di Stefani, A.; Soyer, H.P.: Dermoscopy for skin cancer detection. Curr. Opin. Oncol. 17(2), 147–153 (2005)CrossRef Massone, C.; Di Stefani, A.; Soyer, H.P.: Dermoscopy for skin cancer detection. Curr. Opin. Oncol. 17(2), 147–153 (2005)CrossRef
8.
Zurück zum Zitat Wolner, Z.J.; Yélamos, O.; Liopyris, K.; Rogers, T.; Marchetti, M.A.; Marghoob, A.A.: Enhancing skin cancer diagnosis with dermoscopy. Dermatol. Clin. 35(4), 417–437 (2017)CrossRef Wolner, Z.J.; Yélamos, O.; Liopyris, K.; Rogers, T.; Marchetti, M.A.; Marghoob, A.A.: Enhancing skin cancer diagnosis with dermoscopy. Dermatol. Clin. 35(4), 417–437 (2017)CrossRef
9.
Zurück zum Zitat Jain, S.; Pise, N.; et al.: Computer aided melanoma skin cancer detection using image processing. Procedia Comput. Sci. 48, 735–740 (2015)CrossRef Jain, S.; Pise, N.; et al.: Computer aided melanoma skin cancer detection using image processing. Procedia Comput. Sci. 48, 735–740 (2015)CrossRef
10.
Zurück zum Zitat Barata, C.; Ruela, M.; Francisco, M.; Mendonça, T.; Marques, J.S.: Two systems for the detection of melanomas in dermoscopy images using texture and color features. IEEE Syst. J. 8(3), 965–979 (2013)CrossRef Barata, C.; Ruela, M.; Francisco, M.; Mendonça, T.; Marques, J.S.: Two systems for the detection of melanomas in dermoscopy images using texture and color features. IEEE Syst. J. 8(3), 965–979 (2013)CrossRef
11.
Zurück zum Zitat Nezhadian, F.K.; Rashidi, S.: Melanoma skin cancer detection using color and new texture features. In: 2017 Artificial Intelligence and Signal Processing Conference (AISP), pp 1–5. IEEE (2017) Nezhadian, F.K.; Rashidi, S.: Melanoma skin cancer detection using color and new texture features. In: 2017 Artificial Intelligence and Signal Processing Conference (AISP), pp 1–5. IEEE (2017)
12.
Zurück zum Zitat Ashour, A.S.; Hawas, A.R.; Guo, Y.; Wahba, M.A.: A novel optimized neutrosophic k-means using genetic algorithm for skin lesion detection in dermoscopy images. Signal Image Video Process. 12(7), 1311–1318 (2018)CrossRef Ashour, A.S.; Hawas, A.R.; Guo, Y.; Wahba, M.A.: A novel optimized neutrosophic k-means using genetic algorithm for skin lesion detection in dermoscopy images. Signal Image Video Process. 12(7), 1311–1318 (2018)CrossRef
13.
Zurück zum Zitat Abuzaghleh, O.; Barkana, B.D.; Faezipour, M.: Noninvasive real-time automated skin lesion analysis system for melanoma early detection and prevention. IEEE J. Transl. Eng. Health Med. 2015, 1–12 (2015)CrossRef Abuzaghleh, O.; Barkana, B.D.; Faezipour, M.: Noninvasive real-time automated skin lesion analysis system for melanoma early detection and prevention. IEEE J. Transl. Eng. Health Med. 2015, 1–12 (2015)CrossRef
14.
Zurück zum Zitat Mhaske, H.R.; Phalke, D.A.: Melanoma skin cancer detection and classification based on supervised and unsupervised learning. In: 2013 International conference on Circuits, Controls and Communications (CCUBE), pp. 1–5. IEEE (2013) Mhaske, H.R.; Phalke, D.A.: Melanoma skin cancer detection and classification based on supervised and unsupervised learning. In: 2013 International conference on Circuits, Controls and Communications (CCUBE), pp. 1–5. IEEE (2013)
15.
Zurück zum Zitat Alquran, H.; Qasmieh, I.A.; Alqudah, A.M.; Alhammouri, S.; Alawneh, E.; Abughazaleh, A.; Hasayen, F.: The melanoma skin cancer detection and classification using support vector machine. In: 2017 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT), pp 1–5. IEEE (2017) Alquran, H.; Qasmieh, I.A.; Alqudah, A.M.; Alhammouri, S.; Alawneh, E.; Abughazaleh, A.; Hasayen, F.: The melanoma skin cancer detection and classification using support vector machine. In: 2017 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT), pp 1–5. IEEE (2017)
16.
Zurück zum Zitat Saez, A.; Sanchez-Monedero, J.; Gutiérrez, P.A.; Hervás-Martínez, C.: Machine learning methods for binary and multiclass classification of melanoma thickness from dermoscopic images. IEEE Trans. Med. Imaging 35(4), 1036–1045 (2015)CrossRef Saez, A.; Sanchez-Monedero, J.; Gutiérrez, P.A.; Hervás-Martínez, C.: Machine learning methods for binary and multiclass classification of melanoma thickness from dermoscopic images. IEEE Trans. Med. Imaging 35(4), 1036–1045 (2015)CrossRef
17.
Zurück zum Zitat Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; Thrun, S.: Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639), 115–118 (2017)CrossRef Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; Thrun, S.: Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639), 115–118 (2017)CrossRef
18.
Zurück zum Zitat Pham, T.-C.; Luong, C.-M.; Visani, M.; Hoang, V.-D.: Deep CNN and data augmentation for skin lesion classification. In: Asian Conference on Intelligent Information and Database Systems, pp. 573–582. Springer (2018). Pham, T.-C.; Luong, C.-M.; Visani, M.; Hoang, V.-D.: Deep CNN and data augmentation for skin lesion classification. In: Asian Conference on Intelligent Information and Database Systems, pp. 573–582. Springer (2018).
19.
Zurück zum Zitat DeVries,T.; Ramachandram, D.: Skin lesion classification using deep multi-scale convolutional neural networks. arXiv:1703.01402 (2017) DeVries,T.; Ramachandram, D.: Skin lesion classification using deep multi-scale convolutional neural networks. arXiv:​1703.​01402 (2017)
20.
Zurück zum Zitat Peng, X.; Saenko, K.: Combining texture and shape cues for object recognition with minimal supervision. In: Asian Conference on Computer Vision, pp. 256–272. Springer (2016) Peng, X.; Saenko, K.: Combining texture and shape cues for object recognition with minimal supervision. In: Asian Conference on Computer Vision, pp. 256–272. Springer (2016)
21.
Zurück zum Zitat Saba, T.; Khan, M.A.; Rehman, A.; Marie-Sainte, S.L.: Region extraction and classification of skin cancer: a heterogeneous framework of deep CNN features fusion and reduction. J. Med. Syst. 43(9), 289 (2019)CrossRef Saba, T.; Khan, M.A.; Rehman, A.; Marie-Sainte, S.L.: Region extraction and classification of skin cancer: a heterogeneous framework of deep CNN features fusion and reduction. J. Med. Syst. 43(9), 289 (2019)CrossRef
22.
Zurück zum Zitat Rashid, M.; Khan, M.A.; Sharif, M.; Raza, M.; Sarfraz, M.M.; Afza, F.: Object detection and classification: a joint selection and fusion strategy of deep convolutional neural network and sift point features. Multimed. Tools Appl. 78(12), 15751–15777 (2019)CrossRef Rashid, M.; Khan, M.A.; Sharif, M.; Raza, M.; Sarfraz, M.M.; Afza, F.: Object detection and classification: a joint selection and fusion strategy of deep convolutional neural network and sift point features. Multimed. Tools Appl. 78(12), 15751–15777 (2019)CrossRef
23.
Zurück zum Zitat Serte, S.; Demirel, H.: Gabor wavelet-based deep learning for skin lesion classification. Comput. Biol. Med. 113, 103423 (2019)CrossRef Serte, S.; Demirel, H.: Gabor wavelet-based deep learning for skin lesion classification. Comput. Biol. Med. 113, 103423 (2019)CrossRef
25.
Zurück zum Zitat Taqi, A.M.; Al-Azzo, F.; Awad, A.; Milanova, M.: Skin lesion detection by android camera based on SSD-mobilenet and tensorflow object detection API. Am. J. Adv. Res. 1, 3 (2019) Taqi, A.M.; Al-Azzo, F.; Awad, A.; Milanova, M.: Skin lesion detection by android camera based on SSD-mobilenet and tensorflow object detection API. Am. J. Adv. Res. 1, 3 (2019)
26.
Zurück zum Zitat Roy, S.S.; Haque, A.U.; Neubert, J.: Automatic diagnosis of melanoma from dermoscopic image using real-time object detection. In: 2018 52nd annual conference on information sciences and systems (CISS), pp. 1–5. IEEE (2018) Roy, S.S.; Haque, A.U.; Neubert, J.: Automatic diagnosis of melanoma from dermoscopic image using real-time object detection. In: 2018 52nd annual conference on information sciences and systems (CISS), pp. 1–5. IEEE (2018)
27.
Zurück zum Zitat Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016) Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
28.
Zurück zum Zitat Situ, N.; Yuan, X.; Chen, J.; Zouridakis, G.: Malignant melanoma detection by bag-of-features classification. In: 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3110–3113. IEEE (2008) Situ, N.; Yuan, X.; Chen, J.; Zouridakis, G.: Malignant melanoma detection by bag-of-features classification. In: 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3110–3113. IEEE (2008)
29.
Zurück zum Zitat Barata, C.; Celebi, M.E.; Marques, J.S.J.S.: A survey of feature extraction in dermoscopy image analysis of skin cancer. IEEE J. Biomed. Health Inform. 23(3), 1096–1109 (2018)CrossRef Barata, C.; Celebi, M.E.; Marques, J.S.J.S.: A survey of feature extraction in dermoscopy image analysis of skin cancer. IEEE J. Biomed. Health Inform. 23(3), 1096–1109 (2018)CrossRef
30.
Zurück zum Zitat Sivic, J.; Zisserman, A.: Video google: a text retrieval approach to object matching in videos. In: Null, p. 1470. IEEE (2003) Sivic, J.; Zisserman, A.: Video google: a text retrieval approach to object matching in videos. In: Null, p. 1470. IEEE (2003)
31.
Zurück zum Zitat Sultana, N.N.; Puhan, N.B.: Recent deep learning methods for melanoma detection: a review. In: International Conference on Mathematics and Computing, pp. 118–132. Springer (2018) Sultana, N.N.; Puhan, N.B.: Recent deep learning methods for melanoma detection: a review. In: International Conference on Mathematics and Computing, pp. 118–132. Springer (2018)
32.
Zurück zum Zitat Kavitha, J.C.; Suruliandi, A.: Texture and color feature extraction for classification of melanoma using SVM. In: 2016 International Conference on Computing Technologies and Intelligent Data Engineering (ICCTIDE’16), pp. 1–6. IEEE (2016) Kavitha, J.C.; Suruliandi, A.: Texture and color feature extraction for classification of melanoma using SVM. In: 2016 International Conference on Computing Technologies and Intelligent Data Engineering (ICCTIDE’16), pp. 1–6. IEEE (2016)
33.
Zurück zum Zitat Sotoodeh, M.; Moosavi, M.R.; Boostani, R.: A novel adaptive lbp-based descriptor for color image retrieval. Expert Syst. Appl. 127, 342–352 (2019)CrossRef Sotoodeh, M.; Moosavi, M.R.; Boostani, R.: A novel adaptive lbp-based descriptor for color image retrieval. Expert Syst. Appl. 127, 342–352 (2019)CrossRef
34.
Zurück zum Zitat Zhu, C.; Bichot, C.-E.; Chen, L.: Multi-scale color local binary patterns for visual object classes recognition. In: 2010 20th International Conference on Pattern Recognition, pp. 3065–3068. IEEE (2010). Zhu, C.; Bichot, C.-E.; Chen, L.: Multi-scale color local binary patterns for visual object classes recognition. In: 2010 20th International Conference on Pattern Recognition, pp. 3065–3068. IEEE (2010).
35.
Zurück zum Zitat Singh, G.; Chhabra, I.: Effective and fast face recognition system using complementary OC-LBP and HOG feature descriptors with SVM classifier. J. Inf. Technol. Res. (JITR) 11(1), 91–110 (2018)MathSciNetCrossRef Singh, G.; Chhabra, I.: Effective and fast face recognition system using complementary OC-LBP and HOG feature descriptors with SVM classifier. J. Inf. Technol. Res. (JITR) 11(1), 91–110 (2018)MathSciNetCrossRef
36.
Zurück zum Zitat Li, J.; Sang, N.; Gao, C.: Completed local similarity pattern for color image recognition. Neurocomputing 182, 111–117 (2016)CrossRef Li, J.; Sang, N.; Gao, C.: Completed local similarity pattern for color image recognition. Neurocomputing 182, 111–117 (2016)CrossRef
37.
Zurück zum Zitat Benco, M.; Hudec, R.; Kamencay, P.; Zachariasova, M.; Matuska, S.: An advanced approach to extraction of colour texture features based on GLCM. Int. J. Adv. Robot. Syst. 11(7), 104 (2014)CrossRef Benco, M.; Hudec, R.; Kamencay, P.; Zachariasova, M.; Matuska, S.: An advanced approach to extraction of colour texture features based on GLCM. Int. J. Adv. Robot. Syst. 11(7), 104 (2014)CrossRef
38.
Zurück zum Zitat Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009) Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
39.
Zurück zum Zitat Lin, T.-Y.; Maire, M.; Belongie, S.; Hays, J.; Perona, P.; Ramanan, D.; Dollár, P.; Zitnick, C.L.: Microsoft coco: common objects in context. In: European Conference on Computer Vision, pp. 740–755. Springer (2014) Lin, T.-Y.; Maire, M.; Belongie, S.; Hays, J.; Perona, P.; Ramanan, D.; Dollár, P.; Zitnick, C.L.: Microsoft coco: common objects in context. In: European Conference on Computer Vision, pp. 740–755. Springer (2014)
40.
Zurück zum Zitat Gutman, D.; Codella, N.C.F.; Celebi, E.; Helba, B.; Marchetti, M.; Mishra, N.; Halpern, A.: Skin lesion analysis toward melanoma detection: a challenge at the international symposium on biomedical imaging (ISBI) 2016, hosted by the international skin imaging collaboration (ISIC). arXiv:1605.01397 (2016) Gutman, D.; Codella, N.C.F.; Celebi, E.; Helba, B.; Marchetti, M.; Mishra, N.; Halpern, A.: Skin lesion analysis toward melanoma detection: a challenge at the international symposium on biomedical imaging (ISBI) 2016, hosted by the international skin imaging collaboration (ISIC). arXiv:​1605.​01397 (2016)
Metadaten
Titel
A Dermoscopic Skin Lesion Classification Technique Using YOLO-CNN and Traditional Feature Model
verfasst von
Ruban Nersisson
Tharun J. Iyer
Alex Noel Joseph Raj
Vijayarajan Rajangam
Publikationsdatum
07.04.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
Arabian Journal for Science and Engineering / Ausgabe 10/2021
Print ISSN: 2193-567X
Elektronische ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-05571-1

Weitere Artikel der Ausgabe 10/2021

Arabian Journal for Science and Engineering 10/2021 Zur Ausgabe

Research Article-Electrical Engineering

Hardware Architecture Exploration for Deep Neural Networks

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.