Skip to main content
Erschienen in: Medical & Biological Engineering & Computing 3/2024

23.11.2023 | Original Article

An efficient multi-class classification of skin cancer using optimized vision transformer

verfasst von: R. P. Desale, P. S. Patil

Erschienen in: Medical & Biological Engineering & Computing | Ausgabe 3/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Skin cancer is a pervasive and deadly disease, prompting a surge in research efforts towards utilizing computer-based techniques to analyze skin lesion images to identify malignancies. This paper introduces an optimized vision transformer approach for effectively classifying skin tumors. The methodology begins with a pre-processing step aimed at preserving color constancy, eliminating hair artifacts, and reducing image noise. Here, a combination of techniques such as piecewise linear bottom hat filtering, adaptive median filtering, Gaussian filtering, and an enhanced gradient intensity method is used for pre-processing. Afterwards, the segmentation phase is initiated using the self-sparse watershed algorithm on the pre-processed image. Subsequently, the segmented image is passed through a feature extraction stage where the hybrid Walsh-Hadamard Karhunen–Loeve expansion technique is employed. The final step involves the application of an improved vision transformer for skin cancer classification. The entire methodology is implemented using the Python programming language, and the International Skin Imaging Collaboration (ISIC) 2019 database is utilized for experimentation. The experimental results demonstrate remarkable performance with the different performance metrics is accuracy 99.81%, precision 96.65%, sensitivity 98.21%, F-measure 97.42%, specificity 99.88%, recall 98.21%, Jaccard coefficient 98.54%, and Mathew’s correlation coefficient (MCC) 98.89%. The proposed methodology outperforms the existing methodology.

Graphical Abstract

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chmiel P, Kłosińska M, Forma A, Pelc Z, Gęca K, Skórzewska M (2022) Novel approaches in non-melanoma skin cancers—a focus on hedgehog pathway in basal cell carcinoma (BCC). Cells 11(20):3210CrossRefPubMedPubMedCentral Chmiel P, Kłosińska M, Forma A, Pelc Z, Gęca K, Skórzewska M (2022) Novel approaches in non-melanoma skin cancers—a focus on hedgehog pathway in basal cell carcinoma (BCC). Cells 11(20):3210CrossRefPubMedPubMedCentral
2.
Zurück zum Zitat Chamoli A, Gosavi AS, Shirwadkar UP, Wangdale KV, Behera SK, Kurrey NK, Kalia K, Mandoli A (2021) Overview of oral cavity squamous cell carcinoma: Risk factors, mechanisms, and diagnostics. Oral Oncol 121:105451CrossRefPubMed Chamoli A, Gosavi AS, Shirwadkar UP, Wangdale KV, Behera SK, Kurrey NK, Kalia K, Mandoli A (2021) Overview of oral cavity squamous cell carcinoma: Risk factors, mechanisms, and diagnostics. Oral Oncol 121:105451CrossRefPubMed
3.
Zurück zum Zitat Kohoutova D, Worku D, Aziz H, Teare J, Weir J, Larkin J (2021) Malignant melanoma of the gastrointestinal tract: symptoms, diagnosis, and current treatment options. Cells 10(2):327CrossRefPubMedPubMedCentral Kohoutova D, Worku D, Aziz H, Teare J, Weir J, Larkin J (2021) Malignant melanoma of the gastrointestinal tract: symptoms, diagnosis, and current treatment options. Cells 10(2):327CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat Hayashi A, Hong J, Iacobuzio-Donahue CA (2021) The pancreatic cancer genome revisited. Nat Rev Gastroenterol Hepatol 18(7):469–481CrossRefPubMed Hayashi A, Hong J, Iacobuzio-Donahue CA (2021) The pancreatic cancer genome revisited. Nat Rev Gastroenterol Hepatol 18(7):469–481CrossRefPubMed
5.
Zurück zum Zitat Santos D (2022) Melanoma skin cancer detection using deep learning, medRxiv. 2022–02. Santos D (2022) Melanoma skin cancer detection using deep learning, medRxiv. 2022–02.
7.
Zurück zum Zitat Jutzi TB, Krieghoff-Henning EI, Holland-Letz T, Utikal JS, Hauschild A, Schadendorf D, Sondermann W, Fröhling S, Hekler A, Schmitt M, Maron RC (2020) Artificial intelligence in skin cancer diagnostics: the patients’ perspective. Front Med 7:233CrossRef Jutzi TB, Krieghoff-Henning EI, Holland-Letz T, Utikal JS, Hauschild A, Schadendorf D, Sondermann W, Fröhling S, Hekler A, Schmitt M, Maron RC (2020) Artificial intelligence in skin cancer diagnostics: the patients’ perspective. Front Med 7:233CrossRef
8.
Zurück zum Zitat Ke Y, Wang XJ (2021) TGFβ signaling in photoaging and UV-induced skin cancer. J Investig Dermatol 141(4):1104–1110CrossRefPubMed Ke Y, Wang XJ (2021) TGFβ signaling in photoaging and UV-induced skin cancer. J Investig Dermatol 141(4):1104–1110CrossRefPubMed
9.
Zurück zum Zitat Mayeza ZE (2021) Knowledge, attitudes and practices of Black African males towards the use of sun protection: a case study of a University of Technology in KwaZulu-Natal (Doctoral dissertation) Mayeza ZE (2021) Knowledge, attitudes and practices of Black African males towards the use of sun protection: a case study of a University of Technology in KwaZulu-Natal (Doctoral dissertation)
10.
Zurück zum Zitat Bhatt H, Shah V, Shah K, Shah R, Shah M (2022) State-of-the-art machine learning techniques for melanoma skin cancer detection and classification: a comprehensive review. Intelligent Medicine 3(03):180–190CrossRef Bhatt H, Shah V, Shah K, Shah R, Shah M (2022) State-of-the-art machine learning techniques for melanoma skin cancer detection and classification: a comprehensive review. Intelligent Medicine 3(03):180–190CrossRef
12.
Zurück zum Zitat Trager MH, Geskin LJ, Samie FH, Liu L (2022) Biomarkers in melanoma and non-melanoma skin cancer prevention and risk stratification. Exp Dermatol 31(1):4–12CrossRefPubMed Trager MH, Geskin LJ, Samie FH, Liu L (2022) Biomarkers in melanoma and non-melanoma skin cancer prevention and risk stratification. Exp Dermatol 31(1):4–12CrossRefPubMed
13.
Zurück zum Zitat Seitter SJ, Sherry RM, Yang JC, Robbins PF, Shindorf ML, Copeland AR, McGowan CT, Epstein M, Shelton TE, Langhan MM, Franco Z (2021) Impact of prior treatment on the efficacy of adoptive transfer of tumor-infiltrating lymphocytes in patients with metastatic melanomaimpact of prior treatment on TIL for metastatic melanoma. Clin Cancer Res 27(19):5289–5298CrossRefPubMedPubMedCentral Seitter SJ, Sherry RM, Yang JC, Robbins PF, Shindorf ML, Copeland AR, McGowan CT, Epstein M, Shelton TE, Langhan MM, Franco Z (2021) Impact of prior treatment on the efficacy of adoptive transfer of tumor-infiltrating lymphocytes in patients with metastatic melanomaimpact of prior treatment on TIL for metastatic melanoma. Clin Cancer Res 27(19):5289–5298CrossRefPubMedPubMedCentral
14.
Zurück zum Zitat Saba T (2021) Computer vision for microscopic skin cancer diagnosis using handcrafted and non-handcrafted features. Microsc Res Tech 84(6):1272–1283CrossRefPubMed Saba T (2021) Computer vision for microscopic skin cancer diagnosis using handcrafted and non-handcrafted features. Microsc Res Tech 84(6):1272–1283CrossRefPubMed
15.
Zurück zum Zitat Mueller B, Kinoshita T, Peebles A, Graber MA, Lee S (2022) Artificial intelligence and machine learning in emergency medicine: a narrative review. Acute medicine & surgery 9(1):e740CrossRef Mueller B, Kinoshita T, Peebles A, Graber MA, Lee S (2022) Artificial intelligence and machine learning in emergency medicine: a narrative review. Acute medicine & surgery 9(1):e740CrossRef
16.
Zurück zum Zitat Yousaf N, Hussein S, Sultani W (2021) Estimation of BMI from facial images using semantic segmentation based region-aware pooling. Comput Biol Med 133:104392CrossRefPubMed Yousaf N, Hussein S, Sultani W (2021) Estimation of BMI from facial images using semantic segmentation based region-aware pooling. Comput Biol Med 133:104392CrossRefPubMed
17.
Zurück zum Zitat Aloupogianni E, Ishikawa M, Ichimura T, Hamada M, Murakami T, Sasaki A, Nakamura K, Kobayashi N, Obi T (2023) Effects of dimension reduction of hyperspectral images in skin gross pathology. Skin Res Technol 29(2):e13270CrossRefPubMedPubMedCentral Aloupogianni E, Ishikawa M, Ichimura T, Hamada M, Murakami T, Sasaki A, Nakamura K, Kobayashi N, Obi T (2023) Effects of dimension reduction of hyperspectral images in skin gross pathology. Skin Res Technol 29(2):e13270CrossRefPubMedPubMedCentral
19.
Zurück zum Zitat Allugunti VR (2022) A machine learning model for skin disease classification using convolution neural network. Int J Computing, Programming Database Management 3(1):141–147CrossRef Allugunti VR (2022) A machine learning model for skin disease classification using convolution neural network. Int J Computing, Programming Database Management 3(1):141–147CrossRef
20.
Zurück zum Zitat Wang L, Fu S, Wen A, Ruan X, He H, Liu S, Moon S, Mai M, Riaz IB, Wang N, Yang P (2022) Assessment of electronic health record for cancer research and patient care through a scoping review of cancer natural language processing. JCO Clinical Cancer Informatics 6:e2200006CrossRefPubMedPubMedCentral Wang L, Fu S, Wen A, Ruan X, He H, Liu S, Moon S, Mai M, Riaz IB, Wang N, Yang P (2022) Assessment of electronic health record for cancer research and patient care through a scoping review of cancer natural language processing. JCO Clinical Cancer Informatics 6:e2200006CrossRefPubMedPubMedCentral
21.
Zurück zum Zitat Gulzar Y, Khan SA (2022) Skin lesion segmentation based on vision transformers and convolutional neural networks—a comparative study. Appl Sci 12(12):5990CrossRef Gulzar Y, Khan SA (2022) Skin lesion segmentation based on vision transformers and convolutional neural networks—a comparative study. Appl Sci 12(12):5990CrossRef
22.
Zurück zum Zitat Höhn J, Krieghoff-Henning E, Jutzi TB, von Kalle C, Utikal JS, Meier F, Gellrich FF, Hobelsberger S, Hauschild A, Schlager JG, French L (2021) Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classification. Eur J Cancer 149:94–101CrossRefPubMed Höhn J, Krieghoff-Henning E, Jutzi TB, von Kalle C, Utikal JS, Meier F, Gellrich FF, Hobelsberger S, Hauschild A, Schlager JG, French L (2021) Combining CNN-based histologic whole slide image analysis and patient data to improve skin cancer classification. Eur J Cancer 149:94–101CrossRefPubMed
23.
Zurück zum Zitat Pacheco AG, Krohling RA (2021) An attention-based mechanism to combine images and metadata in deep learning models applied to skin cancer classification. IEEE J Biomed Health Inform 25(9):3554–3563CrossRefPubMed Pacheco AG, Krohling RA (2021) An attention-based mechanism to combine images and metadata in deep learning models applied to skin cancer classification. IEEE J Biomed Health Inform 25(9):3554–3563CrossRefPubMed
24.
Zurück zum Zitat Maron RC, Schlager JG, Haggenmüller S, von Kalle C, Utikal JS, Meier F, Gellrich FF, Hobelsberger S, Hauschild A, French L, Heinzerling L (2021) A benchmark for neural network robustness in skin cancer classification. Eur J Cancer 155:191–199CrossRefPubMed Maron RC, Schlager JG, Haggenmüller S, von Kalle C, Utikal JS, Meier F, Gellrich FF, Hobelsberger S, Hauschild A, French L, Heinzerling L (2021) A benchmark for neural network robustness in skin cancer classification. Eur J Cancer 155:191–199CrossRefPubMed
25.
Zurück zum Zitat Ali K, Shaikh ZA, Khan AA, Laghari AA (2022) Multi-class skin cancer classification using EfficientNets–a first step towards preventing skin cancer. Neuroscience Informatics 2(4):100034CrossRef Ali K, Shaikh ZA, Khan AA, Laghari AA (2022) Multi-class skin cancer classification using EfficientNets–a first step towards preventing skin cancer. Neuroscience Informatics 2(4):100034CrossRef
26.
Zurück zum Zitat Xin C, Liu Z, Zhao K, Miao L, Ma Y, Zhu X, Zhou Q, Wang S, Li L, Yang F, Xu S (2022) An improved transformer network for skin cancer classification. Comput Biol Med 149:105939CrossRefPubMed Xin C, Liu Z, Zhao K, Miao L, Ma Y, Zhu X, Zhou Q, Wang S, Li L, Yang F, Xu S (2022) An improved transformer network for skin cancer classification. Comput Biol Med 149:105939CrossRefPubMed
27.
Zurück zum Zitat Eisham ZK, Haque MM, Rahman MS, Nishat MM, Faisal F, Islam MR (2023) Chimp optimization algorithm in multilevel image thresholding and image clustering. Evol Syst 14(4):605–648 Eisham ZK, Haque MM, Rahman MS, Nishat MM, Faisal F, Islam MR (2023) Chimp optimization algorithm in multilevel image thresholding and image clustering. Evol Syst 14(4):605–648
29.
30.
Zurück zum Zitat Hasan MK, Dahal L, Samarakoon PN, Tushar FI, Martí R (2020) DSNet: Automatic dermoscopic skin lesion segmentation. Comput Biol Med 120:103738CrossRefPubMed Hasan MK, Dahal L, Samarakoon PN, Tushar FI, Martí R (2020) DSNet: Automatic dermoscopic skin lesion segmentation. Comput Biol Med 120:103738CrossRefPubMed
31.
Zurück zum Zitat Xie Y, Zhang J, Xia Y, Shen C (2020) A mutual bootstrapping model for automated skin lesion segmentation and classification. IEEE Trans Med Imaging 39(7):2482–2493ADSCrossRefPubMed Xie Y, Zhang J, Xia Y, Shen C (2020) A mutual bootstrapping model for automated skin lesion segmentation and classification. IEEE Trans Med Imaging 39(7):2482–2493ADSCrossRefPubMed
32.
33.
Zurück zum Zitat Saba T, Khan MA, Rehman A, Marie-Sainte SL (2019) Region extraction and classification of skin cancer: a heterogeneous framework of deep CNN features fusion and reduction. J Med Syst 43(9):289CrossRefPubMed Saba T, Khan MA, Rehman A, Marie-Sainte SL (2019) Region extraction and classification of skin cancer: a heterogeneous framework of deep CNN features fusion and reduction. J Med Syst 43(9):289CrossRefPubMed
34.
Zurück zum Zitat Bi L, Kim J, Ahn E, Kumar A, Feng D, Fulham M (2019) Step-wise integration of deep class-specific learning for dermoscopic image segmentation. Pattern Recogn 85:78–89ADSCrossRef Bi L, Kim J, Ahn E, Kumar A, Feng D, Fulham M (2019) Step-wise integration of deep class-specific learning for dermoscopic image segmentation. Pattern Recogn 85:78–89ADSCrossRef
35.
Zurück zum Zitat Bi L, Kim J, Ahn E, Feng D (2017) Automatic skin lesion analysis using large-scale dermoscopy images and deep residual networks. arXiv preprint arXiv:1703.04197. Bi L, Kim J, Ahn E, Feng D (2017) Automatic skin lesion analysis using large-scale dermoscopy images and deep residual networks. arXiv preprint arXiv:​1703.​04197.
37.
Zurück zum Zitat Anand V, Gupta S, Altameem A, Nayak SR, Poonia RC, Saudagar AKJ (2022) An enhanced transfer learning based classification for diagnosis of skin cancer. Diagnostics 12(7):1628CrossRefPubMedPubMedCentral Anand V, Gupta S, Altameem A, Nayak SR, Poonia RC, Saudagar AKJ (2022) An enhanced transfer learning based classification for diagnosis of skin cancer. Diagnostics 12(7):1628CrossRefPubMedPubMedCentral
38.
Zurück zum Zitat Gouda W, Sama NU, Al-Waakid G, Humayun M, Jhanjhi NZ (2022) June) Detection of skin cancer based on skin lesion images using deep learning. In Healthcare MDPI 10(7):1183CrossRef Gouda W, Sama NU, Al-Waakid G, Humayun M, Jhanjhi NZ (2022) June) Detection of skin cancer based on skin lesion images using deep learning. In Healthcare MDPI 10(7):1183CrossRef
39.
Zurück zum Zitat Alam TM, Shaukat K, Khan WA, Hameed IA, Almuqren LA, Raza MA, Luo S (2022) An efficient deep learning-based skin cancer classifier for an imbalanced dataset. Diagnostics 12(9):2115CrossRefPubMedPubMedCentral Alam TM, Shaukat K, Khan WA, Hameed IA, Almuqren LA, Raza MA, Luo S (2022) An efficient deep learning-based skin cancer classifier for an imbalanced dataset. Diagnostics 12(9):2115CrossRefPubMedPubMedCentral
40.
Zurück zum Zitat Chandra TB, Verma K, Singh BK, Jain D, Netam SS (2021) Coronavirus disease (COVID-19) detection in chest X-ray images using majority voting based classifier ensemble. Expert Syst Appl 165:113909CrossRefPubMed Chandra TB, Verma K, Singh BK, Jain D, Netam SS (2021) Coronavirus disease (COVID-19) detection in chest X-ray images using majority voting based classifier ensemble. Expert Syst Appl 165:113909CrossRefPubMed
41.
Zurück zum Zitat Chandra TB, Singh BK, Jain D (2022) Disease localization and severity assessment in chest X-ray images using multi-stage superpixels classification. Comput Methods Programs Biomed 222:106947CrossRefPubMedPubMedCentral Chandra TB, Singh BK, Jain D (2022) Disease localization and severity assessment in chest X-ray images using multi-stage superpixels classification. Comput Methods Programs Biomed 222:106947CrossRefPubMedPubMedCentral
42.
Zurück zum Zitat Kavitha G, Prakash C, Alhomrani M, Pradeep N, Alamri AS, Pareek PK & Alhassan M (2023) Noise estimation and type identification in natural scene and medical images using deep learning approaches. Contrast Media & Molecular Imaging, 2023. Kavitha G, Prakash C, Alhomrani M, Pradeep N, Alamri AS, Pareek PK & Alhassan M (2023) Noise estimation and type identification in natural scene and medical images using deep learning approaches. Contrast Media & Molecular Imaging, 2023.
43.
Zurück zum Zitat Chandra TB, Verma K, Jain D & Netam SS (2021) Segmented lung boundary correction in chest radiograph using context-aware adaptive scan algorithm. In Advances in Biomedical Engineering and Technology: Select Proceedings of ICBEST 2018, Springer Singapore, 263–275. Chandra TB, Verma K, Jain D & Netam SS (2021) Segmented lung boundary correction in chest radiograph using context-aware adaptive scan algorithm. In Advances in Biomedical Engineering and Technology: Select Proceedings of ICBEST 2018, Springer Singapore, 263–275.
44.
Zurück zum Zitat Chandra TB, Verma K, Jain D & Netam SS (2020, January) Localization of the suspected abnormal region in chest radiograph images. In 2020 First international conference on power, control and computing technologies (ICPC2T) IEEE 204–209. Chandra TB, Verma K, Jain D & Netam SS (2020, January) Localization of the suspected abnormal region in chest radiograph images. In 2020 First international conference on power, control and computing technologies (ICPC2T) IEEE 204–209.
45.
Zurück zum Zitat Arshed MA, Mumtaz S, Ibrahim M, Ahmed S, Tahir M, Shafi M (2023) Multi-class skin cancer classification using vision transformer networks and convolutional neural network-based pre-trained models. Information 14(7):415CrossRef Arshed MA, Mumtaz S, Ibrahim M, Ahmed S, Tahir M, Shafi M (2023) Multi-class skin cancer classification using vision transformer networks and convolutional neural network-based pre-trained models. Information 14(7):415CrossRef
46.
Zurück zum Zitat Srinivasu PN, SivaSai JG, Ijaz MF, Bhoi AK, Kim W, Kang JJ (2021) Classification of skin disease using deep learning neural networks with MobileNet V2 and LSTM. Sensors 21(8):2852ADSCrossRefPubMedPubMedCentral Srinivasu PN, SivaSai JG, Ijaz MF, Bhoi AK, Kim W, Kang JJ (2021) Classification of skin disease using deep learning neural networks with MobileNet V2 and LSTM. Sensors 21(8):2852ADSCrossRefPubMedPubMedCentral
Metadaten
Titel
An efficient multi-class classification of skin cancer using optimized vision transformer
verfasst von
R. P. Desale
P. S. Patil
Publikationsdatum
23.11.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
Medical & Biological Engineering & Computing / Ausgabe 3/2024
Print ISSN: 0140-0118
Elektronische ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-023-02969-x

Weitere Artikel der Ausgabe 3/2024

Medical & Biological Engineering & Computing 3/2024 Zur Ausgabe

Premium Partner