Skip to main content
Erschienen in: Multimedia Systems 4/2022

30.08.2021 | Special Issue Paper

Automatic segmentation of melanoma skin cancer using transfer learning and fine-tuning

verfasst von: Rafael Luz Araújo, Flávio H. D. de Araújo, Romuere R. V. e Silva

Erschienen in: Multimedia Systems | Ausgabe 4/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The massive use of multimedia technologies has enabled the exploration of information in many data such as texts, audio, videos, and images. Computational methods are being developed for several purposes such as monitoring, security, business, and even health through the automatic diagnosis of diseases by medical images. Among these diseases, we have melanoma skin cancer. Melanoma is a skin cancer that causes a large number of fatalities worldwide. Several methods for the automatic diagnosis of melanoma in dermoscopic images have been developed. For these methods to be more efficient, it is essential to isolate the lesion region. This study used a melanoma segmentation method based on U-net and LinkNet deep learning networks combined with transfer learning and fine-tuning techniques. Additionally, we evaluate the model’s ability to learn to segment the disease or just the dataset by combining datasets. The experiments were carried out in three datasets (PH2, ISIC 2018, and DermIS) and obtained promising results, emphasizing the U-net that obtained an average Dice of 0.923 in the PH2 dataset, Dice =  0.893 in ISIC 2018, and Dice = 0.879 in the DermIS dataset.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The codes, databases, and information for using the proposed methodology are available in a public repository: https://​github.​com/​rafaluz/​skin-seg-unet-linknet.
 
Literatur
1.
Zurück zum Zitat Memon, M.H., Khan, A., Li, J.-P., Shaikh, R.A., Memon, I., Deep, S.: Content based image retrieval based on geo-location driven image tagging on the social web, in: 2014 11th International Computer Conference on Wavelet Actiev Media Technology and Information Processing (ICCWAMTIP), IEEE, 2014, pp. 280–283 Memon, M.H., Khan, A., Li, J.-P., Shaikh, R.A., Memon, I., Deep, S.: Content based image retrieval based on geo-location driven image tagging on the social web, in: 2014 11th International Computer Conference on Wavelet Actiev Media Technology and Information Processing (ICCWAMTIP), IEEE, 2014, pp. 280–283
2.
Zurück zum Zitat Memon, I.: Authentication user’s privacy: An integrating location privacy protection algorithm for secure moving objects in location based services. Wireless Personal Communications 82(3), 1585–1600 (2015) Memon, I.: Authentication user’s privacy: An integrating location privacy protection algorithm for secure moving objects in location based services. Wireless Personal Communications 82(3), 1585–1600 (2015)
3.
Zurück zum Zitat Memon, M.H., Li, J.-P., Memon, I., Arain, Q.A.: Geo matching regions: multiple regions of interests using content based image retrieval based on relative locations. Multimedia Tools Appl. 76(14), 15377–15411 (2017)CrossRef Memon, M.H., Li, J.-P., Memon, I., Arain, Q.A.: Geo matching regions: multiple regions of interests using content based image retrieval based on relative locations. Multimedia Tools Appl. 76(14), 15377–15411 (2017)CrossRef
4.
Zurück zum Zitat Said, Y., Atri, M.: Efficient and high-performance pedestrian detector implementation for intelligent vehicles. IET Intell. Trans. Syst. 10(6), 438–444 (2016)CrossRef Said, Y., Atri, M.: Efficient and high-performance pedestrian detector implementation for intelligent vehicles. IET Intell. Trans. Syst. 10(6), 438–444 (2016)CrossRef
5.
Zurück zum Zitat Arain, Q.A., Memon, H., Memon, I., Memon, M.H., Shaikh, R.A., Mangi, F.A.: Intelligent travel information platform based on location base services to predict user travel behavior from user-generated gps traces. Int. J. Comput. Appl. 39(3), 155–168 (2017) Arain, Q.A., Memon, H., Memon, I., Memon, M.H., Shaikh, R.A., Mangi, F.A.: Intelligent travel information platform based on location base services to predict user travel behavior from user-generated gps traces. Int. J. Comput. Appl. 39(3), 155–168 (2017)
6.
Zurück zum Zitat Amin, J., Sharif, A., Gul, N., Anjum, M.A., Nisar, M.W., Azam, F., Bukhari, S.A.C.: Integrated design of deep features fusion for localization and classification of skin cancer. Pattern Recognit. Lett. 131, 63–70 (2020)CrossRef Amin, J., Sharif, A., Gul, N., Anjum, M.A., Nisar, M.W., Azam, F., Bukhari, S.A.C.: Integrated design of deep features fusion for localization and classification of skin cancer. Pattern Recognit. Lett. 131, 63–70 (2020)CrossRef
7.
Zurück zum Zitat Al Nazi, Z., Abir, T.A.: Automatic skin lesion segmentation and melanoma detection: Transfer learning approach with u-net and dcnn-svm, in: Proceedings of International Joint Conference on Computational Intelligence, Springer, 2020, pp. 371–381 Al Nazi, Z., Abir, T.A.: Automatic skin lesion segmentation and melanoma detection: Transfer learning approach with u-net and dcnn-svm, in: Proceedings of International Joint Conference on Computational Intelligence, Springer, 2020, pp. 371–381
9.
Zurück zum Zitat Haenssle, H.A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A.B.H., Thomas, L., Enk, A., et al.: Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann. Oncol. 29(8), 1836–1842 (2018)CrossRef Haenssle, H.A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A.B.H., Thomas, L., Enk, A., et al.: Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann. Oncol. 29(8), 1836–1842 (2018)CrossRef
10.
Zurück zum Zitat Argenziano, G., Soyer, H.P.: Dermoscopy of pigmented skin lesions-a valuable tool for early. Lancet Oncol. 2(7), 443–449 (2001)CrossRef Argenziano, G., Soyer, H.P.: Dermoscopy of pigmented skin lesions-a valuable tool for early. Lancet Oncol. 2(7), 443–449 (2001)CrossRef
11.
Zurück zum Zitat Moura, N., Veras, R., Aires, K., Machado, V., Silva, R., Araújo, F., Claro, M.: Abcd rule and pre-trained cnns for melanoma diagnosis. Multimedia Tools Appl. 78(6), 6869–6888 (2019)CrossRef Moura, N., Veras, R., Aires, K., Machado, V., Silva, R., Araújo, F., Claro, M.: Abcd rule and pre-trained cnns for melanoma diagnosis. Multimedia Tools Appl. 78(6), 6869–6888 (2019)CrossRef
12.
Zurück zum Zitat Barata, C., Ruela, M., Francisco, M., Mendonça, T., Marques, J.S.: Two systems for the detection of melanomas in dermoscopy images using texture and color features. IEEE Syst. J. 8(3), 965–979 (2013)CrossRef Barata, C., Ruela, M., Francisco, M., Mendonça, T., Marques, J.S.: Two systems for the detection of melanomas in dermoscopy images using texture and color features. IEEE Syst. J. 8(3), 965–979 (2013)CrossRef
13.
Zurück zum Zitat Tang, P., Liang, Q., Yan, X., Xiang, S., Sun, W., Zhang, D., Coppola, G.: Efficient skin lesion segmentation using separable-unet with stochastic weight averaging. Comput. Methods Programs Biomed. 178, 289–301 (2019)CrossRef Tang, P., Liang, Q., Yan, X., Xiang, S., Sun, W., Zhang, D., Coppola, G.: Efficient skin lesion segmentation using separable-unet with stochastic weight averaging. Comput. Methods Programs Biomed. 178, 289–301 (2019)CrossRef
14.
Zurück zum Zitat Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation, in: International Conference on Medical image computing and computer-assisted intervention, Springer, 2015, pp. 234–241 Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation, in: International Conference on Medical image computing and computer-assisted intervention, Springer, 2015, pp. 234–241
15.
Zurück zum Zitat Chaurasia, A., Culurciello, E., Linknet: Exploiting encoder representations for efficient semantic segmentation, in, : IEEE Visual Communications and Image Processing (VCIP). IEEE 2017, 1–4 (2017) Chaurasia, A., Culurciello, E., Linknet: Exploiting encoder representations for efficient semantic segmentation, in, : IEEE Visual Communications and Image Processing (VCIP). IEEE 2017, 1–4 (2017)
16.
Zurück zum Zitat Hosny, K.M., Kassem, M.A., Foaud, M.M.: Classification of skin lesions using transfer learning and augmentation with alex-net. PloS one 14(5), e0217293 (2019) Hosny, K.M., Kassem, M.A., Foaud, M.M.: Classification of skin lesions using transfer learning and augmentation with alex-net. PloS one 14(5), e0217293 (2019)
19.
Zurück zum Zitat Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybernet. 9(1), 62–66 (1979)CrossRef Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybernet. 9(1), 62–66 (1979)CrossRef
20.
Zurück zum Zitat MacQueen, J., et al.: Some methods for classification and analysis of multivariate observations, in: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, Vol. 1, Oakland, CA, USA, 1967, pp. 281–297 MacQueen, J., et al.: Some methods for classification and analysis of multivariate observations, in: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, Vol. 1, Oakland, CA, USA, 1967, pp. 281–297
21.
Zurück zum Zitat Fan, H., Xie, F., Li, Y., Jiang, Z., Liu, J.: Automatic segmentation of dermoscopy images using saliency combined with otsu threshold. Comput. Biol. Med. 85, 75–85 (2017)CrossRef Fan, H., Xie, F., Li, Y., Jiang, Z., Liu, J.: Automatic segmentation of dermoscopy images using saliency combined with otsu threshold. Comput. Biol. Med. 85, 75–85 (2017)CrossRef
22.
Zurück zum Zitat Ahn, E., Kim, J., Bi, L., Kumar, A., Li, C., Fulham, M., Feng, D.D.: Saliency-based lesion segmentation via background detection in dermoscopic images. IEEE J. Biomed. Health Informatics 21(6), 1685–1693 (2017)CrossRef Ahn, E., Kim, J., Bi, L., Kumar, A., Li, C., Fulham, M., Feng, D.D.: Saliency-based lesion segmentation via background detection in dermoscopic images. IEEE J. Biomed. Health Informatics 21(6), 1685–1693 (2017)CrossRef
23.
Zurück zum Zitat Al-Masni, M.A., Al-Antari, M.A., Choi, M.-T., Han, S.-M., Kim, T.-S.: Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks. Comput. Methods Programs Biomed. 162, 221–231 (2018)CrossRef Al-Masni, M.A., Al-Antari, M.A., Choi, M.-T., Han, S.-M., Kim, T.-S.: Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks. Comput. Methods Programs Biomed. 162, 221–231 (2018)CrossRef
24.
Zurück zum Zitat Aljanabi, M., Özok, Y.E., Rahebi, J., Abdullah, A.S.: Skin lesion segmentation method for dermoscopy images using artificial bee colony algorithm. Symmetry 10(8), 347 (2018)CrossRef Aljanabi, M., Özok, Y.E., Rahebi, J., Abdullah, A.S.: Skin lesion segmentation method for dermoscopy images using artificial bee colony algorithm. Symmetry 10(8), 347 (2018)CrossRef
25.
Zurück zum Zitat Peng, Y., Wang, N., Wang, Y., Wang, M.: Segmentation of dermoscopy image using adversarial networks. Multimedia Tools Appl. 78(8), 10965–10981 (2019)CrossRef Peng, Y., Wang, N., Wang, Y., Wang, M.: Segmentation of dermoscopy image using adversarial networks. Multimedia Tools Appl. 78(8), 10965–10981 (2019)CrossRef
26.
Zurück zum Zitat Goyal, M., Oakley, A., Bansal, P., Dancey, D., Yap, M.H.: Skin lesion segmentation in dermoscopic images with ensemble deep learning methods. IEEE Access 8, 4171–4181 (2019)CrossRef Goyal, M., Oakley, A., Bansal, P., Dancey, D., Yap, M.H.: Skin lesion segmentation in dermoscopic images with ensemble deep learning methods. IEEE Access 8, 4171–4181 (2019)CrossRef
27.
Zurück zum Zitat Khan, M.Q., Hussain, A., Rehman, S.U., Khan, U., Maqsood, M., Mehmood, K., Khan, M.A.: Classification of melanoma and nevus in digital images for diagnosis of skin cancer. IEEE Access 7, 90132–90144 (2019)CrossRef Khan, M.Q., Hussain, A., Rehman, S.U., Khan, U., Maqsood, M., Mehmood, K., Khan, M.A.: Classification of melanoma and nevus in digital images for diagnosis of skin cancer. IEEE Access 7, 90132–90144 (2019)CrossRef
28.
Zurück zum Zitat Abraham, N., Khan, N.M.: A novel focal tversky loss function with improved attention u-net for lesion segmentation, in, : IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). IEEE 2019, 683–687 (2019) Abraham, N., Khan, N.M.: A novel focal tversky loss function with improved attention u-net for lesion segmentation, in, : IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). IEEE 2019, 683–687 (2019)
29.
Zurück zum Zitat Santos, E., Veras, R., Miguel, H., Aires, K., Claro, M.L., Junior, G.B.: A skin lesion semi-supervised segmentation method, in: 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), IEEE, 2020, pp. 33–38 Santos, E., Veras, R., Miguel, H., Aires, K., Claro, M.L., Junior, G.B.: A skin lesion semi-supervised segmentation method, in: 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), IEEE, 2020, pp. 33–38
30.
Zurück zum Zitat Guo, X., Chen, Z., Yuan, Y.: Complementary network with adaptive receptive fields for melanoma segmentation, in, : IEEE 17th International Symposium on Biomedical Imaging (ISBI). IEEE 2020, 2010–2013 (2020) Guo, X., Chen, Z., Yuan, Y.: Complementary network with adaptive receptive fields for melanoma segmentation, in, : IEEE 17th International Symposium on Biomedical Imaging (ISBI). IEEE 2020, 2010–2013 (2020)
31.
Zurück zum Zitat Araújo, R.L., Ricardo de Andrade, L.R., Rodrigues, J.J., e Silva, R.R.: Automatic segmentation of melanoma skin cancer using deep learning, in: 2020 IEEE International Conference on E-health Networking, Application & Services (HEALTHCOM), IEEE, 2021, pp. 1–6 Araújo, R.L., Ricardo de Andrade, L.R., Rodrigues, J.J., e Silva, R.R.: Automatic segmentation of melanoma skin cancer using deep learning, in: 2020 IEEE International Conference on E-health Networking, Application & Services (HEALTHCOM), IEEE, 2021, pp. 1–6
32.
Zurück zum Zitat Al-Masni, M.A., Al-Antari, M.A., Park, J.-M., Gi, G., Kim, T.-Y., Rivera, P., Valarezo, E., Choi, M.-T., Han, S.-M., Kim, T.-S.: Simultaneous detection and classification of breast masses in digital mammograms via a deep learning yolo-based cad system. Comput. Methods Programs Biomed. 157, 85–94 (2018)CrossRef Al-Masni, M.A., Al-Antari, M.A., Park, J.-M., Gi, G., Kim, T.-Y., Rivera, P., Valarezo, E., Choi, M.-T., Han, S.-M., Kim, T.-S.: Simultaneous detection and classification of breast masses in digital mammograms via a deep learning yolo-based cad system. Comput. Methods Programs Biomed. 157, 85–94 (2018)CrossRef
33.
Zurück zum Zitat Mendonca, T., Celebi, M., Mendonca, T., Marques, J.: Ph2: A public database for the analysis of dermoscopic images, in: Dermoscopy image analysis, CRC Press, 2015 Mendonca, T., Celebi, M., Mendonca, T., Marques, J.: Ph2: A public database for the analysis of dermoscopic images, in: Dermoscopy image analysis, CRC Press, 2015
34.
Zurück zum Zitat Codella, N., Rotemberg, V., Tschandl, P., Celebi, M.E., Dusza, S., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., Marchetti, M., et al.: Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (isic), arXiv preprint arXiv:1902.03368 Codella, N., Rotemberg, V., Tschandl, P., Celebi, M.E., Dusza, S., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., Marchetti, M., et al.: Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (isic), arXiv preprint arXiv:​1902.​03368
35.
Zurück zum Zitat Tschandl, P., Rosendahl, C., Kittler, H.: The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5, 180161 (2018)CrossRef Tschandl, P., Rosendahl, C., Kittler, H.: The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5, 180161 (2018)CrossRef
37.
Zurück zum Zitat Bi, L., Kim, J., Ahn, E., Kumar, A., Feng, D., Fulham, M.: Step-wise integration of deep class-specific learning for dermoscopic image segmentation. Pattern Recognit. 85, 78–89 (2019)CrossRef Bi, L., Kim, J., Ahn, E., Kumar, A., Feng, D., Fulham, M.: Step-wise integration of deep class-specific learning for dermoscopic image segmentation. Pattern Recognit. 85, 78–89 (2019)CrossRef
39.
Zurück zum Zitat Zeng, C., Zhu, Z., Liu, G., Hu, W., Wang, X., Yang, C., Wang, H., He, D., Tan, J.: Randomized, double-blind, placebo-controlled trial of oral enalapril in patients with neurally mediated syncope. Am. Heart J. 136(5), 852–858 (1998)CrossRef Zeng, C., Zhu, Z., Liu, G., Hu, W., Wang, X., Yang, C., Wang, H., He, D., Tan, J.: Randomized, double-blind, placebo-controlled trial of oral enalapril in patients with neurally mediated syncope. Am. Heart J. 136(5), 852–858 (1998)CrossRef
40.
Zurück zum Zitat Provost, F., Domingos, P.: Well-trained pets: Improving probability estimation trees, Raport instytutowy IS-00-04, Stern School of Business, New York University Provost, F., Domingos, P.: Well-trained pets: Improving probability estimation trees, Raport instytutowy IS-00-04, Stern School of Business, New York University
41.
Zurück zum Zitat Ginsberg, J.R., Young, T.P.: Measuring association between individuals or groups in behavioural studies. Animal Behaviour 44(1), 377–379 (1992)CrossRef Ginsberg, J.R., Young, T.P.: Measuring association between individuals or groups in behavioural studies. Animal Behaviour 44(1), 377–379 (1992)CrossRef
42.
Zurück zum Zitat Hamers, L., et al.: Similarity measures in scientometric research: The jaccard index versus salton’s cosine formula. Information Processing and Management 25(3), 315–18 (1989) Hamers, L., et al.: Similarity measures in scientometric research: The jaccard index versus salton’s cosine formula. Information Processing and Management 25(3), 315–18 (1989)
43.
Zurück zum Zitat Burman, P.: A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods. Biometrika 76(3), 503–514 (1989)MathSciNetCrossRef Burman, P.: A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods. Biometrika 76(3), 503–514 (1989)MathSciNetCrossRef
44.
Zurück zum Zitat Chakkaravarthy, A.P., Chandrasekar, A.: Automatic detection and segmentation of melanoma using fuzzy c-means, in: 2019 Fifth International Conference on Science Technology Engineering and Mathematics (ICONSTEM), Vol. 1, IEEE, 2019, pp. 132–136 Chakkaravarthy, A.P., Chandrasekar, A.: Automatic detection and segmentation of melanoma using fuzzy c-means, in: 2019 Fifth International Conference on Science Technology Engineering and Mathematics (ICONSTEM), Vol. 1, IEEE, 2019, pp. 132–136
45.
Zurück zum Zitat Dey, N., Rajinikanth, V., Ashour, A.S., Tavares, J.M.R.: Social group optimization supported segmentation and evaluation of skin melanoma images. Symmetry 10(2), 51 (2018)CrossRef Dey, N., Rajinikanth, V., Ashour, A.S., Tavares, J.M.R.: Social group optimization supported segmentation and evaluation of skin melanoma images. Symmetry 10(2), 51 (2018)CrossRef
46.
Zurück zum Zitat Rastrelli, M., Tropea, S., Rossi, C.R., Alaibac, M.: Melanoma: epidemiology, risk factors, pathogenesis, diagnosis and classification. vivo 28(6), 1005–1011 (2014) Rastrelli, M., Tropea, S., Rossi, C.R., Alaibac, M.: Melanoma: epidemiology, risk factors, pathogenesis, diagnosis and classification. vivo 28(6), 1005–1011 (2014)
Metadaten
Titel
Automatic segmentation of melanoma skin cancer using transfer learning and fine-tuning
verfasst von
Rafael Luz Araújo
Flávio H. D. de Araújo
Romuere R. V. e Silva
Publikationsdatum
30.08.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems / Ausgabe 4/2022
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-021-00840-3

Weitere Artikel der Ausgabe 4/2022

Multimedia Systems 4/2022 Zur Ausgabe

Neuer Inhalt