Skip to main content
Erschienen in: Health and Technology 6/2022

13.10.2022 | Original Paper

A New method for promote the performance of deep learning paradigm in diagnosing breast cancer: improving role of fusing multiple views of thermography images

verfasst von: Mahsa Ensafi, Mohammad Reza Keyvanpour, Seyed Vahab Shojaedini

Erschienen in: Health and Technology | Ausgabe 6/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Breast cancer is one of the deadliest cancers among women worldwide which its early detection may significantly reduce its mortality rate. Thermgraphy is a new, non-invasive, non-painful, and low-cost modality that detects abnormalities by detecting heat from the breast surface.

Method

Recent research has applied deep learning to early breast cancer diagnosis via thermography, using only the frontal view of thermograms. We combine several views of thermal images to improve the performance of pre-trained deep learning architectures in this article. This goal is achieved by combining frontal-45 data with lateral-45 and lateral45 thermograms to construct a detection model that utilizes transfer learning.

Result

Research in this area uses the Database for Mastology Research (DMR) with infrared images. In this study, transfer based deep learning methods are demonstrated to be effective in fusing several views of thermograms to diagnose breast cancer in a manner that can result in a sensitivity increase of 2-15 percent and a specificity increase of 2-30 percent compared to other deep learning-based or handcrafted schemes.

Conclusion

Using multiple views of thermograms and transfer learning, this paper proposes a method for improving breast cancer diagnosis. Using methods based on deep learning and methods based on hand-crafted features, we evaluated the performance of the proposed model. Using the obtained results as a basis for future research, the proposed design can be improved and developed as a valid approach in interpreting breast thermography images.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mahmood T, et al. A Brief Survey on Breast Cancer Diagnostic with Deep Learning Schemes Using Multi-Image Modalities. Journals & Magazines. 2020;8:165779–809. Mahmood T, et al. A Brief Survey on Breast Cancer Diagnostic with Deep Learning Schemes Using Multi-Image Modalities. Journals & Magazines. 2020;8:165779–809.
2.
Zurück zum Zitat Mashekova A, et al. Early detection of the breast cancer using infrared technology – A comprehensive review. Therm Sci Eng Prog. 2022;27. Mashekova A, et al. Early detection of the breast cancer using infrared technology – A comprehensive review. Therm Sci Eng Prog. 2022;27.
3.
Zurück zum Zitat El Chamieh C, et al. Statistical methods for evaluating the fine needle aspiration cytology procedure in breast cancer diagnosis. BMC Med Res Methodol. 2022;22. El Chamieh C, et al. Statistical methods for evaluating the fine needle aspiration cytology procedure in breast cancer diagnosis. BMC Med Res Methodol. 2022;22.
4.
Zurück zum Zitat Husaini MASA, et al. A Systematic Review of Breast Cancer Detection Using Thermography and Neural Networks. IEEE Access. 2020;8:208922–208937. Husaini MASA, et al. A Systematic Review of Breast Cancer Detection Using Thermography and Neural Networks. IEEE Access. 2020;8:208922–208937.
5.
Zurück zum Zitat Sánchez-Cauce R, et al. Multi-input convolutional neural network for breast cancer detection using thermal images and clinical data. Comput Methods Programs Biomed. 2021;204. Sánchez-Cauce R, et al. Multi-input convolutional neural network for breast cancer detection using thermal images and clinical data. Comput Methods Programs Biomed. 2021;204.
6.
Zurück zum Zitat Houssein EH, et al. Deep and machine learning techniques for medical imaging-based breast cancer: A comprehensive review. Expert Syst Appl. 2020;167. Houssein EH, et al. Deep and machine learning techniques for medical imaging-based breast cancer: A comprehensive review. Expert Syst Appl. 2020;167.
7.
Zurück zum Zitat Dihmani H, et al. A review on Suspicious-Regions Segmentation Methods in Breast Thermogram Image. 2nd Innovative Research in Applied Science, Engineering and Technology (IRASET), Conference on. 2022. Dihmani H, et al. A review on Suspicious-Regions Segmentation Methods in Breast Thermogram Image. 2nd Innovative Research in Applied Science, Engineering and Technology (IRASET), Conference on. 2022.
8.
Zurück zum Zitat Mačianskytė D, et al. Automatic Detection of Human Maxillofacial Tumors by Using Thermal Imaging: A Preliminary Study. Sensors. 2022;22. Mačianskytė D, et al. Automatic Detection of Human Maxillofacial Tumors by Using Thermal Imaging: A Preliminary Study. Sensors. 2022;22.
9.
Zurück zum Zitat Singh D, et al. Role of image thermography in early breast cancer detection- Past, present and future. Comput Methods Programs Biomed. 2020;183. Singh D, et al. Role of image thermography in early breast cancer detection- Past, present and future. Comput Methods Programs Biomed. 2020;183.
10.
Zurück zum Zitat Resmini R, et al. A hybrid methodology for breast screening and cancer diagnosis using thermography. Comp Biol Med. 2021;135. Resmini R, et al. A hybrid methodology for breast screening and cancer diagnosis using thermography. Comp Biol Med. 2021;135.
11.
Zurück zum Zitat Barbosa VAF, et al. Deep-wavelet neural networks for breast cancer early diagnosis using mammary termographies. Deep Learning for Data Analytics. 2020:99–124. Barbosa VAF, et al. Deep-wavelet neural networks for breast cancer early diagnosis using mammary termographies. Deep Learning for Data Analytics. 2020:99–124.
12.
Zurück zum Zitat Al-antari MA, et al. Evaluation of Deep Learning Detection and Classification towards Computer-aided Diagnosis of Breast Lesions in Digital X-ray Mammograms. Comput Methods Programs Biomed. 2020;196. Al-antari MA, et al. Evaluation of Deep Learning Detection and Classification towards Computer-aided Diagnosis of Breast Lesions in Digital X-ray Mammograms. Comput Methods Programs Biomed. 2020;196.
13.
Zurück zum Zitat Baduge SK, et al. Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods and applications. Autom Constr. 2022;141. Baduge SK, et al. Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods and applications. Autom Constr. 2022;141.
14.
Zurück zum Zitat Lessa V, et al. Applying Artificial Neural Network for the Classification of Breast Cancer Using Infrared Thermographic Images. International Conference on Computer Vision and Graphics. 2016;429–438. Lessa V, et al. Applying Artificial Neural Network for the Classification of Breast Cancer Using Infrared Thermographic Images. International Conference on Computer Vision and Graphics. 2016;429–438.
15.
Zurück zum Zitat Sourav P, et al. Texture Analysis of Breast Thermogram for Differentiation of Malignant and Benign Breast. International Conference on Advances in Computing, Communications and Informatics (ICACCI). 2016;8–14. Sourav P, et al. Texture Analysis of Breast Thermogram for Differentiation of Malignant and Benign Breast. International Conference on Advances in Computing, Communications and Informatics (ICACCI). 2016;8–14.
16.
Zurück zum Zitat Gogoi UR, et al. Discriminative Feature Selection for Breast Abnormality Detection and Accurate Classification of Thermograms. International Conference on Innovations in Electronics, Signal Processing and Communication (IESC). 2017:39–44. Gogoi UR, et al. Discriminative Feature Selection for Breast Abnormality Detection and Accurate Classification of Thermograms. International Conference on Innovations in Electronics, Signal Processing and Communication (IESC). 2017:39–44.
17.
Zurück zum Zitat Sathish D, et al. Asymmetry analysis of breast thermograms using automated segmentation and texture features. SIViP. 2017;11:745–52.CrossRef Sathish D, et al. Asymmetry analysis of breast thermograms using automated segmentation and texture features. SIViP. 2017;11:745–52.CrossRef
18.
Zurück zum Zitat Sanchez-Ruiz D, et al. Automatic region of interest segmentation for breast thermogram image classification. Pattern Recognit Lett. 2020;135:72–81. Sanchez-Ruiz D, et al. Automatic region of interest segmentation for breast thermogram image classification. Pattern Recognit Lett. 2020;135:72–81.
19.
Zurück zum Zitat Angkoso CV, et al. Multiplane ConVolutional Neural Network (Mp-CNN) for Alzheimer’s Disease Classification. International Journal of Intelligent Engineering and Systems. 2022;15(1):329–40. Angkoso CV, et al. Multiplane ConVolutional Neural Network (Mp-CNN) for Alzheimer’s Disease Classification. International Journal of Intelligent Engineering and Systems. 2022;15(1):329–40.
20.
Zurück zum Zitat Farooq MA, et al. Infrared Imaging for Human Thermography and Breast Tumor Classification using Thermal Images. 31st Irish Signals and Systems Conference (ISSC). 2020. Farooq MA, et al. Infrared Imaging for Human Thermography and Breast Tumor Classification using Thermal Images. 31st Irish Signals and Systems Conference (ISSC). 2020.
21.
Zurück zum Zitat Zuluaga-Gomez J, et al. A CNN-based methodology for breast cancer diagnosis using thermal images. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2020. Zuluaga-Gomez J, et al. A CNN-based methodology for breast cancer diagnosis using thermal images. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2020.
22.
Zurück zum Zitat Fernández-ovies FJ, et al. Detection of breast cancer using infrared thermography and deep neural networks detection of breast cancer using infrared thermography and deep neural networks, in Bio informatics and Biomedical Engineering. Berlin, Germany: Springer-Verlag; 2019. Fernández-ovies FJ, et al. Detection of breast cancer using infrared thermography and deep neural networks detection of breast cancer using infrared thermography and deep neural networks, in Bio informatics and Biomedical Engineering. Berlin, Germany: Springer-Verlag; 2019.
23.
Zurück zum Zitat Roslidar R, et al. BreaCNet: A high-accuracy breast thermogram classifier based on mobile convolutional neural network. Mathematical Bioscience and Engineering. 2021;19:1304–31.CrossRefMATH Roslidar R, et al. BreaCNet: A high-accuracy breast thermogram classifier based on mobile convolutional neural network. Mathematical Bioscience and Engineering. 2021;19:1304–31.CrossRefMATH
24.
Zurück zum Zitat Husaini MASA, etal. Thermal-based early breast cancer detection using inception V3, inception V4 and modified inception MV4. Neural Comput Appl. 2022. Husaini MASA, etal. Thermal-based early breast cancer detection using inception V3, inception V4 and modified inception MV4. Neural Comput Appl. 2022.
25.
Zurück zum Zitat Yamashita R, et al. Convolutional neural networks: an overview and application in radiology. Insights Imaging. 2018;9:611–29.CrossRef Yamashita R, et al. Convolutional neural networks: an overview and application in radiology. Insights Imaging. 2018;9:611–29.CrossRef
26.
Zurück zum Zitat Mardi M, et al. Temporal Convolutional Learning: A New Sequence-based Structure to Promote the Performance of Convolutional Neural Networks in Recognizing P300 Signals. Journal of Health Management and Informatics. 2021;8(1):68–77. Mardi M, et al. Temporal Convolutional Learning: A New Sequence-based Structure to Promote the Performance of Convolutional Neural Networks in Recognizing P300 Signals. Journal of Health Management and Informatics. 2021;8(1):68–77.
27.
Zurück zum Zitat Esraa AM, et al. Deep learning model for fully automated breast cancer detection system from thermograms. PLoS One. 2022:17(1). Esraa AM, et al. Deep learning model for fully automated breast cancer detection system from thermograms. PLoS One. 2022:17(1).
28.
Zurück zum Zitat Krishna ST, et al. Deep Learning and Transfer Learning Approaches for Image Classification. International Journal of Recent Technology and Engineering (IJRTE). 2019;7:427–32. Krishna ST, et al. Deep Learning and Transfer Learning Approaches for Image Classification. International Journal of Recent Technology and Engineering (IJRTE). 2019;7:427–32.
29.
Zurück zum Zitat Simonyan K. Very deep convolutional networks for large-scale image recognition. arXiv. 2015. Simonyan K. Very deep convolutional networks for large-scale image recognition. arXiv. 2015.
30.
Zurück zum Zitat Kaiming H, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016:770–778. Kaiming H, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016:770–778.
31.
Zurück zum Zitat Huang G, et al. Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017;4700–4708. Huang G, et al. Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017;4700–4708.
32.
Zurück zum Zitat Tan M, et al. Efficientnet: Rethinking model scaling for convolutional neural networks. In: International Conference on Machine Learning. PMLR. 2019;97:6105–6114. http://visual.ic.uff.br/. Tan M, et al. Efficientnet: Rethinking model scaling for convolutional neural networks. In: International Conference on Machine Learning. PMLR. 2019;97:6105–6114. http://​visual.​ic.​uff.​br/​.
34.
Zurück zum Zitat Silva LF, et al. A New Database for Breast Research with Infrared Image. J Med Imaging Health Inform. 2014;4:92–100.CrossRef Silva LF, et al. A New Database for Breast Research with Infrared Image. J Med Imaging Health Inform. 2014;4:92–100.CrossRef
35.
Zurück zum Zitat Rahman T, et al. Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray. Appl Sci. 2020;10(9):3233.CrossRef Rahman T, et al. Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-ray. Appl Sci. 2020;10(9):3233.CrossRef
36.
Zurück zum Zitat Baffa MFO, et al. Convolutional Neural Networks for Static and Dynamic Breast Infrared Imaging Classification. 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). 2018:174–181. Baffa MFO, et al. Convolutional Neural Networks for Static and Dynamic Breast Infrared Imaging Classification. 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). 2018:174–181.
37.
Zurück zum Zitat Karim CN, et al. A new approach for breast abnormality detection based on thermography. Med Technol J. 2018;2:257–65.CrossRef Karim CN, et al. A new approach for breast abnormality detection based on thermography. Med Technol J. 2018;2:257–65.CrossRef
38.
Zurück zum Zitat Pramanik S, et al. A Computer-Aided Hybrid Framework for Early Diagnosis of Breast Cancer. Adv Comp Syst Sec. 2019:111–124. Pramanik S, et al. A Computer-Aided Hybrid Framework for Early Diagnosis of Breast Cancer. Adv Comp Syst Sec. 2019:111–124.
39.
Zurück zum Zitat Pramanik S, et al. Suspicious-Region Segmentation From Breast Thermogram Using DLPE-Based Level Set Method. IEEE Trans Med Imaging. 2019;38:572–84.CrossRef Pramanik S, et al. Suspicious-Region Segmentation From Breast Thermogram Using DLPE-Based Level Set Method. IEEE Trans Med Imaging. 2019;38:572–84.CrossRef
40.
Zurück zum Zitat Sathish D, et al. Role of normalization of breast thermogram images and automatic classification of breast cancer. Vis Comput. 2019;35:57–70.CrossRef Sathish D, et al. Role of normalization of breast thermogram images and automatic classification of breast cancer. Vis Comput. 2019;35:57–70.CrossRef
Metadaten
Titel
A New method for promote the performance of deep learning paradigm in diagnosing breast cancer: improving role of fusing multiple views of thermography images
verfasst von
Mahsa Ensafi
Mohammad Reza Keyvanpour
Seyed Vahab Shojaedini
Publikationsdatum
13.10.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
Health and Technology / Ausgabe 6/2022
Print ISSN: 2190-7188
Elektronische ISSN: 2190-7196
DOI
https://doi.org/10.1007/s12553-022-00702-6

Weitere Artikel der Ausgabe 6/2022

Health and Technology 6/2022 Zur Ausgabe

Premium Partner