Skip to main content
Top

2020 | OriginalPaper | Chapter

Mid-Level Feature Extractor for Transfer Learning to Small-Scale Dataset of Medical Images

Authors : Dong-ho Lee, Yeon Lee, Byeong-seok Shin

Published in: Advances in Computer Science and Ubiquitous Computing

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In fine-tuning-based transfer learning, the size of the dataset may affect the learning accuracy. When a dataset scale is small, fine-tuning-based transfer learning methods use high computing costs, similar to a large-scale dataset. we propose a mid-level feature extractor that only retrains the mid-level convolutional layers, resulting in increased efficiency and reduced computing costs. This mid-level feature extractor is likely to provide an effective alternative in training a small-scale medical image dataset. The performance of the mid-level feature extractor is compared with performance of low- and high-level feature extractors, as well as the fine-tuning method. The mid-level feature extractor takes shorter time to converge than other methods, and it shows good accuracy, obtaining an area under the ROC curve (AUC) of 0.87 in untrained test dataset that is very different from training dataset.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef
2.
go back to reference Bar, Y., Diamant, I., Greenspan, H., Wolf, L.: Chest pathology detection using deep learning with non-medical training. In: Proc. IEEE, 12th International Symposium on Biomedical Imaging, pp. 294–297 (2015) Bar, Y., Diamant, I., Greenspan, H., Wolf, L.: Chest pathology detection using deep learning with non-medical training. In: Proc. IEEE, 12th International Symposium on Biomedical Imaging, pp. 294–297 (2015)
3.
go back to reference Shin, H., et al.: Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imag. 35(5), 1285–1298 (2016)CrossRef Shin, H., et al.: Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imag. 35(5), 1285–1298 (2016)CrossRef
4.
go back to reference Rajpurkar, P., et al.: CheXNet: radiologist level pneumonia detection on chest x-rays with deep learning, arXiv preprint arXiv:1711.05225 (2017) Rajpurkar, P., et al.: CheXNet: radiologist level pneumonia detection on chest x-rays with deep learning, arXiv preprint arXiv:​1711.​05225 (2017)
5.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: Proc. NIPS, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: Proc. NIPS, pp. 1097–1105 (2012)
6.
go back to reference Szegedy, C., et al.: Going deeper with convolutions. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015) Szegedy, C., et al.: Going deeper with convolutions. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
7.
go back to reference Oquab, M., Bottou, L., Laptev, I., Josef, S.: Learning and transferring mid-level image representations using convolutional neural networks. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1717–1724 (2015) Oquab, M., Bottou, L., Laptev, I., Josef, S.: Learning and transferring mid-level image representations using convolutional neural networks. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1717–1724 (2015)
8.
go back to reference Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN Features off-the-shelf: an astounding baseline for recognition, CoRR, abs/1403.6382 (2014) Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN Features off-the-shelf: an astounding baseline for recognition, CoRR, abs/1403.6382 (2014)
9.
go back to reference Zeiler, M., Fergus, R.: Visualizing and understanding convolutional networks. In: Proc. European Conference on Computer Vision, pp. 818–833 (2014)CrossRef Zeiler, M., Fergus, R.: Visualizing and understanding convolutional networks. In: Proc. European Conference on Computer Vision, pp. 818–833 (2014)CrossRef
Metadata
Title
Mid-Level Feature Extractor for Transfer Learning to Small-Scale Dataset of Medical Images
Authors
Dong-ho Lee
Yeon Lee
Byeong-seok Shin
Copyright Year
2020
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-9341-9_2