Skip to main content

2016 | OriginalPaper | Buchkapitel

Understanding the Mechanisms of Deep Transfer Learning for Medical Images

verfasst von : Hariharan Ravishankar, Prasad Sudhakar, Rahul Venkataramani, Sheshadri Thiruvenkadam, Pavan Annangi, Narayanan Babu, Vivek Vaidya

Erschienen in: Deep Learning and Data Labeling for Medical Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The ability to automatically learn task specific feature representations has led to a huge success of deep learning methods. When large training data is scarce, such as in medical imaging problems, transfer learning has been very effective. In this paper, we systematically investigate the process of transferring a Convolutional Neural Network, trained on ImageNet images to perform image classification, to kidney detection problem in ultrasound images. We study how the detection performance depends on the extent of transfer. We show that a transferred and tuned CNN can outperform a state-of-the-art feature engineered pipeline and a hybridization of these two techniques achieves 20 % higher performance. We also investigate how the evolution of intermediate response images from our network. Finally, we compare these responses to state-of-the-art image processing filters in order to gain greater insight into how transfer learning is able to effectively manage widely varying imaging regimes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ardon, R., Cuingnet, R., Bacchuwar, K., Auvray, V.: Fast kidney detection and segmentation with learned kernel convolution and model deformation in 3D ultrasound images. In: Proceedings of ISBI, pp. 268–271 (2015) Ardon, R., Cuingnet, R., Bacchuwar, K., Auvray, V.: Fast kidney detection and segmentation with learned kernel convolution and model deformation in 3D ultrasound images. In: Proceedings of ISBI, pp. 268–271 (2015)
2.
Zurück zum Zitat Becker, C., Rigamonti, R., Lepetit, V., Fua, P.: Supervised feature learning for curvilinear structure segmentation. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part I. LNCS, vol. 8149, pp. 526–533. Springer, Heidelberg (2013)CrossRef Becker, C., Rigamonti, R., Lepetit, V., Fua, P.: Supervised feature learning for curvilinear structure segmentation. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013, Part I. LNCS, vol. 8149, pp. 526–533. Springer, Heidelberg (2013)CrossRef
3.
Zurück zum Zitat Carneiro, G., Georgescu, B., Good, S., Comaniciu, D.: Detection and measurement of fetal anatomies from ultrasound images using a constrained probabilistic boosting tree. IEEE Trans. Med. Imaging 27(9), 1342–1355 (2008)CrossRef Carneiro, G., Georgescu, B., Good, S., Comaniciu, D.: Detection and measurement of fetal anatomies from ultrasound images using a constrained probabilistic boosting tree. IEEE Trans. Med. Imaging 27(9), 1342–1355 (2008)CrossRef
4.
Zurück zum Zitat Carneiro, G., Nascimento, J., Bradley, A.P.: Unregistered multiview mammogramanalysis with pre-trained deep learning models. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 652–660. Springer, Heidelberg (2015)CrossRef Carneiro, G., Nascimento, J., Bradley, A.P.: Unregistered multiview mammogramanalysis with pre-trained deep learning models. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 652–660. Springer, Heidelberg (2015)CrossRef
5.
Zurück zum Zitat Caruana, R., Niculescu-Mizil, A.: An empirical comparison of supervised learning algorithms. In: Proceedings of ICML, pp. 161–168 (2006) Caruana, R., Niculescu-Mizil, A.: An empirical comparison of supervised learning algorithms. In: Proceedings of ICML, pp. 161–168 (2006)
6.
Zurück zum Zitat Chen, H., Ni, D., Qin, J., Li, S., Yang, X., Wang, T., Heng, P.A.: Standard plane localization in fetal ultrasound via domain transferred deep neural networks. IEEE J. Biomed. Health Inform. 19(5), 1627–1636 (2015)CrossRef Chen, H., Ni, D., Qin, J., Li, S., Yang, X., Wang, T., Heng, P.A.: Standard plane localization in fetal ultrasound via domain transferred deep neural networks. IEEE J. Biomed. Health Inform. 19(5), 1627–1636 (2015)CrossRef
7.
Zurück zum Zitat Cho, J., Lee, K., Shin, E., Choy, G., Do, S.: How much data is needed to train a medical image deep learning system to achieve necessary high accuracy? In: ICLR (2016) Cho, J., Lee, K., Shin, E., Choy, G., Do, S.: How much data is needed to train a medical image deep learning system to achieve necessary high accuracy? In: ICLR (2016)
8.
Zurück zum Zitat Emamian, S.A., Nielsen, M.B., Pedersen, J.F., Ytte, L.: Kidney dimensions at sonography: correlation with age, sex, and habitus in 665 adult volunteers. Am. J. Roentgenol. 160(1), 83–86 (1993)CrossRef Emamian, S.A., Nielsen, M.B., Pedersen, J.F., Ytte, L.: Kidney dimensions at sonography: correlation with age, sex, and habitus in 665 adult volunteers. Am. J. Roentgenol. 160(1), 83–86 (1993)CrossRef
9.
Zurück zum Zitat Frangi, A.F., Niessen, W.J., Vincken, K.L., Viergever, M.A.: Multiscale vessel enhancement filtering. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 130–137. Springer, Heidelberg (1998) Frangi, A.F., Niessen, W.J., Vincken, K.L., Viergever, M.A.: Multiscale vessel enhancement filtering. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 130–137. Springer, Heidelberg (1998)
10.
Zurück zum Zitat Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation (2014) Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation (2014)
11.
Zurück zum Zitat Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: Convolutional architecture for fast feature embedding. In: Proceedings of the ACM International Conference on Multimedia, pp. 675–678 (2014) Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: Convolutional architecture for fast feature embedding. In: Proceedings of the ACM International Conference on Multimedia, pp. 675–678 (2014)
12.
Zurück zum Zitat Keramidas, E.G., Iakovidis, D.K., Maroulis, D.E., Karkanis, S.A.: Efficient and effective ultrasound image analysis scheme for thyroid nodule detection. In: Kamel, M.S., Campilho, A. (eds.) ICIAR 2007. LNCS, vol. 4633, pp. 1052–1060. Springer, Heidelberg (2007)CrossRef Keramidas, E.G., Iakovidis, D.K., Maroulis, D.E., Karkanis, S.A.: Efficient and effective ultrasound image analysis scheme for thyroid nodule detection. In: Kamel, M.S., Campilho, A. (eds.) ICIAR 2007. LNCS, vol. 4633, pp. 1052–1060. Springer, Heidelberg (2007)CrossRef
13.
Zurück zum Zitat Kop, A.M., Hegadi, R.: Kidney segmentation from ultrasound images using gradient vector force. IJCA 2, 104–109 (2010). Special Issue on RTIPPR Kop, A.M., Hegadi, R.: Kidney segmentation from ultrasound images using gradient vector force. IJCA 2, 104–109 (2010). Special Issue on RTIPPR
14.
Zurück zum Zitat Kovesi, P.: Phase congruency detects corners and edges. In: Proceedings of the Australian Pattern Recognition Society Conference: DICTA, pp. 309–318 (2003) Kovesi, P.: Phase congruency detects corners and edges. In: Proceedings of the Australian Pattern Recognition Society Conference: DICTA, pp. 309–318 (2003)
15.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Proceedings of Advances in Neural Information Processing Systems NIPS, pp. 1106–1114 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Proceedings of Advances in Neural Information Processing Systems NIPS, pp. 1106–1114 (2012)
16.
Zurück zum Zitat Martin-Fernandez, M., Alberola-Lopez, C.: An approach for contour detection of human kidneys from ultrasound images using Markov random fields and active contours. Med. Image Anal. 9(1), 1–23 (2005)CrossRef Martin-Fernandez, M., Alberola-Lopez, C.: An approach for contour detection of human kidneys from ultrasound images using Markov random fields and active contours. Med. Image Anal. 9(1), 1–23 (2005)CrossRef
17.
Zurück zum Zitat Ravishankar, H., Annangi, P.: Automated kidney morphology measurements from ultrasound images using texture and edge analysis. In: SPIE Medical Imaging (2016) Ravishankar, H., Annangi, P.: Automated kidney morphology measurements from ultrasound images using texture and edge analysis. In: SPIE Medical Imaging (2016)
18.
Zurück zum Zitat Shie, C.K., Chuang, C.H., Chou, C.N., Wu, M.H., Chang, E.Y.: Transfer representation learning for medical image analysis. In: EMBC, pp. 711–714 (2015) Shie, C.K., Chuang, C.H., Chou, C.N., Wu, M.H., Chang, E.Y.: Transfer representation learning for medical image analysis. In: EMBC, pp. 711–714 (2015)
19.
Zurück zum Zitat Shin, H., Roth, H.R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D.J., Summers, R.M.: Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)CrossRef Shin, H., Roth, H.R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D.J., Summers, R.M.: Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)CrossRef
20.
Zurück zum Zitat Sohail, A.S.M., Rahman, M.M., Bhattacharya, P., Krishnamurthy, S., Mudur, S.P.: Retrieval and classification of ultrasound images of ovarian cysts combining texture features and histogram moments. In: Proceedings of ISBI, pp. 288–291, April 2010 Sohail, A.S.M., Rahman, M.M., Bhattacharya, P., Krishnamurthy, S., Mudur, S.P.: Retrieval and classification of ultrasound images of ovarian cysts combining texture features and histogram moments. In: Proceedings of ISBI, pp. 288–291, April 2010
21.
Zurück zum Zitat Tajbakhsh, N., Shin, J.Y., Gurudu, S.R., Hurst, R.T., Kendall, C.B., Gotway, M.B., Liang, J.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35(5), 1299–1312 (2016)CrossRef Tajbakhsh, N., Shin, J.Y., Gurudu, S.R., Hurst, R.T., Kendall, C.B., Gotway, M.B., Liang, J.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35(5), 1299–1312 (2016)CrossRef
22.
Zurück zum Zitat Xie, J., Jiang, Y., Tsui, H.T.: Segmentation of kidney from ultrasound images based on texture and shape priors. IEEE Trans. Med. Imaging 24(1), 45–57 (2005)CrossRef Xie, J., Jiang, Y., Tsui, H.T.: Segmentation of kidney from ultrasound images based on texture and shape priors. IEEE Trans. Med. Imaging 24(1), 45–57 (2005)CrossRef
23.
Zurück zum Zitat Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks? In: Proceedings Advances in Neural Information Processing Systems NIPS, pp. 3320–3328 (2014) Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks? In: Proceedings Advances in Neural Information Processing Systems NIPS, pp. 3320–3328 (2014)
24.
Zurück zum Zitat Zheng, Y., Liu, D., Georgescu, B., Nguyen, H., Comaniciu, D.: 3D deep learning for efficient and robust landmark detection in volumetric data. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9349, pp. 565–572. Springer, Heidelberg (2015). doi:10.1007/978-3-319-24553-9_69 CrossRef Zheng, Y., Liu, D., Georgescu, B., Nguyen, H., Comaniciu, D.: 3D deep learning for efficient and robust landmark detection in volumetric data. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9349, pp. 565–572. Springer, Heidelberg (2015). doi:10.​1007/​978-3-319-24553-9_​69 CrossRef
Metadaten
Titel
Understanding the Mechanisms of Deep Transfer Learning for Medical Images
verfasst von
Hariharan Ravishankar
Prasad Sudhakar
Rahul Venkataramani
Sheshadri Thiruvenkadam
Pavan Annangi
Narayanan Babu
Vivek Vaidya
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46976-8_20