Skip to main content
Top

2020 | OriginalPaper | Chapter

DR Detection Using Optical Coherence Tomography Angiography (OCTA): A Transfer Learning Approach with Robustness Analysis

Authors : Rayna Andreeva, Alessandro Fontanella, Ylenia Giarratano, Miguel O. Bernabeu

Published in: Ophthalmic Medical Image Analysis

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

OCTA imaging is an emerging modality for the discovery of retinal biomarkers in systemic disease. Several studies have already shown the potential of deep learning algorithms in the medical domain. However, they generally require large amount of manually graded images which may not always be available. In our study, we aim to investigate whether transfer learning can help in identifying patient status from a relatively small dataset. Additionally, we explore if data augmentation may help in improving our classification accuracy. Finally, for the first time, we propose a validation of our model on OCTA images acquired with a different device. OCTA scans from three different groups of participants were analysed: diabetic with and without retinopathy (DR and NoDR, respectively) and healthy subjects. We used the convolutional neural network architecture VGG16 and achieved \(83.29\%\) accuracy when classifying DR, NoDR and Controls. Our results demonstrate how transfer learning enables fairly accurate OCTA scan classification and augmentation based on geometric transformations helps in improving the classification accuracy further. Finally, we show how our model maintains consistent performance across OCTA imaging devices, without any re-training.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alam, M., Zhang, Y., Lim, J.I., Chan, R.V., Yang, M., Yao, X.: Quantitative optical coherence tomography angiography features for objective classification and staging of diabetic retinopathy. Retina 40(2), 322–332 (2020) Alam, M., Zhang, Y., Lim, J.I., Chan, R.V., Yang, M., Yao, X.: Quantitative optical coherence tomography angiography features for objective classification and staging of diabetic retinopathy. Retina 40(2), 322–332 (2020)
2.
go back to reference Alam, M.N., Son, T., Toslak, D., Lim, J.I., Yao, X.: Quantitative artery-vein analysis in optical coherence tomography angiography of diabetic retinopathy. In: Ophthalmic Technologies XXIX, vol. 10858, p. 1085802. International Society for Optics and Photonics (2019) Alam, M.N., Son, T., Toslak, D., Lim, J.I., Yao, X.: Quantitative artery-vein analysis in optical coherence tomography angiography of diabetic retinopathy. In: Ophthalmic Technologies XXIX, vol. 10858, p. 1085802. International Society for Optics and Photonics (2019)
3.
go back to reference Baker, M.L., Hand, P.J., Wang, J.J., Wong, T.Y.: Retinal signs and stroke: revisiting the link between the eye and brain. Stroke 39(4), 1371–1379 (2008)CrossRef Baker, M.L., Hand, P.J., Wang, J.J., Wong, T.Y.: Retinal signs and stroke: revisiting the link between the eye and brain. Stroke 39(4), 1371–1379 (2008)CrossRef
4.
go back to reference Beede, E., et al.: A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–12 (2020) Beede, E., et al.: A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–12 (2020)
5.
go back to reference House of Commons Health Committee and others: Managing the care of people with long-term conditions. Second report of session, vol. 1, pp. 1–89 (2014) House of Commons Health Committee and others: Managing the care of people with long-term conditions. Second report of session, vol. 1, pp. 1–89 (2014)
7.
go back to reference Decencière, E., et al.: Feedback on a publicly distributed image database: the Messidor database. Image Anal. Stereol. 33(3), 231–234 (2014)CrossRef Decencière, E., et al.: Feedback on a publicly distributed image database: the Messidor database. Image Anal. Stereol. 33(3), 231–234 (2014)CrossRef
8.
go back to reference Díaz, M., Novo, J., Cutrín, P., Gómez-Ulla, F., Penedo, M.G., Ortega, M.: Automatic segmentation of the foveal avascular zone in ophthalmological OCT-A images. PLOS ONE 14(2), e0212364 (2019)CrossRef Díaz, M., Novo, J., Cutrín, P., Gómez-Ulla, F., Penedo, M.G., Ortega, M.: Automatic segmentation of the foveal avascular zone in ophthalmological OCT-A images. PLOS ONE 14(2), e0212364 (2019)CrossRef
9.
go back to reference Donahue, J., et al.: DeCAF: a deep convolutional activation feature for generic visual recognition. In: International Conference on Machine Learning, pp. 647–655 (2014) Donahue, J., et al.: DeCAF: a deep convolutional activation feature for generic visual recognition. In: International Conference on Machine Learning, pp. 647–655 (2014)
10.
go back to reference Frost, S., et al.: Retinal vascular biomarkers for early detection and monitoring of Alzheimer’s disease. Transl. Psychiatry 3(2), e233 (2013)CrossRef Frost, S., et al.: Retinal vascular biomarkers for early detection and monitoring of Alzheimer’s disease. Transl. Psychiatry 3(2), e233 (2013)CrossRef
11.
go back to reference Giarratano, Y., et al.: Automated and Network Structure Preserving Segmentation of Optical Coherence Tomography Angiograms. arXiv preprint arXiv:1912.09978 (2019) Giarratano, Y., et al.: Automated and Network Structure Preserving Segmentation of Optical Coherence Tomography Angiograms. arXiv preprint arXiv:​1912.​09978 (2019)
12.
go back to reference Hong, J.T., Sung, K.R., Cho, J.W., Yun, S.C., Kang, S.Y., Kook, M.S.: Retinal nerve fiber layer measurement variability with spectral domain optical coherence tomography. Korean J. Ophthalmol. 26(1), 32–38 (2012)CrossRef Hong, J.T., Sung, K.R., Cho, J.W., Yun, S.C., Kang, S.Y., Kook, M.S.: Retinal nerve fiber layer measurement variability with spectral domain optical coherence tomography. Korean J. Ophthalmol. 26(1), 32–38 (2012)CrossRef
13.
go back to reference Khadamy, J., Aghdam, K.A., Falavarjani, K.G.: An update on optical coherence tomography angiography in diabetic retinopathy. J. Ophthalmic Vis. Res. 13(4), 487 (2018)CrossRef Khadamy, J., Aghdam, K.A., Falavarjani, K.G.: An update on optical coherence tomography angiography in diabetic retinopathy. J. Ophthalmic Vis. Res. 13(4), 487 (2018)CrossRef
14.
go back to reference Le, D., Alam, M., Miao, B.A., Lim, J.I., Yao, X.: Fully automated geometric feature analysis in optical coherence tomography angiography for objective classification of diabetic retinopathy. Biomed. Opt. Exp. 10(5), 2493–2503 (2019)CrossRef Le, D., Alam, M., Miao, B.A., Lim, J.I., Yao, X.: Fully automated geometric feature analysis in optical coherence tomography angiography for objective classification of diabetic retinopathy. Biomed. Opt. Exp. 10(5), 2493–2503 (2019)CrossRef
15.
go back to reference Le, D., Alam, M.N., Lim, J.I., Chan, R., Yao, X.: Deep learning for objective OCTA detection of diabetic retinopathy. In: Ophthalmic Technologies XXX, vol. 11218, p. 112181P. International Society for Optics and Photonics (2020) Le, D., Alam, M.N., Lim, J.I., Chan, R., Yao, X.: Deep learning for objective OCTA detection of diabetic retinopathy. In: Ophthalmic Technologies XXX, vol. 11218, p. 112181P. International Society for Optics and Photonics (2020)
16.
go back to reference Li, F., Liu, Z., Chen, H., Jiang, M., Zhang, X., Wu, Z.: Automatic detection of diabetic retinopathy in retinal fundus photographs based on deep learning algorithm. Trans. Vis. Sci. Technol. 8(6), 4 (2019)CrossRef Li, F., Liu, Z., Chen, H., Jiang, M., Zhang, X., Wu, Z.: Automatic detection of diabetic retinopathy in retinal fundus photographs based on deep learning algorithm. Trans. Vis. Sci. Technol. 8(6), 4 (2019)CrossRef
17.
go back to reference Li, X., Hu, X., Yu, L., Zhu, L., Fu, C.W., Heng, P.A.: CANet: cross-disease attention network for joint diabetic retinopathy and diabetic macular edema grading. IEEE Trans. Med. Imaging 39(5), 1483–1493 (2019)CrossRef Li, X., Hu, X., Yu, L., Zhu, L., Fu, C.W., Heng, P.A.: CANet: cross-disease attention network for joint diabetic retinopathy and diabetic macular edema grading. IEEE Trans. Med. Imaging 39(5), 1483–1493 (2019)CrossRef
18.
go back to reference Lin, G.M., et al.: Transforming retinal photographs to entropy images in deep learning to improve automated detection for diabetic retinopathy. J. Ophthalmol. 2018, 1–6 (2018)CrossRef Lin, G.M., et al.: Transforming retinal photographs to entropy images in deep learning to improve automated detection for diabetic retinopathy. J. Ophthalmol. 2018, 1–6 (2018)CrossRef
19.
go back to reference MacGillivray, T., Trucco, E., Cameron, J., Dhillon, B., Houston, J., Van Beek, E.: Retinal imaging as a source of biomarkers for diagnosis, characterization and prognosis of chronic illness or long-term conditions. Br. J. Radiol. 87(1040), 20130832 (2014)CrossRef MacGillivray, T., Trucco, E., Cameron, J., Dhillon, B., Houston, J., Van Beek, E.: Retinal imaging as a source of biomarkers for diagnosis, characterization and prognosis of chronic illness or long-term conditions. Br. J. Radiol. 87(1040), 20130832 (2014)CrossRef
20.
go back to reference Mwanza, J.C., Gendy, M.G., Feuer, W.J., Shi, W., Budenz, D.L.: Effects of changing operators and instruments on time-domain and spectral-domain OCT measurements of retinal nerve fiber layer thickness. Ophthalmic Surg. Lasers Imaging Retina 42(4), 328–337 (2011)CrossRef Mwanza, J.C., Gendy, M.G., Feuer, W.J., Shi, W., Budenz, D.L.: Effects of changing operators and instruments on time-domain and spectral-domain OCT measurements of retinal nerve fiber layer thickness. Ophthalmic Surg. Lasers Imaging Retina 42(4), 328–337 (2011)CrossRef
21.
go back to reference Qayyum, A., Qadir, J., Bilal, M., Al-Fuqaha, A.: Secure and robust machine learning for healthcare: A survey. arXiv preprint arXiv:2001.08103 (2020) Qayyum, A., Qadir, J., Bilal, M., Al-Fuqaha, A.: Secure and robust machine learning for healthcare: A survey. arXiv preprint arXiv:​2001.​08103 (2020)
22.
go back to reference Sasongko, M., Wong, T., Nguyen, T., Cheung, C., Shaw, J., Wang, J.: Retinal vascular tortuosity in persons with diabetes and diabetic retinopathy. Diabetologia 54(9), 2409–2416 (2011)CrossRef Sasongko, M., Wong, T., Nguyen, T., Cheung, C., Shaw, J., Wang, J.: Retinal vascular tortuosity in persons with diabetes and diabetic retinopathy. Diabetologia 54(9), 2409–2416 (2011)CrossRef
23.
go back to reference Sayres, R., et al.: Using a deep learning algorithm and integrated gradients explanation to assist grading for diabetic retinopathy. Ophthalmology 126(4), 552–564 (2019)CrossRef Sayres, R., et al.: Using a deep learning algorithm and integrated gradients explanation to assist grading for diabetic retinopathy. Ophthalmology 126(4), 552–564 (2019)CrossRef
24.
go back to reference Sharif Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 806–813 (2014) Sharif Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 806–813 (2014)
25.
go back to reference Takase, N., Nozaki, M., Kato, A., Ozeki, H., Yoshida, M., Ogura, Y.: Enlargement of foveal avascular zone in diabetic eyes evaluated by en face optical coherence tomography angiography. Retina 35(11), 2377–2383 (2015)CrossRef Takase, N., Nozaki, M., Kato, A., Ozeki, H., Yoshida, M., Ogura, Y.: Enlargement of foveal avascular zone in diabetic eyes evaluated by en face optical coherence tomography angiography. Retina 35(11), 2377–2383 (2015)CrossRef
26.
go back to reference Tanner, M.A., Wong, W.H.: The calculation of posterior distributions by data augmentation. J. Am. Stat. Assoc. 82(398), 528–540 (1987)MathSciNetCrossRef Tanner, M.A., Wong, W.H.: The calculation of posterior distributions by data augmentation. J. Am. Stat. Assoc. 82(398), 528–540 (1987)MathSciNetCrossRef
27.
go back to reference Vadalà, M., Castellucci, M., Guarrasi, G., Terrasi, M., La Blasca, T., Mulè, G.: Retinal and choroidal vasculature changes associated with chronic kidney disease. Graefe’s Arch. Clin. Exp. Ophthalmol. 257(8), 1687–1698 (2019)CrossRef Vadalà, M., Castellucci, M., Guarrasi, G., Terrasi, M., La Blasca, T., Mulè, G.: Retinal and choroidal vasculature changes associated with chronic kidney disease. Graefe’s Arch. Clin. Exp. Ophthalmol. 257(8), 1687–1698 (2019)CrossRef
28.
go back to reference Wagner, S.K., et al.: Insights into systemic disease through retinal imaging-based oculomics. Trans. Vis. Sci. Technol. 9(2), 6 (2020)CrossRef Wagner, S.K., et al.: Insights into systemic disease through retinal imaging-based oculomics. Trans. Vis. Sci. Technol. 9(2), 6 (2020)CrossRef
29.
go back to reference Wang, Z., Yin, Y., Shi, J., Fang, W., Li, H., Wang, X.: Zoom-in-Net: deep mining lesions for diabetic retinopathy detection. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 267–275. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66179-7_31CrossRef Wang, Z., Yin, Y., Shi, J., Fang, W., Li, H., Wang, X.: Zoom-in-Net: deep mining lesions for diabetic retinopathy detection. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 267–275. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-66179-7_​31CrossRef
31.
go back to reference Yoon, S.P., et al.: Retinal microvascular and neurodegenerative changes in Alzheimer’s disease and mild cognitive impairment compared with control participants. Ophthalmol. Retina 3(6), 489–499 (2019)CrossRef Yoon, S.P., et al.: Retinal microvascular and neurodegenerative changes in Alzheimer’s disease and mild cognitive impairment compared with control participants. Ophthalmol. Retina 3(6), 489–499 (2019)CrossRef
32.
go back to reference Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks? In: Advances in Neural Information Processing Systems, pp. 3320–3328 (2014) Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks? In: Advances in Neural Information Processing Systems, pp. 3320–3328 (2014)
Metadata
Title
DR Detection Using Optical Coherence Tomography Angiography (OCTA): A Transfer Learning Approach with Robustness Analysis
Authors
Rayna Andreeva
Alessandro Fontanella
Ylenia Giarratano
Miguel O. Bernabeu
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-63419-3_2

Premium Partner