Skip to main content

2018 | OriginalPaper | Buchkapitel

Vessel Preserving CNN-Based Image Resampling of Retinal Images

verfasst von : Andrey Krylov, Andrey Nasonov, Konstantin Chesnakov, Alexandra Nasonova, Seung Oh Jin, Uk Kang, Sang Min Park

Erschienen in: Image Analysis and Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

High quality resolution enhancement of eye fundus images is an important problem in medical image processing. Retinal images are usually noisy and contain low-contrast details that have to be preserved during upscaling. This makes the development of retinal image resampling algorithm a challenging problem.
The most promising results are achieved with the use of convolutional neural networks (CNN). We choose the popular algorithm SRCNN for general image resampling and investigate the possibility of using this algorithm for retinal image upscaling.
In this paper, we propose a new training scenario for SRCNN with specific preparation of training data and a transfer learning. We demonstrate an improvement of image quality in terms of general purpose image metrics (PSNR, SSIM) and basic edges metrics—the metrics that represent the image quality for strong isolated edges.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kim, W.H., Lee, J.S.: Blind single image super resolution with low computational complexity. Multimed. Tools Appl. 76(5), 7235–7249 (2017)CrossRef Kim, W.H., Lee, J.S.: Blind single image super resolution with low computational complexity. Multimed. Tools Appl. 76(5), 7235–7249 (2017)CrossRef
2.
Zurück zum Zitat Li, Z., Huang, F., Zhang, J., Dashtbozorg, B., Abbasi-Sureshjani, S., Sun, Y., Long, X., Yu, Q., ter Haar Romeny, B., Tan, T.: Multi-modal and multi-vendor retina image registration. Biomed. Opt. Express 9(2), 410–422 (2018)CrossRef Li, Z., Huang, F., Zhang, J., Dashtbozorg, B., Abbasi-Sureshjani, S., Sun, Y., Long, X., Yu, Q., ter Haar Romeny, B., Tan, T.: Multi-modal and multi-vendor retina image registration. Biomed. Opt. Express 9(2), 410–422 (2018)CrossRef
3.
Zurück zum Zitat Deng, K., Tian, J., Zheng, J., Zhang, X., Dai, X., Xu, M.: Retinal fundus image registration via vascular structure graph matching. J. Biomed. Imaging 2010, 14 (2010) Deng, K., Tian, J., Zheng, J., Zhang, X., Dai, X., Xu, M.: Retinal fundus image registration via vascular structure graph matching. J. Biomed. Imaging 2010, 14 (2010)
4.
Zurück zum Zitat Abdel-Hamid, L., El-Rafei, A., El-Ramly, S., Michelson, G.: Performance dependency of retinal image quality assessment algorithms on image resolution: analyses and solutions. Signal Image Video Process. 12(1), 9–16 (2018)CrossRef Abdel-Hamid, L., El-Rafei, A., El-Ramly, S., Michelson, G.: Performance dependency of retinal image quality assessment algorithms on image resolution: analyses and solutions. Signal Image Video Process. 12(1), 9–16 (2018)CrossRef
5.
Zurück zum Zitat Xu, J., Chutatape, O.: Auto-adjusted 3-d optic disk viewing from low-resolution stereo fundus image. Comput. Biol. Med. 36(9), 921–940 (2006)CrossRef Xu, J., Chutatape, O.: Auto-adjusted 3-d optic disk viewing from low-resolution stereo fundus image. Comput. Biol. Med. 36(9), 921–940 (2006)CrossRef
6.
Zurück zum Zitat Nakagawa, T., Suzuki, T., Hayashi, Y., Mizukusa, Y., Hatanaka, Y., Ishida, K., Hara, T., Fujita, H., Yamamoto, T.: Quantitative depth analysis of optic nerve head using stereo retinal fundus image pair. J. Biomed. Opt. 13(6), 064026 (2008)CrossRef Nakagawa, T., Suzuki, T., Hayashi, Y., Mizukusa, Y., Hatanaka, Y., Ishida, K., Hara, T., Fujita, H., Yamamoto, T.: Quantitative depth analysis of optic nerve head using stereo retinal fundus image pair. J. Biomed. Opt. 13(6), 064026 (2008)CrossRef
7.
Zurück zum Zitat Jebadurai, J., Peter, J.D.: Super-resolution of retinal images using multi-kernel SVR for IoT healthcare applications. Future Gener. Comput. Syst. 83, 338–346 (2018)CrossRef Jebadurai, J., Peter, J.D.: Super-resolution of retinal images using multi-kernel SVR for IoT healthcare applications. Future Gener. Comput. Syst. 83, 338–346 (2018)CrossRef
8.
Zurück zum Zitat Xu, X., Ding, W., Wang, X., Cao, R., Zhang, M., Lv, P., Xu, F.: Smartphone-based accurate analysis of retinal vasculature towards point-of-care diagnostics. Sci. Rep. 6, 34603 (2016)CrossRef Xu, X., Ding, W., Wang, X., Cao, R., Zhang, M., Lv, P., Xu, F.: Smartphone-based accurate analysis of retinal vasculature towards point-of-care diagnostics. Sci. Rep. 6, 34603 (2016)CrossRef
9.
Zurück zum Zitat Zhang, L., Wu, X.: An edge-guide image interpolation via directional filtering and data fusion. IEEE Trans. Image Process. 15, 2226–2235 (2006)CrossRef Zhang, L., Wu, X.: An edge-guide image interpolation via directional filtering and data fusion. IEEE Trans. Image Process. 15, 2226–2235 (2006)CrossRef
10.
Zurück zum Zitat Giachetti, A., Asuni, N.: Real time artifact-free image interpolation. IEEE Trans. Image Process. 20(10), 2760–2768 (2011)MathSciNetCrossRef Giachetti, A., Asuni, N.: Real time artifact-free image interpolation. IEEE Trans. Image Process. 20(10), 2760–2768 (2011)MathSciNetCrossRef
11.
Zurück zum Zitat Zhou, D., Shen, X., Dong, W.: Image zooming using directional cubic convolution interpolation. IET Image Process. 6(6), 627–634 (2012)MathSciNetCrossRef Zhou, D., Shen, X., Dong, W.: Image zooming using directional cubic convolution interpolation. IET Image Process. 6(6), 627–634 (2012)MathSciNetCrossRef
12.
Zurück zum Zitat Li, X., Orchard, M.: New edge-directed interpolation. IEEE Trans. Image Process. 10, 1521–1527 (2001)CrossRef Li, X., Orchard, M.: New edge-directed interpolation. IEEE Trans. Image Process. 10, 1521–1527 (2001)CrossRef
13.
Zurück zum Zitat Choi, J.S., Kim, M.: Super-interpolation with edge-orientation based mapping kernels for low complex 2x upscaling. IEEE Trans. Image Process. 25(1), 469–483 (2015)CrossRef Choi, J.S., Kim, M.: Super-interpolation with edge-orientation based mapping kernels for low complex 2x upscaling. IEEE Trans. Image Process. 25(1), 469–483 (2015)CrossRef
14.
Zurück zum Zitat Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef
15.
Zurück zum Zitat Dong, W., Zhang, L., Lukac, R., Shi, G.: Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Trans. Image Process. 22(4), 1382–1394 (2013)MathSciNetCrossRef Dong, W., Zhang, L., Lukac, R., Shi, G.: Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Trans. Image Process. 22(4), 1382–1394 (2013)MathSciNetCrossRef
17.
Zurück zum Zitat Nasonov, A., Chesnakov, K., Krylov, A.: CNN Based Retinal Image Upscaling Using Zero Component Analysis, pp. 27–31. ISPRS-International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2017)CrossRef Nasonov, A., Chesnakov, K., Krylov, A.: CNN Based Retinal Image Upscaling Using Zero Component Analysis, pp. 27–31. ISPRS-International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2017)CrossRef
18.
Zurück zum Zitat Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: convolutional architecture for fast feature embedding (2014). arXiv preprint: arXiv:1408.5093 Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: convolutional architecture for fast feature embedding (2014). arXiv preprint: arXiv:​1408.​5093
19.
Zurück zum Zitat Staal, J., Abramoff, M., Niemeijer, M., Viergever, M., van Ginneken, B.: Ridge based vessel segmentation in color images of the retina. IEEE Trans. Med. Imaging 23, 501–509 (2004)CrossRef Staal, J., Abramoff, M., Niemeijer, M., Viergever, M., van Ginneken, B.: Ridge based vessel segmentation in color images of the retina. IEEE Trans. Med. Imaging 23, 501–509 (2004)CrossRef
21.
Zurück zum Zitat Nasonov, A., Chesnakov, K., Krylov, A.: Convolutional neural networks based image resampling with noisy training set. In: International Conference on Signal Processing (ICSP2016), Chengdu, China, pp. 62–66 (2016) Nasonov, A., Chesnakov, K., Krylov, A.: Convolutional neural networks based image resampling with noisy training set. In: International Conference on Signal Processing (ICSP2016), Chengdu, China, pp. 62–66 (2016)
22.
Zurück zum Zitat Kälviäinen, R., Uusitalo, H.: DIARETDB1 diabetic retinopathy database and evaluation protocol. In: Medical Image Understanding and Analysis (2007) Kälviäinen, R., Uusitalo, H.: DIARETDB1 diabetic retinopathy database and evaluation protocol. In: Medical Image Understanding and Analysis (2007)
23.
Zurück zum Zitat Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
25.
Zurück zum Zitat Nasonov, A.V., Krylov, A.S.: Edge quality metrics for image enhancement. Pattern Recogn. Image Anal. 22(1), 346–353 (2012)CrossRef Nasonov, A.V., Krylov, A.S.: Edge quality metrics for image enhancement. Pattern Recogn. Image Anal. 22(1), 346–353 (2012)CrossRef
Metadaten
Titel
Vessel Preserving CNN-Based Image Resampling of Retinal Images
verfasst von
Andrey Krylov
Andrey Nasonov
Konstantin Chesnakov
Alexandra Nasonova
Seung Oh Jin
Uk Kang
Sang Min Park
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-93000-8_67

Premium Partner