Skip to main content

2018 | OriginalPaper | Buchkapitel

Towards Evolutionary Super-Resolution

verfasst von : Michal Kawulok, Pawel Benecki, Daniel Kostrzewa, Lukasz Skonieczny

Erschienen in: Applications of Evolutionary Computation

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Super-resolution reconstruction (SRR) allows for producing a high-resolution (HR) image from a set of low-resolution (LR) observations. The majority of existing methods require tuning a number of hyper-parameters which control the reconstruction process and configure the imaging model that is supposed to reflect the relation between high and low resolution. In this paper, we demonstrate that the reconstruction process is very sensitive to the actual relation between LR and HR images, and we argue that this is a substantial obstacle in deploying SRR in practice. We propose to search the hyper-parameter space using a genetic algorithm (GA), thus adapting to the actual relation between LR and HR, which has not been reported in the literature so far. The results of our extensive experimental study clearly indicate that our GA improves the capacities of SRR. Importantly, the GA converges to different values of the hyper-parameters depending on the applied degradation procedure, which is confirmed using statistical tests.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhu, H., Song, W., Tan, H., Wang, J., Jia, D.: Super resolution reconstruction based on adaptive detail enhancement for ZY-3 satellite images. In: Proceedings ISPRS Congress, pp. 213–217 (2016) Zhu, H., Song, W., Tan, H., Wang, J., Jia, D.: Super resolution reconstruction based on adaptive detail enhancement for ZY-3 satellite images. In: Proceedings ISPRS Congress, pp. 213–217 (2016)
2.
Zurück zum Zitat Yang, F., Chen, Y., Wang, R., Zhang, Q.: Super-resolution microwave imaging: time-domain tomography using highly accurate evolutionary optimization method. In: Proceedings EuCAP, pp. 1–4. IEEE (2015) Yang, F., Chen, Y., Wang, R., Zhang, Q.: Super-resolution microwave imaging: time-domain tomography using highly accurate evolutionary optimization method. In: Proceedings EuCAP, pp. 1–4. IEEE (2015)
3.
Zurück zum Zitat Jiang, J., Hu, R., Wang, Z., Han, Z.: Face super-resolution via multilayer locality-constrained iterative neighbor embedding and intermediate dictionary learning. IEEE Trans. Image Process. 23(10), 4220–4231 (2014)MathSciNetCrossRefMATH Jiang, J., Hu, R., Wang, Z., Han, Z.: Face super-resolution via multilayer locality-constrained iterative neighbor embedding and intermediate dictionary learning. IEEE Trans. Image Process. 23(10), 4220–4231 (2014)MathSciNetCrossRefMATH
4.
Zurück zum Zitat Lukinavičius, G., Umezawa, K., Olivier, N., Honigmann, A., Yang, G., Plass, T., Mueller, V., Reymond, L., Corrêa Jr., I.R., Luo, Z.G., et al.: A near-infrared fluorophore for live-cell super-resolution microscopy of cellular proteins. Nature Chem. 5(2), 132–139 (2013)CrossRef Lukinavičius, G., Umezawa, K., Olivier, N., Honigmann, A., Yang, G., Plass, T., Mueller, V., Reymond, L., Corrêa Jr., I.R., Luo, Z.G., et al.: A near-infrared fluorophore for live-cell super-resolution microscopy of cellular proteins. Nature Chem. 5(2), 132–139 (2013)CrossRef
5.
Zurück zum Zitat Capel, D., Zisserman, A.: Super-resolution enhancement of text image sequences. In: Proceedings IEEE ICPR, vol. 1, pp. 600–605 Capel, D., Zisserman, A.: Super-resolution enhancement of text image sequences. In: Proceedings IEEE ICPR, vol. 1, pp. 600–605
6.
Zurück zum Zitat Demirel, H., Anbarjafari, G.: Discrete wavelet transform-based satellite image resolution enhancement. IEEE Trans. Geosci. Remote Sens. 49(6), 1997–2004 (2011)CrossRefMATH Demirel, H., Anbarjafari, G.: Discrete wavelet transform-based satellite image resolution enhancement. IEEE Trans. Geosci. Remote Sens. 49(6), 1997–2004 (2011)CrossRefMATH
7.
Zurück zum Zitat Qian, S.E., Chen, G.: Enhancing spatial resolution of hyperspectral imagery using sensor’s intrinsic keystone distortion. IEEE Trans. Geosci. Remote Sens. 50(12), 5033–5048 (2012)CrossRef Qian, S.E., Chen, G.: Enhancing spatial resolution of hyperspectral imagery using sensor’s intrinsic keystone distortion. IEEE Trans. Geosci. Remote Sens. 50(12), 5033–5048 (2012)CrossRef
8.
Zurück zum Zitat Li, L., Zhang, Y., Tian, Q.: Multi-face location on embedded dsp image processing system. In: Proceedings CISP, vol. 4, pp. 124–128 (2008) Li, L., Zhang, Y., Tian, Q.: Multi-face location on embedded dsp image processing system. In: Proceedings CISP, vol. 4, pp. 124–128 (2008)
9.
10.
Zurück zum Zitat Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings IEEE CVPR, pp. 5197–5206 (2015) Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings IEEE CVPR, pp. 5197–5206 (2015)
11.
Zurück zum Zitat Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2016)CrossRef Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2016)CrossRef
12.
Zurück zum Zitat Liebel, L., Körner, M.: Single-image super resolution for multispectral remote sensing data using convolutional neural networks. In: Proceedings ISPRS Congress, pp. 883–890 (2016) Liebel, L., Körner, M.: Single-image super resolution for multispectral remote sensing data using convolutional neural networks. In: Proceedings ISPRS Congress, pp. 883–890 (2016)
13.
Zurück zum Zitat Kim, J., Kwon Lee, J., Mu Lee, K.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings IEEE CVPR, pp. 1646–1654 (2016) Kim, J., Kwon Lee, J., Mu Lee, K.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings IEEE CVPR, pp. 1646–1654 (2016)
14.
Zurück zum Zitat Efrat, N., Glasner, D., Apartsin, A., Nadler, B., Levin, A.: Accurate blur models vs. image priors in single image super-resolution. In: Proceedings IEEE ICCV, pp. 2832–2839 (2013) Efrat, N., Glasner, D., Apartsin, A., Nadler, B., Levin, A.: Accurate blur models vs. image priors in single image super-resolution. In: Proceedings IEEE ICCV, pp. 2832–2839 (2013)
15.
Zurück zum Zitat Nasrollahi, K., Moeslund, T.B.: Super-resolution: a comprehensive survey. Mach. Vis. Appl. 25(6), 1423–1468 (2014)CrossRef Nasrollahi, K., Moeslund, T.B.: Super-resolution: a comprehensive survey. Mach. Vis. Appl. 25(6), 1423–1468 (2014)CrossRef
16.
Zurück zum Zitat Panagiotopoulou, A., Anastassopoulos, V.: Super-resolution image reconstruction techniques: trade-offs between the data-fidelity and regularization terms. Inf. Fusion 13(3), 185–195 (2012)CrossRef Panagiotopoulou, A., Anastassopoulos, V.: Super-resolution image reconstruction techniques: trade-offs between the data-fidelity and regularization terms. Inf. Fusion 13(3), 185–195 (2012)CrossRef
17.
Zurück zum Zitat Irani, M., Peleg, S.: Improving resolution by image registration. CVGIP. Graph. Mod. Image Process. 53(3), 231–239 (1991)CrossRef Irani, M., Peleg, S.: Improving resolution by image registration. CVGIP. Graph. Mod. Image Process. 53(3), 231–239 (1991)CrossRef
18.
Zurück zum Zitat Schultz, R.R., Stevenson, R.L.: Extraction of high-resolution frames from video sequences. IEEE Trans. Image Process. 5(6), 996–1011 (1996)CrossRef Schultz, R.R., Stevenson, R.L.: Extraction of high-resolution frames from video sequences. IEEE Trans. Image Process. 5(6), 996–1011 (1996)CrossRef
19.
Zurück zum Zitat Wang, Y., Fevig, R., Schultz, R.R.: Super-resolution mosaicking of UAV surveillance video. In: Proceedings IEEE ICIP, pp. 345–348. IEEE (2008) Wang, Y., Fevig, R., Schultz, R.R.: Super-resolution mosaicking of UAV surveillance video. In: Proceedings IEEE ICIP, pp. 345–348. IEEE (2008)
20.
Zurück zum Zitat Akgun, T., Altunbasak, Y., Mersereau, R.M.: Super-resolution reconstruction of hyperspectral images. IEEE Trans. Image Process. 14(11), 1860–1875 (2005)CrossRef Akgun, T., Altunbasak, Y., Mersereau, R.M.: Super-resolution reconstruction of hyperspectral images. IEEE Trans. Image Process. 14(11), 1860–1875 (2005)CrossRef
21.
Zurück zum Zitat Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. Image Process. 13(10), 1327–1344 (2004)CrossRef Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. Image Process. 13(10), 1327–1344 (2004)CrossRef
22.
Zurück zum Zitat Hardie, R.: A fast image super-resolution algorithm using an adaptive wiener filter. IEEE Trans. Image Process. 16(12), 2953–2964 (2007)MathSciNetCrossRef Hardie, R.: A fast image super-resolution algorithm using an adaptive wiener filter. IEEE Trans. Image Process. 16(12), 2953–2964 (2007)MathSciNetCrossRef
23.
Zurück zum Zitat Li, F., Jia, X., Fraser, D.: Universal HMT based super resolution for remote sensing images. In: Proceedings IEEE ICIP, pp. 333–336 (2008) Li, F., Jia, X., Fraser, D.: Universal HMT based super resolution for remote sensing images. In: Proceedings IEEE ICIP, pp. 333–336 (2008)
24.
Zurück zum Zitat Ahrens, B.: Genetic algorithm optimization of superresolution parameters. In: Proceedings GECCO, pp. 2083–2088. ACM (2005) Ahrens, B.: Genetic algorithm optimization of superresolution parameters. In: Proceedings GECCO, pp. 2083–2088. ACM (2005)
25.
Zurück zum Zitat Cheng, M.H., Hwang, K.S., Jeng, J.H., Lin, N.W.: PSO-based fusion method for video super-resolution. J. Sign. Proces. Syst. 73(1), 25–42 (2013)CrossRef Cheng, M.H., Hwang, K.S., Jeng, J.H., Lin, N.W.: PSO-based fusion method for video super-resolution. J. Sign. Proces. Syst. 73(1), 25–42 (2013)CrossRef
26.
Zurück zum Zitat Wu, B., Li, C., Zhan, X.: Integrating spatial structure in super-resolution mapping of hyper-spectral image. Procedia Eng. 29, 1957–1962 (2012)CrossRef Wu, B., Li, C., Zhan, X.: Integrating spatial structure in super-resolution mapping of hyper-spectral image. Procedia Eng. 29, 1957–1962 (2012)CrossRef
27.
Zurück zum Zitat Zhong, Y., Zhang, L.: Remote sensing image subpixel mapping based on adaptive differential evolution. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 42(5), 1306–1329 (2012)CrossRef Zhong, Y., Zhang, L.: Remote sensing image subpixel mapping based on adaptive differential evolution. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 42(5), 1306–1329 (2012)CrossRef
28.
Zurück zum Zitat Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Proces. 13, 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Proces. 13, 600–612 (2004)CrossRef
29.
Zurück zum Zitat Kawulok, M., Smolka, B.: Texture-adaptive image colorization framework. EURASIP J. Adv. Sign. Proces. 2011(99) (2011) Kawulok, M., Smolka, B.: Texture-adaptive image colorization framework. EURASIP J. Adv. Sign. Proces. 2011(99) (2011)
30.
Zurück zum Zitat Kawulok, M., Benecki, P., Nalepa, J., Kostrzewa, D., Skonieczny, L.: Towards robust evaluation of super-resolution satellite image reconstruction. In: ACIIDS 2018, Part I. LNAI, vol. 10751. Springer, Cham (2018) Kawulok, M., Benecki, P., Nalepa, J., Kostrzewa, D., Skonieczny, L.: Towards robust evaluation of super-resolution satellite image reconstruction. In: ACIIDS 2018, Part I. LNAI, vol. 10751. Springer, Cham (2018)
31.
Zurück zum Zitat Yue, L., Shen, H., Li, J., Yuan, Q., Zhang, H., Zhang, L.: Image super-resolution: the techniques, applications, and future. Sig. Process. 128, 389–408 (2016)CrossRef Yue, L., Shen, H., Li, J., Yuan, Q., Zhang, H., Zhang, L.: Image super-resolution: the techniques, applications, and future. Sig. Process. 128, 389–408 (2016)CrossRef
32.
Zurück zum Zitat Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1–4), 259–268 (1992)MathSciNetCrossRefMATH Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1–4), 259–268 (1992)MathSciNetCrossRefMATH
33.
Zurück zum Zitat Arcuri, A., Briand, L.: A practical guide for using statistical tests to assess randomized algorithms in software engineering. In: Proceedings ICSE, pp. 1–10. IEEE (2011) Arcuri, A., Briand, L.: A practical guide for using statistical tests to assess randomized algorithms in software engineering. In: Proceedings ICSE, pp. 1–10. IEEE (2011)
35.
Zurück zum Zitat Lorenzo, P.R., Nalepa, J., Kawulok, M., Ramos, L.S., Pastor, J.R.: Particle swarm optimization for hyper-parameter selection in deep neural networks. In: Proceedings GECCO, pp. 481–488. ACM, New York (2017) Lorenzo, P.R., Nalepa, J., Kawulok, M., Ramos, L.S., Pastor, J.R.: Particle swarm optimization for hyper-parameter selection in deep neural networks. In: Proceedings GECCO, pp. 481–488. ACM, New York (2017)
Metadaten
Titel
Towards Evolutionary Super-Resolution
verfasst von
Michal Kawulok
Pawel Benecki
Daniel Kostrzewa
Lukasz Skonieczny
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-77538-8_33

Premium Partner