Skip to main content
Erschienen in: Mobile Networks and Applications 1/2021

22.02.2021

ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution

verfasst von: Jialiang Shen, Yucheng Wang, Jian Zhang

Erschienen in: Mobile Networks and Applications | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Deep convolutional neural networks have significantly improved the peak signal-to-noise ratio of Super-Resolution (SR). However, image viewer applications commonly allow users to zoom the images to arbitrary magnification scales, thus far imposing a large number of required training scales at a tremendous computational cost. To obtain a more computationally efficient model for arbitrary-scale SR, this paper employs a Laplacian pyramid method to reconstruct any-scale high-resolution (HR) images using the high-frequency image details in a Laplacian Frequency Representation. For SR of small-scales (between 1 and 2), images are constructed by interpolation from a sparse set of precalculated Laplacian pyramid levels. SR of larger scales is computed by recursion from small scales, which significantly reduces the computational cost. For a full comparison, fixed- and any-scale experiments are conducted using various benchmarks. At fixed scales, ASDN outperforms predefined upsampling methods (e.g., SRCNN, VDSR, DRRN) by about 1 dB in PSNR. At any-scale, ASDN generally exceeds Meta-SR on many scales.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Agustsson E, Timofte R (2017) Ntire 2017 challenge on single image super-resolution: Dataset and study. In: The IEEE conference on computer vision and pattern recognition (CVPR) workshops, vol 3, p 2 Agustsson E, Timofte R (2017) Ntire 2017 challenge on single image super-resolution: Dataset and study. In: The IEEE conference on computer vision and pattern recognition (CVPR) workshops, vol 3, p 2
2.
Zurück zum Zitat Bevilacqua M, Roumy A, Guillemot C, Alberi-morel ML (2012) Low-complexity single-image super-resolution based on nonnegative neighbor embedding Bevilacqua M, Roumy A, Guillemot C, Alberi-morel ML (2012) Low-complexity single-image super-resolution based on nonnegative neighbor embedding
3.
Zurück zum Zitat Burt PJ, Adelson EH (1987) The laplacian pyramid as a compact image code. In: Readings in computer vision, pp 671–679. Elsevier Burt PJ, Adelson EH (1987) The laplacian pyramid as a compact image code. In: Readings in computer vision, pp 671–679. Elsevier
4.
Zurück zum Zitat Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In: European conference on computer vision, pp 184–199. Springer Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In: European conference on computer vision, pp 184–199. Springer
5.
Zurück zum Zitat Gao G, Zhu D, Yang M, Lu H, Yang W, Gao H (2018) Face image super-resolution with pose via nuclear norm regularized structural orthogonal procrustes regression. Neural Comput & Applic, 1–11 Gao G, Zhu D, Yang M, Lu H, Yang W, Gao H (2018) Face image super-resolution with pose via nuclear norm regularized structural orthogonal procrustes regression. Neural Comput & Applic, 1–11
6.
Zurück zum Zitat Haris M, Shakhnarovich G, Ukita N (2018) Deep backprojection networks for super-resolution. In: Conference on computer vision and pattern recognition Haris M, Shakhnarovich G, Ukita N (2018) Deep backprojection networks for super-resolution. In: Conference on computer vision and pattern recognition
7.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
8.
Zurück zum Zitat Hu X, Mu H, Zhang X, Wang Z, Tan T, Sun J (2019) Meta-sr: a magnification-arbitrary network for super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1575–1584 Hu X, Mu H, Zhang X, Wang Z, Tan T, Sun J (2019) Meta-sr: a magnification-arbitrary network for super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1575–1584
9.
Zurück zum Zitat Hu Y, Li J, Huang Y, Gao X (2019) Channel-wise and spatial feature modulation network for single image super-resolution. IEEE Transactions on Circuits and Systems for Video Technology Hu Y, Li J, Huang Y, Gao X (2019) Channel-wise and spatial feature modulation network for single image super-resolution. IEEE Transactions on Circuits and Systems for Video Technology
10.
Zurück zum Zitat Huang G, Sun Y, Liu Z, Sedra D, Weinberger KQ (2016) Deep networks with stochastic depth. In: European conference on computer vision, pp 646–661. Springer Huang G, Sun Y, Liu Z, Sedra D, Weinberger KQ (2016) Deep networks with stochastic depth. In: European conference on computer vision, pp 646–661. Springer
11.
Zurück zum Zitat Huang JB, Singh A, Ahuja N (2015) Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 5197–5206 Huang JB, Singh A, Ahuja N (2015) Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 5197–5206
12.
Zurück zum Zitat Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 1646–1654 Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 1646–1654
13.
Zurück zum Zitat Lai WS, Huang JB, Ahuja N, Yang MH (2017) Deep laplacian pyramid networks for fast and accurate superresolution. In: IEEE Conference on computer vision and pattern recognition, vol 2, p 5 Lai WS, Huang JB, Ahuja N, Yang MH (2017) Deep laplacian pyramid networks for fast and accurate superresolution. In: IEEE Conference on computer vision and pattern recognition, vol 2, p 5
14.
Zurück zum Zitat Lai WS, Huang JB, Ahuja N, Yang MH (2018) Fast and accurate image super-resolution with deep laplacian pyramid networks IEEE transactions on pattern analysis and machine intelligence Lai WS, Huang JB, Ahuja N, Yang MH (2018) Fast and accurate image super-resolution with deep laplacian pyramid networks IEEE transactions on pattern analysis and machine intelligence
15.
Zurück zum Zitat Lim B, Son S, Kim H, Nah S, Lee KM (2017) Enhanced deep residual networks for single image super-resolution. In: The IEEE conference on computer vision and pattern recognition (CVPR) workshops, vol 1, p 4 Lim B, Son S, Kim H, Nah S, Lee KM (2017) Enhanced deep residual networks for single image super-resolution. In: The IEEE conference on computer vision and pattern recognition (CVPR) workshops, vol 1, p 4
16.
Zurück zum Zitat Liu Y, Wang Y, Li N, Cheng X, Zhang Y, Huang Y, Lu G (2018) An attention-based approach for single image super resolution. In: 2018 24Th international conference on pattern recognition (ICPR), pp 2777–2784. IEEE Liu Y, Wang Y, Li N, Cheng X, Zhang Y, Huang Y, Lu G (2018) An attention-based approach for single image super resolution. In: 2018 24Th international conference on pattern recognition (ICPR), pp 2777–2784. IEEE
17.
Zurück zum Zitat Lu H, Li Y, Nakashima S, Kim H, Serikawa S (2017) Underwater image super-resolution by descattering and fusion. IEEE Access 5:670–679CrossRef Lu H, Li Y, Nakashima S, Kim H, Serikawa S (2017) Underwater image super-resolution by descattering and fusion. IEEE Access 5:670–679CrossRef
18.
Zurück zum Zitat Lu T, Wang J, Zhang Y, Wang Z, Jiang J (2019) Satellite image super-resolution via multi-scale residual deep neural network. Remote Sens 11(13):1588CrossRef Lu T, Wang J, Zhang Y, Wang Z, Jiang J (2019) Satellite image super-resolution via multi-scale residual deep neural network. Remote Sens 11(13):1588CrossRef
19.
Zurück zum Zitat Matsui Y, Ito K, Aramaki Y, Fujimoto A, Ogawa T, Yamasaki T, Aizawa K (2017) Sketch-based manga retrieval using manga109 dataset. Multimed Tools Appl 76(20):21811–21838CrossRef Matsui Y, Ito K, Aramaki Y, Fujimoto A, Ogawa T, Yamasaki T, Aizawa K (2017) Sketch-based manga retrieval using manga109 dataset. Multimed Tools Appl 76(20):21811–21838CrossRef
20.
Zurück zum Zitat Schulter S, Leistner C, Bischof H (2015) Fast and accurate image upscaling with super-resolution forests. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3791–3799 Schulter S, Leistner C, Bischof H (2015) Fast and accurate image upscaling with super-resolution forests. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3791–3799
21.
Zurück zum Zitat Tai Y, Yang J, Liu X, Xu C (2017) Memnet: a persistent memory network for image restoration. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 4539–4547 Tai Y, Yang J, Liu X, Xu C (2017) Memnet: a persistent memory network for image restoration. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 4539–4547
22.
Zurück zum Zitat Timofte R, De Smet V, Van Gool L (2014) A+: Adjusted anchored neighborhood regression for fast super-resolution. In: Asian conference on computer vision, pp 111–126. Springer Timofte R, De Smet V, Van Gool L (2014) A+: Adjusted anchored neighborhood regression for fast super-resolution. In: Asian conference on computer vision, pp 111–126. Springer
23.
Zurück zum Zitat Tong T, Li G, Liu X, Gao Q (2017) Image super-resolution using dense skip connections. In: Computer vision (ICCV), 2017 IEEE international conference on, pp 4809–4817. IEEE Tong T, Li G, Liu X, Gao Q (2017) Image super-resolution using dense skip connections. In: Computer vision (ICCV), 2017 IEEE international conference on, pp 4809–4817. IEEE
24.
Zurück zum Zitat Wang D, Lu H, Yang MH (2015) Robust visual tracking via least soft-threshold squares. IEEE Trans Circuits Sys Vid Techn 26(9):1709–1721CrossRef Wang D, Lu H, Yang MH (2015) Robust visual tracking via least soft-threshold squares. IEEE Trans Circuits Sys Vid Techn 26(9):1709–1721CrossRef
25.
Zurück zum Zitat Wang Y, Shen J, Zhang J (2018) Deep bi-dense networks for image super-resolution. In: 2018 Digital image computing: techniques and applications (DICTA), pp 1–8. IEEE Wang Y, Shen J, Zhang J (2018) Deep bi-dense networks for image super-resolution. In: 2018 Digital image computing: techniques and applications (DICTA), pp 1–8. IEEE
26.
Zurück zum Zitat Zeyde R, Elad M, Protter M (2010) On single image scale-up using sparse-representations. International conference on curves and surfaces. 711–730 Zeyde R, Elad M, Protter M (2010) On single image scale-up using sparse-representations. International conference on curves and surfaces. 711–730
27.
Zurück zum Zitat Zhang K, Zuo W, Zhang L (2018) Learning a single convolutional super-resolution network for multiple degradations. In: IEEE Conference on computer vision and pattern recognition, vol 6 Zhang K, Zuo W, Zhang L (2018) Learning a single convolutional super-resolution network for multiple degradations. In: IEEE Conference on computer vision and pattern recognition, vol 6
28.
Zurück zum Zitat Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 286–301 Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 286–301
29.
Zurück zum Zitat Zhang Y, Tian Y, Kong Y, Zhong B, Fu Y (2018) Residual dense network for image super-resolution. In: The IEEE conference on computer vision and pattern recognition (CVPR) Zhang Y, Tian Y, Kong Y, Zhong B, Fu Y (2018) Residual dense network for image super-resolution. In: The IEEE conference on computer vision and pattern recognition (CVPR)
Metadaten
Titel
ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution
verfasst von
Jialiang Shen
Yucheng Wang
Jian Zhang
Publikationsdatum
22.02.2021
Verlag
Springer US
Erschienen in
Mobile Networks and Applications / Ausgabe 1/2021
Print ISSN: 1383-469X
Elektronische ISSN: 1572-8153
DOI
https://doi.org/10.1007/s11036-020-01720-2

Weitere Artikel der Ausgabe 1/2021

Mobile Networks and Applications 1/2021 Zur Ausgabe

Neuer Inhalt