Skip to main content
Erschienen in: Pattern Recognition and Image Analysis 1/2021

01.01.2021 | MATHEMATICAL THEORY OF IMAGES AND SIGNALS REPRESENTING, PROCESSING, ANALYSIS, RECOGNITION, AND UNDERSTANDING

A Single Image Super-Resolution Algorithm Based on Dense Residual Convolutional Network

verfasst von: Liu Chengming, Duan Junyi, Pang Haibo

Erschienen in: Pattern Recognition and Image Analysis | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Single image super-resolution via convolutional neural network (CNN) has demonstrated superior performance. In this paper, we propose a deep CNN model named super-resolution dense residual convolutional network (SRDCR) with the goal of reconstructing high quality high-resolution (HR) image. We propose a dense residual block (DRB) to learn residual information by residual connected layers. The local fusion layer (LFL) is then used to adaptively fuse the input of DRB and the output of the last residual layer. After multiple DRBs residual learning, the global fusion layer (GFL) reconstructs an HR image by adaptively combining the original low-resolution (LR) information and learned information. Experiments on extensive benchmark show that our method achieves favorable performance with much less CNN layers than DRB network.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen, “Progressive growing of GANs for improved quality, stability, and variation” (2017). arXiv:1710.10196 Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen, “Progressive growing of GANs for improved quality, stability, and variation” (2017). arXiv:1710.10196
2.
Zurück zum Zitat Wenzhe Shi, Jose Caballero, Christian Ledig, Xiahai Zhuang, Wenjia Bai, Kanwal Bhatia, Antonio M. Simoes Monteiro de Marvao, Tim Dawes, Declan O’Regan, and Daniel Rueckert, “Cardiac image super-resolution with global correspondence using multi-atlas patchmatch,” in MICCAI 2013: Medical Image Computing and Computer-Assisted Intervention (2013), pp. 9–16. Wenzhe Shi, Jose Caballero, Christian Ledig, Xiahai Zhuang, Wenjia Bai, Kanwal Bhatia, Antonio M. Simoes Monteiro de Marvao, Tim Dawes, Declan O’Regan, and Daniel Rueckert, “Cardiac image super-resolution with global correspondence using multi-atlas patchmatch,” in MICCAI 2013: Medical Image Computing and Computer-Assisted Intervention (2013), pp. 9–16.
3.
Zurück zum Zitat Wilman W. W. Zou, and Pong C. Yuen, “Very low-resolution face recognition problem,” IEEE Trans. Image Process. 21 (1), 327–340 (2012).MathSciNetCrossRef Wilman W. W. Zou, and Pong C. Yuen, “Very low-resolution face recognition problem,” IEEE Trans. Image Process. 21 (1), 327–340 (2012).MathSciNetCrossRef
4.
Zurück zum Zitat Matt W. Thornton, Peter M. Atkinson, and D. A. Holland, “Sub-pixel mapping of rural land cover objects from fine spatial resolution satellite sensor imagery using super-resolution pixel-swapping,” Int. J. Remote Sens. 27 (3), 473–491 (2006).CrossRef Matt W. Thornton, Peter M. Atkinson, and D. A. Holland, “Sub-pixel mapping of rural land cover objects from fine spatial resolution satellite sensor imagery using super-resolution pixel-swapping,” Int. J. Remote Sens. 27 (3), 473–491 (2006).CrossRef
5.
Zurück zum Zitat Liu Chengming, Wang Zekun, Pang Haibo, and Xue Junxiao, “Image interpolation via scanning line algorithm and discontinuous b-spline,” Math. Comput. Appl. 22 (2), 1–6 (2017).MathSciNetCrossRef Liu Chengming, Wang Zekun, Pang Haibo, and Xue Junxiao, “Image interpolation via scanning line algorithm and discontinuous b-spline,” Math. Comput. Appl. 22 (2), 1–6 (2017).MathSciNetCrossRef
6.
Zurück zum Zitat Dan Su and Philip Willis, “Image interpolation by pixel-level data-dependent triangulation,” Comput. Graphics Forum 23 (2), 189–201 (2004).CrossRef Dan Su and Philip Willis, “Image interpolation by pixel-level data-dependent triangulation,” Comput. Graphics Forum 23 (2), 189–201 (2004).CrossRef
7.
Zurück zum Zitat Jun-Yi Duan, Cheng-Ming Liu, and Zhi-Hui Yue, “Image interpolation by pixel-level data-dependent triangulation on android platform,” in 2017 3rd International Conference on Computer Science and Mechanical Automation (2017), pp. 297–301. Jun-Yi Duan, Cheng-Ming Liu, and Zhi-Hui Yue, “Image interpolation by pixel-level data-dependent triangulation on android platform,” in 2017 3rd International Conference on Computer Science and Mechanical Automation (2017), pp. 297–301.
8.
Zurück zum Zitat Carey W. Knox, Daniel B. Chuang, and Sheila S. Hemami, “Regularity-preserving image interpolation,” IEEE Trans. Image Process. 8 (9), 1293–1297 (1999).CrossRef Carey W. Knox, Daniel B. Chuang, and Sheila S. Hemami, “Regularity-preserving image interpolation,” IEEE Trans. Image Process. 8 (9), 1293–1297 (1999).CrossRef
9.
Zurück zum Zitat Cheng-Ming Liu and Xiao-Nan Luo, “Image enlargement via interpolatory subdivision,” IET Image Process. 5 (6), 567–571 (2011).MathSciNetCrossRef Cheng-Ming Liu and Xiao-Nan Luo, “Image enlargement via interpolatory subdivision,” IET Image Process. 5 (6), 567–571 (2011).MathSciNetCrossRef
10.
Zurück zum Zitat Xin Li and Michael T. Orchard, “New edge-directed interpolation,” IEEE Trans. Image Process. 10 (10), 1521–1527 (2001).CrossRef Xin Li and Michael T. Orchard, “New edge-directed interpolation,” IEEE Trans. Image Process. 10 (10), 1521–1527 (2001).CrossRef
11.
Zurück zum Zitat Xiaohua Yu, Bryan S. Morse, and Thomas W. Sederberg, “Image reconstruction using data-dependent triangulation,” IEEE Comput. Graphics Appl. 21 (3), 62–68 (2001). Xiaohua Yu, Bryan S. Morse, and Thomas W. Sederberg, “Image reconstruction using data-dependent triangulation,” IEEE Comput. Graphics Appl. 21 (3), 62–68 (2001).
12.
Zurück zum Zitat Raymond H. Chan, Sherman D. Riemenschneider, Li-Xin Shen, and Zuo-Wei Shen, “Tight frame: An efficient way for high-resolution image reconstruction,” Appl. Comput. Harmonic Anal. 17, 91–115 (2004).MathSciNetCrossRef Raymond H. Chan, Sherman D. Riemenschneider, Li-Xin Shen, and Zuo-Wei Shen, “Tight frame: An efficient way for high-resolution image reconstruction,” Appl. Comput. Harmonic Anal. 17, 91–115 (2004).MathSciNetCrossRef
13.
Zurück zum Zitat Kwang In Kim and Younghee Kwon, “Single-image super-resolution using sparse regression and natural image prior,” IEEE Trans. Pattern Anal. Mach. Intell. 32 (6), 1127–1133 (2010).CrossRef Kwang In Kim and Younghee Kwon, “Single-image super-resolution using sparse regression and natural image prior,” IEEE Trans. Pattern Anal. Mach. Intell. 32 (6), 1127–1133 (2010).CrossRef
14.
Zurück zum Zitat Min Li and Truong Q. Nguyen, “Markov random field model-based edge-directed image interpolation,” IEEE Trans. Image Process. 17 (7), 1121–1128 (2008).MathSciNetCrossRef Min Li and Truong Q. Nguyen, “Markov random field model-based edge-directed image interpolation,” IEEE Trans. Image Process. 17 (7), 1121–1128 (2008).MathSciNetCrossRef
15.
Zurück zum Zitat Christian Ledig, Lucas Theis, Ferenc Huszár, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew P. Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, et al., “Photo-realistic single image super-resolution using a generative adversarial network,” in IEEE Conference on Computer Vision and Pattern Recognition (2017), pp. 105–114. Christian Ledig, Lucas Theis, Ferenc Huszár, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew P. Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, et al., “Photo-realistic single image super-resolution using a generative adversarial network,” in IEEE Conference on Computer Vision and Pattern Recognition (2017), pp. 105–114.
16.
Zurück zum Zitat Huang Jia-Bin, Singh Abhishek, and Ahuja Narendra, “Single image super-resolution from transformed self-exemplars,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015), pp. 5197–5206. Huang Jia-Bin, Singh Abhishek, and Ahuja Narendra, “Single image super-resolution from transformed self-exemplars,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015), pp. 5197–5206.
17.
Zurück zum Zitat Kim Jiwon, Kwon Lee Jung, and Mu Lee Kyoung, “Deeply-recursive convolutional network for image super-resolution,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 1637–1645. Kim Jiwon, Kwon Lee Jung, and Mu Lee Kyoung, “Deeply-recursive convolutional network for image super-resolution,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 1637–1645.
18.
Zurück zum Zitat Samuel Schulter, Christian Leistner, and Horst Bischof, “Fast and accurate image upscaling with super-resolution forests,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015), pp. 3791–3799. Samuel Schulter, Christian Leistner, and Horst Bischof, “Fast and accurate image upscaling with super-resolution forests,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015), pp. 3791–3799.
19.
Zurück zum Zitat Lai Wei-Sheng, Huang Jia-Bin, Ahuja Narendra, and Yang Ming-Hsuan, “Deep Laplacian pyramid networks for fast and accurate super resolution,” in IEEE Conference on Computer Vision and Pattern Recognition (2017), pp. 5835–5843. Lai Wei-Sheng, Huang Jia-Bin, Ahuja Narendra, and Yang Ming-Hsuan, “Deep Laplacian pyramid networks for fast and accurate super resolution,” in IEEE Conference on Computer Vision and Pattern Recognition (2017), pp. 5835–5843.
20.
Zurück zum Zitat Radu Timofte, Vincent De Smet, and Luc Van Gool, “A+: Adjusted anchored neighborhood regression for fast super-resolution,” in Asian Conference on Computer Vision (2014), pp. 111–126. Radu Timofte, Vincent De Smet, and Luc Van Gool, “A+: Adjusted anchored neighborhood regression for fast super-resolution,” in Asian Conference on Computer Vision (2014), pp. 111–126.
21.
Zurück zum Zitat Dong Chao, Loy Chen Change, He Kaiming, and Tang Xiaoou, “Learning a deep convolutional network for image super-resolution,” in European Conference on Computer Vision (2014), pp. 184–199. Dong Chao, Loy Chen Change, He Kaiming, and Tang Xiaoou, “Learning a deep convolutional network for image super-resolution,” in European Conference on Computer Vision (2014), pp. 184–199.
22.
Zurück zum Zitat C. Dong, C. C. Loy, K. He, and X. Tang, “Image super-resolution using deep convolutional networks,” IEEE Trans. Pattern Anal. Mach. Intell. 38 (2), 295– 307 (2016).CrossRef C. Dong, C. C. Loy, K. He, and X. Tang, “Image super-resolution using deep convolutional networks,” IEEE Trans. Pattern Anal. Mach. Intell. 38 (2), 295– 307 (2016).CrossRef
23.
Zurück zum Zitat Dong Chao, Loy Chen Change, and Tang Xiaoou, “Accelerating the super-resolution convolutional neural network,” in European Conference on Computer Vision (2016), pp. 391–407. Dong Chao, Loy Chen Change, and Tang Xiaoou, “Accelerating the super-resolution convolutional neural network,” in European Conference on Computer Vision (2016), pp. 391–407.
24.
Zurück zum Zitat Shi Wenzhe, Jose Caballero, Ferenc Huszár, Johannes Totz, Andrew P. Aitken, Rob Bishop, Daniel Rueckert, and Wang Zehan, “Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 1874–1883. Shi Wenzhe, Jose Caballero, Ferenc Huszár, Johannes Totz, Andrew P. Aitken, Rob Bishop, Daniel Rueckert, and Wang Zehan, “Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 1874–1883.
25.
Zurück zum Zitat Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 770–778. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 770–778.
26.
Zurück zum Zitat Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger, “Densely connected convolutional networks,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017), Vol. 1, p. 3. Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger, “Densely connected convolutional networks,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017), Vol. 1, p. 3.
27.
Zurück zum Zitat Radu Timofte, Eirikur Agustsson, Luc Van Gool, Ming-Hsuan Yang, Lei Zhang, Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, Kyoung Mu Lee, et al., “NTIRE 2017 Challenge on single image super-resolution: Methods and results,” in IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2017), pp. 1110–1121. Radu Timofte, Eirikur Agustsson, Luc Van Gool, Ming-Hsuan Yang, Lei Zhang, Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, Kyoung Mu Lee, et al., “NTIRE 2017 Challenge on single image super-resolution: Methods and results,” in IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2017), pp. 1110–1121.
28.
Zurück zum Zitat Marco Bevilacqua, Aline Roumy, Christine Guillemot, and Marie Line Alberi-Morel, “Low-complexity single-image super-resolution based on nonnegative neighbor embedding,” in British Machine Vision Conference (2012), p. 1. Marco Bevilacqua, Aline Roumy, Christine Guillemot, and Marie Line Alberi-Morel, “Low-complexity single-image super-resolution based on nonnegative neighbor embedding,” in British Machine Vision Conference (2012), p. 1.
29.
Zurück zum Zitat Roman Zeyde, Michael Elad, and Matan Protter, “On single image scale-up using sparse-representations,” in International Conference on Curves and Surfaces (2010), pp. 711–730. Roman Zeyde, Michael Elad, and Matan Protter, “On single image scale-up using sparse-representations,” in International Conference on Curves and Surfaces (2010), pp. 711–730.
30.
Zurück zum Zitat David Martin, Charless Fowlkes, Doron Tal, and Jitendra Malik, “A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics,” in IEEE International Conference on Computer Vision (2001), pp. 416–423. David Martin, Charless Fowlkes, Doron Tal, and Jitendra Malik, “A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics,” in IEEE International Conference on Computer Vision (2001), pp. 416–423.
31.
Zurück zum Zitat Zhou Wang, Alan C. Bovik, Hamid R. Sheikh, and Eero P. Simoncelli, “Image quality assessment: From error visibility to structural similarity,” IEEE Trans. Image Process. 13, 600–612 (2004).CrossRef Zhou Wang, Alan C. Bovik, Hamid R. Sheikh, and Eero P. Simoncelli, “Image quality assessment: From error visibility to structural similarity,” IEEE Trans. Image Process. 13, 600–612 (2004).CrossRef
Metadaten
Titel
A Single Image Super-Resolution Algorithm Based on Dense Residual Convolutional Network
verfasst von
Liu Chengming
Duan Junyi
Pang Haibo
Publikationsdatum
01.01.2021
Verlag
Pleiades Publishing
Erschienen in
Pattern Recognition and Image Analysis / Ausgabe 1/2021
Print ISSN: 1054-6618
Elektronische ISSN: 1555-6212
DOI
https://doi.org/10.1134/S1054661821010053

Weitere Artikel der Ausgabe 1/2021

Pattern Recognition and Image Analysis 1/2021 Zur Ausgabe

MATHEMATICAL THEORY OF IMAGES AND SIGNALS REPRESENTING, PROCESSING, ANALYSIS, RECOGNITION, AND UNDERSTANDING

Multi-Modal Image Registration Based on Local Self-Similarity and Bidirectional Matching

PATTERN RECOGNITION AND IMAGE ANALYSIS MILIEU

Deep Neural Networks: Selected Aspects of Learning and Application

PATTERN RECOGNITION AND IMAGE ANALYSIS MILIEU

Analysis of the Dynamical Biological Objects of Optical Microscopy