Skip to main content
Top

2024 | OriginalPaper | Chapter

Single Image Super Resolution Based on Dual-Path Large Kernel Learning

Authors : He Jiang, Gui Liu, Gaoting Cao, Ping Zheng, Haoxiang Zhang, Qiqi Kou, Feixiang Xu, Deqiang Cheng

Published in: Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

To excel in image super-resolution, deep neural network-based models often employ a stacking strategy of network modules. However, this approach leads to parameter explosion and information redundancy, thereby restricting the feasibility of deploying these models on mobile devices. To tackle this challenge, this study introduces a lightweight Dual-path Large Kernel Learning approach, namely DLKL, and applies it to image super-resolution. In DLKL, the first step involves the utilization of multi-scale large kernel decomposition to effectively establish long-range dependencies between pixels and successfully preserve local information. Subsequently, DLKL enhances the feature expression ability and achieves effective feature fusion through its dual-path network architecture. Furthermore, DLKL reduces the number of parameters while maintaining performance, thus striking a balance between network performance and efficiency. The remarkable performance of DLKL has been validated through a multitude of experiments by quantitative metric tests and visual evaluations. Comparative analysis, conducted against other prevailing algorithms, provides evidence of the DLKL method’s consistent proficiency in generating images featuring enhanced texture clarity and more faithful representation of natural structures. These findings serve to reinforce the method’s inherent superiority and robustness.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Dong, C., et al.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38, 295–307 (2014)CrossRef Dong, C., et al.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38, 295–307 (2014)CrossRef
2.
go back to reference Kim, J., et al.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1646–1654 (2015) Kim, J., et al.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1646–1654 (2015)
3.
go back to reference Lim, B., et al.: Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1132–1140 (2017) Lim, B., et al.: Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1132–1140 (2017)
4.
go back to reference Kim, J., et al.: Deeply-recursive convolutional network for image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1637–1645 (2015) Kim, J., et al.: Deeply-recursive convolutional network for image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1637–1645 (2015)
5.
go back to reference Zhang, Y., et al.: Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 286–301 (2018) Zhang, Y., et al.: Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 286–301 (2018)
6.
go back to reference Chen, H., et al.: Pre-trained image processing transformer. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12294–12305 (2020) Chen, H., et al.: Pre-trained image processing transformer. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12294–12305 (2020)
7.
go back to reference Lan, R., et al.: MADNet: a fast and lightweight network for single-image super resolution. IEEE Trans. Cybern. 51, 1443–1453 (2020)CrossRef Lan, R., et al.: MADNet: a fast and lightweight network for single-image super resolution. IEEE Trans. Cybern. 51, 1443–1453 (2020)CrossRef
8.
go back to reference Guo, M., et al.: Visual attention network. Comput. Vis. Media 9, 733–752 (2022)CrossRef Guo, M., et al.: Visual attention network. Comput. Vis. Media 9, 733–752 (2022)CrossRef
9.
go back to reference Wang, Q., et al.: ECA-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.11531–11539 (2019) Wang, Q., et al.: ECA-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.11531–11539 (2019)
10.
go back to reference Bevilacqua, M., et al.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of the British Machine Vision Conference (2012) Bevilacqua, M., et al.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of the British Machine Vision Conference (2012)
12.
go back to reference Huang, J-B., et al.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5197–5206 (2015) Huang, J-B., et al.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5197–5206 (2015)
14.
go back to reference Lai, W-S., et al.: Deep Laplacian pyramid networks for fast and accurate super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5835–5843 (2017) Lai, W-S., et al.: Deep Laplacian pyramid networks for fast and accurate super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5835–5843 (2017)
15.
go back to reference Ahn, N., et al.: Fast, accurate, and, lightweight super-resolution with cascading residual network. In: Proceedings of the European Conference on Computer Vision, (ECCV), pp. 256–272 (2018) Ahn, N., et al.: Fast, accurate, and, lightweight super-resolution with cascading residual network. In: Proceedings of the European Conference on Computer Vision, (ECCV), pp. 256–272 (2018)
16.
go back to reference Hui, Z., et al.: Lightweight image super-resolution with information multi-distillation network. In: Proceedings of the ACM International Conference on Multimedia, pp. 2024–2032 (2019) Hui, Z., et al.: Lightweight image super-resolution with information multi-distillation network. In: Proceedings of the ACM International Conference on Multimedia, pp. 2024–2032 (2019)
17.
go back to reference Wang, X., et al.: Lightweight single-image super-resolution network with attentive auxiliary feature learning. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 3023–3041 (2020) Wang, X., et al.: Lightweight single-image super-resolution network with attentive auxiliary feature learning. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 3023–3041 (2020)
18.
go back to reference Wang, L., et al.: Exploring sparsity in image super-resolution for efficient inference. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4915–4924 (2021) Wang, L., et al.: Exploring sparsity in image super-resolution for efficient inference. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4915–4924 (2021)
19.
go back to reference Yan, Y., et al.: Lightweight attended multi-scale residual network for single image super-resolution. IEEE Access 9, 52202–52212 (2021)CrossRef Yan, Y., et al.: Lightweight attended multi-scale residual network for single image super-resolution. IEEE Access 9, 52202–52212 (2021)CrossRef
20.
go back to reference Qin, J., et al.: Lightweight single image super-resolution with attentive residual refinement network. Neurocomputing 500, 846–855 (2022)CrossRef Qin, J., et al.: Lightweight single image super-resolution with attentive residual refinement network. Neurocomputing 500, 846–855 (2022)CrossRef
21.
go back to reference Woo, S., et al.: CBAM: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision, pp. 3–19 (2018) Woo, S., et al.: CBAM: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision, pp. 3–19 (2018)
22.
go back to reference Kou, Q., et al.: Single image super resolution via multi-attention fusion recurrent network. IEEE Access 11, 98653–98665 (2023)CrossRef Kou, Q., et al.: Single image super resolution via multi-attention fusion recurrent network. IEEE Access 11, 98653–98665 (2023)CrossRef
23.
go back to reference Jiang, H., et al.: Learning in-place residual homogeneity for image detail enhancement. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1428–1432 (2018) Jiang, H., et al.: Learning in-place residual homogeneity for image detail enhancement. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1428–1432 (2018)
24.
go back to reference Jiang, H., et al.: Single image detail enhancement via metropolis theorem. Multimedia Tools Appl. 1–25 (2023) Jiang, H., et al.: Single image detail enhancement via metropolis theorem. Multimedia Tools Appl. 1–25 (2023)
25.
go back to reference Wan, J., et al.: Lightweight image super-resolution by multi-scale aggregation. IEEE Trans. Broadcast. 67, 372–382 (2021)CrossRef Wan, J., et al.: Lightweight image super-resolution by multi-scale aggregation. IEEE Trans. Broadcast. 67, 372–382 (2021)CrossRef
26.
go back to reference Wang, Z., et al.: Lightweight image super-resolution with multi-scale feature interaction network. In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2021) Wang, Z., et al.: Lightweight image super-resolution with multi-scale feature interaction network. In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2021)
27.
go back to reference Arbeláez, P., et al.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 898–916 (2011)CrossRef Arbeláez, P., et al.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 898–916 (2011)CrossRef
29.
go back to reference Holla, R., et al.: High-performance medical image secret sharing using super-resolution for CAD systems. Appl. Intell. 52, 16852–16868 (2022)CrossRef Holla, R., et al.: High-performance medical image secret sharing using super-resolution for CAD systems. Appl. Intell. 52, 16852–16868 (2022)CrossRef
30.
go back to reference Wu, H., et al.: Remote sensing image super-resolution via saliency-guided feedback GANs. IEEE Trans. Geosci. Remote Sens. 60, 1–16 (2022)CrossRef Wu, H., et al.: Remote sensing image super-resolution via saliency-guided feedback GANs. IEEE Trans. Geosci. Remote Sens. 60, 1–16 (2022)CrossRef
Metadata
Title
Single Image Super Resolution Based on Dual-Path Large Kernel Learning
Authors
He Jiang
Gui Liu
Gaoting Cao
Ping Zheng
Haoxiang Zhang
Qiqi Kou
Feixiang Xu
Deqiang Cheng
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2757-5_63

Premium Partner