Skip to main content
Top
Published in:

21-04-2024

FCNet: a deep neural network based on multi-channel feature cascading for image denoising

Authors: Siling Feng, Zhisheng Qi, Guirong Zhang, Cong Lin, Mengxing Huang

Published in: The Journal of Supercomputing | Issue 12/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The article introduces FCNet, a deep neural network designed for image denoising that leverages multi-channel feature cascading to enhance performance and convergence speed. The network consists of five key components: Sparse Block, Feature Fusion Block, Feature Compression Block, Information Interaction Block, and Reconstruction Block. Each component plays a crucial role in capturing and processing noise features at various levels. The FCNet architecture is evaluated against state-of-the-art methods and demonstrates superior denoising capabilities, particularly in handling both known and blind denoising tasks. The authors highlight the importance of channel features and propose innovative techniques to reuse underlying features, leading to faster convergence and improved denoising performance. The article also discusses the use of L1 loss to enhance robustness and the effectiveness of the Squeeze-and-Excitation module in improving denoising performance. Comprehensive experimental results on various datasets showcase the superiority of FCNet in both quantitative and qualitative evaluations. The article concludes with a discussion on future research directions, including the removal of real noise and the interpretability of denoising models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Business + Economics"

Online-Abonnement

Springer Professional "Business + Economics" gives you access to:

  • more than 67.000 books
  • more than 340 journals

from the following specialised fileds:

  • Construction + Real Estate
  • Business IT + Informatics
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Insurance + Risk



Secure your knowledge advantage now!

Springer Professional "Engineering + Technology"

Online-Abonnement

Springer Professional "Engineering + Technology" gives you access to:

  • more than 67.000 books
  • more than 390 journals

from the following specialised fileds:

  • Automotive
  • Business IT + Informatics
  • Construction + Real Estate
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Mechanical Engineering + Materials





 

Secure your knowledge advantage now!

Springer Professional "Business + Economics & Engineering + Technology"

Online-Abonnement

Springer Professional "Business + Economics & Engineering + Technology" gives you access to:

  • more than 102.000 books
  • more than 537 journals

from the following subject areas:

  • Automotive
  • Construction + Real Estate
  • Business IT + Informatics
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Mechanical Engineering + Materials
  • Insurance + Risk


Secure your knowledge advantage now!

Literature
1.
go back to reference He W, Zhang H, Zhang L, Shen H (2015) Hyperspectral image denoising via noise-adjusted iterative low-rank matrix approximation. IEEE J Select Top Appl Earth Observ Remote Sens 8(6):3050–3061CrossRef He W, Zhang H, Zhang L, Shen H (2015) Hyperspectral image denoising via noise-adjusted iterative low-rank matrix approximation. IEEE J Select Top Appl Earth Observ Remote Sens 8(6):3050–3061CrossRef
2.
go back to reference Wonga YKe, Zhou Y, Liang YS (2024) Quantum image denoising with machine learning: a novel approach to improve quantum image processing quality and reliability. arXiv preprint arXiv:2402.11645 Wonga YKe, Zhou Y, Liang YS (2024) Quantum image denoising with machine learning: a novel approach to improve quantum image processing quality and reliability. arXiv preprint arXiv:​2402.​11645
3.
go back to reference Sanderson D, Olmos PM, Del Cerro CF, Desco M, Abella M (2024) Diffusion X-ray image denoising. In: Medical imaging with deep learning Sanderson D, Olmos PM, Del Cerro CF, Desco M, Abella M (2024) Diffusion X-ray image denoising. In: Medical imaging with deep learning
4.
go back to reference Chen M, Pu YF, Bai YC (2021) Low-dose CT image denoising using residual convolutional network with fractional TV loss. Neurocomputing 452:510–520CrossRef Chen M, Pu YF, Bai YC (2021) Low-dose CT image denoising using residual convolutional network with fractional TV loss. Neurocomputing 452:510–520CrossRef
5.
go back to reference Holt KM (2014) Total nuclear variation and Jacobian extensions of total variation for vector fields. IEEE Trans Image Process 23(9):3975–3989MathSciNetCrossRef Holt KM (2014) Total nuclear variation and Jacobian extensions of total variation for vector fields. IEEE Trans Image Process 23(9):3975–3989MathSciNetCrossRef
6.
go back to reference Jiang CZ, Wu CM, Lin C, Xiao XC (2023) Robust neural dynamics with adaptive coefficient applied to solve the dynamic matrix square root. Complex Intell Syst 9:4213–4226CrossRef Jiang CZ, Wu CM, Lin C, Xiao XC (2023) Robust neural dynamics with adaptive coefficient applied to solve the dynamic matrix square root. Complex Intell Syst 9:4213–4226CrossRef
7.
go back to reference Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095MathSciNetCrossRef Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095MathSciNetCrossRef
8.
go back to reference Chen Y, Pock T (2016) Trainable nonlinear reaction diffusion: a flexible framework for fast and effective image restoration. IEEE Trans Pattern Anal Mach Intell 39(6):1256–1272CrossRef Chen Y, Pock T (2016) Trainable nonlinear reaction diffusion: a flexible framework for fast and effective image restoration. IEEE Trans Pattern Anal Mach Intell 39(6):1256–1272CrossRef
9.
go back to reference Fu Bo, Wang Liyan, Luo Zhongxuan (2022) A robust image denoising method with multiview texture-aware convolutional neural networks. IEEE Multimed 29(3):80–90CrossRef Fu Bo, Wang Liyan, Luo Zhongxuan (2022) A robust image denoising method with multiview texture-aware convolutional neural networks. IEEE Multimed 29(3):80–90CrossRef
10.
go back to reference Wang D, Tang H, Pan J, Tang J (2021) Learning a tree-structured channel-wise refinement network for efficient image deraining. In: 2021 IEEE International Conference on Mand Expo (ICME), pp 1–6 Wang D, Tang H, Pan J, Tang J (2021) Learning a tree-structured channel-wise refinement network for efficient image deraining. In: 2021 IEEE International Conference on Mand Expo (ICME), pp 1–6
11.
go back to reference Wang D, Pan J, Tang J (2023) Single image deraining using residual channel attention networks. J Comput Sci Technol 38(2):439–454CrossRef Wang D, Pan J, Tang J (2023) Single image deraining using residual channel attention networks. J Comput Sci Technol 38(2):439–454CrossRef
12.
go back to reference Krizhevsky A, Sutskever I, and Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst, 25 Krizhevsky A, Sutskever I, and Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst, 25
13.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 770–778
14.
go back to reference Liu L, Fieguth P, Guo Y, Wang X, Pietikäinen M (2017) Local binary features for texture classification: taxonomy and experimental study. Pattern Recogn 62:135–160CrossRef Liu L, Fieguth P, Guo Y, Wang X, Pietikäinen M (2017) Local binary features for texture classification: taxonomy and experimental study. Pattern Recogn 62:135–160CrossRef
15.
go back to reference Liu L, Chen J, Fieguth P, Zhao G, Chellappa R, Pietikainen M (2018) A survey of recent advances in texture representation. arXiv preprint arXiv:1801.10324, 3 Liu L, Chen J, Fieguth P, Zhao G, Chellappa R, Pietikainen M (2018) A survey of recent advances in texture representation. arXiv preprint arXiv:​1801.​10324, 3
16.
go back to reference Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans Image Process 26(7):3142–3155MathSciNetCrossRef Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans Image Process 26(7):3142–3155MathSciNetCrossRef
17.
go back to reference Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp 448–456 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp 448–456
18.
go back to reference Wu Y, Li Y, Feng S, Huang M (2023) Pansharpening using unsupervised generative adversarial networks with recursive mixed-scale feature fusion. IEEE J Select Top Appl Earth Observ Remote Sens 16:3742–3759CrossRef Wu Y, Li Y, Feng S, Huang M (2023) Pansharpening using unsupervised generative adversarial networks with recursive mixed-scale feature fusion. IEEE J Select Top Appl Earth Observ Remote Sens 16:3742–3759CrossRef
19.
go back to reference Guo S, Yan Z, Zhang K, Zuo W, Zhang L (2019) Toward convolutional blind denoising of real photographs. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 1712–1722 Guo S, Yan Z, Zhang K, Zuo W, Zhang L (2019) Toward convolutional blind denoising of real photographs. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 1712–1722
21.
go back to reference Zhang K, Zuo W, Gu S, Zhang L (2017) Learning deep CNN denoiser prior for image restoration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3929–3938 Zhang K, Zuo W, Gu S, Zhang L (2017) Learning deep CNN denoiser prior for image restoration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3929–3938
22.
go back to reference Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S et al (2014) Generative adversarial nets. Adv Neural Inf Process Syst, 27 Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S et al (2014) Generative adversarial nets. Adv Neural Inf Process Syst, 27
23.
go back to reference Chen J, Chen J, Chao H, Yang M (2018) Image blind denoising with generative adversarial network based noise modeling. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3155–3164 Chen J, Chen J, Chao H, Yang M (2018) Image blind denoising with generative adversarial network based noise modeling. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3155–3164
24.
go back to reference Dong W, Wang P, Yin W, Shi G, Wu F, Lu X (2018) Denoising prior driven deep neural network for image restoration. IEEE Trans Pattern Anal Mach Intell 41(10):2305–2318CrossRef Dong W, Wang P, Yin W, Shi G, Wu F, Lu X (2018) Denoising prior driven deep neural network for image restoration. IEEE Trans Pattern Anal Mach Intell 41(10):2305–2318CrossRef
25.
go back to reference Liu D, Wen B, Fan Y, Loy CC, Huang TS (2018) Non-local recurrent network for image restoration. Adv Neural Inf Process Syst, 31 Liu D, Wen B, Fan Y, Loy CC, Huang TS (2018) Non-local recurrent network for image restoration. Adv Neural Inf Process Syst, 31
26.
go back to reference Malvar H, He L, and Cutler R (2004, May) High-quality linear interpolation for demosaicing of Bayer-patterned color images. In: 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol 3, pp 474–485. IEEE Malvar H, He L, and Cutler R (2004, May) High-quality linear interpolation for demosaicing of Bayer-patterned color images. In: 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol 3, pp 474–485. IEEE
27.
go back to reference Yang J, Zhang Weijia, Liu Jiaxing, Jinzhao Wu, Yang Jie (2022) Generating de-identification facial images based on the attention models and adversarial examples. Alex Eng J 61(11):8417–8429CrossRef Yang J, Zhang Weijia, Liu Jiaxing, Jinzhao Wu, Yang Jie (2022) Generating de-identification facial images based on the attention models and adversarial examples. Alex Eng J 61(11):8417–8429CrossRef
28.
go back to reference Yang J, Qiao S, Wang Z, Zuo Z (2023) Adversarial Secret-Identity Generation Model for Face Anonymization in the Internet of Vehicles. IEEE Syst J 7(14):5161–5170CrossRef Yang J, Qiao S, Wang Z, Zuo Z (2023) Adversarial Secret-Identity Generation Model for Face Anonymization in the Internet of Vehicles. IEEE Syst J 7(14):5161–5170CrossRef
29.
go back to reference Xiao T, Xu Y, Yang K, Zhang J, Peng Y, Zhang Z (2015) The application of two-level attention models in deep convolutional neural network for fine-grained image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 842–850 Xiao T, Xu Y, Yang K, Zhang J, Peng Y, Zhang Z (2015) The application of two-level attention models in deep convolutional neural network for fine-grained image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 842–850
30.
go back to reference Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, et al (2017) Residual attention network for image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3156–3164 Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, et al (2017) Residual attention network for image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3156–3164
31.
go back to reference Xu K, Ba J, Kiros R, Cho K, Courville A, Salakhudinov R, et al (2015) Show, attend and tell: Neural image caption generation with visual attention. In: International Conference on Machine Learning, pp 2048-2057 Xu K, Ba J, Kiros R, Cho K, Courville A, Salakhudinov R, et al (2015) Show, attend and tell: Neural image caption generation with visual attention. In: International Conference on Machine Learning, pp 2048-2057
32.
go back to reference Anwar S, Barnes N (2019) Real image denoising with feature attention. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 3155–3164 Anwar S, Barnes N (2019) Real image denoising with feature attention. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 3155–3164
33.
go back to reference Tian C, Xu Y, Li Z, Zuo W, Fei L, Liu H (2020) Attention-guided CNN for image denoising. Neural Netw 124:117–129CrossRef Tian C, Xu Y, Li Z, Zuo W, Fei L, Liu H (2020) Attention-guided CNN for image denoising. Neural Netw 124:117–129CrossRef
35.
36.
go back to reference Li X, Li F, Fern X, Raich R (2016) Filter shaping for convolutional neural networks Li X, Li F, Fern X, Raich R (2016) Filter shaping for convolutional neural networks
37.
go back to reference Luo W, Li Y, Urtasun R, Zemel R (2016) Understanding the effective receptive field in deep convolutional neural networks. Adv Neural Inf Process Syst, 29 Luo W, Li Y, Urtasun R, Zemel R (2016) Understanding the effective receptive field in deep convolutional neural networks. Adv Neural Inf Process Syst, 29
38.
go back to reference Cheng W, Lu J, Zhu X, Hong J, Liu X, Li M, Li P (2019) Dilated residual learning with skip connections for real-time denoising of laser speckle imaging of blood flow in a log-transformed domain. IEEE Trans Med Imaging 39(5):1582–1593CrossRef Cheng W, Lu J, Zhu X, Hong J, Liu X, Li M, Li P (2019) Dilated residual learning with skip connections for real-time denoising of laser speckle imaging of blood flow in a log-transformed domain. IEEE Trans Med Imaging 39(5):1582–1593CrossRef
39.
go back to reference He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp 1026–1034 He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp 1026–1034
40.
go back to reference Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 7132–7141 Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 7132–7141
41.
go back to reference Srivastava R, Greff K, Schmidhuber J (2015) Training very deep networks. Adv Neural Inf Process Syst, 28 Srivastava R, Greff K, Schmidhuber J (2015) Training very deep networks. Adv Neural Inf Process Syst, 28
42.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III 18, pp 234–241. Springer International Publishing Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III 18, pp 234–241. Springer International Publishing
43.
go back to reference Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 4700–4708 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 4700–4708
44.
go back to reference Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1–9
45.
go back to reference Ephraim Y, Malah D (1985) Speech enhancement using a minimum mean-square error log-spectral amplitude estimator. IEEE Trans Acoust Speech Signal Process 33(2):443–445CrossRef Ephraim Y, Malah D (1985) Speech enhancement using a minimum mean-square error log-spectral amplitude estimator. IEEE Trans Acoust Speech Signal Process 33(2):443–445CrossRef
46.
go back to reference Gu S, Zhang L, Zuo W, Feng X (2014) Weighted nuclear norm minimization with application to image denoising. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2862–2869 Gu S, Zhang L, Zuo W, Feng X (2014) Weighted nuclear norm minimization with application to image denoising. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2862–2869
47.
go back to reference Zoran D, Weiss Y (2011) From learning models of natural image patches to whole image restoration. In: 2011 international Conference on Computer Vision, pp 479–486. IEEE Zoran D, Weiss Y (2011) From learning models of natural image patches to whole image restoration. In: 2011 international Conference on Computer Vision, pp 479–486. IEEE
48.
go back to reference Zhang K, Zuo W, Zhang L (2018) FFDNet: toward a fast and flexible solution for CNN-based image denoising. IEEE Trans Image Process 27(9):4608–4622MathSciNetCrossRef Zhang K, Zuo W, Zhang L (2018) FFDNet: toward a fast and flexible solution for CNN-based image denoising. IEEE Trans Image Process 27(9):4608–4622MathSciNetCrossRef
49.
go back to reference Tian C, Xu Y, Fei L, Wang J, Wen J, Luo N (2019) Enhanced CNN for image denoising. CAAI Trans Intell Technol 4(1):17–23CrossRef Tian C, Xu Y, Fei L, Wang J, Wen J, Luo N (2019) Enhanced CNN for image denoising. CAAI Trans Intell Technol 4(1):17–23CrossRef
50.
go back to reference Wang Y, Chang D, Zhao Y (2021) A new blind image denoising method based on asymmetric generative adversarial network. IET Image Proc 15(6):1260–1272CrossRef Wang Y, Chang D, Zhao Y (2021) A new blind image denoising method based on asymmetric generative adversarial network. IET Image Proc 15(6):1260–1272CrossRef
51.
go back to reference Xu J, Deng X, Xu M (2022) Revisiting convolutional sparse coding for image denoising: from a multi-scale perspective. IEEE Signal Process Lett 29:1202–1206CrossRef Xu J, Deng X, Xu M (2022) Revisiting convolutional sparse coding for image denoising: from a multi-scale perspective. IEEE Signal Process Lett 29:1202–1206CrossRef
52.
go back to reference Vaksman G, Elad M, Milanfar P (2020) Lidia: lightweight learned image denoising with instance adaptation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 1–15 Vaksman G, Elad M, Milanfar P (2020) Lidia: lightweight learned image denoising with instance adaptation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 1–15
53.
go back to reference Lefkimmiatis Stamatios (2018) Universal denoising networks: a novel CNN architecture for image denoising. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1–8 Lefkimmiatis Stamatios (2018) Universal denoising networks: a novel CNN architecture for image denoising. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1–8
54.
go back to reference Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision, vol 2, pp 416–423 Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision, vol 2, pp 416–423
55.
go back to reference Ma K, Duanmu Z, Wu Q, Wang Z, Yong H, Li H, Zhang L (2016) Waterloo exploration database: new challenges for image quality assessment models. IEEE Trans Image Process 26(2):1004–1016MathSciNetCrossRef Ma K, Duanmu Z, Wu Q, Wang Z, Yong H, Li H, Zhang L (2016) Waterloo exploration database: new challenges for image quality assessment models. IEEE Trans Image Process 26(2):1004–1016MathSciNetCrossRef
Metadata
Title
FCNet: a deep neural network based on multi-channel feature cascading for image denoising
Authors
Siling Feng
Zhisheng Qi
Guirong Zhang
Cong Lin
Mengxing Huang
Publication date
21-04-2024
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 12/2024
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-024-06045-5

Premium Partner