Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 5/2024

16-10-2023 | Original Article

RDMA: low-light image enhancement based on retinex decomposition and multi-scale adjustment

Authors: Jiafeng Li, Shuai Hao, Tianshuo Li, Li Zhuo, Jing Zhang

Published in: International Journal of Machine Learning and Cybernetics | Issue 5/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Images are often affected by insufficient illumination and suffer from degradation problems such as low brightness, noise, and color distortion, which results in reduced image quality. Existing low-light image enhancement methods based on Retinex theory decompose images into reflectance and illumination components, which are adjusted separately; however, the intrinsic connection between reflectance and illumination during decomposition is not considered, and multi-scale information during subsequent adjustments is inadequately utilized. In this study, we propose a low-light image enhancement network based on Retinex decomposition and multi-scale adjustment (RDMA), which performs initial decomposition followed by subsequent adjustment. We utilized prior knowledge to design the feature interaction module (FIM) and the feature fusion module (FFM) for image decomposition. Furthermore, a coarse-to-fine multi-scale network with residual channel and spatial attention (RCSA) was designed to remove noise from reflectance, suppress color distortion, preserve image details, and adjust the brightness of illumination. An evaluation of various low-light image datasets and comparisons with state-of-the-art methods showed that the proposed network is superior in terms of enhancement results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Wang L, Wang T, Yang D, Fang X, Wan S (2022) Near-infrared fusion for deep lightness enhancement. Int J Mach Learn Cybern 14(5):1–13 Wang L, Wang T, Yang D, Fang X, Wan S (2022) Near-infrared fusion for deep lightness enhancement. Int J Mach Learn Cybern 14(5):1–13
2.
go back to reference Liu C, Wu F, Wang X (2022) Efinet: restoration for low-light images via enhancement-fusion iterative network. IEEE Transactions on Circuits and Systems for Video Technology 32(12):8486–8499CrossRef Liu C, Wu F, Wang X (2022) Efinet: restoration for low-light images via enhancement-fusion iterative network. IEEE Transactions on Circuits and Systems for Video Technology 32(12):8486–8499CrossRef
3.
go back to reference Xu J, Yuan M, Yan D-M, Wu T (2022) Illumination guided attentive wavelet network for low-light image enhancement. IEEE Transactions on Multimedia Xu J, Yuan M, Yan D-M, Wu T (2022) Illumination guided attentive wavelet network for low-light image enhancement. IEEE Transactions on Multimedia
4.
go back to reference Lu Y, Jung S-W (2022) Progressive joint low-light enhancement and noise removal for raw images. IEEE Trans Image Process 31:2390–2404CrossRef Lu Y, Jung S-W (2022) Progressive joint low-light enhancement and noise removal for raw images. IEEE Trans Image Process 31:2390–2404CrossRef
5.
go back to reference Wan R, Shi B, Yang W, Wen B, Duan LY, Kot AC (2022) Purifying low-light images via near-infrared enlightened image. IEEE Transactions on Multimedia Wan R, Shi B, Yang W, Wen B, Duan LY, Kot AC (2022) Purifying low-light images via near-infrared enlightened image. IEEE Transactions on Multimedia
6.
go back to reference Pizer SM, Johnston RE, Ericksen JP, Yankaskas BC, Muller KE (1990) Contrast-limited adaptive histogram equalization: speed and effectiveness. In: Proceedings of the First Conference on Visualization in Biomedical Computing, pp. 337–338. IEEE Computer Society Pizer SM, Johnston RE, Ericksen JP, Yankaskas BC, Muller KE (1990) Contrast-limited adaptive histogram equalization: speed and effectiveness. In: Proceedings of the First Conference on Visualization in Biomedical Computing, pp. 337–338. IEEE Computer Society
7.
go back to reference Liu Y-F, Guo J-M, Lai B-S, Lee J-D (2013) High efficient contrast enhancement using parametric approximation. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2444–2448. IEEE Liu Y-F, Guo J-M, Lai B-S, Lee J-D (2013) High efficient contrast enhancement using parametric approximation. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 2444–2448. IEEE
8.
go back to reference Land EH (1977) The retinex theory of color vision. Scient Am 237(6):108–129CrossRef Land EH (1977) The retinex theory of color vision. Scient Am 237(6):108–129CrossRef
9.
go back to reference Jobson DJ, Rahman Z-U, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976CrossRef Jobson DJ, Rahman Z-U, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976CrossRef
10.
go back to reference Kimmel R, Elad M, Shaked D, Keshet R, Sobel I (2003) A variational framework for retinex. Int J Comput Vis 52(1):7–23CrossRef Kimmel R, Elad M, Shaked D, Keshet R, Sobel I (2003) A variational framework for retinex. Int J Comput Vis 52(1):7–23CrossRef
12.
go back to reference Lv F, Li Y, Lu F (2021) Attention guided low-light image enhancement with a large scale low-light simulation dataset. Int J Comput Vis 129(7):2175–2193CrossRef Lv F, Li Y, Lu F (2021) Attention guided low-light image enhancement with a large scale low-light simulation dataset. Int J Comput Vis 129(7):2175–2193CrossRef
13.
go back to reference Tu Z, Talebi H, Zhang H, Yang F, Milanfar P, Bovik A, Li Y (2022) Maxim: Multi-axis mlp for image processing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5769–5780 Tu Z, Talebi H, Zhang H, Yang F, Milanfar P, Bovik A, Li Y (2022) Maxim: Multi-axis mlp for image processing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5769–5780
14.
go back to reference Zhang Y, Zhang J, Guo X (2019) Kindling the darkness: A practical low-light image enhancer. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 1632–1640 Zhang Y, Zhang J, Guo X (2019) Kindling the darkness: A practical low-light image enhancer. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 1632–1640
15.
go back to reference Zhang Y, Guo X, Ma J, Liu W, Zhang J (2021) Beyond brightening low-light images. Int J Comput Vis 129(4):1013–1037CrossRef Zhang Y, Guo X, Ma J, Liu W, Zhang J (2021) Beyond brightening low-light images. Int J Comput Vis 129(4):1013–1037CrossRef
16.
go back to reference Reddy E, Reddy R (2019) Dynamic clipped histogram equalization technique for enhancing low contrast images. Proceed Natl Acad Sci India Sect A Phys Sci 89(4):673–698MathSciNetCrossRef Reddy E, Reddy R (2019) Dynamic clipped histogram equalization technique for enhancing low contrast images. Proceed Natl Acad Sci India Sect A Phys Sci 89(4):673–698MathSciNetCrossRef
17.
go back to reference Sirajuddeen C, Kansal S, Tripathi RK (2020) Adaptive histogram equalization based on modified probability density function and expected value of image intensity. Signal Image Video Process 14(1):9–17CrossRef Sirajuddeen C, Kansal S, Tripathi RK (2020) Adaptive histogram equalization based on modified probability density function and expected value of image intensity. Signal Image Video Process 14(1):9–17CrossRef
18.
go back to reference Guo X, Li Y, Ling H (2016) Lime: low-light image enhancement via illumination map estimation. IEEE Trans Image Process 26(2):982–993MathSciNetCrossRef Guo X, Li Y, Ling H (2016) Lime: low-light image enhancement via illumination map estimation. IEEE Trans Image Process 26(2):982–993MathSciNetCrossRef
19.
go back to reference Dabov K, Foi A, Katkovnik V, Egiazarian K (2006) Image denoising with block-matching and 3d filtering. In: Image Processing: Algorithms and Systems, Neural Networks, and Machine Learning. (vol. 6064:606414) International Society for Optics and Photonics Dabov K, Foi A, Katkovnik V, Egiazarian K (2006) Image denoising with block-matching and 3d filtering. In: Image Processing: Algorithms and Systems, Neural Networks, and Machine Learning. (vol. 6064:606414) International Society for Optics and Photonics
20.
go back to reference Fu X, Zeng D, Huang Y, Zhang X-P, Ding X (2016) A weighted variational model for simultaneous reflectance and illumination estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2782–2790 Fu X, Zeng D, Huang Y, Zhang X-P, Ding X (2016) A weighted variational model for simultaneous reflectance and illumination estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2782–2790
21.
go back to reference He R, Guan M, Wen C (2020) Scens: simultaneous contrast enhancement and noise suppression for low-light images. IEEE Trans Ind Electron 68(9):8687–8697CrossRef He R, Guan M, Wen C (2020) Scens: simultaneous contrast enhancement and noise suppression for low-light images. IEEE Trans Ind Electron 68(9):8687–8697CrossRef
22.
go back to reference Lore KG, Akintayo A, Sarkar S (2017) Llnet: a deep autoencoder approach to natural low-light image enhancement. Pattern Recogn 61:650–662CrossRef Lore KG, Akintayo A, Sarkar S (2017) Llnet: a deep autoencoder approach to natural low-light image enhancement. Pattern Recogn 61:650–662CrossRef
23.
go back to reference Lv F, Lu F, Wu J, Lim C (2018) Mbllen: low-light image/video enhancement using cnns. In: BMVC 220:4 Lv F, Lu F, Wu J, Lim C (2018) Mbllen: low-light image/video enhancement using cnns. In: BMVC 220:4
24.
go back to reference Lim S, Kim W (2020) Dslr: deep stacked laplacian restorer for low-light image enhancement. IEEE Trans Multimedia 23:4272–4284CrossRef Lim S, Kim W (2020) Dslr: deep stacked laplacian restorer for low-light image enhancement. IEEE Trans Multimedia 23:4272–4284CrossRef
25.
go back to reference Afifi M, Derpanis KG, Ommer B, Brown MS (2021) Learning multi-scale photo exposure correction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9157–9167 Afifi M, Derpanis KG, Ommer B, Brown MS (2021) Learning multi-scale photo exposure correction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9157–9167
26.
go back to reference Fan G-D, Fan B, Gan M, Chen G-Y, Chen CP (2022) Multiscale low-light image enhancement network with illumination constraint. IEEE Trans Circuits Syst Video Technol 32(11):7403–7417CrossRef Fan G-D, Fan B, Gan M, Chen G-Y, Chen CP (2022) Multiscale low-light image enhancement network with illumination constraint. IEEE Trans Circuits Syst Video Technol 32(11):7403–7417CrossRef
27.
go back to reference Jiang Y, Gong X, Liu D, Cheng Y, Fang C, Shen X, Yang J, Zhou P, Wang Z (2021) Enlightengan: deep light enhancement without paired supervision. IEEE Trans Image Process 30:2340–2349CrossRef Jiang Y, Gong X, Liu D, Cheng Y, Fang C, Shen X, Yang J, Zhou P, Wang Z (2021) Enlightengan: deep light enhancement without paired supervision. IEEE Trans Image Process 30:2340–2349CrossRef
28.
go back to reference Guo C, Li C, Guo J, Loy CC, Hou J, Kwong S, Cong R (2020) Zero-reference deep curve estimation for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1780–1789 Guo C, Li C, Guo J, Loy CC, Hou J, Kwong S, Cong R (2020) Zero-reference deep curve estimation for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1780–1789
29.
go back to reference Li C, Guo C, Loy CC (2021) Learning to enhance low-light image via zero-reference deep curve estimation. arXiv preprint arXiv:2103.00860 Li C, Guo C, Loy CC (2021) Learning to enhance low-light image via zero-reference deep curve estimation. arXiv preprint arXiv:​2103.​00860
30.
go back to reference Jiang Q, Mao Y, Cong R, Ren W, Huang C, Shao F (2022) Unsupervised decomposition and correction network for low-light image enhancement. IEEE Transactions on Intelligent Transportation Systems Jiang Q, Mao Y, Cong R, Ren W, Huang C, Shao F (2022) Unsupervised decomposition and correction network for low-light image enhancement. IEEE Transactions on Intelligent Transportation Systems
31.
go back to reference Ma L, Ma T, Liu R, Fan X, Luo Z (2022) Toward fast, flexible, and robust low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5637–5646 Ma L, Ma T, Liu R, Fan X, Luo Z (2022) Toward fast, flexible, and robust low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5637–5646
32.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-assisted Intervention, pp. 234–241. Springer Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-assisted Intervention, pp. 234–241. Springer
33.
go back to reference Wang W, Wei C, Yang W, Liu J (2018) Gladnet: low-light enhancement network with global awareness. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pp. 751–755. IEEE Wang W, Wei C, Yang W, Liu J (2018) Gladnet: low-light enhancement network with global awareness. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pp. 751–755. IEEE
34.
go back to reference Wang R, Zhang Q, Fu C-W, Shen X, Zheng W-S, Jia J (2019) Underexposed photo enhancement using deep illumination estimation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6849–6857 Wang R, Zhang Q, Fu C-W, Shen X, Zheng W-S, Jia J (2019) Underexposed photo enhancement using deep illumination estimation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6849–6857
35.
go back to reference Ma K, Zeng K, Wang Z (2015) Perceptual quality assessment for multi-exposure image fusion. IEEE Trans Image Process 24(11):3345–3356MathSciNetCrossRef Ma K, Zeng K, Wang Z (2015) Perceptual quality assessment for multi-exposure image fusion. IEEE Trans Image Process 24(11):3345–3356MathSciNetCrossRef
36.
go back to reference Wang S, Zheng J, Hu H-M, Li B (2013) Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans Image Process 22(9):3538–3548CrossRef Wang S, Zheng J, Hu H-M, Li B (2013) Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans Image Process 22(9):3538–3548CrossRef
37.
go back to reference Vonikakis V, Andreadis I, Gasteratos A (2008) Fast centre-surround contrast modification. IET Image Process 2(1):19–34CrossRef Vonikakis V, Andreadis I, Gasteratos A (2008) Fast centre-surround contrast modification. IET Image Process 2(1):19–34CrossRef
38.
go back to reference Wang Q, Fu X, Zhang X-P, Ding X (2016) A fusion-based method for single backlit image enhancement. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 4077–4081. IEEE Wang Q, Fu X, Zhang X-P, Ding X (2016) A fusion-based method for single backlit image enhancement. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 4077–4081. IEEE
39.
go back to reference Liu R, Ma L, Zhang J, Fan X, Luo Z (2021) Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10561–10570 Liu R, Ma L, Zhang J, Fan X, Luo Z (2021) Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10561–10570
40.
go back to reference Zhang R, Isola P, Efros AA, Shechtman E, Wang O (2018) The unreasonable effectiveness of deep features as a perceptual metric. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–595 Zhang R, Isola P, Efros AA, Shechtman E, Wang O (2018) The unreasonable effectiveness of deep features as a perceptual metric. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–595
41.
go back to reference Hordley SD, Finlayson GD (2004) Re-evaluating colour constancy algorithms. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004., vol. 1, pp. 76–79. IEEE Hordley SD, Finlayson GD (2004) Re-evaluating colour constancy algorithms. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004., vol. 1, pp. 76–79. IEEE
42.
go back to reference Mittal A, Soundararajan R, Bovik AC (2012) Making a “completely blind’’ image quality analyzer. IEEE Signal Process Lett 20(3):209–212CrossRef Mittal A, Soundararajan R, Bovik AC (2012) Making a “completely blind’’ image quality analyzer. IEEE Signal Process Lett 20(3):209–212CrossRef
43.
go back to reference Zhang L, Zhang L, Bovik AC (2015) A feature-enriched completely blind image quality evaluator. IEEE Trans Image Process 24(8):2579–2591MathSciNetCrossRef Zhang L, Zhang L, Bovik AC (2015) A feature-enriched completely blind image quality evaluator. IEEE Trans Image Process 24(8):2579–2591MathSciNetCrossRef
Metadata
Title
RDMA: low-light image enhancement based on retinex decomposition and multi-scale adjustment
Authors
Jiafeng Li
Shuai Hao
Tianshuo Li
Li Zhuo
Jing Zhang
Publication date
16-10-2023
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 5/2024
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-023-01991-7

Other articles of this Issue 5/2024

International Journal of Machine Learning and Cybernetics 5/2024 Go to the issue