Skip to main content
Erschienen in: Journal of Scientific Computing 2/2024

01.02.2024

Low-light Image Enhancement via Dual Reflectance Estimation

verfasst von: Fan Jia, Tiange Wang, Tieyong Zeng

Erschienen in: Journal of Scientific Computing | Ausgabe 2/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Improving the quality of low-light images is a fundamental task with vast applications in computer vision. Retinex-based methods which decompose the images into reflectance and illumination components have been actively studied over the past years. In this paper, we propose a Retinex-based method with dual reflectance estimation. To be precise, we start with a simple reflectance estimation based on the HSV color space, which is then accompanied by another variational-based estimation of both the reflectance and illumination. Finally, we bring a new perspective to the Retinex model by reconstructing the normal-light image with a novel transformation map given by the estimated reflectance and illumination, which we call radiance mapping. Extensive experiments show that our method obtains outstanding results, both numerically and visually, compared to state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Blomgren, P., Chan, T.F., Mulet, P.: Extensions to total variation denoising. In: Advanced Signal Processing: Algorithms, Architectures, and Implementations VII, vol. 3162, pp. 367–375. SPIE (1997) Blomgren, P., Chan, T.F., Mulet, P.: Extensions to total variation denoising. In: Advanced Signal Processing: Algorithms, Architectures, and Implementations VII, vol. 3162, pp. 367–375. SPIE (1997)
2.
Zurück zum Zitat Cai, X., Chan, R., Zeng, T.: A two-stage image segmentation method using a convex variant of the Mumford-Shah model and thresholding. SIAM J. Imaging Sci. 6(1), 368–390 (2013)MathSciNetCrossRef Cai, X., Chan, R., Zeng, T.: A two-stage image segmentation method using a convex variant of the Mumford-Shah model and thresholding. SIAM J. Imaging Sci. 6(1), 368–390 (2013)MathSciNetCrossRef
3.
Zurück zum Zitat Chang, H., Ng, M.K., Wang, W., Zeng, T.: Retinex image enhancement via a learned dictionary. Opt. Eng. 54(1), 013107 (2015)CrossRef Chang, H., Ng, M.K., Wang, W., Zeng, T.: Retinex image enhancement via a learned dictionary. Opt. Eng. 54(1), 013107 (2015)CrossRef
4.
Zurück zum Zitat Coltuc, D., Bolon, P., Chassery, J.M.: Exact histogram specification. IEEE Trans. Image Process. 15(5), 1143–1152 (2006)CrossRef Coltuc, D., Bolon, P., Chassery, J.M.: Exact histogram specification. IEEE Trans. Image Process. 15(5), 1143–1152 (2006)CrossRef
5.
Zurück zum Zitat Elad, M.: Retinex by two bilateral filters. In: International Conference on Scale-Space Theories in Computer Vision, pp. 217–229. Springer (2005) Elad, M.: Retinex by two bilateral filters. In: International Conference on Scale-Space Theories in Computer Vision, pp. 217–229. Springer (2005)
6.
Zurück zum Zitat Fu, X., Zeng, D., Huang, Y., Zhang, X.P., Ding, X.: A weighted variational model for simultaneous reflectance and illumination estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2782–2790 (2016) Fu, X., Zeng, D., Huang, Y., Zhang, X.P., Ding, X.: A weighted variational model for simultaneous reflectance and illumination estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2782–2790 (2016)
7.
Zurück zum Zitat Goldstein, T., Osher, S.: The split Bregman method for L1-regularized problems. SIAM J. Imaging Sci. 2(2), 323–343 (2009)MathSciNetCrossRef Goldstein, T., Osher, S.: The split Bregman method for L1-regularized problems. SIAM J. Imaging Sci. 2(2), 323–343 (2009)MathSciNetCrossRef
8.
Zurück zum Zitat Gu, Z., Li, F., Lv, X.G.: A detail preserving variational model for image retinex. Appl. Math. Model. 68, 643–661 (2019)MathSciNetCrossRef Gu, Z., Li, F., Lv, X.G.: A detail preserving variational model for image retinex. Appl. Math. Model. 68, 643–661 (2019)MathSciNetCrossRef
9.
Zurück zum Zitat Guo, C., Li, C., Guo, J., Loy, C.C., Hou, J., Kwong, S., Cong, R.: Zero-reference deep curve estimation for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1780–1789 (2020) Guo, C., Li, C., Guo, J., Loy, C.C., Hou, J., Kwong, S., Cong, R.: Zero-reference deep curve estimation for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1780–1789 (2020)
10.
Zurück zum Zitat Guo, X., Li, Y., Ling, H.: LIME: low-light image enhancement via illumination map estimation. IEEE Trans. Image Process. 26(2), 982–993 (2016)MathSciNetCrossRef Guo, X., Li, Y., Ling, H.: LIME: low-light image enhancement via illumination map estimation. IEEE Trans. Image Process. 26(2), 982–993 (2016)MathSciNetCrossRef
11.
Zurück zum Zitat He, W., Liu, Y., Feng, J., Zhang, W., Gu, G., Chen, Q.: Low-light image enhancement combined with attention map and U-Net network. In: 2020 IEEE 3rd International Conference on Information Systems and Computer Aided Education (ICISCAE), pp. 397–401. IEEE (2020) He, W., Liu, Y., Feng, J., Zhang, W., Gu, G., Chen, Q.: Low-light image enhancement combined with attention map and U-Net network. In: 2020 IEEE 3rd International Conference on Information Systems and Computer Aided Education (ICISCAE), pp. 397–401. IEEE (2020)
12.
Zurück zum Zitat Hines, G., Rahman, Z. U., Jobson, D., Woodell, G.: Single-scale retinex using digital signal processors. In: Global Signal Processing Conference, Paper 1324 (2005) Hines, G., Rahman, Z. U., Jobson, D., Woodell, G.: Single-scale retinex using digital signal processors. In: Global Signal Processing Conference, Paper 1324 (2005)
13.
Zurück zum Zitat Hiriart-Urruty, J.B., Lemaréchal, C.: Convex Analysis and Minimization Algorithms I: Fundamentals, vol. 305. Springer Science & Business Media, Berlin (2013) Hiriart-Urruty, J.B., Lemaréchal, C.: Convex Analysis and Minimization Algorithms I: Fundamentals, vol. 305. Springer Science & Business Media, Berlin (2013)
14.
Zurück zum Zitat Ibrahim, H., Kong, N.S.P.: Brightness preserving dynamic histogram equalization for image contrast enhancement. IEEE Trans. Consum. Electron. 53(4), 1752–1758 (2007)CrossRef Ibrahim, H., Kong, N.S.P.: Brightness preserving dynamic histogram equalization for image contrast enhancement. IEEE Trans. Consum. Electron. 53(4), 1752–1758 (2007)CrossRef
15.
Zurück zum Zitat Jiang, Y., Gong, X., Liu, D., Cheng, Y., Fang, C., Shen, X., Yang, J., Zhou, P., Wang, Z.: EnlightenGAN: deep light enhancement without paired supervision. IEEE Trans. Image Process. 30, 2340–2349 (2021)CrossRef Jiang, Y., Gong, X., Liu, D., Cheng, Y., Fang, C., Shen, X., Yang, J., Zhou, P., Wang, Z.: EnlightenGAN: deep light enhancement without paired supervision. IEEE Trans. Image Process. 30, 2340–2349 (2021)CrossRef
16.
Zurück zum Zitat Kim, T.K., Paik, J.K., Kang, B.S.: Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering. IEEE Trans. Consum. Electron. 44(1), 82–87 (1998)CrossRef Kim, T.K., Paik, J.K., Kang, B.S.: Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering. IEEE Trans. Consum. Electron. 44(1), 82–87 (1998)CrossRef
17.
Zurück zum Zitat Kim, Y.T.: Contrast enhancement using brightness preserving bi-histogram equalization. IEEE Trans. Consum. Electron. 43(1), 1–8 (1997)CrossRef Kim, Y.T.: Contrast enhancement using brightness preserving bi-histogram equalization. IEEE Trans. Consum. Electron. 43(1), 1–8 (1997)CrossRef
18.
Zurück zum Zitat Kimmel, R., Elad, M., Shaked, D., Keshet, R., Sobel, I.: A variational framework for retinex. Int. J. Comput. Vis. 52(1), 7–23 (2003)CrossRef Kimmel, R., Elad, M., Shaked, D., Keshet, R., Sobel, I.: A variational framework for retinex. Int. J. Comput. Vis. 52(1), 7–23 (2003)CrossRef
19.
Zurück zum Zitat Land, E.H., McCann, J.J.: Lightness and retinex theory. Josa 61(1), 1–11 (1971)CrossRef Land, E.H., McCann, J.J.: Lightness and retinex theory. Josa 61(1), 1–11 (1971)CrossRef
20.
Zurück zum Zitat Lee, C., Lee, C., Kim, C.S.: Contrast enhancement based on layered difference representation of 2D histograms. IEEE Trans. Image Process. 22(12), 5372–5384 (2013)CrossRef Lee, C., Lee, C., Kim, C.S.: Contrast enhancement based on layered difference representation of 2D histograms. IEEE Trans. Image Process. 22(12), 5372–5384 (2013)CrossRef
21.
Zurück zum Zitat Li, H., Zhang, L., Shen, H.: A perceptually inspired variational method for the uneven intensity correction of remote sensing images. IEEE Trans. Geosci. Remote Sens. 50(8), 3053–3065 (2012)CrossRef Li, H., Zhang, L., Shen, H.: A perceptually inspired variational method for the uneven intensity correction of remote sensing images. IEEE Trans. Geosci. Remote Sens. 50(8), 3053–3065 (2012)CrossRef
22.
Zurück zum Zitat Li, L., Wang, R., Wang, W., Gao, W.: A low-light image enhancement method for both denoising and contrast enlarging. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3730–3734. IEEE (2015) Li, L., Wang, R., Wang, W., Gao, W.: A low-light image enhancement method for both denoising and contrast enlarging. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3730–3734. IEEE (2015)
23.
Zurück zum Zitat Li, M., Liu, J., Yang, W., Sun, X., Guo, Z.: Structure-revealing low-light image enhancement via robust retinex model. IEEE Trans. Image Process. 27(6), 2828–2841 (2018)MathSciNetCrossRef Li, M., Liu, J., Yang, W., Sun, X., Guo, Z.: Structure-revealing low-light image enhancement via robust retinex model. IEEE Trans. Image Process. 27(6), 2828–2841 (2018)MathSciNetCrossRef
24.
Zurück zum Zitat Limare, N., Lisani, J.L., Morel, J.M., Petro, A.B., Sbert, C.: Simplest color balance. Image Process. On Line 1, 297–315 (2011)CrossRef Limare, N., Lisani, J.L., Morel, J.M., Petro, A.B., Sbert, C.: Simplest color balance. Image Process. On Line 1, 297–315 (2011)CrossRef
25.
Zurück zum Zitat Ma, K., Zeng, K., Wang, Z.: Perceptual quality assessment for multi-exposure image fusion. IEEE Trans. Image Process. 24(11), 3345–3356 (2015)MathSciNetCrossRef Ma, K., Zeng, K., Wang, Z.: Perceptual quality assessment for multi-exposure image fusion. IEEE Trans. Image Process. 24(11), 3345–3356 (2015)MathSciNetCrossRef
27.
Zurück zum Zitat Ma, W., Morel, J.M., Osher, S., Chien, A.: An l 1-based variational model for retinex theory and its application to medical images. In: CVPR 2011, pp. 153–160. IEEE (2011) Ma, W., Morel, J.M., Osher, S., Chien, A.: An l 1-based variational model for retinex theory and its application to medical images. In: CVPR 2011, pp. 153–160. IEEE (2011)
28.
29.
Zurück zum Zitat McCann, J.J., Parraman, C.E., Rizzi, A.: Pixel and spatial mechanisms of color constancy. In: Color Imaging XV: Displaying, Processing, Hardcopy, and Applications, vol. 7528, pp. 24–31. SPIE (2010) McCann, J.J., Parraman, C.E., Rizzi, A.: Pixel and spatial mechanisms of color constancy. In: Color Imaging XV: Displaying, Processing, Hardcopy, and Applications, vol. 7528, pp. 24–31. SPIE (2010)
30.
Zurück zum Zitat Mittal, A., Soundararajan, R., Bovik, A.C.: Making a “completely blind’’ image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2012)CrossRef Mittal, A., Soundararajan, R., Bovik, A.C.: Making a “completely blind’’ image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2012)CrossRef
31.
32.
Zurück zum Zitat Palma-Amestoy, R., Provenzi, E., Bertalmío, M., Caselles, V.: A perceptually inspired variational framework for color enhancement. IEEE Trans. Pattern Anal. Mach. Intell. 31(3), 458–474 (2008)CrossRef Palma-Amestoy, R., Provenzi, E., Bertalmío, M., Caselles, V.: A perceptually inspired variational framework for color enhancement. IEEE Trans. Pattern Anal. Mach. Intell. 31(3), 458–474 (2008)CrossRef
33.
Zurück zum Zitat Rahman, Z.u., Jobson, D.J., Woodell, G.A.: Multi-scale retinex for color image enhancement. In: Proceedings of 3rd IEEE International Conference on Image Processing, vol. 3, pp. 1003–1006. IEEE (1996) Rahman, Z.u., Jobson, D.J., Woodell, G.A.: Multi-scale retinex for color image enhancement. In: Proceedings of 3rd IEEE International Conference on Image Processing, vol. 3, pp. 1003–1006. IEEE (1996)
34.
Zurück zum Zitat Ren, X., Yang, W., Cheng, W.H., Liu, J.: LR3M: robust low-light enhancement via low-rank regularized retinex model. IEEE Trans. Image Process. 29, 5862–5876 (2020)MathSciNetCrossRef Ren, X., Yang, W., Cheng, W.H., Liu, J.: LR3M: robust low-light enhancement via low-rank regularized retinex model. IEEE Trans. Image Process. 29, 5862–5876 (2020)MathSciNetCrossRef
35.
Zurück zum Zitat Salas, J.G.G., Lisani, J.L.: Local color correction. Image Process. on Line 1, 260–280 (2011)CrossRef Salas, J.G.G., Lisani, J.L.: Local color correction. Image Process. on Line 1, 260–280 (2011)CrossRef
36.
Zurück zum Zitat Stark, J.A.: Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Trans. Image Process. 9(5), 889–896 (2000)CrossRef Stark, J.A.: Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Trans. Image Process. 9(5), 889–896 (2000)CrossRef
37.
Zurück zum Zitat Wang, L.W., Liu, Z.S., Siu, W.C., Lun, D.P.: Lightening network for low-light image enhancement. IEEE Trans. Image Process. 29, 7984–7996 (2020)CrossRef Wang, L.W., Liu, Z.S., Siu, W.C., Lun, D.P.: Lightening network for low-light image enhancement. IEEE Trans. Image Process. 29, 7984–7996 (2020)CrossRef
38.
Zurück zum Zitat Wang, R., Zhang, Q., Fu, C.W., Shen, X., Zheng, W.S., Jia, J.: Underexposed photo enhancement using deep illumination estimation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6849–6857 (2019) Wang, R., Zhang, Q., Fu, C.W., Shen, X., Zheng, W.S., Jia, J.: Underexposed photo enhancement using deep illumination estimation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6849–6857 (2019)
39.
Zurück zum Zitat Wang, S., Zheng, J., Hu, H.M., Li, B.: Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans. Image Process. 22(9), 3538–3548 (2013)CrossRef Wang, S., Zheng, J., Hu, H.M., Li, B.: Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans. Image Process. 22(9), 3538–3548 (2013)CrossRef
40.
Zurück zum Zitat Wang, W., He, C.: A variational model with barrier functionals for retinex. SIAM J. Imag. Sci. 8(3), 1955–1980 (2015)MathSciNetCrossRef Wang, W., He, C.: A variational model with barrier functionals for retinex. SIAM J. Imag. Sci. 8(3), 1955–1980 (2015)MathSciNetCrossRef
41.
Zurück zum Zitat Wang, W., Ng, M.K.: A nonlocal total variation model for image decomposition: illumination and reflectance. Numer. Math. Theory Methods Appl. 7(3), 334–355 (2014)MathSciNetCrossRef Wang, W., Ng, M.K.: A nonlocal total variation model for image decomposition: illumination and reflectance. Numer. Math. Theory Methods Appl. 7(3), 334–355 (2014)MathSciNetCrossRef
42.
Zurück zum Zitat Wei, C., Wang, W., Yang, W., Liu, J.: Deep retinex decomposition for low-light enhancement. arXiv preprint arXiv:1808.04560 (2018) Wei, C., Wang, W., Yang, W., Liu, J.: Deep retinex decomposition for low-light enhancement. arXiv preprint arXiv:​1808.​04560 (2018)
43.
Zurück zum Zitat Wei, S., Xu, H.: Staircasing reduction model applied to total variation based image reconstruction. In: 2009 17th European Signal Processing Conference, pp. 2579–2583. IEEE (2009) Wei, S., Xu, H.: Staircasing reduction model applied to total variation based image reconstruction. In: 2009 17th European Signal Processing Conference, pp. 2579–2583. IEEE (2009)
44.
Zurück zum Zitat Xu, K., Yang, X., Yin, B., Lau, R.W.: Learning to restore low-light images via decomposition-and-enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2281–2290 (2020) Xu, K., Yang, X., Yin, B., Lau, R.W.: Learning to restore low-light images via decomposition-and-enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2281–2290 (2020)
45.
Zurück zum Zitat Zhang, K., Zuo, W., Chen, Y., Meng, D., Zhang, L.: Beyond a gaussian denoiser: residual learning of deep cnn for image denoising. IEEE Trans. Image Process. 26(7), 3142–3155 (2017)MathSciNetCrossRef Zhang, K., Zuo, W., Chen, Y., Meng, D., Zhang, L.: Beyond a gaussian denoiser: residual learning of deep cnn for image denoising. IEEE Trans. Image Process. 26(7), 3142–3155 (2017)MathSciNetCrossRef
46.
Zurück zum Zitat Zhang, L., Shen, P., Peng, X., Zhu, G., Song, J., Wei, W., Song, H.: Simultaneous enhancement and noise reduction of a single low-light image. IET Image Proc. 10(11), 840–847 (2016)CrossRef Zhang, L., Shen, P., Peng, X., Zhu, G., Song, J., Wei, W., Song, H.: Simultaneous enhancement and noise reduction of a single low-light image. IET Image Proc. 10(11), 840–847 (2016)CrossRef
47.
Zurück zum Zitat Zimmerman, J.B., Pizer, S.M., Staab, E.V., Perry, J.R., McCartney, W., Brenton, B.C.: An evaluation of the effectiveness of adaptive histogram equalization for contrast enhancement. IEEE Trans. Med. Imaging 7(4), 304–312 (1988)CrossRef Zimmerman, J.B., Pizer, S.M., Staab, E.V., Perry, J.R., McCartney, W., Brenton, B.C.: An evaluation of the effectiveness of adaptive histogram equalization for contrast enhancement. IEEE Trans. Med. Imaging 7(4), 304–312 (1988)CrossRef
48.
Zurück zum Zitat Zosso, D., Tran, G., Osher, S.J.: Non-local retinex–a unifying framework and beyond. SIAM J. Imag. Sci. 8(2), 787–826 (2015)MathSciNetCrossRef Zosso, D., Tran, G., Osher, S.J.: Non-local retinex–a unifying framework and beyond. SIAM J. Imag. Sci. 8(2), 787–826 (2015)MathSciNetCrossRef
49.
Zurück zum Zitat Zuiderveld, K.: Contrast limited adaptive histogram equalization. Graphics Gems pp. 474–485 (1994) Zuiderveld, K.: Contrast limited adaptive histogram equalization. Graphics Gems pp. 474–485 (1994)
Metadaten
Titel
Low-light Image Enhancement via Dual Reflectance Estimation
verfasst von
Fan Jia
Tiange Wang
Tieyong Zeng
Publikationsdatum
01.02.2024
Verlag
Springer US
Erschienen in
Journal of Scientific Computing / Ausgabe 2/2024
Print ISSN: 0885-7474
Elektronische ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-023-02431-y

Weitere Artikel der Ausgabe 2/2024

Journal of Scientific Computing 2/2024 Zur Ausgabe

Premium Partner