Skip to main content
Erschienen in:

14.08.2024

Low-Light Image Deraining Based on Higher Order Variational Model

verfasst von: Yanan Gu, Yiming Gao, Dong Wang, Chunyang Wang, Bibo Lu

Erschienen in: Circuits, Systems, and Signal Processing | Ausgabe 12/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The existing rain streaks removal methods provide better deraining results, but it cannot be implemented on the low-light images due to the poor visual quality. To solve this problem, this paper presents a novel rain streaks removal approach using m fold infimal convolution of oscillating TGV(\(ICTGV^{osci}\)) regularization and Retinex theory for low-light images. Experiments on a number of challenging low-light rainy images are presented to demonstrate the efficiency and the flexibility of the proposed approaches in comparison with state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

ATZelektronik

Die Fachzeitschrift ATZelektronik bietet für Entwickler und Entscheider in der Automobil- und Zulieferindustrie qualitativ hochwertige und fundierte Informationen aus dem gesamten Spektrum der Pkw- und Nutzfahrzeug-Elektronik. 

Lassen Sie sich jetzt unverbindlich 2 kostenlose Ausgabe zusenden.

ATZelectronics worldwide

ATZlectronics worldwide is up-to-speed on new trends and developments in automotive electronics on a scientific level with a high depth of information. 

Order your 30-days-trial for free and without any commitment.

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat F. Albu, C. Vertan, C. Florea, et al., One scan shadow compensation and visual enhancement of color images, in IEEE International Conference on Image Processing, (2010) F. Albu, C. Vertan, C. Florea, et al., One scan shadow compensation and visual enhancement of color images, in IEEE International Conference on Image Processing, (2010)
2.
Zurück zum Zitat H.H. Bauschke, P.L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces (CMS Books in Mathematics, Springer, New York, 2011)CrossRef H.H. Bauschke, P.L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces (CMS Books in Mathematics, Springer, New York, 2011)CrossRef
3.
Zurück zum Zitat K. Bredies, Recovering piecewise smooth multichannel images by minimization of convex functionals with total generalized variation penalty. Lect. Notes Comput. Sci. 8293, 44–77 (2014)CrossRef K. Bredies, Recovering piecewise smooth multichannel images by minimization of convex functionals with total generalized variation penalty. Lect. Notes Comput. Sci. 8293, 44–77 (2014)CrossRef
4.
5.
Zurück zum Zitat Y.L. Chen, C.T. Hsu, A generalized low-rank appearance model for spatio-temporally correlated rain streaks, in IEEE International Conference on Computer Vision, (2013) Y.L. Chen, C.T. Hsu, A generalized low-rank appearance model for spatio-temporally correlated rain streaks, in IEEE International Conference on Computer Vision, (2013)
6.
Zurück zum Zitat L.J. Deng, T.Z. Huang, X.L. Zhao, T.X. Jiang, A directional global sparse model for single image rain removal. Appl. Math. Model. 59, 662–679 (2018)MathSciNetCrossRef L.J. Deng, T.Z. Huang, X.L. Zhao, T.X. Jiang, A directional global sparse model for single image rain removal. Appl. Math. Model. 59, 662–679 (2018)MathSciNetCrossRef
7.
Zurück zum Zitat C. Florea, F. Albu, C. Vertan, et al., Logarithmic tools for in-camera image processing, in Signals Systems Conference IET, (2009) C. Florea, F. Albu, C. Vertan, et al., Logarithmic tools for in-camera image processing, in Signals Systems Conference IET, (2009)
8.
Zurück zum Zitat X. Fu, J. Huang, X. Ding, Y. Liao, J. Paisley, Clearing the skies: a deep network architecture for single-image rain removal. IEEE Trans. Image Process. 26(6), 2944–2956 (2017)MathSciNetCrossRef X. Fu, J. Huang, X. Ding, Y. Liao, J. Paisley, Clearing the skies: a deep network architecture for single-image rain removal. IEEE Trans. Image Process. 26(6), 2944–2956 (2017)MathSciNetCrossRef
9.
Zurück zum Zitat X. Fu, J. Huang, D. Zeng, Y. Huang, X. Ding, J. Paisley, Removing rain from single images via a deep detail network, in IEEE International Conference on Computer Vision and Pattern Recognition, (2017) X. Fu, J. Huang, D. Zeng, Y. Huang, X. Ding, J. Paisley, Removing rain from single images via a deep detail network, in IEEE International Conference on Computer Vision and Pattern Recognition, (2017)
10.
Zurück zum Zitat X. Fu, D. Zeng, Y. Huang, Y. Liao, X. Ding, J. Paisley, A fusion-based enhancing method for weakly illuminated images. Signal Process. 129, 82–96 (2016)CrossRef X. Fu, D. Zeng, Y. Huang, Y. Liao, X. Ding, J. Paisley, A fusion-based enhancing method for weakly illuminated images. Signal Process. 129, 82–96 (2016)CrossRef
11.
Zurück zum Zitat Y. Gao, K. Bredies, Infimal convolution of oscillation total generalized variation for the recovery of images with structured texture. SIAM J. Imag. Sci. 11, 2021–2063 (2018)MathSciNetCrossRef Y. Gao, K. Bredies, Infimal convolution of oscillation total generalized variation for the recovery of images with structured texture. SIAM J. Imag. Sci. 11, 2021–2063 (2018)MathSciNetCrossRef
12.
Zurück zum Zitat K. Garg, S.K. Nayar, Photorealistic rendering of rain streaks. ACM Trans. Graph. 25(3), 996–1002 (2006)CrossRef K. Garg, S.K. Nayar, Photorealistic rendering of rain streaks. ACM Trans. Graph. 25(3), 996–1002 (2006)CrossRef
13.
Zurück zum Zitat Y. Gu, Y. Gao, H. Liu et al., Multi-directional rain streak removal based on infimal convolution of oscillation TGV. Neurocomputing 486, 61–76 (2022)CrossRef Y. Gu, Y. Gao, H. Liu et al., Multi-directional rain streak removal based on infimal convolution of oscillation TGV. Neurocomputing 486, 61–76 (2022)CrossRef
14.
Zurück zum Zitat D.A. Huang, L.W. Kang, Y.C.F. Wang, C.W. Lin, Self-learning based image decomposition with applications to single image denoising. IEEE Trans. Multimedia 16(1), 83–93 (2014)CrossRef D.A. Huang, L.W. Kang, Y.C.F. Wang, C.W. Lin, Self-learning based image decomposition with applications to single image denoising. IEEE Trans. Multimedia 16(1), 83–93 (2014)CrossRef
15.
Zurück zum Zitat D. A. Huang, L. W. Kang, M. C. Yang, C. W. Lin, Y.C.F. Wang, Context-aware single image rain removal, in IEEE International Conference Multimedia Expo, pp. 164-169 (2012) D. A. Huang, L. W. Kang, M. C. Yang, C. W. Lin, Y.C.F. Wang, Context-aware single image rain removal, in IEEE International Conference Multimedia Expo, pp. 164-169 (2012)
16.
Zurück zum Zitat D.J. Jobson, Z.U. Rahman, G.A. Woodell, A multiscale Retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6(7), 965–976 (1997)CrossRef D.J. Jobson, Z.U. Rahman, G.A. Woodell, A multiscale Retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6(7), 965–976 (1997)CrossRef
17.
Zurück zum Zitat D.J. Jobson, Z.U. Rahman, G.A. Woodell, Properties and performance of a center/surround Retinex. IEEE Trans. Image Process. 6(3), 451–462 (1997)CrossRef D.J. Jobson, Z.U. Rahman, G.A. Woodell, Properties and performance of a center/surround Retinex. IEEE Trans. Image Process. 6(3), 451–462 (1997)CrossRef
18.
Zurück zum Zitat L.W. Kang, C.W. Lin, Y.H. Fu, Automatic single-image-based rain streaks removal via image decomposition. IEEE Trans. Image Process. 21(4), 1742–1755 (2012)MathSciNetCrossRef L.W. Kang, C.W. Lin, Y.H. Fu, Automatic single-image-based rain streaks removal via image decomposition. IEEE Trans. Image Process. 21(4), 1742–1755 (2012)MathSciNetCrossRef
19.
Zurück zum Zitat E.H. Land, The Retinex theory of color vision. Sci. Am. 237(6), 108–28 (1977)CrossRef E.H. Land, The Retinex theory of color vision. Sci. Am. 237(6), 108–28 (1977)CrossRef
20.
Zurück zum Zitat Y. Li, R.T. Tan, X. Guo, J. Lu, M.S. Brown, Rain streak removal using layer priors, in IEEE International Conference on Computer Vision and Pattern Recognition, (2016) Y. Li, R.T. Tan, X. Guo, J. Lu, M.S. Brown, Rain streak removal using layer priors, in IEEE International Conference on Computer Vision and Pattern Recognition, (2016)
21.
Zurück zum Zitat Y. Luo, Y. Xu, H. Ji, Removing rain from a single image via discriminative sparse coding, in IEEE International Conference on Computer Vision, (2015) Y. Luo, Y. Xu, H. Ji, Removing rain from a single image via discriminative sparse coding, in IEEE International Conference on Computer Vision, (2015)
22.
23.
Zurück zum Zitat A. Mittal, R. Soundararajan, A.C. Bovik, Making a completely blind image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)CrossRef A. Mittal, R. Soundararajan, A.C. Bovik, Making a completely blind image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)CrossRef
24.
Zurück zum Zitat J. Redmon, A. Farhadi, YOLOv3: An incremental improvement, arXiv e-prints (2018) J. Redmon, A. Farhadi, YOLOv3: An incremental improvement, arXiv e-prints (2018)
25.
Zurück zum Zitat R.T. Tan, Visibility in bad weather from a single image, in IEEE International Conference on Computer Vision and Pattern Recognition, (2008) R.T. Tan, Visibility in bad weather from a single image, in IEEE International Conference on Computer Vision and Pattern Recognition, (2008)
26.
Zurück zum Zitat S. Wang, J. Zheng, H.M. Hu, B. Li, Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans. Image Process. 22(9), 3538–3578 (2013)CrossRef S. Wang, J. Zheng, H.M. Hu, B. Li, Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans. Image Process. 22(9), 3538–3578 (2013)CrossRef
27.
Zurück zum Zitat Y. Wang, S. Liu, C. Chen, B. Zeng, A hierarchical approach for rain or snow removing in a single color image. IEEE Trans. Image Process. 26(8), 3936–3950 (2017)MathSciNetCrossRef Y. Wang, S. Liu, C. Chen, B. Zeng, A hierarchical approach for rain or snow removing in a single color image. IEEE Trans. Image Process. 26(8), 3936–3950 (2017)MathSciNetCrossRef
28.
Zurück zum Zitat Y. Wang, S. Liu, S. Yang et al., Scale-free single image deraining via visibility-enhanced recurrent wavelet learning. IEEE Trans. Image Process. 28(6), 2948–2961 (2019)MathSciNetCrossRef Y. Wang, S. Liu, S. Yang et al., Scale-free single image deraining via visibility-enhanced recurrent wavelet learning. IEEE Trans. Image Process. 28(6), 2948–2961 (2019)MathSciNetCrossRef
29.
Zurück zum Zitat J. Xu, W. Zhao, P. Liu, X.L. Tang, An improved guidance image based method to remove rain and snow in a single image. Comput. Inf. Sci. 5(3), 49–55 (2012) J. Xu, W. Zhao, P. Liu, X.L. Tang, An improved guidance image based method to remove rain and snow in a single image. Comput. Inf. Sci. 5(3), 49–55 (2012)
30.
Zurück zum Zitat W. Yang, R.T. Tan, J. Feng, J. Liu, Z. Guo, S. Yan, Deep joint rain detection and removal from a single image, in IEEE International Conference on Computer Vision and Pattern Recognition, (2017) W. Yang, R.T. Tan, J. Feng, J. Liu, Z. Guo, S. Yan, Deep joint rain detection and removal from a single image, in IEEE International Conference on Computer Vision and Pattern Recognition, (2017)
31.
Zurück zum Zitat H. Zhang, V.M. Patel, Density-aware single image de-raining using a multi-stream dense network, in IEEE International Conference on Computer Vision and Pattern Recognition, (2018) H. Zhang, V.M. Patel, Density-aware single image de-raining using a multi-stream dense network, in IEEE International Conference on Computer Vision and Pattern Recognition, (2018)
32.
Zurück zum Zitat L. Zhu, C.W. Fu, D. Lischinski, P.A. Heng, Joint bi-layer optimization for single-image rain streak removal, in IEEE International Conference on Computer Vision, (2017) L. Zhu, C.W. Fu, D. Lischinski, P.A. Heng, Joint bi-layer optimization for single-image rain streak removal, in IEEE International Conference on Computer Vision, (2017)
Metadaten
Titel
Low-Light Image Deraining Based on Higher Order Variational Model
verfasst von
Yanan Gu
Yiming Gao
Dong Wang
Chunyang Wang
Bibo Lu
Publikationsdatum
14.08.2024
Verlag
Springer US
Erschienen in
Circuits, Systems, and Signal Processing / Ausgabe 12/2024
Print ISSN: 0278-081X
Elektronische ISSN: 1531-5878
DOI
https://doi.org/10.1007/s00034-024-02762-7