Skip to main content
Top
Published in: Neural Processing Letters 1/2019

05-01-2019

From Night to Day: GANs Based Low Quality Image Enhancement

Authors: Yingying Meng, Deqiang Kong, Zhenfeng Zhu, Yao Zhao

Published in: Neural Processing Letters | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nighttime images have lower contrast and higher noise than their daytime counterparts of the same scene. The aim of nighttime image enhancement is to improve the visual quality of nighttime images, so that they are visually as close as possible to daytime images. This problem is still challenging because of the deteriorated conditions of illumination lack and uneven lighting. In this paper, we propose a generative adversarial networks (GANs) based framework for nighttime image enhancement. To take advantage of GANs’ powerful ability of generating image from real data distribution, we make the established network well constrained by combining several loss functions including adversarial loss, perceptual loss, and total variation loss. Particularly, a pre-trained network is applied to leverage the perceptual loss which is beneficial to generate high-quality images. Meanwhile, for tackling the light-at-night effect, we present a fusion network in which the dark channel prior based illumination compensation is employed for the training of generator network. Experimental results have demonstrated the effectiveness of the proposed nighttime image enhancement network.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ketcham DJ (1976) Real-time image enhancement techniques. OSA Image Process 74(2):120–125CrossRef Ketcham DJ (1976) Real-time image enhancement techniques. OSA Image Process 74(2):120–125CrossRef
2.
go back to reference Rahman Z, Jobson DJ, Woodell GA (2002) Multi-scale retinex for color image enhancement. In: International conference on image processing, pp 1003–1006 Rahman Z, Jobson DJ, Woodell GA (2002) Multi-scale retinex for color image enhancement. In: International conference on image processing, pp 1003–1006
3.
go back to reference Jobson DJ, Rahman Z, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976CrossRef Jobson DJ, Rahman Z, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976CrossRef
4.
go back to reference He K, Sun J, Tang X (2009) Single image haze removal using dark channel prior. In: IEEE conference on computer vision and pattern recognition, pp 1956–1963 He K, Sun J, Tang X (2009) Single image haze removal using dark channel prior. In: IEEE conference on computer vision and pattern recognition, pp 1956–1963
5.
go back to reference Dong X, Wang G, Pang Y, Li W, Wen J, Meng W, Lu Y (2011) Fast efficient algorithm for enhancement of low lighting video. In: IEEE international conference on multimedia and expo, pp 1–6 Dong X, Wang G, Pang Y, Li W, Wen J, Meng W, Lu Y (2011) Fast efficient algorithm for enhancement of low lighting video. In: IEEE international conference on multimedia and expo, pp 1–6
6.
go back to reference Jiang X, Yao H, Zhang S, Lu X, Zeng W (2013) Night video enhancement using improved dark channel prior. In: IEEE international conference on image processing, pp 553–557 Jiang X, Yao H, Zhang S, Lu X, Zeng W (2013) Night video enhancement using improved dark channel prior. In: IEEE international conference on image processing, pp 553–557
7.
go back to reference Gong Y, Lee Y, Nguyen TQ (2016) Nighttime image enhancement applying dark channel prior to raw data from camera. In: International SoC design conference, pp 173–174 Gong Y, Lee Y, Nguyen TQ (2016) Nighttime image enhancement applying dark channel prior to raw data from camera. In: International SoC design conference, pp 173–174
8.
go back to reference Iizuka S, Simo-Serra E, Ishikawa H (2017) Globally and locally consistent image completion. ACM Trans Graph 36(4):107:1–107:14CrossRef Iizuka S, Simo-Serra E, Ishikawa H (2017) Globally and locally consistent image completion. ACM Trans Graph 36(4):107:1–107:14CrossRef
9.
go back to reference Yeh RA, Chen C, Lim T, Hasegawa-Johnson M, Do MN (2017) Semantic image inpainting with perceptual and contextual losses. In: IEEE conference on computer vision and pattern recognition Yeh RA, Chen C, Lim T, Hasegawa-Johnson M, Do MN (2017) Semantic image inpainting with perceptual and contextual losses. In: IEEE conference on computer vision and pattern recognition
10.
go back to reference Taigman Y, Polyak A, Wolf L (2017) Unsupervised cross-domain image generation. In: International conference on learning representations Taigman Y, Polyak A, Wolf L (2017) Unsupervised cross-domain image generation. In: International conference on learning representations
11.
go back to reference Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken AP, Tejani A, Totz J, Wang Z, Shi W (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: IEEE conference on computer vision and pattern recognition, pp 105–114 Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken AP, Tejani A, Totz J, Wang Z, Shi W (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: IEEE conference on computer vision and pattern recognition, pp 105–114
12.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770–778
13.
go back to reference Zhu J, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: IEEE international conference on computer vision, pp 2242–2251 Zhu J, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: IEEE international conference on computer vision, pp 2242–2251
14.
go back to reference Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Conference on neural information processing systems, pp 2672–2680 Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Conference on neural information processing systems, pp 2672–2680
15.
go back to reference Arjovsky M, Chintala S, Bottou L (2017) Wasserstein generative adversarial networks. In: International conference on machine learning, pp 214–223 Arjovsky M, Chintala S, Bottou L (2017) Wasserstein generative adversarial networks. In: International conference on machine learning, pp 214–223
16.
go back to reference Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC (2017) Improved training of Wasserstein GANs. In: Conference on neural information processing systems, pp 5769–5779 Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC (2017) Improved training of Wasserstein GANs. In: Conference on neural information processing systems, pp 5769–5779
17.
go back to reference Liu M, Breuel T, Kautz J (2017) Unsupervised image-to-image translation networks. In: Conference on neural information processing systems, pp 700–708 Liu M, Breuel T, Kautz J (2017) Unsupervised image-to-image translation networks. In: Conference on neural information processing systems, pp 700–708
18.
go back to reference Huang R, Zhang S, Li T, He R (2017) Beyond face rotation: global and local perception GAN for photorealistic and identity preserving frontal view synthesis. In: IEEE international conference on computer vision, pp 2458–2467 Huang R, Zhang S, Li T, He R (2017) Beyond face rotation: global and local perception GAN for photorealistic and identity preserving frontal view synthesis. In: IEEE international conference on computer vision, pp 2458–2467
19.
go back to reference Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. In: International conference on machine learning, vol 30, p 1 Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. In: International conference on machine learning, vol 30, p 1
20.
go back to reference Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning, pp 448–456 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning, pp 448–456
21.
go back to reference Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. In: International conference on learning representations Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. In: International conference on learning representations
22.
go back to reference Johnson J, Alahi A, Li F (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp 694–711 Johnson J, Alahi A, Li F (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp 694–711
23.
go back to reference Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations
24.
go back to reference Deng J, Dong W, Socher R, Li L, Li K, Li F (2009) ImageNet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, pp 248–255 Deng J, Dong W, Socher R, Li L, Li K, Li F (2009) ImageNet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, pp 248–255
25.
26.
go back to reference Strong D, Chan T (2003) Edge-preserving and scale-dependent properties of total variation regularization. Inverse Probl 19(6):165–187MathSciNetCrossRefMATH Strong D, Chan T (2003) Edge-preserving and scale-dependent properties of total variation regularization. Inverse Probl 19(6):165–187MathSciNetCrossRefMATH
27.
go back to reference Milford M, Wyeth GF (2012) SeqSLAM: visual route-based navigation for sunny summer days and stormy winter nights. In: IEEE international conference on robotics and automation, pp 1643–1649 Milford M, Wyeth GF (2012) SeqSLAM: visual route-based navigation for sunny summer days and stormy winter nights. In: IEEE international conference on robotics and automation, pp 1643–1649
28.
go back to reference Bermejo S, Cabestany J (2001) Oriented principal component analysis for large margin classifiers. Neural Netw 14(10):1447–1461CrossRefMATH Bermejo S, Cabestany J (2001) Oriented principal component analysis for large margin classifiers. Neural Netw 14(10):1447–1461CrossRefMATH
29.
go back to reference Isola P, Zhu J, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: IEEE conference on computer vision and pattern recognition, pp 5967–5976 Isola P, Zhu J, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: IEEE conference on computer vision and pattern recognition, pp 5967–5976
Metadata
Title
From Night to Day: GANs Based Low Quality Image Enhancement
Authors
Yingying Meng
Deqiang Kong
Zhenfeng Zhu
Yao Zhao
Publication date
05-01-2019
Publisher
Springer US
Published in
Neural Processing Letters / Issue 1/2019
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-018-09968-2

Other articles of this Issue 1/2019

Neural Processing Letters 1/2019 Go to the issue