Skip to main content
Erschienen in: Neural Processing Letters 1/2019

05.01.2019

From Night to Day: GANs Based Low Quality Image Enhancement

verfasst von: Yingying Meng, Deqiang Kong, Zhenfeng Zhu, Yao Zhao

Erschienen in: Neural Processing Letters | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nighttime images have lower contrast and higher noise than their daytime counterparts of the same scene. The aim of nighttime image enhancement is to improve the visual quality of nighttime images, so that they are visually as close as possible to daytime images. This problem is still challenging because of the deteriorated conditions of illumination lack and uneven lighting. In this paper, we propose a generative adversarial networks (GANs) based framework for nighttime image enhancement. To take advantage of GANs’ powerful ability of generating image from real data distribution, we make the established network well constrained by combining several loss functions including adversarial loss, perceptual loss, and total variation loss. Particularly, a pre-trained network is applied to leverage the perceptual loss which is beneficial to generate high-quality images. Meanwhile, for tackling the light-at-night effect, we present a fusion network in which the dark channel prior based illumination compensation is employed for the training of generator network. Experimental results have demonstrated the effectiveness of the proposed nighttime image enhancement network.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ketcham DJ (1976) Real-time image enhancement techniques. OSA Image Process 74(2):120–125CrossRef Ketcham DJ (1976) Real-time image enhancement techniques. OSA Image Process 74(2):120–125CrossRef
2.
Zurück zum Zitat Rahman Z, Jobson DJ, Woodell GA (2002) Multi-scale retinex for color image enhancement. In: International conference on image processing, pp 1003–1006 Rahman Z, Jobson DJ, Woodell GA (2002) Multi-scale retinex for color image enhancement. In: International conference on image processing, pp 1003–1006
3.
Zurück zum Zitat Jobson DJ, Rahman Z, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976CrossRef Jobson DJ, Rahman Z, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976CrossRef
4.
Zurück zum Zitat He K, Sun J, Tang X (2009) Single image haze removal using dark channel prior. In: IEEE conference on computer vision and pattern recognition, pp 1956–1963 He K, Sun J, Tang X (2009) Single image haze removal using dark channel prior. In: IEEE conference on computer vision and pattern recognition, pp 1956–1963
5.
Zurück zum Zitat Dong X, Wang G, Pang Y, Li W, Wen J, Meng W, Lu Y (2011) Fast efficient algorithm for enhancement of low lighting video. In: IEEE international conference on multimedia and expo, pp 1–6 Dong X, Wang G, Pang Y, Li W, Wen J, Meng W, Lu Y (2011) Fast efficient algorithm for enhancement of low lighting video. In: IEEE international conference on multimedia and expo, pp 1–6
6.
Zurück zum Zitat Jiang X, Yao H, Zhang S, Lu X, Zeng W (2013) Night video enhancement using improved dark channel prior. In: IEEE international conference on image processing, pp 553–557 Jiang X, Yao H, Zhang S, Lu X, Zeng W (2013) Night video enhancement using improved dark channel prior. In: IEEE international conference on image processing, pp 553–557
7.
Zurück zum Zitat Gong Y, Lee Y, Nguyen TQ (2016) Nighttime image enhancement applying dark channel prior to raw data from camera. In: International SoC design conference, pp 173–174 Gong Y, Lee Y, Nguyen TQ (2016) Nighttime image enhancement applying dark channel prior to raw data from camera. In: International SoC design conference, pp 173–174
8.
Zurück zum Zitat Iizuka S, Simo-Serra E, Ishikawa H (2017) Globally and locally consistent image completion. ACM Trans Graph 36(4):107:1–107:14CrossRef Iizuka S, Simo-Serra E, Ishikawa H (2017) Globally and locally consistent image completion. ACM Trans Graph 36(4):107:1–107:14CrossRef
9.
Zurück zum Zitat Yeh RA, Chen C, Lim T, Hasegawa-Johnson M, Do MN (2017) Semantic image inpainting with perceptual and contextual losses. In: IEEE conference on computer vision and pattern recognition Yeh RA, Chen C, Lim T, Hasegawa-Johnson M, Do MN (2017) Semantic image inpainting with perceptual and contextual losses. In: IEEE conference on computer vision and pattern recognition
10.
Zurück zum Zitat Taigman Y, Polyak A, Wolf L (2017) Unsupervised cross-domain image generation. In: International conference on learning representations Taigman Y, Polyak A, Wolf L (2017) Unsupervised cross-domain image generation. In: International conference on learning representations
11.
Zurück zum Zitat Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken AP, Tejani A, Totz J, Wang Z, Shi W (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: IEEE conference on computer vision and pattern recognition, pp 105–114 Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken AP, Tejani A, Totz J, Wang Z, Shi W (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: IEEE conference on computer vision and pattern recognition, pp 105–114
12.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770–778
13.
Zurück zum Zitat Zhu J, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: IEEE international conference on computer vision, pp 2242–2251 Zhu J, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: IEEE international conference on computer vision, pp 2242–2251
14.
Zurück zum Zitat Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Conference on neural information processing systems, pp 2672–2680 Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Conference on neural information processing systems, pp 2672–2680
15.
Zurück zum Zitat Arjovsky M, Chintala S, Bottou L (2017) Wasserstein generative adversarial networks. In: International conference on machine learning, pp 214–223 Arjovsky M, Chintala S, Bottou L (2017) Wasserstein generative adversarial networks. In: International conference on machine learning, pp 214–223
16.
Zurück zum Zitat Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC (2017) Improved training of Wasserstein GANs. In: Conference on neural information processing systems, pp 5769–5779 Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC (2017) Improved training of Wasserstein GANs. In: Conference on neural information processing systems, pp 5769–5779
17.
Zurück zum Zitat Liu M, Breuel T, Kautz J (2017) Unsupervised image-to-image translation networks. In: Conference on neural information processing systems, pp 700–708 Liu M, Breuel T, Kautz J (2017) Unsupervised image-to-image translation networks. In: Conference on neural information processing systems, pp 700–708
18.
Zurück zum Zitat Huang R, Zhang S, Li T, He R (2017) Beyond face rotation: global and local perception GAN for photorealistic and identity preserving frontal view synthesis. In: IEEE international conference on computer vision, pp 2458–2467 Huang R, Zhang S, Li T, He R (2017) Beyond face rotation: global and local perception GAN for photorealistic and identity preserving frontal view synthesis. In: IEEE international conference on computer vision, pp 2458–2467
19.
Zurück zum Zitat Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. In: International conference on machine learning, vol 30, p 1 Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. In: International conference on machine learning, vol 30, p 1
20.
Zurück zum Zitat Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning, pp 448–456 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning, pp 448–456
21.
Zurück zum Zitat Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. In: International conference on learning representations Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. In: International conference on learning representations
22.
Zurück zum Zitat Johnson J, Alahi A, Li F (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp 694–711 Johnson J, Alahi A, Li F (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp 694–711
23.
Zurück zum Zitat Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations
24.
Zurück zum Zitat Deng J, Dong W, Socher R, Li L, Li K, Li F (2009) ImageNet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, pp 248–255 Deng J, Dong W, Socher R, Li L, Li K, Li F (2009) ImageNet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, pp 248–255
25.
Zurück zum Zitat Rudin LI, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Phys D Nonlinear Phenom 60:259–268MathSciNetCrossRefMATH Rudin LI, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Phys D Nonlinear Phenom 60:259–268MathSciNetCrossRefMATH
26.
Zurück zum Zitat Strong D, Chan T (2003) Edge-preserving and scale-dependent properties of total variation regularization. Inverse Probl 19(6):165–187MathSciNetCrossRefMATH Strong D, Chan T (2003) Edge-preserving and scale-dependent properties of total variation regularization. Inverse Probl 19(6):165–187MathSciNetCrossRefMATH
27.
Zurück zum Zitat Milford M, Wyeth GF (2012) SeqSLAM: visual route-based navigation for sunny summer days and stormy winter nights. In: IEEE international conference on robotics and automation, pp 1643–1649 Milford M, Wyeth GF (2012) SeqSLAM: visual route-based navigation for sunny summer days and stormy winter nights. In: IEEE international conference on robotics and automation, pp 1643–1649
28.
Zurück zum Zitat Bermejo S, Cabestany J (2001) Oriented principal component analysis for large margin classifiers. Neural Netw 14(10):1447–1461CrossRefMATH Bermejo S, Cabestany J (2001) Oriented principal component analysis for large margin classifiers. Neural Netw 14(10):1447–1461CrossRefMATH
29.
Zurück zum Zitat Isola P, Zhu J, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: IEEE conference on computer vision and pattern recognition, pp 5967–5976 Isola P, Zhu J, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: IEEE conference on computer vision and pattern recognition, pp 5967–5976
Metadaten
Titel
From Night to Day: GANs Based Low Quality Image Enhancement
verfasst von
Yingying Meng
Deqiang Kong
Zhenfeng Zhu
Yao Zhao
Publikationsdatum
05.01.2019
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2019
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-018-09968-2

Weitere Artikel der Ausgabe 1/2019

Neural Processing Letters 1/2019 Zur Ausgabe

Neuer Inhalt