Skip to main content
Erschienen in: Earth Science Informatics 4/2021

03.08.2021 | Research Article

Integrated image defogging network based on improved atmospheric scattering model and attention feature fusion

verfasst von: Shengmin He, Zhixiang Chen, Fengli Wang, Meiya Wang

Erschienen in: Earth Science Informatics | Ausgabe 4/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

During the imaging process, the image will be polluted by noise due to the influence of the earth's atmosphere fog. Noise pollution directly affects the processing of feature extraction, image segmentation, and pattern recognition. Therefore, the purpose of image defogging is to eliminate noise from foggy images to improve image quality. When dealing with uneven fog density in the same image, most of the existing methods are not satisfactory. Integrated image defogging network based on improved atmospheric scattering model and attention feature fusion is proposed. In order to distinguish between the presence of fog with different concentrations in the image. We adopt the concept of attention that has been important in convolutional neural networks (CNN) in recent years. We adopt the attention mechanism to help our network pay more attention to important feature information, treat thick fog and mist differently, and solve the problem of uneven distribution of fog in the image, but the network handles the problem with the same weight. Finally, use a five-layer convolution operation to restore the image. The experimental results show that our method achieves a good defogging effect on the uneven distribution of the fog density of the synthesized foggy image. In the experiment of real natural foggy images, relying on the attention mechanism network to remove the fog, serious patches will appear on the restored images. Our method will not damage the image. Our method can reasonably remove thick fog and mist to obtain a good defogging effect. And our proposed method is robust.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Berman D, Avidan S (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 1674–1682 Berman D, Avidan S (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 1674–1682
Zurück zum Zitat Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25:5187–5198CrossRef Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25:5187–5198CrossRef
Zurück zum Zitat Chen Z, Ou B, Tian Q (2019) An improved dark channel prior image defogging algorithm based on wavelength compensation. Earth Sci Inf 12:501–512CrossRef Chen Z, Ou B, Tian Q (2019) An improved dark channel prior image defogging algorithm based on wavelength compensation. Earth Sci Inf 12:501–512CrossRef
Zurück zum Zitat Choi LK, You J, Bovik AC (2015) Referenceless prediction of perceptual fog density and perceptual image defogging. IEEE Trans Image Process 24:3888–3901CrossRef Choi LK, You J, Bovik AC (2015) Referenceless prediction of perceptual fog density and perceptual image defogging. IEEE Trans Image Process 24:3888–3901CrossRef
Zurück zum Zitat Cozman F, Krotkov E (1997) Depth from scattering. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, pp 801–806 Cozman F, Krotkov E (1997) Depth from scattering. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, pp 801–806
Zurück zum Zitat Fattal R (2008) Single image dehazing. ACM Trans Graph (TOG) 27:1–9CrossRef Fattal R (2008) Single image dehazing. ACM Trans Graph (TOG) 27:1–9CrossRef
Zurück zum Zitat Fattal R (2014) Dehazing using color-lines. ACM Trans Graph (TOG) 34:1–14CrossRef Fattal R (2014) Dehazing using color-lines. ACM Trans Graph (TOG) 34:1–14CrossRef
Zurück zum Zitat Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2019) Dual attention network for scene segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3146–3154 Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2019) Dual attention network for scene segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3146–3154
Zurück zum Zitat He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33:2341–2353 He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33:2341–2353
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
Zurück zum Zitat He T, Zhang Z, Zhang H, Zhang Z, Xie J, Li M (2019) Bag of tricks for image classification with convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 558–567 He T, Zhang Z, Zhang H, Zhang Z, Xie J, Li M (2019) Bag of tricks for image classification with convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 558–567
Zurück zum Zitat Kim J-H, Jang W-D, Sim J-Y, Kim C-S (2013) Optimized contrast enhancement for real-time image and video dehazing. J vis Commun Image Represent 24:410–425CrossRef Kim J-H, Jang W-D, Sim J-Y, Kim C-S (2013) Optimized contrast enhancement for real-time image and video dehazing. J vis Commun Image Represent 24:410–425CrossRef
Zurück zum Zitat Kingma DP, Ba J (2014) Adam: A method for stochastic optimization arXiv preprint arXiv:14126980 Kingma DP, Ba J (2014) Adam: A method for stochastic optimization arXiv preprint arXiv:14126980
Zurück zum Zitat Li B, Peng X, Wang Z, Xu J, Feng D (2017) An all-in-one network for dehazing and beyond arXiv preprint arXiv:170706543 Li B, Peng X, Wang Z, Xu J, Feng D (2017) An all-in-one network for dehazing and beyond arXiv preprint arXiv:170706543
Zurück zum Zitat Li B, Ren W, Fu D, Tao D, Feng D, Zeng W, Wang Z (2018) Benchmarking single-image dehazing and beyond. IEEE Trans Image Process 28:492–505CrossRef Li B, Ren W, Fu D, Tao D, Feng D, Zeng W, Wang Z (2018) Benchmarking single-image dehazing and beyond. IEEE Trans Image Process 28:492–505CrossRef
Zurück zum Zitat Lim B, Son S, Kim H, Nah S, Mu Lee K (2017) Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 136–144 Lim B, Son S, Kim H, Nah S, Mu Lee K (2017) Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 136–144
Zurück zum Zitat Meng G, Wang Y, Duan J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization. In: Proceedings of the IEEE international conference on computer vision, pp 617–624 Meng G, Wang Y, Duan J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization. In: Proceedings of the IEEE international conference on computer vision, pp 617–624
Zurück zum Zitat Narasimhan SG, Nayar SK (2000) Chromatic framework for vision in bad weather. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No. PR00662), IEEE, pp 598–605 Narasimhan SG, Nayar SK (2000) Chromatic framework for vision in bad weather. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No. PR00662), IEEE, pp 598–605
Zurück zum Zitat Narasimhan SG, Nayar SK (2002) Vision and the atmosphere. Int J Comput Vis 48:233–254CrossRef Narasimhan SG, Nayar SK (2002) Vision and the atmosphere. Int J Comput Vis 48:233–254CrossRef
Zurück zum Zitat Paszke A, Gross S, Chinatala S, et al. (2017) Automatic differentiation in pytorch. In: 31st Conference on Neural Information Processing System, pp 1–4 Paszke A, Gross S, Chinatala S, et al. (2017) Automatic differentiation in pytorch. In: 31st Conference on Neural Information Processing System, pp 1–4
Zurück zum Zitat Paszke A et al (2019) Pytorch: an imperative style, high-performance deep learning library. In: Advances in neural information processing systems, pp 8026–8037 Paszke A et al (2019) Pytorch: an imperative style, high-performance deep learning library. In: Advances in neural information processing systems, pp 8026–8037
Zurück zum Zitat Qin X, Wang Z, Bai Y, Xie X, Jia H (2020) FFA-Net: feature fusion attention network for single image dehazing. In: AAAI, pp 11908–11915 Qin X, Wang Z, Bai Y, Xie X, Jia H (2020) FFA-Net: feature fusion attention network for single image dehazing. In: AAAI, pp 11908–11915
Zurück zum Zitat Ren W, Liu S, Zhang H, Pan J, Cao X, Yang M-H (2016) Single image dehazing via multi-scale convolutional neural networks. In: European conference on computer vision. Springer, pp 154–169 Ren W, Liu S, Zhang H, Pan J, Cao X, Yang M-H (2016) Single image dehazing via multi-scale convolutional neural networks. In: European conference on computer vision. Springer, pp 154–169
Zurück zum Zitat Ren W, Ma L, Zhang J, Pan J, Cao X, Liu W, Yang M-H (2018) Gated fusion network for single image dehazing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp 3253–3261 Ren W, Ma L, Zhang J, Pan J, Cao X, Liu W, Yang M-H (2018) Gated fusion network for single image dehazing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp 3253–3261
Zurück zum Zitat Vaswani A et al (2017) Attention is all you need. Adv Neural Inf Process Syst 30:5998–6008 Vaswani A et al (2017) Attention is all you need. Adv Neural Inf Process Syst 30:5998–6008
Zurück zum Zitat Zhang H, Goodfellow I, Metaxas D, Odena A (2019) Self-attention generative adversarial networks. In: International conference on machine learning. PMLR, pp 7354–7363 Zhang H, Goodfellow I, Metaxas D, Odena A (2019) Self-attention generative adversarial networks. In: International conference on machine learning. PMLR, pp 7354–7363
Zurück zum Zitat Zhang X-S, Gao S-B, Li C-Y, Li Y-J (2015) A retina inspired model for enhancing visibility of hazy images. Front Comput Neurosci 9:151 Zhang X-S, Gao S-B, Li C-Y, Li Y-J (2015) A retina inspired model for enhancing visibility of hazy images. Front Comput Neurosci 9:151
Zurück zum Zitat Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 286–301 Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 286–301
Zurück zum Zitat Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24:3522–3533CrossRef Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24:3522–3533CrossRef
Metadaten
Titel
Integrated image defogging network based on improved atmospheric scattering model and attention feature fusion
verfasst von
Shengmin He
Zhixiang Chen
Fengli Wang
Meiya Wang
Publikationsdatum
03.08.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
Earth Science Informatics / Ausgabe 4/2021
Print ISSN: 1865-0473
Elektronische ISSN: 1865-0481
DOI
https://doi.org/10.1007/s12145-021-00672-9

Weitere Artikel der Ausgabe 4/2021

Earth Science Informatics 4/2021 Zur Ausgabe

Premium Partner