Skip to main content
Top
Published in: Neural Computing and Applications 12/2023

16-08-2022 | S.I.: AI based Techniques and Applications for Intelligent IoT Systems

Air infrared small target local dehazing based on multiple-factor fusion cascade network

Authors: Xiaoli Gao, Peiren Tang, Qi Cheng, Jie Li

Published in: Neural Computing and Applications | Issue 12/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Infrared (IR) imaging, an import method of target monitoring, suffers great imaging quality degradation in poor weather conditions such as haze, fog, and smog. This will greatly affect the ability of detecting and identifying for targets with far distance. For visible-light imaging, an image processing technique named dehazing has been developed in the past several years. However, these dehazing methods for visible light can hardly be used to IR picture dehazing directly, due to the natural difference between IR and visible-light images. In this paper, an IR image dehazing algorithm based on multiple-factor fusion cascade network (MFFCN) is proposed, which includes multi-patch image encoder, multi-channel feature enhancement module and multi-level feature fusion module to directly remove the haze. Specifically, a multi-patch image encoder aggregating features from multiple patches of image to improve the response for different levels of haze in different regions and a multi-channel feature enhancement module can provide interactions of cross-feature and enrich the diversity of learned representations. A multi-level feature fusion module is integrated to calculate the importance weights of different network levels, and then, the calculated weights are utilized to fuse the corresponding feature. The experimental results showed that our MFFCN achieves the highest performance with both visual perception and evaluation metric, when compared with previous state-of-the-art methods. Particularly, for thick hazing scene, a greatly contrast enhancement for the local area around target has been achieved. In addition, the effectiveness for ground background image hazing and halation removing is demonstrated, which can also obtain superior performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Zhang Y, Wang X, Bi X et al (2018) A light dual-task neural network for haze removal. IEEE Signal Process Lett 25(8):1231–1235CrossRef Zhang Y, Wang X, Bi X et al (2018) A light dual-task neural network for haze removal. IEEE Signal Process Lett 25(8):1231–1235CrossRef
3.
go back to reference He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353 He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353
4.
go back to reference Fattal R (2014) Dehazing using color-lines. ACM Trans Graph (TOG) 34(1):1–14CrossRef Fattal R (2014) Dehazing using color-lines. ACM Trans Graph (TOG) 34(1):1–14CrossRef
5.
go back to reference Berman D, Avidan S et al (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1674–1682 Berman D, Avidan S et al (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1674–1682
6.
go back to reference Meng G, Wang Y, Duan,J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization. Proceedings of the IEEE international conference on computer vision pp. 617–624, IEEE Meng G, Wang Y, Duan,J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization. Proceedings of the IEEE international conference on computer vision pp. 617–624, IEEE
7.
go back to reference Pei SC, Lee TY (2012) Nighttime haze removal using color transfer preprocessing and dark channel prior. In: 2012 19th IEEE International conference on image processing, pp 957–960, IEEE Pei SC, Lee TY (2012) Nighttime haze removal using color transfer preprocessing and dark channel prior. In: 2012 19th IEEE International conference on image processing, pp 957–960, IEEE
8.
go back to reference Gated context aggregation network for image dehazing and deraining. In: 2019 IEEE winter conference on applications of computer vision (WACV), IEEE, pp 1375–1383 Gated context aggregation network for image dehazing and deraining. In: 2019 IEEE winter conference on applications of computer vision (WACV), IEEE, pp 1375–1383
9.
go back to reference Ancuti CO, Ancuti C (2013) Single image dehazing by multi-scale fusion. IEEE Trans Image Process 22(8):3271–3282CrossRef Ancuti CO, Ancuti C (2013) Single image dehazing by multi-scale fusion. IEEE Trans Image Process 22(8):3271–3282CrossRef
11.
go back to reference Li B, Peng X, Wang Z, Xu J, Feng D (2017) Aod-net: all-in-one dehazing network. In: Proceedings of the IEEE international conference on computer vision, pp 4770–4778 Li B, Peng X, Wang Z, Xu J, Feng D (2017) Aod-net: all-in-one dehazing network. In: Proceedings of the IEEE international conference on computer vision, pp 4770–4778
12.
go back to reference Song Y, Li J, Wang X et al (2017) Single image dehazing using ranking convolutional neural network. IEEE Trans Multimedia 20(6):1548–1560CrossRef Song Y, Li J, Wang X et al (2017) Single image dehazing using ranking convolutional neural network. IEEE Trans Multimedia 20(6):1548–1560CrossRef
13.
go back to reference Das SD, Dutta S (2020a) Fast deep multi-patch hierarchical network for nonhomogeneous image dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 482–483, IEEE Das SD, Dutta S (2020a) Fast deep multi-patch hierarchical network for nonhomogeneous image dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 482–483, IEEE
14.
go back to reference Zhang H, Wu C, Zhang Z, et al (2020) Resnest: Split-attention networks. arXiv preprint arXiv:200408955 Zhang H, Wu C, Zhang Z, et al (2020) Resnest: Split-attention networks. arXiv preprint arXiv:200408955
15.
go back to reference Xie B, Guo F, Cai Z (2010) Improved single image dehazing using dark channel prior and multi-scale retinex. In: 2010 international conference on intelligent system design and engineering application, IEEE, pp 848–851, IEEE Xie B, Guo F, Cai Z (2010) Improved single image dehazing using dark channel prior and multi-scale retinex. In: 2010 international conference on intelligent system design and engineering application, IEEE, pp 848–851, IEEE
17.
go back to reference Xu H, Guo J, Liu Q, et al (2012) Fast image dehazing using improved dark channel prior. In: 2012 IEEE international conference on information science and technology, pp 663–667, IEEE Xu H, Guo J, Liu Q, et al (2012) Fast image dehazing using improved dark channel prior. In: 2012 IEEE international conference on information science and technology, pp 663–667, IEEE
18.
go back to reference Liu X, Ma Y, Shi Z, et al (2019) Griddehazenet: Attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 7314–7323, IEEE Liu X, Ma Y, Shi Z, et al (2019) Griddehazenet: Attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 7314–7323, IEEE
19.
go back to reference Shao Y, Li L, Ren W, et al (2020) Domain adaptation for image dehazing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2808–2817 Shao Y, Li L, Ren W, et al (2020) Domain adaptation for image dehazing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2808–2817
20.
go back to reference Fan Q, Chen D, Yuan L et al (2019) A general decoupled learning framework for parameterized image operators. IEEE Trans Pattern Anal Mach Intell 43(1):33–47CrossRef Fan Q, Chen D, Yuan L et al (2019) A general decoupled learning framework for parameterized image operators. IEEE Trans Pattern Anal Mach Intell 43(1):33–47CrossRef
21.
go back to reference Fan Q, Chen D, Yuan L, et al (2017) A generic deep architecture for single image reflection removal and image smoothing. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 3258–3267 Fan Q, Chen D, Yuan L, et al (2017) A generic deep architecture for single image reflection removal and image smoothing. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 3258–3267
22.
go back to reference Das SD, Dutta S (2020a) Fast deep multi-patch hierarchical network for nonhomogeneous image dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 482–483 Das SD, Dutta S (2020a) Fast deep multi-patch hierarchical network for nonhomogeneous image dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 482–483
23.
go back to reference Zhang H, Patel VM (2018) Densely connected pyramid dehazing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3194–3203 Zhang H, Patel VM (2018) Densely connected pyramid dehazing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3194–3203
24.
go back to reference Yu F, Koltun V (2015) Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:151107122 Yu F, Koltun V (2015) Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:151107122
26.
go back to reference Ulyanov D, Vedaldi A, Lempitsky V (2016) Instance normalization: The missing ingredient for fast stylization. arXiv preprint arXiv:160708022 Ulyanov D, Vedaldi A, Lempitsky V (2016) Instance normalization: The missing ingredient for fast stylization. arXiv preprint arXiv:160708022
27.
go back to reference Li B, Ren W, Fu D, et al (2017b) Reside: a benchmark for single image dehazing. arXiv preprint arXiv:171204143 1 Li B, Ren W, Fu D, et al (2017b) Reside: a benchmark for single image dehazing. arXiv preprint arXiv:171204143 1
28.
go back to reference Deperlioglu O, Kose U (2015) Underwater image enhancement with dark channel prior based image dehazing and histogram equalization. arXiv preprint arXiv:171204143 Deperlioglu O, Kose U (2015) Underwater image enhancement with dark channel prior based image dehazing and histogram equalization. arXiv preprint arXiv:171204143
29.
go back to reference Nawaz, M., Raja, G., Qasim, M. (2021). A new approach for dehazing and enhancement of infrared images. In: 2021 international Bhurban conference on applied sciences and technologies (ibcast), pp 545–551 Nawaz, M., Raja, G., Qasim, M. (2021). A new approach for dehazing and enhancement of infrared images. In: 2021 international Bhurban conference on applied sciences and technologies (ibcast), pp 545–551
Metadata
Title
Air infrared small target local dehazing based on multiple-factor fusion cascade network
Authors
Xiaoli Gao
Peiren Tang
Qi Cheng
Jie Li
Publication date
16-08-2022
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 12/2023
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-022-07553-2

Other articles of this Issue 12/2023

Neural Computing and Applications 12/2023 Go to the issue

S.I.: AI based Techniques and Applications for Intelligent IoT Systems

Arbitrary surface data patching method based on geometric convolutional neural network

S.I.: AI based Techniques and Applications for Intelligent IoT Systems

Multimodal deep collaborative filtering recommendation based on dual attention

S.I.: AI based Techniques and Applications for Intelligent IoT Systems

Research on personalized learning path planning model based on knowledge network

Premium Partner