Skip to main content
Top
Published in: Evolutionary Intelligence 3/2019

16-11-2018 | Special Issue

Removal of rain video based on temporal intensity and chromatic constraint of raindrops

Authors: Jingfeng Zang, Guibin Ren, Jianning Dong, Yan Piao, Seio Jim

Published in: Evolutionary Intelligence | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

An improved algorithm of frame time difference is proposed and applied to raindrops removal of video image.This paper analyzes the temporal intensity waveform and chromatic constraint properties of raindrops, and the method is optimized by these two properties. We make use of the difference between rain and non-rain moving objects in the pixels’ intensity changes, which realized a broad classification between the rain and non-rain moving object pixel. The candidate raindrops pixels are optimized in combination with the chromatic constraint property. The experimental results show that the proposed algorithm has a better effect of rainy day in video image restoration than Garg’s, and it is simple and effective. The algorithm has a strong applicability, and it can be further used for many applications, such as air pollution control, management, outdoor surveillance, remote sensing and intelligent vehicles.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33(5):898–916CrossRef Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33(5):898–916CrossRef
3.
go back to reference Garg K, Nayar SK (2004) Detection and removal of rain from videos. IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:528–535 Garg K, Nayar SK (2004) Detection and removal of rain from videos. IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:528–535
4.
go back to reference Tripathi AK, Mukhopadhyay S (2012) A probabilistic approach for detection and removal of rain from videos. IETE J Res 57:82–91CrossRef Tripathi AK, Mukhopadhyay S (2012) A probabilistic approach for detection and removal of rain from videos. IETE J Res 57:82–91CrossRef
5.
go back to reference Tripathi AK, Mukhopadhyay S (2014) Removal of rain from videos: a review. Signal Image Video Process 8(8):1421–1430CrossRef Tripathi AK, Mukhopadhyay S (2014) Removal of rain from videos: a review. Signal Image Video Process 8(8):1421–1430CrossRef
7.
go back to reference Xu G, Xu J, Wang B et al (2014) Removal of rain in video based on motion and shape characteristics of raindrops. Int J Light Electron Opt 125(15):1–5 Xu G, Xu J, Wang B et al (2014) Removal of rain in video based on motion and shape characteristics of raindrops. Int J Light Electron Opt 125(15):1–5
8.
go back to reference Kim HG, Seo SJ, Song BC (2015) Multi-frame de-raining algorithm using a motion-compensated non-local mean filter for rainy video sequences. J Vis Commun Image Represent 26:317–328CrossRef Kim HG, Seo SJ, Song BC (2015) Multi-frame de-raining algorithm using a motion-compensated non-local mean filter for rainy video sequences. J Vis Commun Image Represent 26:317–328CrossRef
9.
go back to reference Bossu J, Hautire N, Tarel JP (2011) Rain or snow detection in image sequences through use of a histogram of orientation of streaks. Int J Comput Vis 93(3):348–367CrossRef Bossu J, Hautire N, Tarel JP (2011) Rain or snow detection in image sequences through use of a histogram of orientation of streaks. Int J Comput Vis 93(3):348–367CrossRef
10.
go back to reference Malekshahi G, Ebahimnezhad H (2014) Detection and removal of rain from video using predominant direction of Gabor filters. J Inf Syst Telecommun 3(1):42–49 Malekshahi G, Ebahimnezhad H (2014) Detection and removal of rain from video using predominant direction of Gabor filters. J Inf Syst Telecommun 3(1):42–49
11.
go back to reference Liu C, Pang Y, Wang J, Yang A, Pan J (2014) Frequency domain directional filtering based rain streaks removal from a single color image. In: Huang DS, Bevilacqua V, Premaratne P (eds) International conference on intelligent computing, ICIC 2014. Lecture notes in computer science, vol 8588. Springer, Cham, pp 415–424 Liu C, Pang Y, Wang J, Yang A, Pan J (2014) Frequency domain directional filtering based rain streaks removal from a single color image. In: Huang DS, Bevilacqua V, Premaratne P (eds) International conference on intelligent computing, ICIC 2014. Lecture notes in computer science, vol 8588. Springer, Cham, pp 415–424
12.
go back to reference Chen D-Y, Chen C, Kang L-W (2014) Visual depth guided color image rain streaks removal using sparse coding. IEEE Trans Circuits Syst Video Technol 24(8):1430–1455CrossRef Chen D-Y, Chen C, Kang L-W (2014) Visual depth guided color image rain streaks removal using sparse coding. IEEE Trans Circuits Syst Video Technol 24(8):1430–1455CrossRef
14.
go back to reference Kang LW, Lin CW, Fu YH (2012) Automatic single-image-based rain streaks removal via image decomposition. IEEE Trans Image Process 21(4):1742–1755MathSciNetCrossRefMATH Kang LW, Lin CW, Fu YH (2012) Automatic single-image-based rain streaks removal via image decomposition. IEEE Trans Image Process 21(4):1742–1755MathSciNetCrossRefMATH
15.
go back to reference Santhaseelan V, Asari VK (2015) Utilizing local phase information to remove rain from video. Int J Comput Vis 112(1):71–89CrossRef Santhaseelan V, Asari VK (2015) Utilizing local phase information to remove rain from video. Int J Comput Vis 112(1):71–89CrossRef
16.
go back to reference Kim J-H, Sim J-Y, Kim C-S (2015) Video deraining and desnowing using temporal correlation and low-rank matrix completion. IEEE Trans Image Process 24(9):2658–2670MathSciNetCrossRefMATH Kim J-H, Sim J-Y, Kim C-S (2015) Video deraining and desnowing using temporal correlation and low-rank matrix completion. IEEE Trans Image Process 24(9):2658–2670MathSciNetCrossRefMATH
18.
go back to reference Fu X, Huang J, Ding X et al (2017) Clearing the skies: a deep network architecture for single-image rain removal. IEEE Trans Image Process 26(6):2944–2956MathSciNetCrossRefMATH Fu X, Huang J, Ding X et al (2017) Clearing the skies: a deep network architecture for single-image rain removal. IEEE Trans Image Process 26(6):2944–2956MathSciNetCrossRefMATH
19.
go back to reference Nasreen S (2014) Detection and removal of rain in videos using modern approach. Int J Eng Res 3(2):60–63 Nasreen S (2014) Detection and removal of rain in videos using modern approach. Int J Eng Res 3(2):60–63
20.
go back to reference Kim J, Lee JK, Lee KM (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of IEEE international conference on computer vision and pattern recognition (CVPR), pp 1646–1654 Kim J, Lee JK, Lee KM (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of IEEE international conference on computer vision and pattern recognition (CVPR), pp 1646–1654
21.
go back to reference Ren W, Liu S, Zhang H, Pan J, Cao X, Yang MH (2016) Single image dehazing via multi-scale convolutional neural networks. In: Leibe B, Matas J, Sebe N, Welling M (eds) European conference on computer vision—ECCV 2016, Lecture notes in computer science, vol 9906. Springer, Cham, pp 154–169CrossRef Ren W, Liu S, Zhang H, Pan J, Cao X, Yang MH (2016) Single image dehazing via multi-scale convolutional neural networks. In: Leibe B, Matas J, Sebe N, Welling M (eds) European conference on computer vision—ECCV 2016, Lecture notes in computer science, vol 9906. Springer, Cham, pp 154–169CrossRef
22.
go back to reference Huang D-A, Kang L-W, Wang Y-CF, Lin C-W (2014) Self-learning based image decomposition with applications to single image denoising. IEEE Trans Multimedia 16(1):83–93CrossRef Huang D-A, Kang L-W, Wang Y-CF, Lin C-W (2014) Self-learning based image decomposition with applications to single image denoising. IEEE Trans Multimedia 16(1):83–93CrossRef
23.
24.
go back to reference You S, Tan RT, Kawakami R et al (2016) Adherent raindrop modeling, detectionand removal in video. IEEE Trans Pattern Anal Mach Intell 38(9):1721–1733CrossRef You S, Tan RT, Kawakami R et al (2016) Adherent raindrop modeling, detectionand removal in video. IEEE Trans Pattern Anal Mach Intell 38(9):1721–1733CrossRef
25.
go back to reference Barnum PC, Narasimhan S, Kanade T (2010) Analysis of rain and snow in frequency space. Int J Comput Vis 86(2–3):256–274CrossRef Barnum PC, Narasimhan S, Kanade T (2010) Analysis of rain and snow in frequency space. Int J Comput Vis 86(2–3):256–274CrossRef
27.
go back to reference Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRef Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRef
29.
go back to reference Dong A, Loy CC, He K, Tang X (2016) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307CrossRef Dong A, Loy CC, He K, Tang X (2016) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307CrossRef
Metadata
Title
Removal of rain video based on temporal intensity and chromatic constraint of raindrops
Authors
Jingfeng Zang
Guibin Ren
Jianning Dong
Yan Piao
Seio Jim
Publication date
16-11-2018
Publisher
Springer Berlin Heidelberg
Published in
Evolutionary Intelligence / Issue 3/2019
Print ISSN: 1864-5909
Electronic ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-018-0185-x

Other articles of this Issue 3/2019

Evolutionary Intelligence 3/2019 Go to the issue

Premium Partner