Skip to main content
Top
Published in: Multimedia Systems 3/2019

29-08-2018 | Regular Paper

Moving object detection using edges of residuals under varying illuminations

Author: Wonjun Kim

Published in: Multimedia Systems | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a new method for moving object detection under varying illuminations. The key idea of the proposed method is to reconstruct moving objects from edges computed on the result of frame differencing, the so-called edges of residuals. This scheme forces lighting variations to be efficiently suppressed in the gradient space while preserving the boundary of moving objects. The inner areas of moving objects are subsequently reconstructed by utilizing image gradients of the original frame, which are masked by edges of residuals, in a least-square sense. One important advantage of the proposed method is to uniformly highlight moving objects regardless of their scales. Experimental results on various databases demonstrate that the proposed method is effective for moving object detection under diverse lighting conditions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Wang, K., Liu, Y., Guo, C., Wang, F.-Y.: A multi-view learning approach to foreground detection for traffic surveillance applications. IEEE Trans. Veh. Technol. 65(6), 4144–4158 (2016)CrossRef Wang, K., Liu, Y., Guo, C., Wang, F.-Y.: A multi-view learning approach to foreground detection for traffic surveillance applications. IEEE Trans. Veh. Technol. 65(6), 4144–4158 (2016)CrossRef
2.
go back to reference Tian, Y., Wang, Y., Hu, Z., Huang, T.: Selective eigenbackground for background modeling and subtraction in crowded scenes. IEEE Trans. Circuits Syst. Video Technol. 23(11), 1849–1864 (2013)CrossRef Tian, Y., Wang, Y., Hu, Z., Huang, T.: Selective eigenbackground for background modeling and subtraction in crowded scenes. IEEE Trans. Circuits Syst. Video Technol. 23(11), 1849–1864 (2013)CrossRef
3.
go back to reference Baysal, S., Duygulu, P.: Directional coherence-based spatiotemporal descriptor for object detection in static and dynamic scenes. IEEE Trans. Circuits Syst. Video Technol. 26(7), 1350–1362 (2016)CrossRef Baysal, S., Duygulu, P.: Directional coherence-based spatiotemporal descriptor for object detection in static and dynamic scenes. IEEE Trans. Circuits Syst. Video Technol. 26(7), 1350–1362 (2016)CrossRef
4.
go back to reference Tian, Y., Cao, L., Liu, Z., Zhang, Z.: Hierarchical filtered motion for action recognition in crowded videos. IEEE Trans. Syst. Man Cybern.-Part C Appl. Rev 42(3), 313–323 (2012)CrossRef Tian, Y., Cao, L., Liu, Z., Zhang, Z.: Hierarchical filtered motion for action recognition in crowded videos. IEEE Trans. Syst. Man Cybern.-Part C Appl. Rev 42(3), 313–323 (2012)CrossRef
5.
go back to reference Zhang, T., Wiliem, A., Hemson, G., Lovell, B.C.: Detecting kangaroos in the wild: the first step towards automated animal surveillance. In: Proc. IEEE Int. Conf. Acoust., Speech Signal Process, pp. 1961–1965, (2018) Zhang, T., Wiliem, A., Hemson, G., Lovell, B.C.: Detecting kangaroos in the wild: the first step towards automated animal surveillance. In: Proc. IEEE Int. Conf. Acoust., Speech Signal Process, pp. 1961–1965, (2018)
6.
go back to reference Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2, 246–252 (1999) Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2, 246–252 (1999)
7.
go back to reference Zivkovic, Z.: Improved adaptive Gaussian mixture model for background subtraction. In: Proc. 17th Int. Conf. Pattern Recognit. (ICPR), vol. 2. pp. 28–31, (2004) Zivkovic, Z.: Improved adaptive Gaussian mixture model for background subtraction. In: Proc. 17th Int. Conf. Pattern Recognit. (ICPR), vol. 2. pp. 28–31, (2004)
8.
go back to reference White, B., Shah, M.: Automatically tuning background subtraction parameters using particle swarm optimization. In: Proc. IEEE Conf. Multimedia Expo (ICME), pp. 1826–1829, (2007) White, B., Shah, M.: Automatically tuning background subtraction parameters using particle swarm optimization. In: Proc. IEEE Conf. Multimedia Expo (ICME), pp. 1826–1829, (2007)
9.
go back to reference Haines, T.S.F., Xiang, T.: Background subtraction with Dirichlet process mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 36(4), 670–683 (2014)CrossRef Haines, T.S.F., Xiang, T.: Background subtraction with Dirichlet process mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 36(4), 670–683 (2014)CrossRef
10.
go back to reference Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Real-time foreground–background segmentation using codebook model. Real-Time Imaging 11(3), 172–185 (2005)CrossRef Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Real-time foreground–background segmentation using codebook model. Real-Time Imaging 11(3), 172–185 (2005)CrossRef
11.
go back to reference Guo, J.-M., Lium, Y.-F., Hsia, C.-H., Hsu, C.-S.: Hierarchical method for foreground detection using codebook model. IEEE Trans. Circuits Syst. Video Technol. 21(6), 804–815 (2011)CrossRef Guo, J.-M., Lium, Y.-F., Hsia, C.-H., Hsu, C.-S.: Hierarchical method for foreground detection using codebook model. IEEE Trans. Circuits Syst. Video Technol. 21(6), 804–815 (2011)CrossRef
12.
go back to reference Zeng, Z., Jia, J., Zhu, Z., Yu, D.: Adaptive maintenance scheme for codebook-based dynamic background subtraction. Comput. Vis. Image Underst. 152, 58–66 (2016)CrossRef Zeng, Z., Jia, J., Zhu, Z., Yu, D.: Adaptive maintenance scheme for codebook-based dynamic background subtraction. Comput. Vis. Image Underst. 152, 58–66 (2016)CrossRef
13.
go back to reference Barnich, O., Droogenbroeck, M.V.: ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process. 20(6), 1709–1724 (2011)MathSciNetCrossRefMATH Barnich, O., Droogenbroeck, M.V.: ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process. 20(6), 1709–1724 (2011)MathSciNetCrossRefMATH
14.
go back to reference St-Charles, P.L., Bilodeau, G.A., Bergevin, R.: SuBSENSE: a universal change detection method with local adaptive sensitivity. IEEE Trans. Image Process. 24(1), 359–373 (2015)MathSciNetCrossRefMATH St-Charles, P.L., Bilodeau, G.A., Bergevin, R.: SuBSENSE: a universal change detection method with local adaptive sensitivity. IEEE Trans. Image Process. 24(1), 359–373 (2015)MathSciNetCrossRefMATH
15.
go back to reference Maddalena, L., Petrosino, A.: The SOBS algorithm: what are the limits ? In: Proc. IEEE Comput. Vis. Pattern Recognit. Workshop (CVPRW), pp. 21–26 (2012) Maddalena, L., Petrosino, A.: The SOBS algorithm: what are the limits ? In: Proc. IEEE Comput. Vis. Pattern Recognit. Workshop (CVPRW), pp. 21–26 (2012)
16.
go back to reference Zhou, X., Yang, C., Yu, W.: Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35(3), 597–610 (2013)CrossRef Zhou, X., Yang, C., Yu, W.: Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35(3), 597–610 (2013)CrossRef
17.
go back to reference Sobral, A., Javed, S., Jung, S. K., Bouwmans, T., Zahzah, E. H.: Online stochastic tensor decomposition for background subtraction in multispectral video sequences. In: Proc. IEEE Int. Conf. Comput. Vis. Workshop (ICCVW), pp. 946–953 (2015) Sobral, A., Javed, S., Jung, S. K., Bouwmans, T., Zahzah, E. H.: Online stochastic tensor decomposition for background subtraction in multispectral video sequences. In: Proc. IEEE Int. Conf. Comput. Vis. Workshop (ICCVW), pp. 946–953 (2015)
18.
go back to reference Li, L., Wang, P., Hu, Q., Cai, S.: Efficient background modeling based on sparse representation and outlier iterative removal. IEEE Trans. Circuits Syst, Video Technol. 26(2), 278–289 (2016)CrossRef Li, L., Wang, P., Hu, Q., Cai, S.: Efficient background modeling based on sparse representation and outlier iterative removal. IEEE Trans. Circuits Syst, Video Technol. 26(2), 278–289 (2016)CrossRef
19.
go back to reference Hu, W., Li, X., Zhang, X., Shi, X., Maybank, S., Zhang, Z.: Incremental tensor subspace learning and its applications to foreground segmentation and tracking. Int. J. Comput. Vis. 91(3), 303–327 (2011)CrossRefMATH Hu, W., Li, X., Zhang, X., Shi, X., Maybank, S., Zhang, Z.: Incremental tensor subspace learning and its applications to foreground segmentation and tracking. Int. J. Comput. Vis. 91(3), 303–327 (2011)CrossRefMATH
20.
go back to reference Cao, W., Wang, Y., Sun, J., Meng, D., Yang, C., Cichocki, A., Xu, Z.: Total variation regularized tensor RPCA for background subtraction from compressive measurements. IEEE Trans. Image Process. 25(9), 4075–4090 (2016)MathSciNetCrossRefMATH Cao, W., Wang, Y., Sun, J., Meng, D., Yang, C., Cichocki, A., Xu, Z.: Total variation regularized tensor RPCA for background subtraction from compressive measurements. IEEE Trans. Image Process. 25(9), 4075–4090 (2016)MathSciNetCrossRefMATH
21.
go back to reference Horn, B.K.P.: Determining lightness from an image. Comput. Gr. Image Process. 3, 277–299 (1974)CrossRef Horn, B.K.P.: Determining lightness from an image. Comput. Gr. Image Process. 3, 277–299 (1974)CrossRef
22.
go back to reference Kim, C., Hwang, J.-N.: Object-based video abstraction for video surveillance systems. IEEE Trans. Circuits Syst. Video Technol. 12(12), 1128–1138 (2002)CrossRef Kim, C., Hwang, J.-N.: Object-based video abstraction for video surveillance systems. IEEE Trans. Circuits Syst. Video Technol. 12(12), 1128–1138 (2002)CrossRef
23.
go back to reference He, K., Sun, J., Tang, X.: Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1397–1409 (2013)CrossRef He, K., Sun, J., Tang, X.: Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1397–1409 (2013)CrossRef
24.
go back to reference Canny, J.F.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 6, 679–698 (1986)CrossRef Canny, J.F.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 6, 679–698 (1986)CrossRef
25.
go back to reference Tumblin, J., Agrawal, A., Raskar, R.: why I want a gradient camera ? In: Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), pp. 103–110 (2005) Tumblin, J., Agrawal, A., Raskar, R.: why I want a gradient camera ? In: Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), pp. 103–110 (2005)
26.
go back to reference Agrawal, A., Chellappa, R., Raskar, R.: An algebraic approach to surface reconstruction from gradient fields. In: Proc. IEEE Int. Conf. Comput. Vis. (ICCV), pp. 174–181 (2005) Agrawal, A., Chellappa, R., Raskar, R.: An algebraic approach to surface reconstruction from gradient fields. In: Proc. IEEE Int. Conf. Comput. Vis. (ICCV), pp. 174–181 (2005)
28.
go back to reference Davis, J., Sharma, V.: Background subtraction using contour based fusion of thermal and visible imagery. Comput. Vis. Image Underst. 106(2), 162–182 (2007)CrossRef Davis, J., Sharma, V.: Background subtraction using contour based fusion of thermal and visible imagery. Comput. Vis. Image Underst. 106(2), 162–182 (2007)CrossRef
29.
go back to reference Agarwal, S., Awan, A., Roth, D.: Learning to detect objects in images via a sparse, part-based representation. IEEE Trans. Pattern Anal. Mach. Intell. 26(11), 1475–1490 (2004)CrossRef Agarwal, S., Awan, A., Roth, D.: Learning to detect objects in images via a sparse, part-based representation. IEEE Trans. Pattern Anal. Mach. Intell. 26(11), 1475–1490 (2004)CrossRef
30.
go back to reference Cheng, L., Gong, M., Schuurmans, D., Caelli, T.: Real-time discriminative background subtraction. IEEE Trans. Image Process. 20(5), 1401–1414 (2011)MathSciNetCrossRefMATH Cheng, L., Gong, M., Schuurmans, D., Caelli, T.: Real-time discriminative background subtraction. IEEE Trans. Image Process. 20(5), 1401–1414 (2011)MathSciNetCrossRefMATH
31.
go back to reference Kim, W., Kim, Y.: Background subtraction using illumination-invariant structural complexity. IEEE Signal Process. Lett. 23(5), 634–638 (2016)CrossRef Kim, W., Kim, Y.: Background subtraction using illumination-invariant structural complexity. IEEE Signal Process. Lett. 23(5), 634–638 (2016)CrossRef
32.
go back to reference Lim, L. A., Keles, H.Y.: Foreground segmentation using a triplet convolutional neural network for multiscale feature encoding. arXiv:1801.02225, (2018) Lim, L. A., Keles, H.Y.: Foreground segmentation using a triplet convolutional neural network for multiscale feature encoding. arXiv:​1801.​02225, (2018)
33.
go back to reference Wang, Y., Jodoin, P.-M., Porikli, F., Konrad, J., Benezeth, Y., Ishwar, P.: CDnet 2014: an expanded change detection benchmark dataset. In: Proc. IEEE Comput. Vis. Pattern Recognit. Workshops (CVPRW), pp. 387–394 (2014) Wang, Y., Jodoin, P.-M., Porikli, F., Konrad, J., Benezeth, Y., Ishwar, P.: CDnet 2014: an expanded change detection benchmark dataset. In: Proc. IEEE Comput. Vis. Pattern Recognit. Workshops (CVPRW), pp. 387–394 (2014)
34.
go back to reference Ho, J., Lim, J., Yang, M-H., Kriegman, D.: “Integrating surface normal vectors using fast marching method. In: Proc. Eur. Conf. Comput. Vis. (ECCV), pp. 387–394 (2006) Ho, J., Lim, J., Yang, M-H., Kriegman, D.: “Integrating surface normal vectors using fast marching method. In: Proc. Eur. Conf. Comput. Vis. (ECCV), pp. 387–394 (2006)
35.
go back to reference Bhat, P., Curless, B., Cohen, M., Zitnick, C. L.: Fourier analysis of the 2D screened Poisson equation for gradient domain problems. In: Proc. Eur. Conf. Comput. Vis. (ECCV). pp. 114–128, (2008) Bhat, P., Curless, B., Cohen, M., Zitnick, C. L.: Fourier analysis of the 2D screened Poisson equation for gradient domain problems. In: Proc. Eur. Conf. Comput. Vis. (ECCV). pp. 114–128, (2008)
Metadata
Title
Moving object detection using edges of residuals under varying illuminations
Author
Wonjun Kim
Publication date
29-08-2018
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 3/2019
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-018-0593-x

Other articles of this Issue 3/2019

Multimedia Systems 3/2019 Go to the issue