Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2017

06.07.2016 | Original Article

Background subtraction based on modified online robust principal component analysis

verfasst von: Guang Han, Jinkuan Wang, Xi Cai

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In video surveillance, camera jitter occurs frequently and poses a great challenge to foreground detection. To overcome this challenge without any additional anti-jitter preprocessing, we propose a background subtraction method based on modified online robust principal component analysis (ORPCA). We modify the original ORPCA algorithm by introducing a prior-information-based adaptive weighting parameter to make our method adapt to variation of sparsity of foreground objects among frames, which can substantially improve the accuracy of foreground detection. In detail, we utilize sparsity of our foreground detection result of the last frame as the prior information, and adaptively adjust the weighting parameter of the sparse term for the current frame. Moreover, to make the modified ORPCA applicable to foreground detection, we also reduce the dimension of input frames through representing unoverlapped blocks by their median values. Different from recent advanced methods that rely on pixel-based background models, our method utilizes the low-dimensional subspace constructed by backgrounds of previous frames to estimate background of a new input frame, and hence can well handle the camera jitter. Experimental results demonstrate that, our method achieves remarkable results and outperforms several advanced methods in coping with the camera jitter.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Li L, Huang W, Gu I, Tian Q (2004) Statistical modeling of complex backgrounds for foreground object detection. IEEE T Image Process 13(11):1459–1472CrossRef Li L, Huang W, Gu I, Tian Q (2004) Statistical modeling of complex backgrounds for foreground object detection. IEEE T Image Process 13(11):1459–1472CrossRef
2.
Zurück zum Zitat Tavakkoli A, Nicolescu M, Bebis G, Nicolescu M (2009) Non-parametric statistical background modeling for efficient foreground region detection. Mach Vis Appl 20(6):395–409CrossRef Tavakkoli A, Nicolescu M, Bebis G, Nicolescu M (2009) Non-parametric statistical background modeling for efficient foreground region detection. Mach Vis Appl 20(6):395–409CrossRef
3.
Zurück zum Zitat Bhaskar H, Mihaylova L, Achim A (2010) Video foreground detection based on symmetric alpha-stable mixture models. IEEE T Circ Syst Vid 20(8):1133–1138CrossRef Bhaskar H, Mihaylova L, Achim A (2010) Video foreground detection based on symmetric alpha-stable mixture models. IEEE T Circ Syst Vid 20(8):1133–1138CrossRef
4.
Zurück zum Zitat Guo JM, Liu YF, Hsia CH, Shih MH, Hsu CS (2011) Hierarchical method for foreground detection using codebook model. IEEE T Circ Syst Vid 21(6):804–815CrossRef Guo JM, Liu YF, Hsia CH, Shih MH, Hsu CS (2011) Hierarchical method for foreground detection using codebook model. IEEE T Circ Syst Vid 21(6):804–815CrossRef
5.
Zurück zum Zitat Liu Z, Huang K, Tan T (2012) Foreground object detection using top-down information based on EM framework. IEEE T Image Process 21(9):4204–4217CrossRefMathSciNetMATH Liu Z, Huang K, Tan T (2012) Foreground object detection using top-down information based on EM framework. IEEE T Image Process 21(9):4204–4217CrossRefMathSciNetMATH
6.
Zurück zum Zitat Li D, Xu L, Goodman ED (2013) Illumination-robust foreground detection in a video surveillance system. IEEE T Circ Syst Vid 23(10):1637–1650CrossRef Li D, Xu L, Goodman ED (2013) Illumination-robust foreground detection in a video surveillance system. IEEE T Circ Syst Vid 23(10):1637–1650CrossRef
7.
Zurück zum Zitat López-Rubio FJ, López-Rubio E (2015) Features for stochastic approximation based foreground detection. Comput Vis Image Underst 133:30–50CrossRef López-Rubio FJ, López-Rubio E (2015) Features for stochastic approximation based foreground detection. Comput Vis Image Underst 133:30–50CrossRef
8.
Zurück zum Zitat Zhou X, Yang C, Yu W (2013) Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE T Pattern Anal 35(3):597–610CrossRef Zhou X, Yang C, Yu W (2013) Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE T Pattern Anal 35(3):597–610CrossRef
9.
Zurück zum Zitat Haritaoglu I, Harwood D, Davis LS (2000) W4: real-time surveillance of people and their activities. IEEE T Pattern Anal 22(8):809–830CrossRef Haritaoglu I, Harwood D, Davis LS (2000) W4: real-time surveillance of people and their activities. IEEE T Pattern Anal 22(8):809–830CrossRef
10.
Zurück zum Zitat Tian Y, Brown L, Hampapur A, Lu M, Senior A, Shu C (2008) IBM smart surveillance system (S3): event based video surveillance system with an open and extensible framework. Mach Vis Appl 19(5–6):315–327CrossRef Tian Y, Brown L, Hampapur A, Lu M, Senior A, Shu C (2008) IBM smart surveillance system (S3): event based video surveillance system with an open and extensible framework. Mach Vis Appl 19(5–6):315–327CrossRef
11.
Zurück zum Zitat Bulan O, Loce RP, Wu W, Wang Y, Bernal EA, Fan Z (2013) Video-based real-time on-street parking occupancy detection system. J Electron Imaging 22(4):041109CrossRef Bulan O, Loce RP, Wu W, Wang Y, Bernal EA, Fan Z (2013) Video-based real-time on-street parking occupancy detection system. J Electron Imaging 22(4):041109CrossRef
12.
Zurück zum Zitat Loce RP, Bernal EA, Wu W, Bala R (2013) Computer vision in roadway transportation systems: a survey. J Electron Imaging 22(4):041121CrossRef Loce RP, Bernal EA, Wu W, Bala R (2013) Computer vision in roadway transportation systems: a survey. J Electron Imaging 22(4):041121CrossRef
13.
Zurück zum Zitat Rautaray SS, Agrawal A (2012) Vision based hand gesture recognition for human computer interaction: a survey. Artif Intell Rev 43(1):1–54CrossRef Rautaray SS, Agrawal A (2012) Vision based hand gesture recognition for human computer interaction: a survey. Artif Intell Rev 43(1):1–54CrossRef
14.
Zurück zum Zitat Sobral A, Vacavant A (2014) A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. Comput Vis Image Underst 122:4–21CrossRef Sobral A, Vacavant A (2014) A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. Comput Vis Image Underst 122:4–21CrossRef
15.
Zurück zum Zitat Bouwmans T (2014) Traditional and recent approaches in background modeling for foreground detection: an overview. Comput Sci Rev 11–12:31–66CrossRefMATH Bouwmans T (2014) Traditional and recent approaches in background modeling for foreground detection: an overview. Comput Sci Rev 11–12:31–66CrossRefMATH
16.
Zurück zum Zitat Bouwmans T, Zahzah EH (2014) Robust PCA via principal component pursuit: a review for a comparative evaluation in video surveillance. Comput Vis Image Underst 122:22–34CrossRef Bouwmans T, Zahzah EH (2014) Robust PCA via principal component pursuit: a review for a comparative evaluation in video surveillance. Comput Vis Image Underst 122:22–34CrossRef
17.
Zurück zum Zitat Han G, Wang J, Cai X (2014) Improved visual background extractor using an adaptive distance threshold. J Electron Imaging 23(6):063005CrossRef Han G, Wang J, Cai X (2014) Improved visual background extractor using an adaptive distance threshold. J Electron Imaging 23(6):063005CrossRef
18.
Zurück zum Zitat Han G, Wang J, Cai X (2016) Background subtraction based on three-dimensional discrete wavelet transform. Sensors Basel 16(4):456CrossRef Han G, Wang J, Cai X (2016) Background subtraction based on three-dimensional discrete wavelet transform. Sensors Basel 16(4):456CrossRef
19.
Zurück zum Zitat Goyette N, Jodoin PM, Porikli F, Konrad J, Ishwar P (2012) Changedetection.net: a new change detection benchmark dataset. In: Proc CVPRW IEEE. IEEE, Piscataway, pp 1–8 Goyette N, Jodoin PM, Porikli F, Konrad J, Ishwar P (2012) Changedetection.net: a new change detection benchmark dataset. In: Proc CVPRW IEEE. IEEE, Piscataway, pp 1–8
20.
Zurück zum Zitat Stauffer C, Grimson WEL (2000) Learning patterns of activity using real-time tracking. IEEE T Pattern Anal 22(8):747–757CrossRef Stauffer C, Grimson WEL (2000) Learning patterns of activity using real-time tracking. IEEE T Pattern Anal 22(8):747–757CrossRef
21.
Zurück zum Zitat Elgammal A, Duraiswami R, Harwood D, Davis LS (2002) Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. P IEEE 90(7):1151–1163CrossRef Elgammal A, Duraiswami R, Harwood D, Davis LS (2002) Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. P IEEE 90(7):1151–1163CrossRef
22.
Zurück zum Zitat Hofmann M, Tiefenbacher P, Rigoll G (2012) Background segmentation with feedback: the pixel-based adaptive segmenter. Proc CVPRW IEEE. IEEE, Piscataway, pp 38–43 Hofmann M, Tiefenbacher P, Rigoll G (2012) Background segmentation with feedback: the pixel-based adaptive segmenter. Proc CVPRW IEEE. IEEE, Piscataway, pp 38–43
23.
Zurück zum Zitat Van Droogenbroeck M, Paquot O (2012) Background subtraction: experiments and improvements for ViBe. Proc CVPRW IEEE. IEEE, Piscataway, pp 32–37 Van Droogenbroeck M, Paquot O (2012) Background subtraction: experiments and improvements for ViBe. Proc CVPRW IEEE. IEEE, Piscataway, pp 32–37
24.
Zurück zum Zitat Wang Y, Jodoin PM, Porikli F, Konrad J, Benezeth Y, Ishwar P (2014) CDnet 2014: an expanded change detection benchmark dataset. Proc CVPRW IEEE. IEEE Computer Society, Los Alamitos, pp 393–400 Wang Y, Jodoin PM, Porikli F, Konrad J, Benezeth Y, Ishwar P (2014) CDnet 2014: an expanded change detection benchmark dataset. Proc CVPRW IEEE. IEEE Computer Society, Los Alamitos, pp 393–400
25.
Zurück zum Zitat Wang R, Bunyak F, Seetharaman G, Palaniappan K (2014) Static and moving object detection using flux tensor with split Gaussian models. Proc CVPRW IEEE. IEEE Computer Society, Los Alamitos, pp 420–424 Wang R, Bunyak F, Seetharaman G, Palaniappan K (2014) Static and moving object detection using flux tensor with split Gaussian models. Proc CVPRW IEEE. IEEE Computer Society, Los Alamitos, pp 420–424
26.
Zurück zum Zitat St-Charles PL, Bilodeau GA, Bergevin R (2014) Flexible background subtraction with self-balanced local sensitivity. Proc CVPRW IEEE. IEEE Computer Society, Los Alamitos, pp 414–419 St-Charles PL, Bilodeau GA, Bergevin R (2014) Flexible background subtraction with self-balanced local sensitivity. Proc CVPRW IEEE. IEEE Computer Society, Los Alamitos, pp 414–419
27.
Zurück zum Zitat De Gregorio M, Giordano M (2014) Change detection with weightless neural networks. Proc CVPRW IEEE. IEEE Computer Society, Los Alamitos, pp 409–413 De Gregorio M, Giordano M (2014) Change detection with weightless neural networks. Proc CVPRW IEEE. IEEE Computer Society, Los Alamitos, pp 409–413
28.
Zurück zum Zitat Feng J, Xu H, Yan S (2013) Online robust PCA via stochastic optimization. In: Adv Neur In. Neural Information Processing Systems Foundation, La Jolla Feng J, Xu H, Yan S (2013) Online robust PCA via stochastic optimization. In: Adv Neur In. Neural Information Processing Systems Foundation, La Jolla
29.
Zurück zum Zitat You Z-H, Lei Y-K, Zhu L, Xia J, Wang B (2013) Prediction of protein-protein interactions from amino acid sequences with ensemble extreme learning machines and principal component analysis. BMC Bioinform 14(Suppl 8):S10CrossRef You Z-H, Lei Y-K, Zhu L, Xia J, Wang B (2013) Prediction of protein-protein interactions from amino acid sequences with ensemble extreme learning machines and principal component analysis. BMC Bioinform 14(Suppl 8):S10CrossRef
30.
Zurück zum Zitat You Z-H, Zhu L, Zheng C-H, Yu H-J, Deng S-P, Ji Z (2014) Prediction of protein-protein interactions from amino acid sequences using a novel multi-scale continuous and discontinuous feature set. BMC Bioinform 15(Suppl 15):S9CrossRef You Z-H, Zhu L, Zheng C-H, Yu H-J, Deng S-P, Ji Z (2014) Prediction of protein-protein interactions from amino acid sequences using a novel multi-scale continuous and discontinuous feature set. BMC Bioinform 15(Suppl 15):S9CrossRef
31.
Zurück zum Zitat You Z-H, Yu J-Z, Zhu L, Li S, Wen Z-K (2014) A MapReduce based parallel SVM for large-scale predicting protein-protein interactions. Neurocomputing 145:37–43CrossRef You Z-H, Yu J-Z, Zhu L, Li S, Wen Z-K (2014) A MapReduce based parallel SVM for large-scale predicting protein-protein interactions. Neurocomputing 145:37–43CrossRef
32.
33.
Zurück zum Zitat Wang X-Z, Ashfaq RAR, Fu A-M (2015) Fuzziness based sample categorization for classifier performance improvement. J Intell Fuzzy Syst 29(3):1185–1196CrossRefMathSciNet Wang X-Z, Ashfaq RAR, Fu A-M (2015) Fuzziness based sample categorization for classifier performance improvement. J Intell Fuzzy Syst 29(3):1185–1196CrossRefMathSciNet
34.
Zurück zum Zitat Oliver NM, Rosario B, Pentland AP (2000) A Bayesian computer vision system for modeling human interactions. IEEE T Pattern Anal 22(8):831–843CrossRef Oliver NM, Rosario B, Pentland AP (2000) A Bayesian computer vision system for modeling human interactions. IEEE T Pattern Anal 22(8):831–843CrossRef
35.
Zurück zum Zitat Weng J, Zhang Y, Hwang W-S (2003) Candid covariance-free incremental principal component analysis. IEEE T Pattern Anal 25(8):1034–1040CrossRef Weng J, Zhang Y, Hwang W-S (2003) Candid covariance-free incremental principal component analysis. IEEE T Pattern Anal 25(8):1034–1040CrossRef
36.
Zurück zum Zitat Yang J, Zhang D, Frangi AF, Yang J-Y (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE T Pattern Anal 26(1):131–137CrossRef Yang J, Zhang D, Frangi AF, Yang J-Y (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE T Pattern Anal 26(1):131–137CrossRef
37.
Zurück zum Zitat Zhang D, Zhou Z-H (2005) (2D)2PCA: two-directional two-dimensional PCA for efficient face representation and recognition. Neurocomputing 69(1–3):224–231CrossRef Zhang D, Zhou Z-H (2005) (2D)2PCA: two-directional two-dimensional PCA for efficient face representation and recognition. Neurocomputing 69(1–3):224–231CrossRef
38.
Zurück zum Zitat Zou H, Hastie T, Tibshirani R (2006) Sparse principal component analysis. J Comput Graph Stat 15(2):265–286CrossRefMathSciNet Zou H, Hastie T, Tibshirani R (2006) Sparse principal component analysis. J Comput Graph Stat 15(2):265–286CrossRefMathSciNet
39.
Zurück zum Zitat Lu H, Plataniotis KN, Venetsanopoulos AN (2008) MPCA: multilinear principal component analysis of tensor objects. IEEE T Neural Netw 19(1):18–39CrossRef Lu H, Plataniotis KN, Venetsanopoulos AN (2008) MPCA: multilinear principal component analysis of tensor objects. IEEE T Neural Netw 19(1):18–39CrossRef
40.
Zurück zum Zitat Lu H, Plataniotis KN, Venetsanopoulos AN (2009) Uncorrelated multilinear principal component analysis for unsupervised multilinear subspace learning. IEEE T Neural Netw 20(11):1820–1836CrossRef Lu H, Plataniotis KN, Venetsanopoulos AN (2009) Uncorrelated multilinear principal component analysis for unsupervised multilinear subspace learning. IEEE T Neural Netw 20(11):1820–1836CrossRef
42.
Zurück zum Zitat Lai Z, Xu Y, Chen Q, Yang J, Zhang D (2014) Multilinear sparse principal component analysis. IEEE T Neural Netw Learn Syst 25(10):1942–1950CrossRef Lai Z, Xu Y, Chen Q, Yang J, Zhang D (2014) Multilinear sparse principal component analysis. IEEE T Neural Netw Learn Syst 25(10):1942–1950CrossRef
43.
Zurück zum Zitat Tian Y, Wang Y, Hu Z, Huang T (2013) Selective eigenbackground for background modeling and subtraction in crowded scenes. IEEE T Circ Syst Vid 23(11):1849–1864CrossRef Tian Y, Wang Y, Hu Z, Huang T (2013) Selective eigenbackground for background modeling and subtraction in crowded scenes. IEEE T Circ Syst Vid 23(11):1849–1864CrossRef
44.
Zurück zum Zitat Seo J-W, Kim SD (2014) Recursive on-line (2D)2PCA and its application to long-term background subtraction. IEEE T Multimed 16(8):2333–2344CrossRef Seo J-W, Kim SD (2014) Recursive on-line (2D)2PCA and its application to long-term background subtraction. IEEE T Multimed 16(8):2333–2344CrossRef
45.
Zurück zum Zitat Wen J, Xu Y, Tang J, Zhan Y, Lai Z, Guo X (2014) Joint video frame set division and low-rank decomposition for background subtraction. IEEE T Circ Syst Vid 24(12):2034–2048CrossRef Wen J, Xu Y, Tang J, Zhan Y, Lai Z, Guo X (2014) Joint video frame set division and low-rank decomposition for background subtraction. IEEE T Circ Syst Vid 24(12):2034–2048CrossRef
46.
Zurück zum Zitat Gao Z, Cheong L-F, Wang Y-X (2014) Block-sparse RPCA for salient motion detection. IEEE T Pattern Anal 36(10):1975–1987CrossRef Gao Z, Cheong L-F, Wang Y-X (2014) Block-sparse RPCA for salient motion detection. IEEE T Pattern Anal 36(10):1975–1987CrossRef
47.
Zurück zum Zitat Liu X, Zhao G, Yao J, Qi C (2015) Background subtraction based on low-rank and structured sparse decomposition. IEEE T Image Process 24(8):2502–2514CrossRefMathSciNet Liu X, Zhao G, Yao J, Qi C (2015) Background subtraction based on low-rank and structured sparse decomposition. IEEE T Image Process 24(8):2502–2514CrossRefMathSciNet
48.
49.
Zurück zum Zitat Seidel F, Hage C, Kleinsteuber M (2014) pROST: a smoothed ℓp-norm robust online subspace tracking method for background subtraction in video. Mach Vis Appl 25(5):1227–1240CrossRef Seidel F, Hage C, Kleinsteuber M (2014) pROST: a smoothed ℓp-norm robust online subspace tracking method for background subtraction in video. Mach Vis Appl 25(5):1227–1240CrossRef
50.
Zurück zum Zitat Sheikh Y, Shah M (2005) Bayesian modeling of dynamic scenes for object detection. IEEE T Pattern Anal 27(11):1778–1792CrossRef Sheikh Y, Shah M (2005) Bayesian modeling of dynamic scenes for object detection. IEEE T Pattern Anal 27(11):1778–1792CrossRef
51.
Zurück zum Zitat Barnich O, Van Droogenbroeck M (2011) ViBe: a universal background subtraction algorithm for video sequences. IEEE T Image Process 20(6):1709–1724CrossRefMATHMathSciNet Barnich O, Van Droogenbroeck M (2011) ViBe: a universal background subtraction algorithm for video sequences. IEEE T Image Process 20(6):1709–1724CrossRefMATHMathSciNet
52.
Zurück zum Zitat Maddalena L, Petrosino A (2008) A self-organizing approach to background subtraction for visual surveillance applications. IEEE T Image Process 17(7):1168–1177CrossRefMathSciNet Maddalena L, Petrosino A (2008) A self-organizing approach to background subtraction for visual surveillance applications. IEEE T Image Process 17(7):1168–1177CrossRefMathSciNet
Metadaten
Titel
Background subtraction based on modified online robust principal component analysis
verfasst von
Guang Han
Jinkuan Wang
Xi Cai
Publikationsdatum
06.07.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2017
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-016-0562-7

Weitere Artikel der Ausgabe 6/2017

International Journal of Machine Learning and Cybernetics 6/2017 Zur Ausgabe

Neuer Inhalt