Skip to main content
Erschienen in: Soft Computing 1/2018

06.09.2016 | Methodologies and Application

Group object detection and tracking by combining RPCA and fractal analysis

verfasst von: Longxin Lin, Weiwei Lin, Sibin Huang

Erschienen in: Soft Computing | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Automatic video analysis is a hot research topic in the field of computer vision and has broad application prospects. It usually consists of three key steps: object detection, object tracking and behavior recognition. Usually, object detection is just considered as the precondition of object tracking, and the correlation between them is very little. So, existing video analysis solutions treat them as independent procedures and execute them separately. Actually, object detection and tracking are related and the effective combination of them can improve the performance of video analysis. This paper mainly studies object detection and tracking, and tries to utilize the outputs of them to optimize their performance by each other. For this purpose, a unified algorithm framework called group object detection and tracking is presented, which detects moving objects by robust principle component analysis (RPCA) and Graph Cut algorithm and tracks objects via fractal analysis simultaneously. The multi-fractal spectrum (MFS) constrain and Graph Cut improve the complement of object detection, which will bring more exact tracking feature. At the same time, the successful results from tracking can provide optimal constrain for object detection in an opposite manner. Therefore, object detection and tracking are grouped and can be improved by an iterative RPCA algorithm. The experimental results of simulation and real sequence demonstrate that the proposed algorithm is more robust and outperforms state-of-art algorithms in object detection and tracking.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Alper Y, Omar J, Mubarak S (2006) Object tracking: a survey. ACM Comput Surv 38(4):1–35 Alper Y, Omar J, Mubarak S (2006) Object tracking: a survey. ACM Comput Surv 38(4):1–35
Zurück zum Zitat Amiaz T, Kiryati N (2006) Piecewise-smooth dense optical flow via level sets. Int J Comput Vis 68(2):111–124CrossRef Amiaz T, Kiryati N (2006) Piecewise-smooth dense optical flow via level sets. Int J Comput Vis 68(2):111–124CrossRef
Zurück zum Zitat Avidan S (2004) Support vector tracking. IEEE Trans Pattern Anal Mach Intell 26(8):1064–1072CrossRef Avidan S (2004) Support vector tracking. IEEE Trans Pattern Anal Mach Intell 26(8):1064–1072CrossRef
Zurück zum Zitat Bai X, Wang J, Simons D, Sapiro G (2009) Video snapcut: robust video object cutout using localized classifiers. ACM Transactions on Graphics (TOG) 28(3):70CrossRef Bai X, Wang J, Simons D, Sapiro G (2009) Video snapcut: robust video object cutout using localized classifiers. ACM Transactions on Graphics (TOG) 28(3):70CrossRef
Zurück zum Zitat Barnich O, Van Droogenbroeck M (2011) Vibe: a universal background subtraction algorithm for video sequences. IEEE Trans Image Process 20(6):1709–1724MathSciNetCrossRefMATH Barnich O, Van Droogenbroeck M (2011) Vibe: a universal background subtraction algorithm for video sequences. IEEE Trans Image Process 20(6):1709–1724MathSciNetCrossRefMATH
Zurück zum Zitat Bertalmio M, Sapiro G, Randall G (2000) Morphing active contours. IEEE Trans Pattern Anal Mach Intell 22(7):733–737CrossRef Bertalmio M, Sapiro G, Randall G (2000) Morphing active contours. IEEE Trans Pattern Anal Mach Intell 22(7):733–737CrossRef
Zurück zum Zitat Black MJ, Anandan P (1996) The robust estimation of multiple motions: parametric and piecewise-smooth flow fields. Comput Vis Image Underst 63(1):75–104CrossRef Black MJ, Anandan P (1996) The robust estimation of multiple motions: parametric and piecewise-smooth flow fields. Comput Vis Image Underst 63(1):75–104CrossRef
Zurück zum Zitat Bouwmans T (2014) Traditional and recent approaches in background modeling for foreground detection: an overview. Comput Sci Rev 11:31–66CrossRefMATH Bouwmans T (2014) Traditional and recent approaches in background modeling for foreground detection: an overview. Comput Sci Rev 11:31–66CrossRefMATH
Zurück zum Zitat Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239CrossRef Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239CrossRef
Zurück zum Zitat Broida TJ, Chellappa R (1986) Estimation of object motion parameters from noisy images. IEEE Trans Pattern Anal Mach Intell 1:90–99CrossRef Broida TJ, Chellappa R (1986) Estimation of object motion parameters from noisy images. IEEE Trans Pattern Anal Mach Intell 1:90–99CrossRef
Zurück zum Zitat Brox T, Malik J, (2010) Object segmentation by long term analysis of point trajectories. In: Computer vision-ECCV 2010. Springer, Berlin, pp 282–295 Brox T, Malik J, (2010) Object segmentation by long term analysis of point trajectories. In: Computer vision-ECCV 2010. Springer, Berlin, pp 282–295
Zurück zum Zitat Brox T, Bruhn AES, Weickert J, (2006) Variational motion segmentation with level sets. In: Computer vision-ECCV 2006. Springer, Berlin, pp 471–483 Brox T, Bruhn AES, Weickert J, (2006) Variational motion segmentation with level sets. In: Computer vision-ECCV 2006. Springer, Berlin, pp 471–483
Zurück zum Zitat Brutzer S, Hoferlin B, Heidemann G (2011) Evaluation of background subtraction techniques for video surveillance Brutzer S, Hoferlin B, Heidemann G (2011) Evaluation of background subtraction techniques for video surveillance
Zurück zum Zitat Cand ES, Emmanuel J, Li X, Ma Y, Wright J (2011) Robust principal component analysis? J ACM (JACM) 58(3):11MathSciNetMATH Cand ES, Emmanuel J, Li X, Ma Y, Wright J (2011) Robust principal component analysis? J ACM (JACM) 58(3):11MathSciNetMATH
Zurück zum Zitat Chan AB, Vasconcelos N (2009) Layered dynamic textures. IEEE Trans Pattern Anal Mach Intell 31(10):1862–1879CrossRef Chan AB, Vasconcelos N (2009) Layered dynamic textures. IEEE Trans Pattern Anal Mach Intell 31(10):1862–1879CrossRef
Zurück zum Zitat Chen B, Shu H, Coatrieux G, Chen G, Sun X, Coatrieux JL (2015) Color image analysis by quaternion-type moments. J Math Imaging Vis 51(1):124–144MathSciNetCrossRefMATH Chen B, Shu H, Coatrieux G, Chen G, Sun X, Coatrieux JL (2015) Color image analysis by quaternion-type moments. J Math Imaging Vis 51(1):124–144MathSciNetCrossRefMATH
Zurück zum Zitat Comaniciu D, Meer P (1999) Mean shift analysis and applications Comaniciu D, Meer P (1999) Mean shift analysis and applications
Zurück zum Zitat Fazekas SA, Amiaz T, Chetverikov D, Kiryati N (2009) Dynamic texture detection based on motion analysis. Int J Comput Vis 82(1):48–63CrossRef Fazekas SA, Amiaz T, Chetverikov D, Kiryati N (2009) Dynamic texture detection based on motion analysis. Int J Comput Vis 82(1):48–63CrossRef
Zurück zum Zitat Fortun D, Bouthemy P, Kervrann C (2015) Optical flow modeling and computation: a survey. Comput Vis Image Underst 134:1–21CrossRefMATH Fortun D, Bouthemy P, Kervrann C (2015) Optical flow modeling and computation: a survey. Comput Vis Image Underst 134:1–21CrossRefMATH
Zurück zum Zitat Gauglitz S, Llerer THO, Turk M (2011) Evaluation of interest point detectors and feature descriptors for visual tracking. Int J Comput Vis 94(3):335–360CrossRefMATH Gauglitz S, Llerer THO, Turk M (2011) Evaluation of interest point detectors and feature descriptors for visual tracking. Int J Comput Vis 94(3):335–360CrossRefMATH
Zurück zum Zitat Han B, Comaniciu D, Zhu Y, Davis LS (2008) Background subtraction techniques: a review. IEEE Trans Pattern Anal Mach Intell 30(7):1186–1197CrossRef Han B, Comaniciu D, Zhu Y, Davis LS (2008) Background subtraction techniques: a review. IEEE Trans Pattern Anal Mach Intell 30(7):1186–1197CrossRef
Zurück zum Zitat Kang J, Cohen I, Medioni G (2004) Object reacquisition using invariant appearance model Kang J, Cohen I, Medioni G (2004) Object reacquisition using invariant appearance model
Zurück zum Zitat Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground-background segmentation using codebook model. Real-time Imaging 11(3):172–185CrossRef Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground-background segmentation using codebook model. Real-time Imaging 11(3):172–185CrossRef
Zurück zum Zitat Li L, Huang W, Gu IYH, Tian Q (2004) Statistical modeling of complex backgrounds for foreground object detection. IEEE Trans Image Process 13(11):1459–1472CrossRef Li L, Huang W, Gu IYH, Tian Q (2004) Statistical modeling of complex backgrounds for foreground object detection. IEEE Trans Image Process 13(11):1459–1472CrossRef
Zurück zum Zitat Li J, Li X, Yang B, Sun X (2015) Segmentation-based image copy-move forgery detection scheme. IEEE Trans Inf Forensics Secur 10(3):507–518CrossRef Li J, Li X, Yang B, Sun X (2015) Segmentation-based image copy-move forgery detection scheme. IEEE Trans Inf Forensics Secur 10(3):507–518CrossRef
Zurück zum Zitat Lin L, Lin W, Xiao W, Huang S (2015) An optimized video synopsis algorithm and its distributed processing model. Soft Comput 1–13 Lin L, Lin W, Xiao W, Huang S (2015) An optimized video synopsis algorithm and its distributed processing model. Soft Comput 1–13
Zurück zum Zitat Mikolajczyk K, Schmid C (2004) Scale and affine invariant interest point detectors. Int J Comput Vis 60(1):63–86CrossRef Mikolajczyk K, Schmid C (2004) Scale and affine invariant interest point detectors. Int J Comput Vis 60(1):63–86CrossRef
Zurück zum Zitat Mittal A, Paragios N (2004) Motion-based background subtraction using adaptive kernel density estimation Mittal A, Paragios N (2004) Motion-based background subtraction using adaptive kernel density estimation
Zurück zum Zitat Ochs P, Brox T (2011) Object segmentation in video: a hierarchical variational approach for turning point trajectories into dense regions Ochs P, Brox T (2011) Object segmentation in video: a hierarchical variational approach for turning point trajectories into dense regions
Zurück zum Zitat Ochs P, Malik J, Brox T (2014) Segmentation of moving objects by long term video analysis. IEEE Trans Pattern Anal Mach Intell 36(6):1187–1200CrossRef Ochs P, Malik J, Brox T (2014) Segmentation of moving objects by long term video analysis. IEEE Trans Pattern Anal Mach Intell 36(6):1187–1200CrossRef
Zurück zum Zitat Oliver NM, Rosario B, Pentland AP (2000) A bayesian computer vision system for modeling human interactions. IEEE Trans Pattern Anal Mach Intell 22(8):831–843CrossRef Oliver NM, Rosario B, Pentland AP (2000) A bayesian computer vision system for modeling human interactions. IEEE Trans Pattern Anal Mach Intell 22(8):831–843CrossRef
Zurück zum Zitat Pan Z, Zhang Y, Kwong S (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176CrossRef Pan Z, Zhang Y, Kwong S (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176CrossRef
Zurück zum Zitat Paskaš MP, Reljin BD, Reljin IS (2016) Revision of multifractal descriptors for texture classification based on mathematical morphology. Pattern Recogn Lett Paskaš MP, Reljin BD, Reljin IS (2016) Revision of multifractal descriptors for texture classification based on mathematical morphology. Pattern Recogn Lett
Zurück zum Zitat Rittscher J, Kato J, Joga SEB, Blake A, (2000) A probabilistic background model for tracking. In: Computer visionECCV 2000. Springer, Berlin, pp 336–350 Rittscher J, Kato J, Joga SEB, Blake A, (2000) A probabilistic background model for tracking. In: Computer visionECCV 2000. Springer, Berlin, pp 336–350
Zurück zum Zitat Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans Graph (TOG) 23(3):309–314CrossRef Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans Graph (TOG) 23(3):309–314CrossRef
Zurück zum Zitat Sato K, Aggarwal JK (2004) Temporal spatio-velocity transform and its application to tracking and interaction. Comput Vis Image Underst 96(2):100–128CrossRef Sato K, Aggarwal JK (2004) Temporal spatio-velocity transform and its application to tracking and interaction. Comput Vis Image Underst 96(2):100–128CrossRef
Zurück zum Zitat Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905CrossRef Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905CrossRef
Zurück zum Zitat Sobral A, Vacavant A (2014) A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. Comput Vis Image Underst 122:4–21CrossRef Sobral A, Vacavant A (2014) A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. Comput Vis Image Underst 122:4–21CrossRef
Zurück zum Zitat Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking
Zurück zum Zitat Tao H, Sawhney HS, Kumar R (2002) Object tracking with bayesian estimation of dynamic layer representations. IEEE Trans Pattern Anal Mach Intell 24(1):75–89CrossRef Tao H, Sawhney HS, Kumar R (2002) Object tracking with bayesian estimation of dynamic layer representations. IEEE Trans Pattern Anal Mach Intell 24(1):75–89CrossRef
Zurück zum Zitat Veenman CJ, Reinders MJT, Backer E (2001) Resolving motion correspondence for densely moving points. IEEE Trans Pattern Anal Mach Intell 23(1):54–72CrossRef Veenman CJ, Reinders MJT, Backer E (2001) Resolving motion correspondence for densely moving points. IEEE Trans Pattern Anal Mach Intell 23(1):54–72CrossRef
Zurück zum Zitat Wang H, Suter D, (2006) A novel robust statistical method for background initialization and visual surveillance. In: Computer vision-ACCV 2006. Springer, Berlin, pp 328–337 Wang H, Suter D, (2006) A novel robust statistical method for background initialization and visual surveillance. In: Computer vision-ACCV 2006. Springer, Berlin, pp 328–337
Zurück zum Zitat Xia Z, Wang X, Sun X, Liu Q, Xiong N (2016) Steganalysis of lsb matching using differences between nonadjacent pixels. Multimed Tools Appl 75(4):1947–1962CrossRef Xia Z, Wang X, Sun X, Liu Q, Xiong N (2016) Steganalysis of lsb matching using differences between nonadjacent pixels. Multimed Tools Appl 75(4):1947–1962CrossRef
Zurück zum Zitat Xiaowei Z, Can Y, Weichuan Y (2013) Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(3):597–610CrossRef Xiaowei Z, Can Y, Weichuan Y (2013) Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(3):597–610CrossRef
Zurück zum Zitat Xu Y, Huang S-B, Ji H, Fermuller C (2009a) Combining powerful local and global statistics for texture description Xu Y, Huang S-B, Ji H, Fermuller C (2009a) Combining powerful local and global statistics for texture description
Zurück zum Zitat Xu Y, Huang S, Ji H (2009b) Integrating local feature and global statistics for texture analysis Xu Y, Huang S, Ji H (2009b) Integrating local feature and global statistics for texture analysis
Zurück zum Zitat Xu Y, Ji H, Fermür C (2009c) Viewpoint invariant texture description using fractal analysis. Int J Comput Vis 83(1):85–100CrossRef Xu Y, Ji H, Fermür C (2009c) Viewpoint invariant texture description using fractal analysis. Int J Comput Vis 83(1):85–100CrossRef
Zurück zum Zitat Yong X, Quan Y, Zhang Z, Ling H, Ji H (2015) Classifying dynamic textures via spatiotemporal fractal analysis. Pattern Recogn 48(10):3239–3248CrossRef Yong X, Quan Y, Zhang Z, Ling H, Ji H (2015) Classifying dynamic textures via spatiotemporal fractal analysis. Pattern Recogn 48(10):3239–3248CrossRef
Zurück zum Zitat Yan J, Pollefeys M, (2006) A general framework for motion segmentation: independent, articulated, rigid, non-rigid, degenerate and non-degenerate. In: Computer vision-ECCV 2006. Springer, Berlin, pp 94–106 Yan J, Pollefeys M, (2006) A general framework for motion segmentation: independent, articulated, rigid, non-rigid, degenerate and non-degenerate. In: Computer vision-ECCV 2006. Springer, Berlin, pp 94–106
Zurück zum Zitat Yitzhaky Y, Peli E (2003) A method for objective edge detection evaluation and detector parameter selection. IEEE Trans Pattern Anal Mach Intell 25(8):1027–1033CrossRef Yitzhaky Y, Peli E (2003) A method for objective edge detection evaluation and detector parameter selection. IEEE Trans Pattern Anal Mach Intell 25(8):1027–1033CrossRef
Zurück zum Zitat Zeković A, Reljin I (2013) Multifractal and inverse multifractal analysis of multiview 3d video. In: Telecommunications forum (TELFOR), 2013 21st. IEEE, pp 753–756 Zeković A, Reljin I (2013) Multifractal and inverse multifractal analysis of multiview 3d video. In: Telecommunications forum (TELFOR), 2013 21st. IEEE, pp 753–756
Zurück zum Zitat Zheng Y, Jeon B, Danhua X, Wu QM, Zhang H (2015) Image segmentation by generalized hierarchical fuzzy c-means algorithm. J Intell Fuzzy Syst 28(2):961–973 Zheng Y, Jeon B, Danhua X, Wu QM, Zhang H (2015) Image segmentation by generalized hierarchical fuzzy c-means algorithm. J Intell Fuzzy Syst 28(2):961–973
Metadaten
Titel
Group object detection and tracking by combining RPCA and fractal analysis
verfasst von
Longxin Lin
Weiwei Lin
Sibin Huang
Publikationsdatum
06.09.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 1/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-016-2329-1

Weitere Artikel der Ausgabe 1/2018

Soft Computing 1/2018 Zur Ausgabe