Skip to main content
Erschienen in: Neural Processing Letters 3/2017

19.02.2016

Online Depth Image-Based Object Tracking with Sparse Representation and Object Detection

verfasst von: Wei-Long Zheng, Shan-Chun Shen, Bao-Liang Lu

Erschienen in: Neural Processing Letters | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Online object tracking under complex environments is an important but challenging problem in computer vision, especially for illumination changing and occlusion conditions. With the emergence of commercial real-time depth cameras like Kinect, depth image-based object tracking, which is insensitive to illumination changing, gains more and more attentions. In this paper, we propose an online depth image-based object tracking method with sparse representation and object detection. In this framework, we combine tracking and detection to leverage precision and efficiency under heavy occlusion conditions. For tracking, objects are represented by sparse representations learned online with update. For detection, we apply two different strategies based on tracking-learning-detection and wider search window approaches. We evaluate our methods on both the subset of the public dataset Princeton Tracking Benchmark and our own driver face video in a simulated driving environment. The quantitative evaluations of precision and running time on these two datasets demonstrate the effectiveness and efficiency of our proposed object tracking algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Avidan S (2004) Support vector tracking. IEEE Trans Pattern Anal Mach Intell 26(8):1064–1072CrossRef Avidan S (2004) Support vector tracking. IEEE Trans Pattern Anal Mach Intell 26(8):1064–1072CrossRef
2.
Zurück zum Zitat Avidan S (2007) Ensemble tracking. IEEE Trans Pattern Anal Mach Intell 29(2):261–271CrossRef Avidan S (2007) Ensemble tracking. IEEE Trans Pattern Anal Mach Intell 29(2):261–271CrossRef
3.
Zurück zum Zitat Cai Q, Gallup D, Zhang C, Zhang Z (2010) 3D deformable face tracking with a commodity depth camera. In: Computer Vision-ECCV 2010, Springer, pp 229–242 Cai Q, Gallup D, Zhang C, Zhang Z (2010) 3D deformable face tracking with a commodity depth camera. In: Computer Vision-ECCV 2010, Springer, pp 229–242
4.
Zurück zum Zitat Cao Y, Lu BL (2013) Neural information processing., Real-time head detection with kinect for driving fatigue detectionSpringer, Heidelberg, pp 600–607CrossRef Cao Y, Lu BL (2013) Neural information processing., Real-time head detection with kinect for driving fatigue detectionSpringer, Heidelberg, pp 600–607CrossRef
5.
Zurück zum Zitat Colombo A, Cusano C, Schettini R (2006) 3D face detection using curvature analysis. Pattern Recognit 39(3):444–455CrossRefMATH Colombo A, Cusano C, Schettini R (2006) 3D face detection using curvature analysis. Pattern Recognit 39(3):444–455CrossRefMATH
6.
Zurück zum Zitat Comaniciu D, Ramesh V, Meer P (2000) Real-time tracking of non-rigid objects using mean shift. In: IEEE conference on computer vision and pattern recognition, vol 2, pp 142–149 Comaniciu D, Ramesh V, Meer P (2000) Real-time tracking of non-rigid objects using mean shift. In: IEEE conference on computer vision and pattern recognition, vol 2, pp 142–149
7.
Zurück zum Zitat Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25(5):564–577CrossRef Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25(5):564–577CrossRef
8.
Zurück zum Zitat Hale ET, Yin W, Zhang Y (2008) Fixed-point continuation for \(\backslash ell\_1\)-minimization: methodology and convergence. SIAM J Optim 19(3):1107–1130MathSciNetCrossRefMATH Hale ET, Yin W, Zhang Y (2008) Fixed-point continuation for \(\backslash ell\_1\)-minimization: methodology and convergence. SIAM J Optim 19(3):1107–1130MathSciNetCrossRefMATH
9.
Zurück zum Zitat Hu W, Li X, Zhang X, Shi X, Maybank S, Zhang Z (2011) Incremental tensor subspace learning and its applications to foreground segmentation and tracking. Int J Comput Vis 91(3):303–327CrossRefMATH Hu W, Li X, Zhang X, Shi X, Maybank S, Zhang Z (2011) Incremental tensor subspace learning and its applications to foreground segmentation and tracking. Int J Comput Vis 91(3):303–327CrossRefMATH
10.
Zurück zum Zitat Ji Q, Yang X (2002) Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-Time Imaging 8(5):357–377CrossRefMATH Ji Q, Yang X (2002) Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-Time Imaging 8(5):357–377CrossRefMATH
11.
Zurück zum Zitat Ji Q, Zhu Z, Lan P (2004) Real-time nonintrusive monitoring and prediction of driver fatigue. IEEE Trans Veh Technol 53(4):1052–1068CrossRef Ji Q, Zhu Z, Lan P (2004) Real-time nonintrusive monitoring and prediction of driver fatigue. IEEE Trans Veh Technol 53(4):1052–1068CrossRef
12.
Zurück zum Zitat Jia X, Lu H, Yang MH (2012) Visual tracking via adaptive structural local sparse appearance model. In: IEEE conference on computer vision and pattern recognition, pp 1822–1829 Jia X, Lu H, Yang MH (2012) Visual tracking via adaptive structural local sparse appearance model. In: IEEE conference on computer vision and pattern recognition, pp 1822–1829
13.
Zurück zum Zitat Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-learning-detection. IEEE Trans Pattern Anal Mach Intell 34(7):1409–1422CrossRef Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-learning-detection. IEEE Trans Pattern Anal Mach Intell 34(7):1409–1422CrossRef
14.
Zurück zum Zitat Martínez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763CrossRef Martínez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763CrossRef
15.
Zurück zum Zitat Mei X, Ling H (2011) Robust visual tracking and vehicle classification via sparse representation. IEEE Trans Pattern Anal Mach Intell 33(11):2259–2272MathSciNetCrossRef Mei X, Ling H (2011) Robust visual tracking and vehicle classification via sparse representation. IEEE Trans Pattern Anal Mach Intell 33(11):2259–2272MathSciNetCrossRef
16.
Zurück zum Zitat Nummiaro K, Koller-Meier E, Van Gool L (2003) An adaptive color-based particle filter. Image Vision Comput 21(1):99–110CrossRefMATH Nummiaro K, Koller-Meier E, Van Gool L (2003) An adaptive color-based particle filter. Image Vision Comput 21(1):99–110CrossRefMATH
17.
Zurück zum Zitat Paragios N, Deriche R (2000) Geodesic active contours and level sets for the detection and tracking of moving objects. IEEE Trans Pattern Anal Mach Intell 22(3):266–280CrossRef Paragios N, Deriche R (2000) Geodesic active contours and level sets for the detection and tracking of moving objects. IEEE Trans Pattern Anal Mach Intell 22(3):266–280CrossRef
18.
Zurück zum Zitat Paschos G (2001) Perceptually uniform color spaces for color texture analysis: an empirical evaluation. IEEE Trans Image Process 10(6):932–937CrossRefMATH Paschos G (2001) Perceptually uniform color spaces for color texture analysis: an empirical evaluation. IEEE Trans Image Process 10(6):932–937CrossRefMATH
19.
Zurück zum Zitat Pei SC, Lin CN (1995) Image normalization for pattern recognition. Image Vis Comput 13(10):711–723CrossRef Pei SC, Lin CN (1995) Image normalization for pattern recognition. Image Vis Comput 13(10):711–723CrossRef
20.
Zurück zum Zitat Pérez P, Hue C, Vermaak J, Gangnet M (2002) Color-based probabilistic tracking. In: European conference on computer vision, Springer, pp 661–675 Pérez P, Hue C, Vermaak J, Gangnet M (2002) Color-based probabilistic tracking. In: European conference on computer vision, Springer, pp 661–675
21.
Zurück zum Zitat Ross DA, Lim J, Lin RS, Yang MH (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77(1–3):125–141CrossRef Ross DA, Lim J, Lin RS, Yang MH (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77(1–3):125–141CrossRef
22.
Zurück zum Zitat Sahayadhas A, Sundaraj K, Murugappan M (2012) Detecting driver drowsiness based on sensors: a review. Sensors 12(12):16,937–16,953CrossRef Sahayadhas A, Sundaraj K, Murugappan M (2012) Detecting driver drowsiness based on sensors: a review. Sensors 12(12):16,937–16,953CrossRef
23.
Zurück zum Zitat Shen SC, Zheng WL, Lu BL (2014) Online object tracking based on depth image with sparse coding. In: Neural information processing, Springer, pp 234–241 Shen SC, Zheng WL, Lu BL (2014) Online object tracking based on depth image with sparse coding. In: Neural information processing, Springer, pp 234–241
24.
Zurück zum Zitat Shi LC, Lu BL (2013) EEG-based vigilance estimation using extreme learning machines. Neurocomputing 102:135–143CrossRef Shi LC, Lu BL (2013) EEG-based vigilance estimation using extreme learning machines. Neurocomputing 102:135–143CrossRef
25.
Zurück zum Zitat Song S, Xiao J (2013) Tracking revisited using rgbd camera: Unified benchmark and baselines. In: IEEE international conference on computer vision, pp 233–240 Song S, Xiao J (2013) Tracking revisited using rgbd camera: Unified benchmark and baselines. In: IEEE international conference on computer vision, pp 233–240
26.
Zurück zum Zitat Spinello L, Arras KO (2011) People detection in RGB-D data. In: IEEE/RSJ international conference on intelligent robots and systems, pp 3838–3843 Spinello L, Arras KO (2011) People detection in RGB-D data. In: IEEE/RSJ international conference on intelligent robots and systems, pp 3838–3843
27.
Zurück zum Zitat Wang D, Lu H, Yang MH (2013) Online object tracking with sparse prototypes. IEEE Trans Image Process 22(1):314–325MathSciNetCrossRef Wang D, Lu H, Yang MH (2013) Online object tracking with sparse prototypes. IEEE Trans Image Process 22(1):314–325MathSciNetCrossRef
28.
Zurück zum Zitat Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRef
29.
Zurück zum Zitat Wu Y, Lim J, Yang MH (2013) Online object tracking: A benchmark. In: IEEE conference on computer vision and pattern recognition, pp 2411–2418 Wu Y, Lim J, Yang MH (2013) Online object tracking: A benchmark. In: IEEE conference on computer vision and pattern recognition, pp 2411–2418
30.
Zurück zum Zitat Xia L, Chen CC, Aggarwal JK (2011) Human detection using depth information by kinect. In: IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), pp 15–22 Xia L, Chen CC, Aggarwal JK (2011) Human detection using depth information by kinect. In: IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), pp 15–22
31.
Zurück zum Zitat Yang H, Shao L, Zheng F, Wang L, Song Z (2011a) Recent advances and trends in visual tracking: A review. Neurocomputing 74(18):3823–3831CrossRef Yang H, Shao L, Zheng F, Wang L, Song Z (2011a) Recent advances and trends in visual tracking: A review. Neurocomputing 74(18):3823–3831CrossRef
32.
Zurück zum Zitat Yang M, Zhang L (2010) Gabor feature based sparse representation for face recognition with gabor occlusion dictionary. In: Computer Vision-ECCV 2010, Springer, pp 448–461 Yang M, Zhang L (2010) Gabor feature based sparse representation for face recognition with gabor occlusion dictionary. In: Computer Vision-ECCV 2010, Springer, pp 448–461
33.
Zurück zum Zitat Yang M, Zhang L, Yang J, Zhang D (2011b) Robust sparse coding for face recognition. In: IEEE conference on computer vision and pattern recognition, pp 625–632 Yang M, Zhang L, Yang J, Zhang D (2011b) Robust sparse coding for face recognition. In: IEEE conference on computer vision and pattern recognition, pp 625–632
34.
Zurück zum Zitat Yang T, Pan Q, Li J, Li SZ (2005) Real-time multiple objects tracking with occlusion handling in dynamic scenes. IEEE conference on computer vision and pattern recognition, vol 1, pp 970–975 Yang T, Pan Q, Li J, Li SZ (2005) Real-time multiple objects tracking with occlusion handling in dynamic scenes. IEEE conference on computer vision and pattern recognition, vol 1, pp 970–975
35.
Zurück zum Zitat Yilmaz A, Li X, Shah M (2004) Contour-based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans Pattern Anal Mach Intell 26(11):1531–1536CrossRef Yilmaz A, Li X, Shah M (2004) Contour-based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans Pattern Anal Mach Intell 26(11):1531–1536CrossRef
36.
Zurück zum Zitat Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surveys (CSUR) 38(4):13CrossRef Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surveys (CSUR) 38(4):13CrossRef
37.
Zurück zum Zitat Zhang S, Yao H, Sun X, Lu X (2013) Sparse coding based visual tracking: review and experimental comparison. Pattern Recogn 46(7):1772–1788CrossRef Zhang S, Yao H, Sun X, Lu X (2013) Sparse coding based visual tracking: review and experimental comparison. Pattern Recogn 46(7):1772–1788CrossRef
Metadaten
Titel
Online Depth Image-Based Object Tracking with Sparse Representation and Object Detection
verfasst von
Wei-Long Zheng
Shan-Chun Shen
Bao-Liang Lu
Publikationsdatum
19.02.2016
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2017
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-016-9509-y

Weitere Artikel der Ausgabe 3/2017

Neural Processing Letters 3/2017 Zur Ausgabe

Neuer Inhalt