Skip to main content
Erschienen in: Multimedia Systems 2/2018

15.03.2017 | Regular Paper

Visual tracking with conditionally adaptive multiple template update scheme for intricate videos

verfasst von: Emmanuel Joy, J. Dinesh Peter

Erschienen in: Multimedia Systems | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Tracking of moving objects in real-time scenes is a challenging research problem in computer vision. This is due to incessant live changes in the object features, background, occlusions, and illumination deviations occurring at different instances in the scene. With the objective of tracking visual objects in intricate videos, this paper presents a new color-independent tracking approach, the contributions of which are threefold. First, the illumination level of the sequences is maintained constant using fast discrete curvelet transform. Fisher information metric is calculated based on a cumulative score by comparing the template patches with a reference template at different timeframes. This metric is used for quantifying distances between the consecutive frame histogram distributions. Then, a novel iterative algorithm called conditionally adaptive multiple template update is proposed to regulate the object templates for handling dynamic occlusions effectively. The proposed method is evaluated on a set of extensive challenging benchmark datasets. Experimental results in terms of Center Location Error (CLE), Tracking Success Score (TSS), and Occlusion Success Score (OSS) show that the proposed method competes well with other relevant state-of-the-art tracking methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wachs J.P., Kolsch, M., Stern, H., Edan, Y.: Vision-based hand gesture applications. Commun. ACM. 54(2), 60–71 (2011)CrossRef Wachs J.P., Kolsch, M., Stern, H., Edan, Y.: Vision-based hand gesture applications. Commun. ACM. 54(2), 60–71 (2011)CrossRef
2.
Zurück zum Zitat Zhang, P., Thomas, T., Emmanuel, S.: Privacy enabled video surveillance using a two-state Markov tracking algorithm. Multimed. Syst. 18(2), 175–199 (2012)CrossRef Zhang, P., Thomas, T., Emmanuel, S.: Privacy enabled video surveillance using a two-state Markov tracking algorithm. Multimed. Syst. 18(2), 175–199 (2012)CrossRef
3.
Zurück zum Zitat Wang, M., Hong, R., Li, G., Zha, Z.J., Yan, S., Chua, T.S.: Event driven web video summarization by tag localization and key-shot identification. IEEE Trans. Multimed. 14(4), 975–985 (2012)CrossRef Wang, M., Hong, R., Li, G., Zha, Z.J., Yan, S., Chua, T.S.: Event driven web video summarization by tag localization and key-shot identification. IEEE Trans. Multimed. 14(4), 975–985 (2012)CrossRef
4.
Zurück zum Zitat Park, B.S., Yoo, S.J., Park, J.B., Choi, Y.H.: A simple adaptive control approach for trajectory tracking of electrically driven nonholonomic mobile robots. IEEE Trans. Control Syst. Technol. 18(5), 1199–1206 (2010)CrossRef Park, B.S., Yoo, S.J., Park, J.B., Choi, Y.H.: A simple adaptive control approach for trajectory tracking of electrically driven nonholonomic mobile robots. IEEE Trans. Control Syst. Technol. 18(5), 1199–1206 (2010)CrossRef
5.
Zurück zum Zitat Peter, A., Rangarajan, A.: Shape analysis using the Fisher–Rao Riemannian metric: unifying shape representation and deformation. Biomedical Imaging: Nano to Macro, 2006. 3rd IEEE International Symposium IEEE (2006) Peter, A., Rangarajan, A.: Shape analysis using the Fisher–Rao Riemannian metric: unifying shape representation and deformation. Biomedical Imaging: Nano to Macro, 2006. 3rd IEEE International Symposium IEEE (2006)
6.
Zurück zum Zitat Darms, M. S.: Obstacle detection and tracking for the urban challenge. Intell. Transp. Syst. IEEE Trans. 10(3), 475–485 (2009)CrossRef Darms, M. S.: Obstacle detection and tracking for the urban challenge. Intell. Transp. Syst. IEEE Trans. 10(3), 475–485 (2009)CrossRef
7.
Zurück zum Zitat Bo, C., et al.: Online visual tracking based on subspace representation with continuous occlusion modeling. Multimed. Syst.: 1–12 (2015) Bo, C., et al.: Online visual tracking based on subspace representation with continuous occlusion modeling. Multimed. Syst.: 1–12 (2015)
8.
Zurück zum Zitat Jia, X., Lu, H., Yang, M.H.: Visual tracking via adaptive structural local sparse appearance model. Computer vision and pattern recognition (CVPR), 2012 IEEE Conference IEEE, (2012) Jia, X., Lu, H., Yang, M.H.: Visual tracking via adaptive structural local sparse appearance model. Computer vision and pattern recognition (CVPR), 2012 IEEE Conference IEEE, (2012)
9.
Zurück zum Zitat Zhao, H., Wang, X.: Robust visual tracking via discriminative appearance model based on sparse coding. Multimed. Syst. 1–10 (2014) Zhao, H., Wang, X.: Robust visual tracking via discriminative appearance model based on sparse coding. Multimed. Syst. 1–10 (2014)
10.
Zurück zum Zitat Ross, D.A., Lim, J., Lin, RS., Yang, MH.: Incremental learning for robust visual tracking. Int. J. Comput. Vis. 77(1–3), 125–141 (2008)CrossRef Ross, D.A., Lim, J., Lin, RS., Yang, MH.: Incremental learning for robust visual tracking. Int. J. Comput. Vis. 77(1–3), 125–141 (2008)CrossRef
11.
Zurück zum Zitat Yang, H., et al. Recent advances and trends in visual tracking: a review. Neurocomputing 74(18), 3823–3831 (2011)CrossRef Yang, H., et al. Recent advances and trends in visual tracking: a review. Neurocomputing 74(18), 3823–3831 (2011)CrossRef
12.
Zurück zum Zitat Li, S.: Moving object detection and tracking in video surveillance system. Sixth International Symposium on Multispectral Image Processing and Pattern Recognition. International Society for Optics and Photonics (2009) Li, S.: Moving object detection and tracking in video surveillance system. Sixth International Symposium on Multispectral Image Processing and Pattern Recognition. International Society for Optics and Photonics (2009)
13.
Zurück zum Zitat Chakraborty, B., Meher, S.: A real-time trajectory-based ball detection-and-tracking framework for basketball video. J. Opt. 42(2), 156–170 (2013)CrossRef Chakraborty, B., Meher, S.: A real-time trajectory-based ball detection-and-tracking framework for basketball video. J. Opt. 42(2), 156–170 (2013)CrossRef
14.
Zurück zum Zitat Grabner, H., Grabner, M., Bischof, H.: Real-time tracking via on-line boosting. BMVC 1(5), 6 (2006) Grabner, H., Grabner, M., Bischof, H.: Real-time tracking via on-line boosting. BMVC 1(5), 6 (2006)
15.
Zurück zum Zitat Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. Computer vision—ECCV 2000. Springer, Berlin, pp 751–767 (2000) Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. Computer vision—ECCV 2000. Springer, Berlin, pp 751–767 (2000)
16.
Zurück zum Zitat Babenko, B., Yang, M.H., Belongie, S.: Robust object tracking with online multiple instance learning. Pattern Anal. Mach. Intell. IEEE Trans. 33(8), 1619–1632 (2011)CrossRef Babenko, B., Yang, M.H., Belongie, S.: Robust object tracking with online multiple instance learning. Pattern Anal. Mach. Intell. IEEE Trans. 33(8), 1619–1632 (2011)CrossRef
17.
Zurück zum Zitat Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. Proceedings of the IEEE conference on computer vision and pattern recognition (2013) Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. Proceedings of the IEEE conference on computer vision and pattern recognition (2013)
18.
Zurück zum Zitat Wu, Y., Lim, J., Yang, M.H.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell., pp 99 (2015) Wu, Y., Lim, J., Yang, M.H.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell., pp 99 (2015)
19.
Zurück zum Zitat Smeulders, AWM., et al. Visual tracking: an experimental survey. IEEE Trans. Pattern Anal. Mach. Intell. 36(7), 1442–1468 (2014)CrossRef Smeulders, AWM., et al. Visual tracking: an experimental survey. IEEE Trans. Pattern Anal. Mach. Intell. 36(7), 1442–1468 (2014)CrossRef
20.
Zurück zum Zitat Hu, W., Zhou, X., Li, W., Luo, W., Zhang, X., Maybank, S.: Active contour-based visual tracking by integrating colors, shapes, and motions. IEEE Trans. Image Process. 22(5), 1778–1792 (2013)MathSciNetCrossRefMATH Hu, W., Zhou, X., Li, W., Luo, W., Zhang, X., Maybank, S.: Active contour-based visual tracking by integrating colors, shapes, and motions. IEEE Trans. Image Process. 22(5), 1778–1792 (2013)MathSciNetCrossRefMATH
21.
Zurück zum Zitat Sugandi, B.: A color-based particle filter for multiple object tracking in an outdoor environment. Artif. Life Robot. 15(1), 41–47 (2010)CrossRef Sugandi, B.: A color-based particle filter for multiple object tracking in an outdoor environment. Artif. Life Robot. 15(1), 41–47 (2010)CrossRef
22.
Zurück zum Zitat Zhang, Z., Yue, S., Zhang, G.: Fly visual system inspired artificial neural network for collision detection. Neurocomputing 153, 221–234 (2015)CrossRef Zhang, Z., Yue, S., Zhang, G.: Fly visual system inspired artificial neural network for collision detection. Neurocomputing 153, 221–234 (2015)CrossRef
23.
Zurück zum Zitat Ren, T., et al.: Soft-assigned bag of features for object tracking. Multimed. Syst. 21(2), 189–205 (2015)CrossRef Ren, T., et al.: Soft-assigned bag of features for object tracking. Multimed. Syst. 21(2), 189–205 (2015)CrossRef
24.
Zurück zum Zitat Zhang, K., et al.: Robust visual tracking via convolutional networks. arXiv preprint arXiv:1501.04505 (2015) Zhang, K., et al.: Robust visual tracking via convolutional networks. arXiv preprint arXiv:1501.04505 (2015)
25.
Zurück zum Zitat Nebehay, G., Pflugfelder, R.: Clustering of static-adaptive correspondences for deformable object tracking. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015) Nebehay, G., Pflugfelder, R.: Clustering of static-adaptive correspondences for deformable object tracking. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
26.
Zurück zum Zitat Nie, W., Liu, A., Su, Y. et al.: Single/cross-camera multiple-person tracking by graph matching. Neurocomputing 139, 220–232 (2014)CrossRef Nie, W., Liu, A., Su, Y. et al.: Single/cross-camera multiple-person tracking by graph matching. Neurocomputing 139, 220–232 (2014)CrossRef
27.
Zurück zum Zitat Candes, E., Demanet, L., Donoho, D., Ying, L.: Fast discrete curvelet transforms. Multiscale Model. Simul. 5(3), 861–899 (2006)MathSciNetCrossRefMATH Candes, E., Demanet, L., Donoho, D., Ying, L.: Fast discrete curvelet transforms. Multiscale Model. Simul. 5(3), 861–899 (2006)MathSciNetCrossRefMATH
28.
Zurück zum Zitat Kwon, J., Lee, K.M.: Visual tracking decomposition. Computer Vision and Pattern Recognition (CVPR), 2010 IEEE (2010) Kwon, J., Lee, K.M.: Visual tracking decomposition. Computer Vision and Pattern Recognition (CVPR), 2010 IEEE (2010)
29.
Zurück zum Zitat Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. Pattern Anal. Mach. Intell. IEEE Trans. 34(7), 1409–1422 (2012)CrossRef Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. Pattern Anal. Mach. Intell. IEEE Trans. 34(7), 1409–1422 (2012)CrossRef
30.
Zurück zum Zitat Chen, S., Zhu, S., Yan, Y.: Robust visual tracking via online semi-supervised co-boosting. Multimedia Syst. 1–17 (2015) Chen, S., Zhu, S., Yan, Y.: Robust visual tracking via online semi-supervised co-boosting. Multimedia Syst. 1–17 (2015)
31.
Zurück zum Zitat Zhang, T., et al.: Robust visual tracking via exclusive context modeling. IEEE Trans. Cybern. 46(1), 51–63 (2016)CrossRef Zhang, T., et al.: Robust visual tracking via exclusive context modeling. IEEE Trans. Cybern. 46(1), 51–63 (2016)CrossRef
32.
Zurück zum Zitat Ding, J., et al.: Robust tracking with adaptive appearance learning and occlusion detection. Multimedia Syst. 22(2), 255–269 (2016)CrossRef Ding, J., et al.: Robust tracking with adaptive appearance learning and occlusion detection. Multimedia Syst. 22(2), 255–269 (2016)CrossRef
33.
Zurück zum Zitat Kristan, M., Matas, J., Leonardis, A., Felsberg, M., Cehovin, L., Fernandez, G., Pflugfelder, R.: The visual object tracking VOT2015 challenge results. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 1–23 (2015) Kristan, M., Matas, J., Leonardis, A., Felsberg, M., Cehovin, L., Fernandez, G., Pflugfelder, R.: The visual object tracking VOT2015 challenge results. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 1–23 (2015)
34.
Zurück zum Zitat Huang, T., Yang, G., Tang, G.:. A fast two-dimensional median filtering algorithm. Acoust. Speech Signal Process. IEEE Trans. 27(1), 13–18 (1979)CrossRef Huang, T., Yang, G., Tang, G.:. A fast two-dimensional median filtering algorithm. Acoust. Speech Signal Process. IEEE Trans. 27(1), 13–18 (1979)CrossRef
35.
Zurück zum Zitat Barnard, K., Cardei, V., Funt, B.: A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data. Image Process. IEEE Trans. 11(9):972–984 (2002)CrossRef Barnard, K., Cardei, V., Funt, B.: A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data. Image Process. IEEE Trans. 11(9):972–984 (2002)CrossRef
36.
Zurück zum Zitat Zhang, T., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vision. 101(2), 367–383 (2013)MathSciNetCrossRef Zhang, T., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vision. 101(2), 367–383 (2013)MathSciNetCrossRef
37.
Zurück zum Zitat Cehovin, L., Kristan, M., Leonardis, A.: Robust visual tracking using an adaptive coupled-layer visual model. IEEE Trans. Pattern Anal. Mach. Intell. 35(4), 941–953 (2013)CrossRef Cehovin, L., Kristan, M., Leonardis, A.: Robust visual tracking using an adaptive coupled-layer visual model. IEEE Trans. Pattern Anal. Mach. Intell. 35(4), 941–953 (2013)CrossRef
38.
Zurück zum Zitat Bao, C., Wu, Y., Ling, H., Ji, H.: Real-time robust l1 tracker using accelerated proximal gradient approach. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2012) Bao, C., Wu, Y., Ling, H., Ji, H.: Real-time robust l1 tracker using accelerated proximal gradient approach. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2012)
39.
Zurück zum Zitat Yoon, J. H., Kim, D. Y., Yoon, K. J.: Visual tracking via adaptive tracker selection with multiple features. In: Proceedings of European Conference on Computer Vision (ECCV) (2012) Yoon, J. H., Kim, D. Y., Yoon, K. J.: Visual tracking via adaptive tracker selection with multiple features. In: Proceedings of European Conference on Computer Vision (ECCV) (2012)
40.
Zurück zum Zitat Wang, D., Lu, H.: Visual tracking via probability continuous outlier model. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. pp. 3478–3485 (2014) Wang, D., Lu, H.: Visual tracking via probability continuous outlier model. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. pp. 3478–3485 (2014)
41.
Zurück zum Zitat He, S., Yang, Q., Lau, R. W. H., Wang, J., Yang, M.-H.: Visual tracking via locality sensitive histograms. CVPR (2013) He, S., Yang, Q., Lau, R. W. H., Wang, J., Yang, M.-H.: Visual tracking via locality sensitive histograms. CVPR (2013)
42.
Zurück zum Zitat Henriques, J. F., Caseiro, R., Martins, P., Batista, J.: Exploiting the circulant structure of tracking-by-detection with kernels, Computer Vision–ECCV 2012, Springer, pp. 702–715 (2012) Henriques, J. F., Caseiro, R., Martins, P., Batista, J.: Exploiting the circulant structure of tracking-by-detection with kernels, Computer Vision–ECCV 2012, Springer, pp. 702–715 (2012)
43.
Zurück zum Zitat Valera, M., Velastin, S.A.: Intelligent distributed surveillance systems: a review. Vis. Image Signal Process. IEEE Proc. IET 152(2), 77–79 (2005) Valera, M., Velastin, S.A.: Intelligent distributed surveillance systems: a review. Vis. Image Signal Process. IEEE Proc. IET 152(2), 77–79 (2005)
44.
Zurück zum Zitat Zhang, K., Zhang, L., Yang, M.H.: Real-time compressive tracking. European Conference on Computer Vision. Springer, Berlin (2012) Zhang, K., Zhang, L., Yang, M.H.: Real-time compressive tracking. European Conference on Computer Vision. Springer, Berlin (2012)
Metadaten
Titel
Visual tracking with conditionally adaptive multiple template update scheme for intricate videos
verfasst von
Emmanuel Joy
J. Dinesh Peter
Publikationsdatum
15.03.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems / Ausgabe 2/2018
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-017-0540-2

Weitere Artikel der Ausgabe 2/2018

Multimedia Systems 2/2018 Zur Ausgabe

Neuer Inhalt