Skip to main content
Erschienen in: Multimedia Systems 3/2016

01.06.2016 | Regular Paper

Robust visual tracking via online semi-supervised co-boosting

verfasst von: Si Chen, Shunzhi Zhu, Yan Yan

Erschienen in: Multimedia Systems | Ausgabe 3/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a novel visual tracking algorithm via online semi-supervised co-boosting, which investigates the benefits of co-boosting (i.e., the integration of co-training and boosting) and semi-supervised learning in the online tracking process. Existing discriminative tracking algorithms often use the classification results to update the classifier itself. However, the classification errors are easily accumulated during the self-training process. In this paper, we employ an effective online semi-supervised co-boosting framework to update the weak classifiers built on two different feature views. In this framework, the pseudo-label and importance of an unlabeled sample are estimated based on the additive logistic regression for an integration of a prior model and an online classifier learned on one feature view, and then used to update the weak classifiers built on the other feature view. The proposed algorithm has a good ability to recover from drifting by incorporating prior knowledge of the object while being adaptive to appearance changes by effectively combining the complementary strengths of different feature views. Experimental results on a series of challenging video sequences demonstrate the superior performance of our algorithm compared to state-of-the-art tracking algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (CSUR) 38(4), 1–45 (2006)CrossRef Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (CSUR) 38(4), 1–45 (2006)CrossRef
2.
Zurück zum Zitat Yang, H., Shao, L., Zheng, F., Wang, L., Song, Z.: Recent advances and trends in visual tracking: a review. Neurocomputing 74, 3823–3831 (2011)CrossRef Yang, H., Shao, L., Zheng, F., Wang, L., Song, Z.: Recent advances and trends in visual tracking: a review. Neurocomputing 74, 3823–3831 (2011)CrossRef
3.
Zurück zum Zitat Ejaz, N., Baik, S.W.: Video summarization using a network of radial basis functions. Multimedia Syst. 18(6), 483–497 (2012)CrossRef Ejaz, N., Baik, S.W.: Video summarization using a network of radial basis functions. Multimedia Syst. 18(6), 483–497 (2012)CrossRef
4.
Zurück zum Zitat Vondrick, C., Patterson, D., Ramanan, D.: Efficiently scaling up crowdsourced video annotation. Int. J. Comput. Vis. 101(1), 184–204 (2013)CrossRef Vondrick, C., Patterson, D., Ramanan, D.: Efficiently scaling up crowdsourced video annotation. Int. J. Comput. Vis. 101(1), 184–204 (2013)CrossRef
5.
Zurück zum Zitat Zhang, Z., Huang, K., Tan, T., Wang, Y.: 3D model based vehicle tracking using gradient based fitness evaluation under particle filter framework. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1771–1774 (2010) Zhang, Z., Huang, K., Tan, T., Wang, Y.: 3D model based vehicle tracking using gradient based fitness evaluation under particle filter framework. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1771–1774 (2010)
6.
Zurück zum Zitat Gardner, W.F., Lawton, D.T.: Interactive model-based vehicle tracking. IEEE Trans. Pattern Anal. Mach. Intell. 18(11), 1115–1121 (1996)CrossRef Gardner, W.F., Lawton, D.T.: Interactive model-based vehicle tracking. IEEE Trans. Pattern Anal. Mach. Intell. 18(11), 1115–1121 (1996)CrossRef
7.
Zurück zum Zitat Ross, D.A., Lim, J., Lin, R.S., Yang, M.H.: Incremental learning for robust visual tracking. Int. J. Comput. Vis. 77(1), 125–141 (2008)CrossRef Ross, D.A., Lim, J., Lin, R.S., Yang, M.H.: Incremental learning for robust visual tracking. Int. J. Comput. Vis. 77(1), 125–141 (2008)CrossRef
9.
Zurück zum Zitat Yoon, Y., Kosaka, A., Kak, A.C.: A new Kalman-filter-based framework for fast and accurate visual tracking of rigid objects. IEEE Trans. Robot. 24(5), 1238–1251 (2008)CrossRef Yoon, Y., Kosaka, A., Kak, A.C.: A new Kalman-filter-based framework for fast and accurate visual tracking of rigid objects. IEEE Trans. Robot. 24(5), 1238–1251 (2008)CrossRef
10.
Zurück zum Zitat Bao, C., Wu, Y., Ling, H., Ji, H.: Real time robust L1 tracker using accelerated proximal gradient approach. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1830–1837 (2012) Bao, C., Wu, Y., Ling, H., Ji, H.: Real time robust L1 tracker using accelerated proximal gradient approach. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1830–1837 (2012)
11.
Zurück zum Zitat Avidan, S.: Support vector tracking. IEEE Trans. Pattern Anal. Mach. Intell. 26(8), 1064–1072 (2004)CrossRef Avidan, S.: Support vector tracking. IEEE Trans. Pattern Anal. Mach. Intell. 26(8), 1064–1072 (2004)CrossRef
12.
Zurück zum Zitat Avidan, S.: Ensemble tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 494–501 (2005) Avidan, S.: Ensemble tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 494–501 (2005)
13.
Zurück zum Zitat Grabner, H., Bischof, H.: On-line boosting and vision. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 260–267 (2006) Grabner, H., Bischof, H.: On-line boosting and vision. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 260–267 (2006)
14.
Zurück zum Zitat Grabner, H., Grabner, M., Bischof, H.: Real-time tracking via on-line boosting. In: British Machine Vision Conference (BMVC), pp. 47–56 (2006) Grabner, H., Grabner, M., Bischof, H.: Real-time tracking via on-line boosting. In: British Machine Vision Conference (BMVC), pp. 47–56 (2006)
15.
Zurück zum Zitat Oza, N., Russell, S.: Online bagging and boosting. In: International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 105–112 (2001) Oza, N., Russell, S.: Online bagging and boosting. In: International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 105–112 (2001)
16.
Zurück zum Zitat Hare, S., Saffari, A., Torr, P.H.: Struck: structured output tracking with kernels. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 263–270 (2011) Hare, S., Saffari, A., Torr, P.H.: Struck: structured output tracking with kernels. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 263–270 (2011)
17.
Zurück zum Zitat Babenko, B., Yang, M.H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1619–1632 (2011)CrossRef Babenko, B., Yang, M.H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1619–1632 (2011)CrossRef
18.
Zurück zum Zitat Zhang, K., Song, H.: Real-time visual tracking via online weighted multiple instance learning. Pattern Recognit. 46(1), 397–411 (2013)CrossRefMATH Zhang, K., Song, H.: Real-time visual tracking via online weighted multiple instance learning. Pattern Recognit. 46(1), 397–411 (2013)CrossRefMATH
19.
Zurück zum Zitat Zhang, K., Zhang, L., Yang, M.H.: Real-time compressive tracking. In: European Conference on Computer Vision (ECCV), pp. 866–879 (2012) Zhang, K., Zhang, L., Yang, M.H.: Real-time compressive tracking. In: European Conference on Computer Vision (ECCV), pp. 866–879 (2012)
20.
Zurück zum Zitat Grabner, H., Leistner, C., Bischof, H.: Semi-supervised on-line boosting for robust tracking. In: European Conference on Computer Vision (ECCV), pp. 234–247 (2008) Grabner, H., Leistner, C., Bischof, H.: Semi-supervised on-line boosting for robust tracking. In: European Conference on Computer Vision (ECCV), pp. 234–247 (2008)
21.
Zurück zum Zitat Tang, F., Brennan, S., Zhao, Q., Tao, H.: Co-tracking using semi-supervised support vector machines. In: IEEE International Conference on Computer Vision (ICCV), pp. 1–8 (2007) Tang, F., Brennan, S., Zhao, Q., Tao, H.: Co-tracking using semi-supervised support vector machines. In: IEEE International Conference on Computer Vision (ICCV), pp. 1–8 (2007)
22.
Zurück zum Zitat Liu, R., Cheng, J., Lu, H.: A robust boosting tracker with minimum error bound in a co-training framework. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1459–1466 (2009) Liu, R., Cheng, J., Lu, H.: A robust boosting tracker with minimum error bound in a co-training framework. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1459–1466 (2009)
23.
Zurück zum Zitat Ho, M.C., Chiang, C.C., Su, Y.Y.: Object tracking by exploiting adaptive region-wise linear subspace representations and adaptive templates in an iterative particle filter. Pattern Recognit. Lett. 33, 500–512 (2012)CrossRef Ho, M.C., Chiang, C.C., Su, Y.Y.: Object tracking by exploiting adaptive region-wise linear subspace representations and adaptive templates in an iterative particle filter. Pattern Recognit. Lett. 33, 500–512 (2012)CrossRef
24.
Zurück zum Zitat Jiao, L., Wu, Y., Wu, G., Chang, E.Y., Wang, Y.: Anatomy of a multicamera video surveillance system. Multimedia Syst. 10(2), 144–163 (2004)CrossRef Jiao, L., Wu, Y., Wu, G., Chang, E.Y., Wang, Y.: Anatomy of a multicamera video surveillance system. Multimedia Syst. 10(2), 144–163 (2004)CrossRef
25.
Zurück zum Zitat Leistner, C., Saffari, A., Roth, P., Bischof, H.: On robustness of on-line boosting—a competitive study. In: IEEE International Conference on Computer Vision (ICCV), pp. 1362–1369 (2009) Leistner, C., Saffari, A., Roth, P., Bischof, H.: On robustness of on-line boosting—a competitive study. In: IEEE International Conference on Computer Vision (ICCV), pp. 1362–1369 (2009)
26.
Zurück zum Zitat Kalal, Z., Matas, J., Mikolajczyk, K.: P-N learning: bootstrapping binary classifiers by structural constraints. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 49–56 (2010) Kalal, Z., Matas, J., Mikolajczyk, K.: P-N learning: bootstrapping binary classifiers by structural constraints. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 49–56 (2010)
27.
Zurück zum Zitat Zhang, K., Zhang, L., Yang, M.H.: Real-time compressive tracking, In: European Conference on Computer Vision (ECCV), pp. 866–879 (2012) Zhang, K., Zhang, L., Yang, M.H.: Real-time compressive tracking, In: European Conference on Computer Vision (ECCV), pp. 866–879 (2012)
28.
Zurück zum Zitat Rosenberg, C., Hebert, M., Schneiderman, H.: Semi-supervised self-training of object detection models. In: IEEE Workshop on Applications of Computer Vision (WACV), pp. 29–36 (2005) Rosenberg, C., Hebert, M., Schneiderman, H.: Semi-supervised self-training of object detection models. In: IEEE Workshop on Applications of Computer Vision (WACV), pp. 29–36 (2005)
29.
Zurück zum Zitat Zhu, X.: Semi-supervised learning literature survey. In: Computer Sciences TR-1530. University of Wisconsin-Madison, USA (2007) Zhu, X.: Semi-supervised learning literature survey. In: Computer Sciences TR-1530. University of Wisconsin-Madison, USA (2007)
30.
Zurück zum Zitat Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Annual Conference on Computational Learning Theory (COLT), pp. 92–100 (1998) Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Annual Conference on Computational Learning Theory (COLT), pp. 92–100 (1998)
31.
Zurück zum Zitat Nigam, K., Ghani R.: Analyzing the effectiveness and applicability of co-training. In: ACM International Conference on Information and Knowledge Management (CIKM), pp. 86–93 (2000) Nigam, K., Ghani R.: Analyzing the effectiveness and applicability of co-training. In: ACM International Conference on Information and Knowledge Management (CIKM), pp. 86–93 (2000)
32.
Zurück zum Zitat Balcan, M.F., Blum, A., Yang, K.: Co-training and expansion: Towards bridging theory and practice. In: Advances in Neural Information Processing Systems (NIPS), pp. 89–96 (2005) Balcan, M.F., Blum, A., Yang, K.: Co-training and expansion: Towards bridging theory and practice. In: Advances in Neural Information Processing Systems (NIPS), pp. 89–96 (2005)
33.
Zurück zum Zitat Liu, C., Yuen, P.C.: A boosted co-training algorithm for human action recognition. IEEE Trans. Circ. Syst. Vid. 21(9), 1203–1213 (2011)CrossRef Liu, C., Yuen, P.C.: A boosted co-training algorithm for human action recognition. IEEE Trans. Circ. Syst. Vid. 21(9), 1203–1213 (2011)CrossRef
34.
Zurück zum Zitat Mallapragada, P.K., Rong, J., Jain, A.K., Yi, L.: SemiBoost: boosting for semi-supervised learning. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 2000–2014 (2009)CrossRef Mallapragada, P.K., Rong, J., Jain, A.K., Yi, L.: SemiBoost: boosting for semi-supervised learning. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 2000–2014 (2009)CrossRef
35.
Zurück zum Zitat Leistner, C., Grabner, H., Bischof, H.: Semi-supervised boosting using visual similarity learning. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008) Leistner, C., Grabner, H., Bischof, H.: Semi-supervised boosting using visual similarity learning. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008)
36.
Zurück zum Zitat Yang, Y., Zha, Z., Gao, Y.: Xiaofeng Zhu, Tat-Seng Chua, Exploiting web images for semantic video indexing via robust sample-specific loss. IEEE Trans. Multimedia 16(6), 1677–1689 (2014)CrossRef Yang, Y., Zha, Z., Gao, Y.: Xiaofeng Zhu, Tat-Seng Chua, Exploiting web images for semantic video indexing via robust sample-specific loss. IEEE Trans. Multimedia 16(6), 1677–1689 (2014)CrossRef
37.
Zurück zum Zitat Yang, Y., Yang, Y., Shen, H.: Effective transfer tagging from image to video. ACM Trans. Multimedia Comput. Commun. Appl. 9(2), 14 (2013)CrossRef Yang, Y., Yang, Y., Shen, H.: Effective transfer tagging from image to video. ACM Trans. Multimedia Comput. Commun. Appl. 9(2), 14 (2013)CrossRef
38.
Zurück zum Zitat Pan, S., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRef Pan, S., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRef
39.
Zurück zum Zitat Schapire, R.E., Rochery, M., Rahim, M., Gupta, N.: Incorporating prior knowledge into boosting. In: International Conference on Machine Learning (ICML), pp. 538–545 (2002) Schapire, R.E., Rochery, M., Rahim, M., Gupta, N.: Incorporating prior knowledge into boosting. In: International Conference on Machine Learning (ICML), pp. 538–545 (2002)
40.
Zurück zum Zitat Chen, S., Li, S., Su, S., Tian, Q., Ji, R.: Online MIL tracking with instance-level semi-supervised learning. Neurocomputing 139, 272–288 (2014)CrossRef Chen, S., Li, S., Su, S., Tian, Q., Ji, R.: Online MIL tracking with instance-level semi-supervised learning. Neurocomputing 139, 272–288 (2014)CrossRef
41.
Zurück zum Zitat Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: a statistical view of boosting. Ann. Stat. 28(2), 337–407 (2000)MathSciNetCrossRefMATH Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: a statistical view of boosting. Ann. Stat. 28(2), 337–407 (2000)MathSciNetCrossRefMATH
42.
Zurück zum Zitat Oza, N.: Online ensemble learning. Ph.D. thesis. University of California, Berkeley (2001) Oza, N.: Online ensemble learning. Ph.D. thesis. University of California, Berkeley (2001)
43.
Zurück zum Zitat Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE International Conference on Computer Vision (ICCV), pp. 511–518 (2001) Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE International Conference on Computer Vision (ICCV), pp. 511–518 (2001)
44.
Zurück zum Zitat Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRefMATH Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRefMATH
45.
Zurück zum Zitat Welch, G., Bishop, G.: An introduction to the Kalman filter. Technical report. UNC-CH Computer Science Technical Report 95041 (1995) Welch, G., Bishop, G.: An introduction to the Kalman filter. Technical report. UNC-CH Computer Science Technical Report 95041 (1995)
46.
Zurück zum Zitat Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark, In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2411–2418 (2013) Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark, In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2411–2418 (2013)
47.
Zurück zum Zitat Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman A.: The PASCAL visual object classes challenge 2010 (VOC2010) results (2010) Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman A.: The PASCAL visual object classes challenge 2010 (VOC2010) results (2010)
48.
Metadaten
Titel
Robust visual tracking via online semi-supervised co-boosting
verfasst von
Si Chen
Shunzhi Zhu
Yan Yan
Publikationsdatum
01.06.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems / Ausgabe 3/2016
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-015-0459-4

Weitere Artikel der Ausgabe 3/2016

Multimedia Systems 3/2016 Zur Ausgabe

Neuer Inhalt