Skip to main content
Top
Published in:
Cover of the book

2016 | OriginalPaper | Chapter

Visual Tracking by Local Superpixel Matching with Markov Random Field

Authors : Heng Fan, Jinhai Xiang, Zhongmin Chen

Published in: Advances in Multimedia Information Processing - PCM 2016

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a novel method to track non-rigid and/or articulated objects using superpixel matching and markov random field (MRF). Our algorithm consists of three stages. First, a superpixel dataset is constructed by segmenting training frames into superpixels, and each superpixel is represented by multiple features. The appearance information of target is encoded in the superpixel database. Second, each new frame is segmented into superpixels and then its object-background confidence map is derived by comparing its superpixels with k-nearest neighbors in superpixel dataset. Taking context information into account, we utilize MRF to further improve the accuracy of confidence map. In addition, the local context information is incorporated through a feedback to refine superpixel matching. In the last stage, visual tracking is achieved via finding the best candidate by maximum a posterior estimate based on the confidence map. Experiments show that our method outperforms several state-of-the-art trackers.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The surrounding region is a square area centered at the location of target \(X_{t}^{c}\), and its side length is equal to \(\lambda _{s}[X_{s}^{t}]^{\frac{1}{2}}\), where \(X_{t}^{c}\) represents the center location of target region \(X_{t}\) and \(X_{t}^{s}\) denotes its size. The parameter \(\lambda _{s}\) is a constant variable, which determines the size of this surrounding region.
 
Literature
1.
go back to reference Adam, A., Rivlin, E., Shimshoni, I.: Robust fragments based tracking using the integral histogram. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 798–805 (2006) Adam, A., Rivlin, E., Shimshoni, I.: Robust fragments based tracking using the integral histogram. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 798–805 (2006)
2.
go back to reference Avidan, S.: Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 29(2), 261–271 (2007)CrossRef Avidan, S.: Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 29(2), 261–271 (2007)CrossRef
3.
go back to reference Babenko, B., Yang, M.-H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 33(8), 1619–1632 (2011)CrossRef Babenko, B., Yang, M.-H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 33(8), 1619–1632 (2011)CrossRef
4.
go back to reference Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 23(11), 1222–1239 (2001)CrossRef Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 23(11), 1222–1239 (2001)CrossRef
5.
go back to reference Fan, H., Xiang, J.: Robust visual tracking with multitask joint dictionary learning. IEEE Trans. Circ. Syst. Video Technol. PP, 1 (2016) Fan, H., Xiang, J.: Robust visual tracking with multitask joint dictionary learning. IEEE Trans. Circ. Syst. Video Technol. PP, 1 (2016)
6.
go back to reference Fan, H., Xiang, J., Zhao, L.: Robust visual tracking via bag of superpixels. Multimedia Tools Appl. 75, 8781 (2015)CrossRef Fan, H., Xiang, J., Zhao, L.: Robust visual tracking via bag of superpixels. Multimedia Tools Appl. 75, 8781 (2015)CrossRef
7.
go back to reference Fan, H., Xiang, J., Liao, H., Du, X.: Robust tracking based on local structural cell graph. J. Vis. Commun. Image Represent. 31, 54–63 (2015)CrossRef Fan, H., Xiang, J., Liao, H., Du, X.: Robust tracking based on local structural cell graph. J. Vis. Commun. Image Represent. 31, 54–63 (2015)CrossRef
8.
go back to reference Fan, H., Xiang, J., Ni, F.: Multilayer feature combination for visual tracking. In: Asian Conference on Pattern Recognition (ACPR), pp. 589–593 (2015) Fan, H., Xiang, J., Ni, F.: Multilayer feature combination for visual tracking. In: Asian Conference on Pattern Recognition (ACPR), pp. 589–593 (2015)
10.
go back to reference Fan, H., Xiang, J., Xu, J., Liao, H.: Part-based visual tracking via online weighted P-N learning. Sci. World J. (2014) Fan, H., Xiang, J., Xu, J., Liao, H.: Part-based visual tracking via online weighted P-N learning. Sci. World J. (2014)
11.
go back to reference Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph based image segmentation. Int. J. Comput. Vis. (IJCV) 59(2), 167–181 (2004)CrossRef Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph based image segmentation. Int. J. Comput. Vis. (IJCV) 59(2), 167–181 (2004)CrossRef
12.
go back to reference Jia, X., Lu, H., Yang, M.-H.: Visual tracking via adaptive structural local sparse appearance model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1822–1829 (2012) Jia, X., Lu, H., Yang, M.-H.: Visual tracking via adaptive structural local sparse appearance model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1822–1829 (2012)
13.
go back to reference Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 34(7), 1409–1422 (2012)CrossRef Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 34(7), 1409–1422 (2012)CrossRef
14.
go back to reference Liang, P., Blasch, E., Ling, H.: Encoding color information for visual tracking: algorithms and benchmark. IEEE Trans. Image Process. (TIP) 24(12), 5630–5644 (2015)MathSciNetCrossRef Liang, P., Blasch, E., Ling, H.: Encoding color information for visual tracking: algorithms and benchmark. IEEE Trans. Image Process. (TIP) 24(12), 5630–5644 (2015)MathSciNetCrossRef
15.
go back to reference Mei, X., Ling, H.: Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 33(11), 2259–2272 (2011)CrossRef Mei, X., Ling, H.: Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 33(11), 2259–2272 (2011)CrossRef
16.
go back to reference Ross, D.A., Lim, J., Lin, R.S., Yang, M.-H.: Incremental learning for robust visual tracking. Int. J. Comput. Vis. (IJCV) 77(1), 125–141 (2008)CrossRef Ross, D.A., Lim, J., Lin, R.S., Yang, M.-H.: Incremental learning for robust visual tracking. Int. J. Comput. Vis. (IJCV) 77(1), 125–141 (2008)CrossRef
17.
go back to reference Wang, D., Lu, H.: Visual tracking via probability continuous outlier model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3478–3485 (2014) Wang, D., Lu, H.: Visual tracking via probability continuous outlier model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3478–3485 (2014)
18.
go back to reference Yang, F., Lu, H., Yang, M.-H.: Robust superpixel tracking. IEEE Trans. Image Process. (TIP) 23(4), 1639–1651 (2014)MathSciNetCrossRef Yang, F., Lu, H., Yang, M.-H.: Robust superpixel tracking. IEEE Trans. Image Process. (TIP) 23(4), 1639–1651 (2014)MathSciNetCrossRef
19.
go back to reference Yang, J., Price, B., Cohen, S., Yang, M.-H.: Context driven scene parsing with attention to rare classes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3294–3301 (2014) Yang, J., Price, B., Cohen, S., Yang, M.-H.: Context driven scene parsing with attention to rare classes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3294–3301 (2014)
20.
go back to reference Zhang, K., Zhang, L., Yang, M.-H.: Fast compressive tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(10), 2002–2015 (2014)CrossRef Zhang, K., Zhang, L., Yang, M.-H.: Fast compressive tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(10), 2002–2015 (2014)CrossRef
21.
go back to reference Zhang, K., Zhang, L., Liu, Q., Zhang, D., Yang, M.-H.: Fast visual tracking via dense spatio-temporal context learning. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 127–141. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10602-1_9 Zhang, K., Zhang, L., Liu, Q., Zhang, D., Yang, M.-H.: Fast visual tracking via dense spatio-temporal context learning. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 127–141. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10602-1_​9
22.
go back to reference Zhang, T., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vis. (IJCV) 101, 367–383 (2013)MathSciNetCrossRef Zhang, T., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vis. (IJCV) 101, 367–383 (2013)MathSciNetCrossRef
23.
go back to reference Zhong, W., Lu, H., Yang, M.-H.: Robust object tracking via sparsity-based collaborative model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1838–1845 (2012) Zhong, W., Lu, H., Yang, M.-H.: Robust object tracking via sparsity-based collaborative model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1838–1845 (2012)
Metadata
Title
Visual Tracking by Local Superpixel Matching with Markov Random Field
Authors
Heng Fan
Jinhai Xiang
Zhongmin Chen
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-48890-5_1