Skip to main content
Top

2018 | OriginalPaper | Chapter

Salient Superpixel Visual Tracking with Coarse-to-Fine Segmentation and Manifold Ranking

Authors : Jin Zhan, Huimin Zhao

Published in: Advances in Brain Inspired Cognitive Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We propose a novel salient superpixel based tracking algorithm using Coarse-to-Fine segmentation on graph model, where target state is estimated by a combination of pixel-level cues and middle-level cues to achieve accurate target appearance model. We exploit temporal optical flow and color distribution characteristics as coarse grained information from pixel-level processing, and propagate to fine-grained superpixels to improve initial target appearance segmentation from bounding box annotations. Our algorithm constructs a graph model with manifold ranking by improved superpixels to estimate the saliency of target foreground and background in subsequent frames. The tracking result is located by calculating the weight of multi-scale box, where the weight depends on the similarity of scores of foreground and background superpixels in the scale box. We compared our algorithm with the existing techniques in OTB100 dataset, and achieved substantially better performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yang, C., Zhang, L.: Saliency detection via graph-based manifold ranking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3166–3173. IEEE, Portland (2013) Yang, C., Zhang, L.: Saliency detection via graph-based manifold ranking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3166–3173. IEEE, Portland (2013)
2.
go back to reference Achanta, R.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef Achanta, R.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRef
4.
go back to reference Rother, C., Kolmogorov, V.: Grabcut: interactive foreground extraction using iterated graph cuts. In: ACM SIGGRAPH, Los Angeles, vol. 23, pp. 309–314 (2004) Rother, C., Kolmogorov, V.: Grabcut: interactive foreground extraction using iterated graph cuts. In: ACM SIGGRAPH, Los Angeles, vol. 23, pp. 309–314 (2004)
5.
go back to reference Liu, Q.: Decontaminate feature for tracking: adaptive tracking via evolutionary feature subset. J. Electron. Imaging 26(6), 1 (2017) Liu, Q.: Decontaminate feature for tracking: adaptive tracking via evolutionary feature subset. J. Electron. Imaging 26(6), 1 (2017)
6.
go back to reference Son, J., Jung, I.: Tracking-by-segmentation with online gradient boosting decision tree. In: International Conference on Computer Vision (ICCV), pp. 3056–3064. IEEE, Santiago (2015) Son, J., Jung, I.: Tracking-by-segmentation with online gradient boosting decision tree. In: International Conference on Computer Vision (ICCV), pp. 3056–3064. IEEE, Santiago (2015)
7.
go back to reference Ren, X., Malik, J.: Tracking as repeated figure/ground segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8. IEEE, Hawaii (2007) Ren, X., Malik, J.: Tracking as repeated figure/ground segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8. IEEE, Hawaii (2007)
8.
go back to reference Yan, Y., Ren, J.: Cognitive fusion of thermal and visible imagery for effective detection and tracking of pedestrians in videos. Cognit. Comput. 10(1), 94–104 (2018)MathSciNetCrossRef Yan, Y., Ren, J.: Cognitive fusion of thermal and visible imagery for effective detection and tracking of pedestrians in videos. Cognit. Comput. 10(1), 94–104 (2018)MathSciNetCrossRef
9.
go back to reference Kalal, Z., Mikolajczyk, K.: Tracking-learning-detection. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1409–1422 (2012)CrossRef Kalal, Z., Mikolajczyk, K.: Tracking-learning-detection. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1409–1422 (2012)CrossRef
10.
go back to reference Xu, C.: Robust visual tracking via online multiple instance learning with Fisher information. Pattern Recognit. 48(12), 3917–3926 (2015)CrossRef Xu, C.: Robust visual tracking via online multiple instance learning with Fisher information. Pattern Recognit. 48(12), 3917–3926 (2015)CrossRef
11.
go back to reference Hare, S., Saffari, A., Torr, P.H.S.: Struck: structured output tracking with kernels. In: 13th International Conference on Computer Vision (ICCV), pp. 263–270. IEEE, Barcelona (2011) Hare, S., Saffari, A., Torr, P.H.S.: Struck: structured output tracking with kernels. In: 13th International Conference on Computer Vision (ICCV), pp. 263–270. IEEE, Barcelona (2011)
12.
go back to reference Wang, S., Lu, H.: Superpixel tracking. In: 13th International Conference on Computer Vision (ICCV), pp. 1323–1330. IEEE, Barcelona (2011) Wang, S., Lu, H.: Superpixel tracking. In: 13th International Conference on Computer Vision (ICCV), pp. 1323–1330. IEEE, Barcelona (2011)
14.
go back to reference Zhou, X.: Learning a superpixel-driven speed function for level set tracking. IEEE Trans. Cybern. 46(7), 1498–1510 (2016)CrossRef Zhou, X.: Learning a superpixel-driven speed function for level set tracking. IEEE Trans. Cybern. 46(7), 1498–1510 (2016)CrossRef
16.
go back to reference Xiao, J., Stolkin, R., Leonardis, A.: Single target tracking using adaptive clustered decision trees and dynamic multilevel appearance models. In: Computer Vision and Pattern Recognition (CVPR), pp. 4978–4987. IEEE, Boston (2015) Xiao, J., Stolkin, R., Leonardis, A.: Single target tracking using adaptive clustered decision trees and dynamic multilevel appearance models. In: Computer Vision and Pattern Recognition (CVPR), pp. 4978–4987. IEEE, Boston (2015)
17.
go back to reference Yeo, D., Son, J., Han, B., Han, J.H.: Superpixel-based tracking-by-segmentation using Markov chains. In: Computer Vision and Pattern Recognition (CVPR), pp. 511–520. IEEE, Hawaii (2017) Yeo, D., Son, J., Han, B., Han, J.H.: Superpixel-based tracking-by-segmentation using Markov chains. In: Computer Vision and Pattern Recognition (CVPR), pp. 511–520. IEEE, Hawaii (2017)
18.
go back to reference Wang, L., Lu, H., Yang, M.H.: Constrained superpixel tracking. IEEE Trans. Cybern. 48(3), 1030–1041 (2018)CrossRef Wang, L., Lu, H., Yang, M.H.: Constrained superpixel tracking. IEEE Trans. Cybern. 48(3), 1030–1041 (2018)CrossRef
19.
go back to reference Liu, C.: Beyond pixels: exploring new representations and applications for motion analysis. Doctoral Thesis. Massachusetts Institute of Technology (2009) Liu, C.: Beyond pixels: exploring new representations and applications for motion analysis. Doctoral Thesis. Massachusetts Institute of Technology (2009)
21.
go back to reference Rosenfeld, A., Weinshall, D.: Extracting foreground masks towards object recognition. In: IEEE International Conference on Computer Vision (ICCV), 1371–1378. IEEE (2011) Rosenfeld, A., Weinshall, D.: Extracting foreground masks towards object recognition. In: IEEE International Conference on Computer Vision (ICCV), 1371–1378. IEEE (2011)
22.
go back to reference Chai, Y., Ren, J., Zhao, H., et al.: Hierarchical and multi-featured fusion for effective gait recognition under variable scenarios. Pattern Anal. Appl. 19(4), 905–917 (2016)MathSciNetCrossRef Chai, Y., Ren, J., Zhao, H., et al.: Hierarchical and multi-featured fusion for effective gait recognition under variable scenarios. Pattern Anal. Appl. 19(4), 905–917 (2016)MathSciNetCrossRef
23.
go back to reference Ezrinda, M.Z., Kamarul Hawari, G., Ren, J., Mohd Zuki, S.: A hybrid thermal-visible fusion for outdoor human detection. J. Telecommun. Electron. Comput. Eng. (JTEC) 10(1–4), 79–83 (2018) Ezrinda, M.Z., Kamarul Hawari, G., Ren, J., Mohd Zuki, S.: A hybrid thermal-visible fusion for outdoor human detection. J. Telecommun. Electron. Comput. Eng. (JTEC) 10(1–4), 79–83 (2018)
24.
go back to reference Yan, Y., et al.: Unsupervised image saliency detection with Gestalt-laws guided optimization and visual attention based refinement. Pattern Recognit. 79, 65–78 (2018)CrossRef Yan, Y., et al.: Unsupervised image saliency detection with Gestalt-laws guided optimization and visual attention based refinement. Pattern Recognit. 79, 65–78 (2018)CrossRef
25.
go back to reference Wang, Z., et al.: A deep-learning based feature hybrid framework for spatiotemporal saliency detection inside videos. Neurocomputing 287, 68–83 (2018)CrossRef Wang, Z., et al.: A deep-learning based feature hybrid framework for spatiotemporal saliency detection inside videos. Neurocomputing 287, 68–83 (2018)CrossRef
26.
go back to reference Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)CrossRef Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)CrossRef
27.
go back to reference Wu, Y.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 37(9), 1834–1848 (2015)CrossRef Wu, Y.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 37(9), 1834–1848 (2015)CrossRef
29.
go back to reference Babenko, B., Yang, M.-H.: Visual tracking with online multiple instance learning. In: Computer Vision and Pattern Recognition (CVPR), pp. 983–990. IEEE, Florida (2009) Babenko, B., Yang, M.-H.: Visual tracking with online multiple instance learning. In: Computer Vision and Pattern Recognition (CVPR), pp. 983–990. IEEE, Florida (2009)
30.
go back to reference Liu, B., Huang, J.: Robust tracking using local sparse appearance model and k-selection. In: Computer Vision and Pattern Recognition (CVPR), pp. 1313–1320. IEEE (2011) Liu, B., Huang, J.: Robust tracking using local sparse appearance model and k-selection. In: Computer Vision and Pattern Recognition (CVPR), pp. 1313–1320. IEEE (2011)
Metadata
Title
Salient Superpixel Visual Tracking with Coarse-to-Fine Segmentation and Manifold Ranking
Authors
Jin Zhan
Huimin Zhao
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-00563-4_42

Premium Partner