Skip to main content
Top
Published in: Neural Computing and Applications 10/2019

07-03-2018 | Original Article

Object tracking in the presence of shaking motions

Authors: Manna Dai, Shuying Cheng, Xiangjian He, Dadong Wang

Published in: Neural Computing and Applications | Issue 10/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Visual tracking can be particularly interpreted as a process of searching for targets and optimizing the searching. In this paper, we present a novel tracker framework for tracking shaking targets. We formulate the underlying geometrical relevance between a search scope and a target displacement. A uniform sampling among the search scopes is implemented by sliding windows. To alleviate any possible redundant matching, we propose a double-template structure comprising of initial and previous tracking results. The element-wise similarities between a template and its candidates are calculated by jointly using kernel functions which provide a better outlier rejection property. The STC algorithm is used to improve the tracking results by maximizing a confidence map incorporating temporal and spatial context cues about the tracked targets. For better adaptation to appearance variations, we employ a linear interpolation to update the context prior probability of the STC method. Both qualitative and quantitative evaluations are performed on all sequences that contain shaking motions and are selected from the OTB-50 challenging benchmark. The proposed approach is compared with and outperforms 12 state-of-the-art tracking methods on the selected sequences while running on MATLAB without code optimization. We have also performed further experiments on the whole OTB-50 and VOT 2015 datasets. Although the most of sequences in these two datasets do not contain motion blur that this paper is focusing on, the results of our method are still favorable compared with all of the state-of-the-art approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Adam A, Rivlin E, Shimshoni I (2006) Robust fragments-based tracking using the integral histogram. In: 2006 IEEE computer society conference on computer vision and pattern recognition. IEEE, vol 1, pp 798–805 Adam A, Rivlin E, Shimshoni I (2006) Robust fragments-based tracking using the integral histogram. In: 2006 IEEE computer society conference on computer vision and pattern recognition. IEEE, vol 1, pp 798–805
2.
go back to reference Babenko B, Yang MH, Belongie S (2011) Robust object tracking with online multiple instance learning. IEEE Trans Pattern Anal Mach Intell 33(8):1619–1632CrossRef Babenko B, Yang MH, Belongie S (2011) Robust object tracking with online multiple instance learning. IEEE Trans Pattern Anal Mach Intell 33(8):1619–1632CrossRef
3.
go back to reference Bao C, Wu Y, Ling H, Ji H (2012) Real time robust l1 tracker using accelerated proximal gradient approach. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1830–1837 Bao C, Wu Y, Ling H, Ji H (2012) Real time robust l1 tracker using accelerated proximal gradient approach. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1830–1837
4.
go back to reference Bhattacharyya A (1946) On a measure of divergence between two multinomial populations. Sankhyā Indian J Stat 7:401–406MathSciNetMATH Bhattacharyya A (1946) On a measure of divergence between two multinomial populations. Sankhyā Indian J Stat 7:401–406MathSciNetMATH
5.
go back to reference Black MJ, Jepson AD (1998) Eigentracking: robust matching and tracking of articulated objects using a view-based representation. Int J Comput Vis 26(1):63–84CrossRef Black MJ, Jepson AD (1998) Eigentracking: robust matching and tracking of articulated objects using a view-based representation. Int J Comput Vis 26(1):63–84CrossRef
6.
go back to reference Čehovin L, Leonardis A, Kristan M (2016) Robust visual tracking using template anchors. In: 2016 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1–8 Čehovin L, Leonardis A, Kristan M (2016) Robust visual tracking using template anchors. In: 2016 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1–8
7.
go back to reference Cuevas E, Zaldivar D, Rojas R (2005) Kalman filter for vision tracking Cuevas E, Zaldivar D, Rojas R (2005) Kalman filter for vision tracking
8.
go back to reference Dai M, Cheng S, He X (2016) Hybrid generative–discriminative hash tracking with spatio-temporal contextual cues. Neural Comput Appl, pp 1–11 Dai M, Cheng S, He X (2016) Hybrid generative–discriminative hash tracking with spatio-temporal contextual cues. Neural Comput Appl, pp 1–11
9.
go back to reference Dai M, Lin P, Wu L, Chen Z, Lai S, Zhang J, Cheng S, He X (2015) Orderless and blurred visual tracking via spatio-temporal context. In: MultiMedia modeling. Springer, pp 25–36 Dai M, Lin P, Wu L, Chen Z, Lai S, Zhang J, Cheng S, He X (2015) Orderless and blurred visual tracking via spatio-temporal context. In: MultiMedia modeling. Springer, pp 25–36
10.
go back to reference Danelljan M, Hager G, Khan FS, Felsberg M (2016) Discriminative scale space tracking. IEEE Trans Pattern Anal Mach Intell 39:1561–1575CrossRef Danelljan M, Hager G, Khan FS, Felsberg M (2016) Discriminative scale space tracking. IEEE Trans Pattern Anal Mach Intell 39:1561–1575CrossRef
11.
go back to reference Danelljan M, Hager G, Shahbaz Khan F, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. In: Proceedings of the IEEE international conference on computer vision, pp 4310–4318 Danelljan M, Hager G, Shahbaz Khan F, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. In: Proceedings of the IEEE international conference on computer vision, pp 4310–4318
12.
go back to reference Danelljan M, Khan FS, Felsberg M, Weijer Jvd (2014) Adaptive color attributes for real-time visual tracking. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1090–1097 Danelljan M, Khan FS, Felsberg M, Weijer Jvd (2014) Adaptive color attributes for real-time visual tracking. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1090–1097
13.
go back to reference Grabner H, Leistner C, Bischof H (2008) Semi-supervised on-line boosting for robust tracking. In: Computer vision–ECCV 2008. Springer, pp 234–247 Grabner H, Leistner C, Bischof H (2008) Semi-supervised on-line boosting for robust tracking. In: Computer vision–ECCV 2008. Springer, pp 234–247
15.
go back to reference Hare S, Golodetz S, Saffari A, Vineet V, Cheng MM, Hicks SL, Torr PH (2016) Struck: structured output tracking with kernels. IEEE Trans Pattern Anal Mach Intell 38(10):2096–2109CrossRef Hare S, Golodetz S, Saffari A, Vineet V, Cheng MM, Hicks SL, Torr PH (2016) Struck: structured output tracking with kernels. IEEE Trans Pattern Anal Mach Intell 38(10):2096–2109CrossRef
16.
go back to reference Hare S, Saffari A, Torr PH (2011) Struck: structured output tracking with kernels. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 263–270 Hare S, Saffari A, Torr PH (2011) Struck: structured output tracking with kernels. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 263–270
17.
go back to reference Henriques JF, Caseiro R, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels. In: Computer vision–ECCV 2012. Springer, pp 702–715 Henriques JF, Caseiro R, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels. In: Computer vision–ECCV 2012. Springer, pp 702–715
18.
go back to reference Jepson AD, Fleet DJ, El-Maraghi TF (2003) Robust online appearance models for visual tracking. IEEE Trans Pattern Anal Mach Intell 25(10):1296–1311CrossRef Jepson AD, Fleet DJ, El-Maraghi TF (2003) Robust online appearance models for visual tracking. IEEE Trans Pattern Anal Mach Intell 25(10):1296–1311CrossRef
19.
go back to reference Julier SJ, Uhlmann JK, Durrant-Whyte HF (1996) A new approach for the nonlinear transformation of means and covariances in linear filters. IEEE Trans Autom Control 45:477–482CrossRef Julier SJ, Uhlmann JK, Durrant-Whyte HF (1996) A new approach for the nonlinear transformation of means and covariances in linear filters. IEEE Trans Autom Control 45:477–482CrossRef
20.
go back to reference Kalal Z, Matas J, Mikolajczyk K (2010) Pn learning: bootstrapping binary classifiers by structural constraints. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 49–56 Kalal Z, Matas J, Mikolajczyk K (2010) Pn learning: bootstrapping binary classifiers by structural constraints. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 49–56
21.
go back to reference Koikkalainen J, Lötjönen J, Thurfjell L, Rueckert D, Waldemar G, Soininen H, Initiative ADN et al (2011) Multi-template tensor-based morphometry: application to analysis of Alzheimer’s disease. NeuroImage 56(3):1134–1144CrossRef Koikkalainen J, Lötjönen J, Thurfjell L, Rueckert D, Waldemar G, Soininen H, Initiative ADN et al (2011) Multi-template tensor-based morphometry: application to analysis of Alzheimer’s disease. NeuroImage 56(3):1134–1144CrossRef
22.
go back to reference Kristan M, Matas J, Leonardis A, Felsberg M, Cehovin L, Fernandez G, Vojir T, Hager G, Nebehay G, Pflugfelder R (2015) The visual object tracking vot2015 challenge results. In: The IEEE international conference on computer vision (ICCV) workshops Kristan M, Matas J, Leonardis A, Felsberg M, Cehovin L, Fernandez G, Vojir T, Hager G, Nebehay G, Pflugfelder R (2015) The visual object tracking vot2015 challenge results. In: The IEEE international conference on computer vision (ICCV) workshops
23.
go back to reference Kwon J, Lee KM (2010) Visual tracking decomposition. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1269–1276 Kwon J, Lee KM (2010) Visual tracking decomposition. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1269–1276
24.
go back to reference Kwon J, Lee, KM (2011) Tracking by sampling trackers. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 1195–1202 Kwon J, Lee, KM (2011) Tracking by sampling trackers. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 1195–1202
25.
go back to reference Lei JB, Yin JB, Shen HB (2013) Gfo: a data driven approach for optimizing the gaussian function based similarity metric in computational biology. Neurocomputing 99(1):307–315CrossRef Lei JB, Yin JB, Shen HB (2013) Gfo: a data driven approach for optimizing the gaussian function based similarity metric in computational biology. Neurocomputing 99(1):307–315CrossRef
26.
go back to reference Li P, Zhang T, Ma B (2004) Unscented kalman filter for visual curve tracking. Image Vis Comput 22(2):157–164CrossRef Li P, Zhang T, Ma B (2004) Unscented kalman filter for visual curve tracking. Image Vis Comput 22(2):157–164CrossRef
27.
go back to reference Liu M, Zhang D, Shen D (2016) Relationship induced multi-template learning for diagnosis of alzheimers disease and mild cognitive impairment. IEEE Trans Med Imaging 35(6):1463–1474CrossRef Liu M, Zhang D, Shen D (2016) Relationship induced multi-template learning for diagnosis of alzheimers disease and mild cognitive impairment. IEEE Trans Med Imaging 35(6):1463–1474CrossRef
28.
go back to reference Mahalanobis PC (1936) On the generalized distance in statistics. Proc Natl Inst Sci (Calcutta) 2:49–55MATH Mahalanobis PC (1936) On the generalized distance in statistics. Proc Natl Inst Sci (Calcutta) 2:49–55MATH
29.
go back to reference Mei X, Ling H (2009) Robust visual tracking using l1 minimization. In: 2009 IEEE 12th international conference on computer vision. IEEE, pp 1436–1443 Mei X, Ling H (2009) Robust visual tracking using l1 minimization. In: 2009 IEEE 12th international conference on computer vision. IEEE, pp 1436–1443
30.
go back to reference Min R, Wu G, Cheng J, Wang Q, Shen D (2014) Multi-atlas based representations for Alzheimer’s disease diagnosis. Hum Brain Map 35(10):5052–5070CrossRef Min R, Wu G, Cheng J, Wang Q, Shen D (2014) Multi-atlas based representations for Alzheimer’s disease diagnosis. Hum Brain Map 35(10):5052–5070CrossRef
31.
go back to reference Models S (1979) Stochastic models, estimation, and control. Academic Press, London Models S (1979) Stochastic models, estimation, and control. Academic Press, London
32.
go back to reference Oron S, Bar-Hillel A, Levi D, Avidan S (2012) Locally orderless tracking. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1940–1947 Oron S, Bar-Hillel A, Levi D, Avidan S (2012) Locally orderless tracking. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1940–1947
33.
go back to reference Oyedotun OK, Khashman A (2016) Deep learning in vision-based static hand gesture recognition. Neural Comput Appl 28:3941–3951CrossRef Oyedotun OK, Khashman A (2016) Deep learning in vision-based static hand gesture recognition. Neural Comput Appl 28:3941–3951CrossRef
34.
go back to reference Ross DA, Lim J, Lin RS, Yang MH (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77(1–3):125–141CrossRef Ross DA, Lim J, Lin RS, Yang MH (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77(1–3):125–141CrossRef
35.
go back to reference Song H (2014) Robust visual tracking via online informative feature selection. Electron Lett 50(25):1931–1933CrossRef Song H (2014) Robust visual tracking via online informative feature selection. Electron Lett 50(25):1931–1933CrossRef
36.
go back to reference Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Sixth international conference on computer vision. IEEE, pp 839–846 Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Sixth international conference on computer vision. IEEE, pp 839–846
37.
go back to reference Julier SJ, Uhlmann JK (1997) A new extension of the kalman filter to nonlinear systems, vol 3068, pp 182–193 Julier SJ, Uhlmann JK (1997) A new extension of the kalman filter to nonlinear systems, vol 3068, pp 182–193
38.
go back to reference Van De Weijer J, Schmid C, Verbeek J, Larlus D (2009) Learning color names for real-world applications. IEEE Trans Image Process 18(7):1512–1523MathSciNetCrossRef Van De Weijer J, Schmid C, Verbeek J, Larlus D (2009) Learning color names for real-world applications. IEEE Trans Image Process 18(7):1512–1523MathSciNetCrossRef
39.
go back to reference Wang N, Yeung DY (2013) Learning a deep compact image representation for visual tracking. In: Advances in neural information processing systems, pp 809–817 Wang N, Yeung DY (2013) Learning a deep compact image representation for visual tracking. In: Advances in neural information processing systems, pp 809–817
40.
go back to reference Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 2411–2418 Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 2411–2418
41.
go back to reference Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2411–2418 Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2411–2418
42.
go back to reference Yang C, Duraiswami R, Davis L (2005) Efficient mean-shift tracking via a new similarity measure. In: 2005 IEEE Computer Society conference on computer vision and pattern recognition (CVPR’05). IEEE, vol 1, pp 176–183 Yang C, Duraiswami R, Davis L (2005) Efficient mean-shift tracking via a new similarity measure. In: 2005 IEEE Computer Society conference on computer vision and pattern recognition (CVPR’05). IEEE, vol 1, pp 176–183
43.
go back to reference Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surv (CSUR) 38(4):13CrossRef Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surv (CSUR) 38(4):13CrossRef
44.
go back to reference Zhang H, Cao X, Ho JKL, Chow TWS (2016) Object-level video advertising: an optimization framework. IEEE Trans Ind Inf 13:520–531CrossRef Zhang H, Cao X, Ho JKL, Chow TWS (2016) Object-level video advertising: an optimization framework. IEEE Trans Ind Inf 13:520–531CrossRef
45.
go back to reference Zhang K, Liu Q, Wu Y, Yang MH (2016) Robust visual tracking via convolutional networks without training. IEEE Trans Image Process 25(4):1779–1792MathSciNetMATH Zhang K, Liu Q, Wu Y, Yang MH (2016) Robust visual tracking via convolutional networks without training. IEEE Trans Image Process 25(4):1779–1792MathSciNetMATH
46.
go back to reference Zhang K, Song H (2013) Real-time visual tracking via online weighted multiple instance learning. Pattern Recogn 46(1):397–411MathSciNetCrossRef Zhang K, Song H (2013) Real-time visual tracking via online weighted multiple instance learning. Pattern Recogn 46(1):397–411MathSciNetCrossRef
47.
go back to reference Zhang K, Zhang L, Liu Q, Zhang D, Yang MH (2014) Fast visual tracking via dense spatio-temporal context learning. In: Computer Vision–ECCV. Springer, pp 127–141 Zhang K, Zhang L, Liu Q, Zhang D, Yang MH (2014) Fast visual tracking via dense spatio-temporal context learning. In: Computer Vision–ECCV. Springer, pp 127–141
48.
go back to reference Zhang K, Zhang L, Yang MH (2012) Real-time compressive tracking. In: Computer vision–ECCV 2012. Springer, pp 864–877 Zhang K, Zhang L, Yang MH (2012) Real-time compressive tracking. In: Computer vision–ECCV 2012. Springer, pp 864–877
49.
go back to reference Zhou QH, Lu H, Yang MH (2011) Online multiple support instance tracking. In: 2011 IEEE international conference on automatic face and gesture recognition and workshops (FG 2011). IEEE, pp 545–552 Zhou QH, Lu H, Yang MH (2011) Online multiple support instance tracking. In: 2011 IEEE international conference on automatic face and gesture recognition and workshops (FG 2011). IEEE, pp 545–552
50.
go back to reference Zhou T, He X, Xie K, Fu K, Zhang J, Yang J (2015) Robust visual tracking via efficient manifold ranking with low-dimensional compressive features. Pattern Recogn 48(8):2459–2473CrossRef Zhou T, He X, Xie K, Fu K, Zhang J, Yang J (2015) Robust visual tracking via efficient manifold ranking with low-dimensional compressive features. Pattern Recogn 48(8):2459–2473CrossRef
Metadata
Title
Object tracking in the presence of shaking motions
Authors
Manna Dai
Shuying Cheng
Xiangjian He
Dadong Wang
Publication date
07-03-2018
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 10/2019
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-3387-3

Other articles of this Issue 10/2019

Neural Computing and Applications 10/2019 Go to the issue

Premium Partner