Skip to main content

2018 | OriginalPaper | Buchkapitel

Visual Tracking via Spatially Aligned Correlation Filters Network

verfasst von : Mengdan Zhang, Qiang Wang, Junliang Xing, Jin Gao, Peixi Peng, Weiming Hu, Steve Maybank

Erschienen in: Computer Vision – ECCV 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Correlation filters based trackers rely on a periodic assumption of the search sample to efficiently distinguish the target from the background. This assumption however yields undesired boundary effects and restricts aspect ratios of search samples. To handle these issues, an end-to-end deep architecture is proposed to incorporate geometric transformations into a correlation filters based network. This architecture introduces a novel spatial alignment module, which provides continuous feedback for transforming the target from the border to the center with a normalized aspect ratio. It enables correlation filters to work on well-aligned samples for better tracking. The whole architecture not only learns a generic relationship between object geometric transformations and object appearances, but also learns robust representations coupled to correlation filters in case of various geometric transformations. This lightweight architecture permits real-time speed. Experiments show our tracker effectively handles boundary effects and aspect ratio variations, achieving state-of-the-art tracking results on recent benchmarks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Andriluka, M., Roth, S., Schiele, B.: People-tracking-by-detection and people-detection-by-tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008) Andriluka, M., Roth, S., Schiele, B.: People-tracking-by-detection and people-detection-by-tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
3.
Zurück zum Zitat Bolme, D., Beveridge, J., Draper, B., Lui, Y.: Visual object tracking using adaptive correlation filters. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2544–2550 (2010) Bolme, D., Beveridge, J., Draper, B., Lui, Y.: Visual object tracking using adaptive correlation filters. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2544–2550 (2010)
5.
Zurück zum Zitat Choi, J., Chang, H., Yun, S., Fischer, T., Demiris, Y., Choi, J.: Attentional correlation filter network for adaptive visual tracking, pp. 4828–4837 (2017) Choi, J., Chang, H., Yun, S., Fischer, T., Demiris, Y., Choi, J.: Attentional correlation filter network for adaptive visual tracking, pp. 4828–4837 (2017)
6.
Zurück zum Zitat Danelljan, M., Bhat, G., Khan, F., Felsberg, M.: ECO: efficient convolution operators for tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 6931–6939 (2017) Danelljan, M., Bhat, G., Khan, F., Felsberg, M.: ECO: efficient convolution operators for tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 6931–6939 (2017)
7.
Zurück zum Zitat Danelljan, M., Häger, G., Khan, F., Felsberg, M.: Convolutional features for correlation filter based visual tracking. In: Proceedings of IEEE International Conference on Computer Vision Workshops, pp. 58–66 (2015) Danelljan, M., Häger, G., Khan, F., Felsberg, M.: Convolutional features for correlation filter based visual tracking. In: Proceedings of IEEE International Conference on Computer Vision Workshops, pp. 58–66 (2015)
8.
Zurück zum Zitat Danelljan, M., Häger, G., Khan, F., Felsberg, M.: Accurate scale estimation for robust visual tracking. In: Proceedings of British Machine Vision Conference, pp. 65.1–65.11 (2014) Danelljan, M., Häger, G., Khan, F., Felsberg, M.: Accurate scale estimation for robust visual tracking. In: Proceedings of British Machine Vision Conference, pp. 65.1–65.11 (2014)
9.
Zurück zum Zitat Danelljan, M., Häger, G., Khan, F., Felsberg, M.: Learning spatially regularized correlation filters for visual tracking. In: Proceedings of IEEE International Conference on Computer Vision, pp. 4310–4318 (2015) Danelljan, M., Häger, G., Khan, F., Felsberg, M.: Learning spatially regularized correlation filters for visual tracking. In: Proceedings of IEEE International Conference on Computer Vision, pp. 4310–4318 (2015)
10.
Zurück zum Zitat Danelljan, M., Khan, F., Felsberg, M., van de Weijer, J.: Adaptive color attributes for real-time visual tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1090–1097 (2014) Danelljan, M., Khan, F., Felsberg, M., van de Weijer, J.: Adaptive color attributes for real-time visual tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1090–1097 (2014)
11.
12.
Zurück zum Zitat Deng, J., Dong, W., Socher, R., Li, L., Li, K., Li, F.: Imagenet: a large-scale hierarchical image database. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009) Deng, J., Dong, W., Socher, R., Li, L., Li, K., Li, F.: Imagenet: a large-scale hierarchical image database. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009)
13.
Zurück zum Zitat Emami, A., Dadgostar, F., Bigdeli, A., Lovell, B.: Role of spatiotemporal oriented energy features for robust visual tracking in video surveillance. In: Proceedings of International Conference on Advanced Video and Signal-Based Surveillance, pp. 349–354 (2012) Emami, A., Dadgostar, F., Bigdeli, A., Lovell, B.: Role of spatiotemporal oriented energy features for robust visual tracking in video surveillance. In: Proceedings of International Conference on Advanced Video and Signal-Based Surveillance, pp. 349–354 (2012)
15.
Zurück zum Zitat Hamed, K., Ashton, F., Simon, L.: Learning background-aware correlation filters for visual tracking. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1144–1152 (2017) Hamed, K., Ashton, F., Simon, L.: Learning background-aware correlation filters for visual tracking. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1144–1152 (2017)
16.
Zurück zum Zitat Hamed, K., Terence, S., Simon, L.: Correlation filters with limited boundaries. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 4630–4638 (2015) Hamed, K., Terence, S., Simon, L.: Correlation filters with limited boundaries. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 4630–4638 (2015)
18.
Zurück zum Zitat Henriques, J., Caseiro, R., Martins, P., Batista, J.: High-speed tracking with kernelized correlation filters. IEEE Trans Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)CrossRef Henriques, J., Caseiro, R., Martins, P., Batista, J.: High-speed tracking with kernelized correlation filters. IEEE Trans Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)CrossRef
19.
Zurück zum Zitat Hong, S., You, T., Kwak, S., Han, B.: Online tracking by learning discriminative saliency map with convolutional neural network. In: Proceedings of International Conference on Machine Learning, pp. 597–606 (2015) Hong, S., You, T., Kwak, S., Han, B.: Online tracking by learning discriminative saliency map with convolutional neural network. In: Proceedings of International Conference on Machine Learning, pp. 597–606 (2015)
20.
Zurück zum Zitat Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., Tao, D.: Multi-store tracker (MUSTer): a cognitive psychology inspired approach to object tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 749–758 (2015) Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., Tao, D.: Multi-store tracker (MUSTer): a cognitive psychology inspired approach to object tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 749–758 (2015)
21.
Zurück zum Zitat Jaderberg, M., Simonyan, K., Zisserman, A.: Spatial transformer networks. In: Proceedings of Neural Information Processing Systems, pp. 2017–2025 (2015) Jaderberg, M., Simonyan, K., Zisserman, A.: Spatial transformer networks. In: Proceedings of Neural Information Processing Systems, pp. 2017–2025 (2015)
22.
Zurück zum Zitat Kristan, M., et al.: The visual object tracking VOT2015 challenge results. In: Proceedings of IEEE International Conference on Computer Vision Workshops, pp. 1–23 (2015) Kristan, M., et al.: The visual object tracking VOT2015 challenge results. In: Proceedings of IEEE International Conference on Computer Vision Workshops, pp. 1–23 (2015)
23.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.: Imagenet classification with deep convolutional neural networks. In: Proceedings of Neural Information Processing Systems, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.: Imagenet classification with deep convolutional neural networks. In: Proceedings of Neural Information Processing Systems, pp. 1097–1105 (2012)
24.
Zurück zum Zitat Kwon, J., Lee, K.: Visual tracking decomposition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1269–1276 (2010) Kwon, J., Lee, K.: Visual tracking decomposition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1269–1276 (2010)
25.
Zurück zum Zitat Li, F., Yao, Y., Li, P., Zhang, D., Zuo, W., Yang, M.: Integrating boundary and center correlation filters for visual tracking with aspect ratio variation. arXiv preprint arXiv:1710.02039 (2017) Li, F., Yao, Y., Li, P., Zhang, D., Zuo, W., Yang, M.: Integrating boundary and center correlation filters for visual tracking with aspect ratio variation. arXiv preprint arXiv:​1710.​02039 (2017)
27.
Zurück zum Zitat Liu, L., Xing, J., Ai, H., Ruan, X.: Hand posture recognition using finger geometric feature. In: Proceedings of IEEE International Conference on Pattern Recognition, pp. 565–568 (2012) Liu, L., Xing, J., Ai, H., Ruan, X.: Hand posture recognition using finger geometric feature. In: Proceedings of IEEE International Conference on Pattern Recognition, pp. 565–568 (2012)
28.
Zurück zum Zitat Mueller, M., Neil, S., Bernard, G.: Context-aware correlation filter tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1387–1395 (2017) Mueller, M., Neil, S., Bernard, G.: Context-aware correlation filter tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1387–1395 (2017)
29.
Zurück zum Zitat Ma, C., Huang, J., Yang, X., Yang, M.: Hierarchical convolutional features for visual tracking. In: Proceedings of IEEE International Conference on Computer Vision, pp. 3074–3082 (2015) Ma, C., Huang, J., Yang, X., Yang, M.: Hierarchical convolutional features for visual tracking. In: Proceedings of IEEE International Conference on Computer Vision, pp. 3074–3082 (2015)
30.
Zurück zum Zitat Ma, C., Yang, X., Zhang, C., Yang, M.: Long-term correlation tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 5388–5396 (2015) Ma, C., Yang, X., Zhang, C., Yang, M.: Long-term correlation tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 5388–5396 (2015)
31.
Zurück zum Zitat Nam, H., Han, B.: Learning multi-domain convolutional neural networks for visual tracking, pp. 4293–4302 (2016) Nam, H., Han, B.: Learning multi-domain convolutional neural networks for visual tracking, pp. 4293–4302 (2016)
32.
Zurück zum Zitat Qi, Y., et al.: Hedged deep tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 4303–4311 (2016) Qi, Y., et al.: Hedged deep tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 4303–4311 (2016)
33.
Zurück zum Zitat Wang, Q., Gao, J., Xing, J., Zhang, M., Hu, W.: DCFNet: discriminant correlation filters network for visual tracking. arXiv preprint arXiv:1704.04057 (2017) Wang, Q., Gao, J., Xing, J., Zhang, M., Hu, W.: DCFNet: discriminant correlation filters network for visual tracking. arXiv preprint arXiv:​1704.​04057 (2017)
34.
Zurück zum Zitat Song, W., Zhu, J., Li, Y., Chen, C.: Image alignment by online robust PCA via stochastic gradient descent. IEEE Trans Circuits Syst. Video Technol. 26(7), 1241–1250 (2016)CrossRef Song, W., Zhu, J., Li, Y., Chen, C.: Image alignment by online robust PCA via stochastic gradient descent. IEEE Trans Circuits Syst. Video Technol. 26(7), 1241–1250 (2016)CrossRef
35.
Zurück zum Zitat Song, Y., Ma, C., Gong, L., Zhang, J., Lau, R., Yang, M.: CREST: convolutional residual learning for visual tracking, pp. 2574–2583 (2017) Song, Y., Ma, C., Gong, L., Zhang, J., Lau, R., Yang, M.: CREST: convolutional residual learning for visual tracking, pp. 2574–2583 (2017)
36.
Zurück zum Zitat Tang, M., Feng, J.: Multi-kernel correlation filter for visual tracking. In: Proceedings of IEEE International Conference on Computer Vision, pp. 3038–3046 (2015) Tang, M., Feng, J.: Multi-kernel correlation filter for visual tracking. In: Proceedings of IEEE International Conference on Computer Vision, pp. 3038–3046 (2015)
37.
Zurück zum Zitat Tao, R., Gavves, E., Smeulders, A.: Siamese instance search for tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1420–1429 (2016) Tao, R., Gavves, E., Smeulders, A.: Siamese instance search for tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1420–1429 (2016)
38.
Zurück zum Zitat Valmadre, J., Bertinetto, L., Henriques, J., Vedaldi, A., Torr, P.: End-to-end representation learning for correlation filter based tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 5000–5008 (2017) Valmadre, J., Bertinetto, L., Henriques, J., Vedaldi, A., Torr, P.: End-to-end representation learning for correlation filter based tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 5000–5008 (2017)
39.
Zurück zum Zitat Vedaldi, A., Lenc, K.: MatConvNet: convolutional neural networks for Matlab. In: ACM MM (2015) Vedaldi, A., Lenc, K.: MatConvNet: convolutional neural networks for Matlab. In: ACM MM (2015)
40.
Zurück zum Zitat Wang, L., Ouyang, W., Wang, X., Lu, H.: Visual tracking with fully convolutional networks. In: Proceedings of IEEE International Conference on Computer Vision, pp. 3119–3127 (2015) Wang, L., Ouyang, W., Wang, X., Lu, H.: Visual tracking with fully convolutional networks. In: Proceedings of IEEE International Conference on Computer Vision, pp. 3119–3127 (2015)
41.
Zurück zum Zitat Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411–2418 (2013) Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411–2418 (2013)
42.
Zurück zum Zitat Wu, Y., Lim, J., Yang, M.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1834–1848 (2015)CrossRef Wu, Y., Lim, J., Yang, M.: Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1834–1848 (2015)CrossRef
43.
Zurück zum Zitat Wu, Y., Shen, B., Ling, H.: Online robust image alignment via iterative convex optimization. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1808–1814 (2012) Wu, Y., Shen, B., Ling, H.: Online robust image alignment via iterative convex optimization. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1808–1814 (2012)
44.
Zurück zum Zitat Zhang, M., Xing, J., Gao, J., Hu, W.: Robust visual tracking using joint scale-spatial correlation filters. In: Proceedings of IEEE International Conference on Image Processing, pp. 1468–1472 (2015) Zhang, M., Xing, J., Gao, J., Hu, W.: Robust visual tracking using joint scale-spatial correlation filters. In: Proceedings of IEEE International Conference on Image Processing, pp. 1468–1472 (2015)
45.
Metadaten
Titel
Visual Tracking via Spatially Aligned Correlation Filters Network
verfasst von
Mengdan Zhang
Qiang Wang
Junliang Xing
Jin Gao
Peixi Peng
Weiming Hu
Steve Maybank
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01219-9_29