Skip to main content
Top

2018 | OriginalPaper | Chapter

Multi-branch Siamese Networks with Online Selection for Object Tracking

Authors : Zhenxi Li, Guillaume-Alexandre Bilodeau, Wassim Bouachir

Published in: Advances in Visual Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a robust object tracking algorithm based on a branch selection mechanism to choose the most efficient object representations from multi-branch siamese networks. While most deep learning trackers use a single CNN for target representation, the proposed Multi-Branch Siamese Tracker (MBST) employs multiple branches of CNNs pre-trained for different tasks, and used for various target representations in our tracking method. With our branch selection mechanism, the appropriate CNN branch is selected depending on the target characteristics in an online manner. By using the most adequate target representation with respect to the tracked object, our method achieves real-time tracking, while obtaining improved performance compared to standard Siamese network trackers on object tracking benchmarks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Valmadre, J., Bertinetto, L., Henriques, J.F., Vedaldi, A., Torr, P.H: End-to-end representation learning for correlation filter based tracking. In: CVPR 2017, pp. 5000–5008. IEEE (2017) Valmadre, J., Bertinetto, L., Henriques, J.F., Vedaldi, A., Torr, P.H: End-to-end representation learning for correlation filter based tracking. In: CVPR 2017, pp. 5000–5008. IEEE (2017)
4.
go back to reference Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: CVPR 2013, pp. 2411–2418 (2013) Wu, Y., Lim, J., Yang, M.H.: Online object tracking: a benchmark. In: CVPR 2013, pp. 2411–2418 (2013)
5.
go back to reference Wu, Y., Lim, J., Yang, M.H.: Object tracking benchmark. TPAMI 37(9), 1834–1848 (2015)CrossRef Wu, Y., Lim, J., Yang, M.H.: Object tracking benchmark. TPAMI 37(9), 1834–1848 (2015)CrossRef
6.
go back to reference He, A., Luo, C., Tian, X., Zeng, W.: A twofold siamese network for real-time object tracking. In: CVPR 2018, pp. 4834–4843 (2018) He, A., Luo, C., Tian, X., Zeng, W.: A twofold siamese network for real-time object tracking. In: CVPR 2018, pp. 4834–4843 (2018)
7.
go back to reference Huang, C., Lucey, S., Ramanan, D.: Learning policies for adaptive tracking with deep feature cascades. In: ICCV 2017, pp. 105–114 (2017) Huang, C., Lucey, S., Ramanan, D.: Learning policies for adaptive tracking with deep feature cascades. In: ICCV 2017, pp. 105–114 (2017)
8.
go back to reference Choi, J., et al.: Context-aware deep feature compression for high-speed visual tracking. In: CVPR 2018, pp. 479–488 (2018) Choi, J., et al.: Context-aware deep feature compression for high-speed visual tracking. In: CVPR 2018, pp. 479–488 (2018)
9.
go back to reference Nam, H., Han, B: Learning multi-domain convolutional neural networks for visual tracking. In: CVPR 2016, pp. 4293–4302 (2016) Nam, H., Han, B: Learning multi-domain convolutional neural networks for visual tracking. In: CVPR 2016, pp. 4293–4302 (2016)
11.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS 2012, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS 2012, pp. 1097–1105 (2012)
12.
13.
go back to reference Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., Torr, P.H.: Staple: Complementary learners for real-time tracking. In: CVPR 2016, pp. 1401–1409 (2016) Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., Torr, P.H.: Staple: Complementary learners for real-time tracking. In: CVPR 2016, pp. 1401–1409 (2016)
14.
go back to reference Ma, C., Yang, X., Zhang, C., Yang, M.H.: Long-term correlation tracking. In: CVPR 2015, pp. 5388–5396 (2015) Ma, C., Yang, X., Zhang, C., Yang, M.H.: Long-term correlation tracking. In: CVPR 2015, pp. 5388–5396 (2015)
15.
go back to reference Hare, S., Saffari, A., Torr, P.H.: Struck: structured output tracking with kernels. In: ICCV 2011, pp. 263–270 (2011) Hare, S., Saffari, A., Torr, P.H.: Struck: structured output tracking with kernels. In: ICCV 2011, pp. 263–270 (2011)
17.
go back to reference Zhong, W., Lu, H., Yang, M.H.: Robust object tracking via sparsity-based collaborative model. In: CVPR 2012, pp. 1838–1845 (2012) Zhong, W., Lu, H., Yang, M.H.: Robust object tracking via sparsity-based collaborative model. In: CVPR 2012, pp. 1838–1845 (2012)
18.
go back to reference Han, B., Sim, J., Adam, H.: BranchOut: regularization for online ensemble tracking with convolutional neural networks. In: ICCV 2017, pp. 2217–2224 (2017) Han, B., Sim, J., Adam, H.: BranchOut: regularization for online ensemble tracking with convolutional neural networks. In: ICCV 2017, pp. 2217–2224 (2017)
19.
go back to reference Wang, M., Liu, Y., Huang, Z.: Large margin object tracking with circulant feature maps. In: CVPR 2017, pp. 21–26 (2017) Wang, M., Liu, Y., Huang, Z.: Large margin object tracking with circulant feature maps. In: CVPR 2017, pp. 21–26 (2017)
20.
go back to reference Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., Tao, D.: Multi-store tracker (muster): a cognitive psychology inspired approach to object tracking. In: CVPR 2015, pp. 749–758 (2015) Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., Tao, D.: Multi-store tracker (muster): a cognitive psychology inspired approach to object tracking. In: CVPR 2015, pp. 749–758 (2015)
21.
go back to reference Kalal, Z., Mikolajczyk, K., Matas, J., et al.: Tracking-learning-detection. TPAMI 34(7), 1409 (2012)CrossRef Kalal, Z., Mikolajczyk, K., Matas, J., et al.: Tracking-learning-detection. TPAMI 34(7), 1409 (2012)CrossRef
Metadata
Title
Multi-branch Siamese Networks with Online Selection for Object Tracking
Authors
Zhenxi Li
Guillaume-Alexandre Bilodeau
Wassim Bouachir
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-03801-4_28

Premium Partner