Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Neural Processing Letters
Published in: Neural Processing Letters 3/2023

29-08-2022

Robust Visual Tracking with Motion-Aware and Automatic Temporal Regularization

Authors: Heng Yuan, Huan Qi

Published in: Neural Processing Letters | Issue 3/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Discriminative correlation filters (DCF) have significantly advanced visual target tracking. However, most DCF-based trackers suffer from various challenges such as occlusion, rotation, and background clutters. Therefore, we propose a novel visual tracking framework, which introduces a motion-aware strategy and automatic temporal regularization mechanism into the spatial-temporal regularization correlation filter (STRCF) to improve tracking stability. Specifically, the motion-aware strategy based on the optimal Kalman filter (KF) is used to estimate the possible state of the target for overcoming the instability problem in complex environments. Furthermore, a novel automatic temporal regularization mechanism is proposed to solve the problem of target drift due to overhigh temporal penalty. Compared with STRCF, our method obtains AUC gains of 5.86%, 2.60%, 3.82%, 4.95%, 3.55%, and 1.90% for the occlusion, motion blur, in-plane Rotation, out-of-plane rotation, background clutters, and scale variation attributes on the OTB-2015 datasets, respectively. Extensive experiment results on OTB-2013, DTB-70, and UAV-123 datasets have proven the effectiveness and stability of our method.
previous article Two Outlier-Sensitive Measures for Semi-supervised Dynamic Ensemble Anomaly Detection Models
next article Stock Trading Strategy of Reinforcement Learning Driven by Turning Point Classification

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Literature
1.
Kim J-S, Kim M-G (2018) 3d articulated human motion analysis system using a single low-cost rgb-d sensor. In: 2018 International conference on information and communication technology convergence (ICTC), pp. 1446–1448. IEEE
2.
Zhu F, Wang L, Wen Y, Yang L, Pan J, Wang Z, Wang W (2021) Failure handling of robotic pick and place tasks with multimodal cues under partial object occlusion. Front Neurorobot 15:11CrossRef
3.
Zou Y, Zhang W, Weng W, Meng Z (2019) Multi-vehicle tracking via real-time detection probes and a Markov decision process policy. Sensors 19(6):1309CrossRef
4.
Zhang T, Xu C, Yang M.-H (2017) Multi-task correlation particle filter for robust object tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4335–4343
5.
Nai K, Li Z, Gan Y, Wang Q (2021) Robust visual tracking via multitask sparse correlation filters learning. IEEE Trans Neural Netw Learn Syst
6.
LuNežič A, Vojíř T, Čehovin Zajc L, Matas J, Kristan M (2018) Discriminative correlation filter Tracner with channel and spatial reliability. Int J Comput Vision 126(7):671–688MathSciNetCrossRef
7.
Ma C, Huang J-B, Yang X, Yang M-H (2015) Hierarchical convolutional features for visual tracking. In: Proceedings of the IEEE international conference on computer vision, pp. 3074–3082
8.
Danelljan M, Hager G, Shahbaz Khan F, Felsberg M (2016) Adaptive decontamination of the training set: A unified formulation for discriminative visual tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1430–1438
9.
Wang N, Song Y, Ma C, Zhou W, Liu W, Li H (2019) Unsupervised deep tracking. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 1308–1317
10.
Yun S, Choi J, Yoo Y, Yun K, Young Choi J (2017) Action-decision networks for visual tracking with deep reinforcement learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2711–2720
11.
Li F, Yao Y, Li P, Zhang D, Zuo W, Yang M-H (2017) Integrating boundary and center correlation filters for visual tracking with aspect ratio variation. In: Proceedings of the IEEE international conference on computer vision workshops, pp. 2001–2009
12.
Li Y, Zhu J (2014) A scale adaptive kernel correlation filter tracker with feature integration. In: European conference on computer vision, pp. 254–265. Springer
13.
Bolme DS, Beveridge JR, Draper BA, Lui YM (2010) Visual object tracking using adaptive correlation filters. In: 2010 IEEE computer society conference on computer vision and pattern recognition, pp. 2544–2550 . IEEE
14.
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol. 1, pp. 886–893. Ieee
15.
Wang M, Liu Y, Huang Z (2017) Large margin object tracking with circulant feature maps. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4021–4029
16.
Danelljan M, Hager G, Shahbaz Khan F, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. In: Proceedings of the IEEE international conference on computer vision, pp. 4310–4318
17.
Li F, Tian C, Zuo W, Zhang L, Yang M-H (2018) Learning spatial-temporal regularized correlation filters for visual tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4904–4913
18.
Danelljan M, Bhat G, Shahbaz Khan F, Felsberg M (2017) Eco: Efficient convolution operators for tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 6638–6646
19.
Xu T, Feng Z-H, Wu X-J, Kittler J (2019) Learning adaptive discriminative correlation filters via temporal consistency preserving spatial feature selection for robust visual object tracking. IEEE Trans Image Process 28(11):5596–5609MathSciNetCrossRefMATH
20.
Wang M, Liu Y, Huang Z (2017) Large margin object tracking with circulant feature maps. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4021–4029
21.
Wu Y, Lim J, Yang M-H (2013) Online object tracking: A benchmark. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2411–2418
22.
Wu Y, Lim J, Yang MH (2015) Object tracking benchmark 37:1834–1848
23.
Li S, Yeung D-Y (2017) Visual object tracking for unmanned aerial vehicles: a benchmark and new motion models. In: Thirty-first AAAI conference on artificial intelligence
24.
Mueller M, Smith N, Ghanem B (2016) A benchmark and simulator for uav tracking. In: European conference on computer vision, pp. 445–461. Springer
25.
Kiani Galoogahi H, Fagg A, Lucey S (2017) Learning background-aware correlation filters for visual tracking. In: Proceedings of the IEEE international conference on computer vision, pp. 1135–1143
26.
Dai K, Wang D, Lu H, Sun C, Li J (2019) Visual tracking via adaptive spatially-regularized correlation filters. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 4670–4679
27.
Guo Q, Han R, Feng W, Chen Z, Wan L (2019) Selective spatial regularization by reinforcement learned decision making for object tracking. IEEE Trans Image Process 29:2999–3013CrossRefMATH
28.
Xu T, Feng Z, Wu X-J, Kittler J (2021) Adaptive channel selection for robust visual object tracking with discriminative correlation filters, vol. 129, pp. 1359–1375. Springer, ???
29.
Huang Z, Fu C, Li Y, Lin F, Lu P (2019) Learning aberrance repressed correlation filters for real-time uav tracking. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 2891–2900
30.
Li S, Liu Y, Zhao Q, Feng Z (2022) Learning residue-aware correlation filters and refining scale for real-time UAV tracking, vol. 127, p. 108614. Elsevier, ???
31.
Guo Y, Yang D, Chen Z (2019) Object tracking on satellite videos: a correlation filter-based tracking method with trajectory correction by kalman filter. IEEE J Selected Topic Appl Earth Observ Remote Sens 12(9):3538–3551CrossRef
32.
Yang H, Wang J, Miao Y, Yang Y, Zhao Z, Wang Z, Sun Q, Wu DO (2019) Combining spatio-temporal context and kalman filtering for visual tracking. Mathematics 7(11):1059CrossRef
33.
Farahi F, Yazdi HS (2020) Probabilistic kalman filter for moving object tracking. Signal Processing: Image Communication 82:115751
34.
Khan B, Ali A, Jalil A, Mehmood K, Murad M, Awan H (2020) Afam-pec: adaptive failure avoidance tracking mechanism using prediction-estimation collaboration. IEEE Access 8:149077–149092CrossRef
35.
Liao J, Qi C, Cao J, Wang X, Ren L, Zhang C (2022) Rotation-aware correlation filters for robust visual tracking. J Vis Commun Image Represent 83:103422CrossRef
36.
Liu K, Gao J, Liu H, Li L, Li B, Hu W (2022) Exploring motion information for distractor suppression in visual tracking. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 1924–1932
37.
Danelljan M, Häger G, Khan FS, Felsberg M (2016) Discriminative scale space tracking, vol. 39, pp. 1561–1575. IEEE, ???
38.
Zhang K, Zhang L, Liu Q, Zhang D, Yang M-H (2014) Fast visual tracking via dense spatio-temporal context learning. In: European conference on computer vision, pp. 127–141. Springer
39.
Ma C, Yang X, Zhang C, Yang M-H (2015) Long-term correlation tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 5388–5396
40.
Hong Z, Chen Z, Wang C, Mei X, Prokhorov D, Tao D (2015) Multi-store tracker (muster): a cognitive psychology inspired approach to object tracking, 749–758
41.
Li Y, Fu C, Ding F, Huang Z, Lu G (2020) Autotrack: Towards high-performance visual tracking for uav with automatic spatio-temporal regularization. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 11923–11932
42.
Henriques JF, Caseiro R, Martins P, Batista J (2014) High-speed tracking with kernelized correlation filters, vol. 37, pp. 583–596. IEEE, ???
43.
Danelljan M, Häger G, Khan F, Felsberg M (2014) Accurate scale estimation for robust visual tracking. Bmva Press
44.
Bertinetto L, Valmadre J, Golodetz S, Miksik O, Torr PH (2016) Staple: Complementary learners for real-time tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1401–1409
45.
Mueller M, Smith N, Ghanem B (2017) Context-aware correlation filter tracking, 1396–1404
46.
Ma Z, Xiang Z (2017) Robust visual tracking via binocular consistent sparse learning. Neural Process Lett 46(2):627–642CrossRef
47.
De Ath G, Everson R (2018) Visual object tracking: The initialisation problem, 142–149. IEEE
48.
Wang N, Zhou W, Tian Q, Hong R, Wang M, Li H (2018) Multi-cue correlation filters for robust visual tracking, 4844–4853
49.
Li X, Ma C, Wu B, He Z, Yang M-H (2019) Target-aware deep tracking, 1369–1378
50.
Li F, Yao Y, Li P, Zhang D, Zuo W, Yang M-H (2017) Integrating boundary and center correlation filters for visual tracking with aspect ratio variation, 2001–2009
51.
Wang N, Song Y, Ma C, Zhou W, Liu W, Li H (2019) Unsupervised deep tracking, 1308–1317
Metadata
Title
Robust Visual Tracking with Motion-Aware and Automatic Temporal Regularization
Authors
Heng Yuan
Huan Qi
Publication date
29-08-2022
Publisher
Springer US
Published in
Neural Processing Letters / Issue 3/2023
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-022-11018-x

Other articles of this Issue 3/2023

Neural Processing Letters 3/2023 Go to the issue

OriginalPaper

Input-to-state Stabilization of Delayed Semi-Markovian Jump Neural Networks Via Sampled-Data Control

OriginalPaper

Data-Driven Deep Learning for The Multi-Hump Solitons and Parameters Discovery in NLS Equations with Generalized -Scarf-II Potentials

OriginalPaper

AI Assisted Attention Mechanism for Hybrid Neural Model to Assess Online Attitudes About COVID-19

OriginalPaper

Integral Sliding Mode Exponential Synchronization of Inertial Memristive Neural Networks with Time Varying Delays

OriginalPaper

Vascular Enhancement Analysis in Lightweight Deep Feature Space

OriginalPaper

A Novel Hybrid Sampling Method ESMOTE+SSLM for Handling the Problem of Class Imbalance with Overlap in Financial Distress Detection