Skip to main content
Top
Published in: Neural Computing and Applications 7/2021

27-06-2020 | Original Article

Performance evaluation of low resolution visual tracking for unmanned aerial vehicles

Authors: Yong Wang, Xian Wei, Hao Shen, Jilin Hu, Lingkun Luo

Published in: Neural Computing and Applications | Issue 7/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Several datasets for unmanned aerial vehicle (UAV) visual tracking research have been released in recent years. Despite their usefulness, whether they are sufficient for understanding the strengths and weakness of different resolution videos tracking remains questionable. Tracking in low resolution videos is a critical problem in UAV tracking. To address this issue, we construct a group of low resolution tracking datasets and study the performance of different trackers on these datasets. We find that some trackers suffered more performance degradation than others, which brings to light a previously unexplored aspect of the tracking methods. The relative rank of these trackers based on their tracking results on the datasets may change in the presence of low resolution. Based on these findings, we develop a multiple feature tracking framework which takes advantage of image enhancement scheme to improve image quality. In addition, we utilize the forward and backward tracking to evaluate multiple feature tracking results. Experimental results demonstrate that our tracker is competitive in performance to state-of-the-art methods in different resolutions scenarios. We believe our studies can provide a solid baseline when conducting experiments for low resolution UAV tracking research.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Mueller M, Smith N, Ghanem B (2016) A benchmark and simulator for UAV tracking. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision – ECCV 2016, vol 9905. Lecture notes in computer science. Springer, ChamCrossRef Mueller M, Smith N, Ghanem B (2016) A benchmark and simulator for UAV tracking. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision – ECCV 2016, vol 9905. Lecture notes in computer science. Springer, ChamCrossRef
2.
go back to reference Siyi L, Yeung D-Y (2017) Visual object tracking for unmanned aerial vehicles: a benchmark and new motion models. AAAI 122:4140–4146 Siyi L, Yeung D-Y (2017) Visual object tracking for unmanned aerial vehicles: a benchmark and new motion models. AAAI 122:4140–4146
3.
go back to reference Dawei D, Qi Y, Yu H, Yang Y, Duan K, Li G, Zhang W, Huang Q, Tian Q (2018) The unmanned aerial vehicle benchmark: object detection and tracking. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 370–386 Dawei D, Qi Y, Yu H, Yang Y, Duan K, Li G, Zhang W, Huang Q, Tian Q (2018) The unmanned aerial vehicle benchmark: object detection and tracking. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 370–386
5.
go back to reference Lu D, Yong W, Robert L, Xin-Bin L, Fu S (2018) Scale-aware RPN for vehicle detection. ISVC 12:487–499 Lu D, Yong W, Robert L, Xin-Bin L, Fu S (2018) Scale-aware RPN for vehicle detection. ISVC 12:487–499
6.
go back to reference Jianan L, Xiaodan L, ShengMei S, Xu T, Jiashi F, Yan S (2017) Scale-aware fast R-CNN for pedestrian detection. IEEE Trans Multimed 20(4):985–996 Jianan L, Xiaodan L, ShengMei S, Xu T, Jiashi F, Yan S (2017) Scale-aware fast R-CNN for pedestrian detection. IEEE Trans Multimed 20(4):985–996
7.
go back to reference Jiang N, Heng S, Liu W, Ying W (2012) Discriminative metric preservation for tracking low-resolution targets. IEEE Trans Image Process 21(3):1284–1297MathSciNetCrossRef Jiang N, Heng S, Liu W, Ying W (2012) Discriminative metric preservation for tracking low-resolution targets. IEEE Trans Image Process 21(3):1284–1297MathSciNetCrossRef
8.
go back to reference Zhiguan L, Yuan C (2018) Robust visual tracking in low-resolution sequence. In: 25th IEEE International Conference on image processing (ICIP), IEEE, pp 4103–4107 Zhiguan L, Yuan C (2018) Robust visual tracking in low-resolution sequence. In: 25th IEEE International Conference on image processing (ICIP), IEEE, pp 4103–4107
9.
go back to reference Martin D, Bhat G, Khan FS, Felsberg M (2017) ECO: efficient convolution operators for tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6638–6646 Martin D, Bhat G, Khan FS, Felsberg M (2017) ECO: efficient convolution operators for tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6638–6646
10.
go back to reference Fang Y, Yuan Y, Li L, Jinjian W, Lin W, Li Z (2017) Performance evaluation of visual tracking algorithms on video sequences with quality degradation. IEEE Access 5:2430–2441CrossRef Fang Y, Yuan Y, Li L, Jinjian W, Lin W, Li Z (2017) Performance evaluation of visual tracking algorithms on video sequences with quality degradation. IEEE Access 5:2430–2441CrossRef
11.
go back to reference Navneet D, Triggs B (2005) Histograms of oriented gradients for human detection. In: International Conference on computer vision pattern recognition (CVPR’05), IEEE Computer Society, vol 1, pp 886–893 Navneet D, Triggs B (2005) Histograms of oriented gradients for human detection. In: International Conference on computer vision pattern recognition (CVPR’05), IEEE Computer Society, vol 1, pp 886–893
12.
go back to reference Ning W, Zhou W, Tian Q, Hong R, Wang M, Li H (2018) Multi-cue correlation filters for robust visual tracking. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 4844–4853 Ning W, Zhou W, Tian Q, Hong R, Wang M, Li H (2018) Multi-cue correlation filters for robust visual tracking. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 4844–4853
13.
go back to reference Ma C, Huang J-B, Yang X, Yang M-H (2015) Hierarchical convolutional features for visual tracking. Proc IEEE Int Conf Comput Vis 2102:3074–3082 Ma C, Huang J-B, Yang X, Yang M-H (2015) Hierarchical convolutional features for visual tracking. Proc IEEE Int Conf Comput Vis 2102:3074–3082
14.
go back to reference Kristan M, Matas J, Leonardis A, Felsberg M, Cehovin L, Fernandez G, Vojr T, Hager G, Nebehay G, Pflugfelder R (2015) The visual object tracking VOT2015 challenge results. Proc IEEE Int Conf Comput Vis Workshop 2015:564–586 Kristan M, Matas J, Leonardis A, Felsberg M, Cehovin L, Fernandez G, Vojr T, Hager G, Nebehay G, Pflugfelder R (2015) The visual object tracking VOT2015 challenge results. Proc IEEE Int Conf Comput Vis Workshop 2015:564–586
15.
go back to reference He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409CrossRef He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409CrossRef
16.
go back to reference Lu Z, Long B, Li K, Fajin L (2018) Effective guided image filtering for contrast enhancement. IEEE Signal Process Lett 25(10):1585–1589CrossRef Lu Z, Long B, Li K, Fajin L (2018) Effective guided image filtering for contrast enhancement. IEEE Signal Process Lett 25(10):1585–1589CrossRef
17.
go back to reference Guo X, Li Y, Ma J, Ling H (2020) Mutually guided image filtering. IEEE Trans Pattern Anal Mach Intell 42(3):694–707CrossRef Guo X, Li Y, Ma J, Ling H (2020) Mutually guided image filtering. IEEE Trans Pattern Anal Mach Intell 42(3):694–707CrossRef
18.
go back to reference Smeulders AWM, Chu DM, Cucchiara R, Calderara S, Dehghan A, Shah M (2014) Visual tracking: an experimental survey. TPAMI 36(7):1442–1468CrossRef Smeulders AWM, Chu DM, Cucchiara R, Calderara S, Dehghan A, Shah M (2014) Visual tracking: an experimental survey. TPAMI 36(7):1442–1468CrossRef
19.
go back to reference Wu Y, Lim J, Yang M-H (2015) Object tracking benchmark. IEEE Trans Pattern Anal Mach Intell 37(9):1834–1848CrossRef Wu Y, Lim J, Yang M-H (2015) Object tracking benchmark. IEEE Trans Pattern Anal Mach Intell 37(9):1834–1848CrossRef
20.
go back to reference Kristan M, Leonardis A, Matas J, Felsberg M, Pflugfelder R, Cehovin L, Vojr T, Hager G, Lukezic A, Fernandez G (2016) The visual object tracking VOT2016 challenge results. Proc Eur Conf Comput Vis Workshop 9914:777–823 Kristan M, Leonardis A, Matas J, Felsberg M, Pflugfelder R, Cehovin L, Vojr T, Hager G, Lukezic A, Fernandez G (2016) The visual object tracking VOT2016 challenge results. Proc Eur Conf Comput Vis Workshop 9914:777–823
21.
go back to reference Liang P, Blasch E, Ling H (2015) Encoding color information for visual tracking: algorithms and benchmark. IEEE Trans Image Process 24(12):5630–5644MathSciNetCrossRef Liang P, Blasch E, Ling H (2015) Encoding color information for visual tracking: algorithms and benchmark. IEEE Trans Image Process 24(12):5630–5644MathSciNetCrossRef
22.
go back to reference Fan H, Lin L, Yang F, Chu P, Deng G, Yu S, Bai H, Xu Y, Liao C, Ling H (2019) LaSOT: a high-quality benchmark for large-scale single object tracking. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) Fan H, Lin L, Yang F, Chu P, Deng G, Yu S, Bai H, Xu Y, Liao C, Ling H (2019) LaSOT: a high-quality benchmark for large-scale single object tracking. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR)
23.
go back to reference Yong W, Robert L, Daniel L, Ors AO, Xu X, Zhu C (2018) Deep convolutional correlation filters for forward-backward visual tracking. ISVC 132:320–331 Yong W, Robert L, Daniel L, Ors AO, Xu X, Zhu C (2018) Deep convolutional correlation filters for forward-backward visual tracking. ISVC 132:320–331
24.
go back to reference Qi Y, Zhang S, Qin L, Yao H, Huang Q, Lim J, Yang M-H (2016) Hedged deep tracking. Proc IEEE Conf Comput Vis Pattern Recogn 9810:4303–4311 Qi Y, Zhang S, Qin L, Yao H, Huang Q, Lim J, Yang M-H (2016) Hedged deep tracking. Proc IEEE Conf Comput Vis Pattern Recogn 9810:4303–4311
25.
go back to reference Feng L, Tian C, Zuo W, Zhang L, Yang M-H (2018) Learning spatial-temporal regularized correlation filters for visual tracking. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 4904–4913 Feng L, Tian C, Zuo W, Zhang L, Yang M-H (2018) Learning spatial-temporal regularized correlation filters for visual tracking. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 4904–4913
26.
go back to reference Sun Z, Wang Y, Laganiere R (2019) Hard negative mining for correlation filters in visual tracking. Mach Vis Appl 30(3):487–506CrossRef Sun Z, Wang Y, Laganiere R (2019) Hard negative mining for correlation filters in visual tracking. Mach Vis Appl 30(3):487–506CrossRef
27.
go back to reference Bolme DS, Beveridge JR, Draper B, Lui YM (2010) Visual object tracking using adaptive correlation filters. Proc IEEE Conf Comput Vis Pattern Recogn 9123:2544–2550 Bolme DS, Beveridge JR, Draper B, Lui YM (2010) Visual object tracking using adaptive correlation filters. Proc IEEE Conf Comput Vis Pattern Recogn 9123:2544–2550
28.
go back to reference Henriques J, Caseiro R, Martins P, Batista J (2015) High-speed tracking with kernelized correlation filters. IEEE Trans Pattern Anal Mach Intell 37(3):583–596CrossRef Henriques J, Caseiro R, Martins P, Batista J (2015) High-speed tracking with kernelized correlation filters. IEEE Trans Pattern Anal Mach Intell 37(3):583–596CrossRef
29.
go back to reference Danelljan M, Häger G, Khan FS, Felsberg M (2017) Discriminative scale space tracking. IEEE Trans Pattern Anal Machine Intell 39(8):1561–1575CrossRef Danelljan M, Häger G, Khan FS, Felsberg M (2017) Discriminative scale space tracking. IEEE Trans Pattern Anal Machine Intell 39(8):1561–1575CrossRef
30.
go back to reference Luca B, Valmadre J, Golodetz S, Miksik O, Torr HSP (2016) Staple: complementary learners for real-time tracking. CVPR 8943:1401–1409 Luca B, Valmadre J, Golodetz S, Miksik O, Torr HSP (2016) Staple: complementary learners for real-time tracking. CVPR 8943:1401–1409
31.
go back to reference Danelljan M, Hager G, Khan FS, Felsberg M (2016) Adaptive decontamination of the training set: a unified formulation for discriminative visual tracking. Proc IEEE Conf Comput Vis Pattern Recogn 8930:1430–1438 Danelljan M, Hager G, Khan FS, Felsberg M (2016) Adaptive decontamination of the training set: a unified formulation for discriminative visual tracking. Proc IEEE Conf Comput Vis Pattern Recogn 8930:1430–1438
32.
go back to reference Danelljan M, Hager G, Khan FS, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. Proc IEEE Int Conf Comput Vis 9420:4310–4318 Danelljan M, Hager G, Khan FS, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. Proc IEEE Int Conf Comput Vis 9420:4310–4318
33.
go back to reference Collins R, Zhou X, Teh SK (2005) An open source tracking testbed and evaluation web site. In: IEEE Int workshop on performance evaluation of tracking and surveillance, pp 17–24 Collins R, Zhou X, Teh SK (2005) An open source tracking testbed and evaluation web site. In: IEEE Int workshop on performance evaluation of tracking and surveillance, pp 17–24
34.
go back to reference Galoogahi K, Fagg HA, Lucey S (2017) Learning background-aware correlation filters for visual tracking. In: Proceedings of the IEEE Conference on ICCV, pp 1135–1143 Galoogahi K, Fagg HA, Lucey S (2017) Learning background-aware correlation filters for visual tracking. In: Proceedings of the IEEE Conference on ICCV, pp 1135–1143
35.
go back to reference Ning W, Wengang Z, Li H (2018) Reliable re-detection for long-term tracking. In: IEEE transactions on circuits and systems for video technology Ning W, Wengang Z, Li H (2018) Reliable re-detection for long-term tracking. In: IEEE transactions on circuits and systems for video technology
36.
go back to reference Danelljan M, Khan FS, Felsberg M, van de Weijer J (2014) Adaptive color attributes for real-time visual tracking. Proc IEEE Conf Comput Vis Pattern Recogn 9872:1090–1097 Danelljan M, Khan FS, Felsberg M, van de Weijer J (2014) Adaptive color attributes for real-time visual tracking. Proc IEEE Conf Comput Vis Pattern Recogn 9872:1090–1097
37.
go back to reference Mei X, Ling H (2011) Robust visual tracking and vehicle classification via sparse representation. IEEE Trans Pattern Anal Mach Intell 33(11):2259–2272CrossRef Mei X, Ling H (2011) Robust visual tracking and vehicle classification via sparse representation. IEEE Trans Pattern Anal Mach Intell 33(11):2259–2272CrossRef
38.
go back to reference Wei X, Shen H, Kleinsteuber M (2019) Trace quotient with sparsity priors for learning low dimensional image representations. In: IEEE transactions on pattern analysis and machine intelligence, pp 1–17 Wei X, Shen H, Kleinsteuber M (2019) Trace quotient with sparsity priors for learning low dimensional image representations. In: IEEE transactions on pattern analysis and machine intelligence, pp 1–17
39.
go back to reference Wang Y, Shiqiang H, Shandong W (2015) Visual tracking based on group sparsity learning. Mach Vis Appl 26(1):127–139CrossRef Wang Y, Shiqiang H, Shandong W (2015) Visual tracking based on group sparsity learning. Mach Vis Appl 26(1):127–139CrossRef
40.
go back to reference Kim H-U, Lee D-Y, Sim J-Y, Kim C-S (2015) Sowp: spatially ordered and weighted patch descriptor for visual tracking. In: Proceedings of IEEE International Conference on computer vision Kim H-U, Lee D-Y, Sim J-Y, Kim C-S (2015) Sowp: spatially ordered and weighted patch descriptor for visual tracking. In: Proceedings of IEEE International Conference on computer vision
41.
go back to reference Li C, Lin L, Zuo W et al (2018) Visual tracking via dynamic graph learning. IEEE Trans Pattern Anal Mach Intell 41(11):2770–2782CrossRef Li C, Lin L, Zuo W et al (2018) Visual tracking via dynamic graph learning. IEEE Trans Pattern Anal Mach Intell 41(11):2770–2782CrossRef
42.
go back to reference Li C, Liang X, Lu Y, Zhao N, Tang J (2019) RGB-T object tracking: benchmark and baseline. Pattern Recognit 96:106977CrossRef Li C, Liang X, Lu Y, Zhao N, Tang J (2019) RGB-T object tracking: benchmark and baseline. Pattern Recognit 96:106977CrossRef
43.
go back to reference Danelljan M, Hager G, Khan F, Felsberg M (2014) Accurate scale estimation for robust visual tracking. In: British machine vision conference, Nottingham, September 1–5, BMVA Press Danelljan M, Hager G, Khan F, Felsberg M (2014) Accurate scale estimation for robust visual tracking. In: British machine vision conference, Nottingham, September 1–5, BMVA Press
Metadata
Title
Performance evaluation of low resolution visual tracking for unmanned aerial vehicles
Authors
Yong Wang
Xian Wei
Hao Shen
Jilin Hu
Lingkun Luo
Publication date
27-06-2020
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 7/2021
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05067-3

Other articles of this Issue 7/2021

Neural Computing and Applications 7/2021 Go to the issue

Premium Partner