Skip to main content
Erschienen in: Arabian Journal for Science and Engineering 2/2023

21.07.2022 | Research Article-Computer Engineering and Computer Science

Complexity Metric Methodology of Infrared Image Sequence for Single-Object Tracking

verfasst von: Feng Xie, Minzhou Dong, DongSheng Yang, Jie Yan, XiangZheng Cheng

Erschienen in: Arabian Journal for Science and Engineering | Ausgabe 2/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The complexity metric of infrared image sequences is crucial to the prediction and evaluation of single-object tracker performance, and it is a research hotspot in the field of computer vision. However, the accuracy and comprehensiveness of the existing complexity metrics are limited. In this paper, an effective method is proposed to quantify the single-object tracking difficulty of infrared image sequences. First, based on the classification and analysis of trackers, the influencing factors of infrared target tracking are summarized. Then, five metrics combining deep features and shallow features are proposed to characterize the complexity of infrared image sequences. Finally, a synthesis complexity metric is designed for comprehensive evaluations of infrared image sequences. Experimental results indicate that our method performs better than traditional methods on comprehensiveness, and the proposed metrics can more accurately reflect the performance of trackers on different infrared image sequences.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Yi, W.; Lim, J.; Yang, M.: Online object tracking: a benchmark. IEEE Trans. Pattern Anal. 37, 1834–1848 (2015)CrossRef Yi, W.; Lim, J.; Yang, M.: Online object tracking: a benchmark. IEEE Trans. Pattern Anal. 37, 1834–1848 (2015)CrossRef
2.
Zurück zum Zitat Bertinetto, L.; Valmadre, J.; Henriques, J. F. et al.: Fully-convolutional Siamese networks for object tracking. In: ECCV, pp. 850–865 (2016) Bertinetto, L.; Valmadre, J.; Henriques, J. F. et al.: Fully-convolutional Siamese networks for object tracking. In: ECCV, pp. 850–865 (2016)
3.
Zurück zum Zitat Bhat, G.; Johnander, J.; Danelljan, M. et al.: Unveiling the power of deep tracking. In: ECCV, pp. 493–507 (2018) Bhat, G.; Johnander, J.; Danelljan, M. et al.: Unveiling the power of deep tracking. In: ECCV, pp. 493–507 (2018)
4.
Zurück zum Zitat Danelljan, M.; Bhat, G.; Khan, F. S. et al.: ECO: efficient convolution operators for tracking. In: CVPR, pp. 6931–6939 (2017) Danelljan, M.; Bhat, G.; Khan, F. S. et al.: ECO: efficient convolution operators for tracking. In: CVPR, pp. 6931–6939 (2017)
5.
Zurück zum Zitat Chao, M.; Yang, X.; Zhang, C. et al.: Long-term correlation tracking. In: CVPR, pp. 5388–5396 (2015) Chao, M.; Yang, X.; Zhang, C. et al.: Long-term correlation tracking. In: CVPR, pp. 5388–5396 (2015)
6.
Zurück zum Zitat Wang, M.; Liu, Y.; Huang, Z.: Large margin object tracking with circulant feature maps. In: CVPR, pp. 4800–4808 (2017) Wang, M.; Liu, Y.; Huang, Z.: Large margin object tracking with circulant feature maps. In: CVPR, pp. 4800–4808 (2017)
7.
Zurück zum Zitat Huynh-Thu, Q.; Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. Electron. Lett. 44, 800–801 (2008)CrossRef Huynh-Thu, Q.; Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. Electron. Lett. 44, 800–801 (2008)CrossRef
8.
Zurück zum Zitat Wang, Z.; Bovik, A.C.: Mean squared error: Love it or leave it? a new look at signal fidelity measures. IEEE Signal Process. Mag. 26(1), 98–117 (2009)CrossRef Wang, Z.; Bovik, A.C.: Mean squared error: Love it or leave it? a new look at signal fidelity measures. IEEE Signal Process. Mag. 26(1), 98–117 (2009)CrossRef
9.
Zurück zum Zitat Zhou, W.; Bovik, A.C.; Sheikh, H.R., et al.: Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process. 13(4), 600–612 (2004)CrossRef Zhou, W.; Bovik, A.C.; Sheikh, H.R., et al.: Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process. 13(4), 600–612 (2004)CrossRef
10.
Zurück zum Zitat Yang, C.L.: Gradient-based structural similarity for image quality assessment. J. South China Univ. Technol. 34(9), 22–25 (2006) Yang, C.L.: Gradient-based structural similarity for image quality assessment. J. South China Univ. Technol. 34(9), 22–25 (2006)
11.
Zurück zum Zitat Zhang, L.; Zhang, L.; Mou, X., et al.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)MathSciNetCrossRefMATH Zhang, L.; Zhang, L.; Mou, X., et al.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)MathSciNetCrossRefMATH
12.
Zurück zum Zitat Zhu, H.: Image quality assessment model based on multi-feature fusion of energy Internet of Things: ScienceDirect. Futur. Gener. Comput. Syst. 112, 501–506 (2020)CrossRef Zhu, H.: Image quality assessment model based on multi-feature fusion of energy Internet of Things: ScienceDirect. Futur. Gener. Comput. Syst. 112, 501–506 (2020)CrossRef
13.
Zurück zum Zitat Wilson, D.L.: Image-based contrast-to-clutter modeling of detection. Opt. Eng. 40(9), 1852–1857 (2001)CrossRef Wilson, D.L.: Image-based contrast-to-clutter modeling of detection. Opt. Eng. 40(9), 1852–1857 (2001)CrossRef
14.
Zurück zum Zitat Peters, R.A.; Strickland, R.N.: Image complexity metrics for automatic target recognizers. In: Proceedings of the Automatic Target Recognizer System and Technology Conference, pp. 1–7 (1990) Peters, R.A.; Strickland, R.N.: Image complexity metrics for automatic target recognizers. In: Proceedings of the Automatic Target Recognizer System and Technology Conference, pp. 1–7 (1990)
15.
Zurück zum Zitat Diao, W.; Mao, X.; Chang, L.: A new quality estimation method for infrared target images. Acta Aeronautica Et Astronautica Sinica. 31(10), 2026–2033 (2010) Diao, W.; Mao, X.; Chang, L.: A new quality estimation method for infrared target images. Acta Aeronautica Et Astronautica Sinica. 31(10), 2026–2033 (2010)
16.
Zurück zum Zitat Wang, X.T.; Ma, W.C., et al.: Complexity estimation of infrared image sequence for automatic target track. J. Northwest. Polytech. Univ. 37, 664–672 (2019)CrossRef Wang, X.T.; Ma, W.C., et al.: Complexity estimation of infrared image sequence for automatic target track. J. Northwest. Polytech. Univ. 37, 664–672 (2019)CrossRef
17.
Zurück zum Zitat Schmieder, D.E.; Weathersby, M.R.: Detection performance in clutter with variable resolution. IEEE Trans. Aerosp. Electron. Syst. 19(14), 622–630 (1983)CrossRef Schmieder, D.E.; Weathersby, M.R.: Detection performance in clutter with variable resolution. IEEE Trans. Aerosp. Electron. Syst. 19(14), 622–630 (1983)CrossRef
18.
Zurück zum Zitat Liu, R.; Zhi, H.: Infrared point target detection with fisher linear discriminant and kernel fisher linear discriminant. J. Infrared Millim. Terahertz Waves 31, 1491–1502 (2010)CrossRef Liu, R.; Zhi, H.: Infrared point target detection with fisher linear discriminant and kernel fisher linear discriminant. J. Infrared Millim. Terahertz Waves 31, 1491–1502 (2010)CrossRef
19.
Zurück zum Zitat Rotman, S.R.; Kowalczyk, M.L.; George, V.: Modeling human search and target acquisition performance: fixation-point analysis. Opt. Eng. 22(11), 3803–3809 (1994) Rotman, S.R.; Kowalczyk, M.L.; George, V.: Modeling human search and target acquisition performance: fixation-point analysis. Opt. Eng. 22(11), 3803–3809 (1994)
20.
Zurück zum Zitat Li, M.; Zhou, Z.H.; Zhang, G.L.: Image measures in the evolution of ATR algorithm performance. Infrared Laser Eng. 4(3), 412–416 (2007) Li, M.; Zhou, Z.H.; Zhang, G.L.: Image measures in the evolution of ATR algorithm performance. Infrared Laser Eng. 4(3), 412–416 (2007)
21.
Zurück zum Zitat Haralick, R.M.; Shanmugam, K.; Dinstein, I.: Textural features for image classification. Stud. Med. Commun. 3(6), 610–621 (1973) Haralick, R.M.; Shanmugam, K.; Dinstein, I.: Textural features for image classification. Stud. Med. Commun. 3(6), 610–621 (1973)
22.
Zurück zum Zitat Zhu, Y.; Duan, J.; Qian, X.; Xiao, B.: Research on the optimal selection method of image complexity assessment model index parameter. In: AOPC 2015: Image Processing and Analysis (2015) Zhu, Y.; Duan, J.; Qian, X.; Xiao, B.: Research on the optimal selection method of image complexity assessment model index parameter. In: AOPC 2015: Image Processing and Analysis (2015)
23.
Zurück zum Zitat Bing, Z.; Xu, S.; Yang, X.X.: Computing the color complexity of images. In: International Conference on Fuzzy Systems and Knowledge Discovery, pp. 1942–1946 (2016) Bing, Z.; Xu, S.; Yang, X.X.: Computing the color complexity of images. In: International Conference on Fuzzy Systems and Knowledge Discovery, pp. 1942–1946 (2016)
24.
Zurück zum Zitat Wang, X.; Zhang, K.; Yan, J., et al.: Infrared image complexity metric for automatic target recognition based on neural network and traditional approach fusion. Arab. J. Sci. Eng. 45(4), 3245–3255 (2020)CrossRef Wang, X.; Zhang, K.; Yan, J., et al.: Infrared image complexity metric for automatic target recognition based on neural network and traditional approach fusion. Arab. J. Sci. Eng. 45(4), 3245–3255 (2020)CrossRef
25.
Zurück zum Zitat Diao, W.H.; Mao, X.; Zheng, H.C., et al.: Image sequence measures for automatic target tracking. Prog. Electromagnet. Res. 130, 447–472 (2012)CrossRef Diao, W.H.; Mao, X.; Zheng, H.C., et al.: Image sequence measures for automatic target tracking. Prog. Electromagnet. Res. 130, 447–472 (2012)CrossRef
26.
Zurück zum Zitat Zheng, X.: No-reference quality evaluation for infrared image and its application. University of Electronic Science and Technology of China (2015) Zheng, X.: No-reference quality evaluation for infrared image and its application. University of Electronic Science and Technology of China (2015)
27.
Zurück zum Zitat Zheng, H.; Mao, X.; Chen, L., et al.: A novel method for quantifying target tracking difficulty of the infrared image sequence. Infrared Phys. Technol. 72, 8–18 (2015)CrossRef Zheng, H.; Mao, X.; Chen, L., et al.: A novel method for quantifying target tracking difficulty of the infrared image sequence. Infrared Phys. Technol. 72, 8–18 (2015)CrossRef
28.
Zurück zum Zitat Kalal, Z.; Mikolajczyk, K.; Matas, J.: Tracking-learning-detection. PAMI. 34(7), 1409–1422 (2011)CrossRef Kalal, Z.; Mikolajczyk, K.; Matas, J.: Tracking-learning-detection. PAMI. 34(7), 1409–1422 (2011)CrossRef
29.
Zurück zum Zitat Danelljan, M.; Robinson, A.; Khan, F. S. et al.: Beyond correlation filters: Learning continuous convolution operators for visual tracking. In: ECCV, pp. 472–488 (2016) Danelljan, M.; Robinson, A.; Khan, F. S. et al.: Beyond correlation filters: Learning continuous convolution operators for visual tracking. In: ECCV, pp. 472–488 (2016)
30.
Zurück zum Zitat Wang, X.; Chen, C.: Ship detection for complex background SAR images based on a multiscale variance weighted image entropy method. IEEE Geosci. Remote Sens. Lett. 14, 184–187 (2017)CrossRef Wang, X.; Chen, C.: Ship detection for complex background SAR images based on a multiscale variance weighted image entropy method. IEEE Geosci. Remote Sens. Lett. 14, 184–187 (2017)CrossRef
31.
Zurück zum Zitat Itti, L.; Gold, C.; Koch, C.: Visual attention and target detection in cluttered natural scenes. Opt. Eng. 40, 1784–1793 (2001)CrossRef Itti, L.; Gold, C.; Koch, C.: Visual attention and target detection in cluttered natural scenes. Opt. Eng. 40, 1784–1793 (2001)CrossRef
32.
Zurück zum Zitat Mei, X.; Ling, H.: Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(11), 2259–2272 (2011)CrossRef Mei, X.; Ling, H.: Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(11), 2259–2272 (2011)CrossRef
33.
Zurück zum Zitat Jeong, J.; Yoon, T.S.; Park, J.B.: Mean shift tracker combined with online learning-based detector and kalman filtering for real-time tracking. Expert Syst. Appl. 79, 194–206 (2017)CrossRef Jeong, J.; Yoon, T.S.; Park, J.B.: Mean shift tracker combined with online learning-based detector and kalman filtering for real-time tracking. Expert Syst. Appl. 79, 194–206 (2017)CrossRef
34.
Zurück zum Zitat Martin, D.; Gustav, H., et al.: Discriminative scale space tracking. IEEE Trans. Pattern Anal. 39(8), 1561–1575 (2017)CrossRef Martin, D.; Gustav, H., et al.: Discriminative scale space tracking. IEEE Trans. Pattern Anal. 39(8), 1561–1575 (2017)CrossRef
35.
Zurück zum Zitat Yang, L.; Zhu, J.: A scale adaptive kernel correlation filter tracker with feature integration. In: ECCV, pp. 254–265 (2014) Yang, L.; Zhu, J.: A scale adaptive kernel correlation filter tracker with feature integration. In: ECCV, pp. 254–265 (2014)
36.
Zurück zum Zitat Wan, M.; Gu, G.; Qian, W., et al.: Infrared image enhancement using adaptive histogram partition and brightness correction. Remote Sens. 10(5), 682 (2018)CrossRef Wan, M.; Gu, G.; Qian, W., et al.: Infrared image enhancement using adaptive histogram partition and brightness correction. Remote Sens. 10(5), 682 (2018)CrossRef
37.
Zurück zum Zitat Wu, S.; Zhang, K.; Li, S., et al.: Learning to track aircraft in infrared imagery. Remote Sens. 12(23), 3995 (2020)CrossRef Wu, S.; Zhang, K.; Li, S., et al.: Learning to track aircraft in infrared imagery. Remote Sens. 12(23), 3995 (2020)CrossRef
38.
Zurück zum Zitat Qiao, L.Y.; Xu, L.X.; Gao, M.: Infrared image sequence complexity analysis based on multi-attribute decision making. Acta Photonica Sinica. 44(3), 121–132 (2015) Qiao, L.Y.; Xu, L.X.; Gao, M.: Infrared image sequence complexity analysis based on multi-attribute decision making. Acta Photonica Sinica. 44(3), 121–132 (2015)
39.
Zurück zum Zitat Diao, W.H.; Mao, X.; Chang, L.: Quality estimation of image sequence for automatic target recognition. J. Electron. Inf. Technol. 32(8), 1779–1785 (2010)CrossRef Diao, W.H.; Mao, X.; Chang, L.: Quality estimation of image sequence for automatic target recognition. J. Electron. Inf. Technol. 32(8), 1779–1785 (2010)CrossRef
40.
Zurück zum Zitat Li, Z.; He, S.; Hashem, M.: Robust object tracking via multi-feature adaptive fusion based on stability: contrast analysis. Vis. Comput. 31(10), 1319–1337 (2015)CrossRef Li, Z.; He, S.; Hashem, M.: Robust object tracking via multi-feature adaptive fusion based on stability: contrast analysis. Vis. Comput. 31(10), 1319–1337 (2015)CrossRef
41.
Zurück zum Zitat Ma, C.; Huang, J.; Yang, X.; Yang, M. B. I.: Hierarchical convolutional features for visual tracking. In: ICCV, pp. 3074–3082 (2015) Ma, C.; Huang, J.; Yang, X.; Yang, M. B. I.: Hierarchical convolutional features for visual tracking. In: ICCV, pp. 3074–3082 (2015)
42.
Zurück zum Zitat Bo, L.; Yan, J.; Wei, W. et al., High performance visual tracking with Siamese Region Proposal Network. In: CVPR, pp. 8971–8980 (2018) Bo, L.; Yan, J.; Wei, W. et al., High performance visual tracking with Siamese Region Proposal Network. In: CVPR, pp. 8971–8980 (2018)
43.
Zurück zum Zitat Yan, B.; Wang, D.; Lu, H.; Yang, X.: Cooling-shrinking attack: blinding the tracker with imperceptible noises. In: CVPR, pp. 987–996 (2020) Yan, B.; Wang, D.; Lu, H.; Yang, X.: Cooling-shrinking attack: blinding the tracker with imperceptible noises. In: CVPR, pp. 987–996 (2020)
44.
Zurück zum Zitat Dalal, N.; Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR, pp. 886–893 (2005) Dalal, N.; Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR, pp. 886–893 (2005)
45.
Zurück zum Zitat Forsyth, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. 32(9), 1627–1645 (2014) Forsyth, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. 32(9), 1627–1645 (2014)
46.
Zurück zum Zitat Gao, F.; Wang, Y.; Li, P., et al.: DeepSim: deep similarity for image quality assessment. Neurocomputing 257, 104–114 (2017)CrossRef Gao, F.; Wang, Y.; Li, P., et al.: DeepSim: deep similarity for image quality assessment. Neurocomputing 257, 104–114 (2017)CrossRef
47.
Zurück zum Zitat Bolme, D.S.; Beveridge, J.R.; Draper, B.A. et al.: Visual object tracking using adaptive correlation filters. In: CVPR, pp. 2544–2550 (2010) Bolme, D.S.; Beveridge, J.R.; Draper, B.A. et al.: Visual object tracking using adaptive correlation filters. In: CVPR, pp. 2544–2550 (2010)
48.
Zurück zum Zitat Henriques, J.F.; Caseiro, R.; Martins, P., et al.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)CrossRef Henriques, J.F.; Caseiro, R.; Martins, P., et al.: High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37(3), 583–596 (2015)CrossRef
49.
Zurück zum Zitat Kristan, M. et al.: The visual object tracking VOT2015 challenge results. In: 2015 IEEE International Conference on Computer Vision Workshop (ICCV), pp. 564–586 (2015) Kristan, M. et al.: The visual object tracking VOT2015 challenge results. In: 2015 IEEE International Conference on Computer Vision Workshop (ICCV), pp. 564–586 (2015)
50.
Zurück zum Zitat Nam, H.; Han, B.: Learning multi-domain convolutional neural networks for visual tracking. In: CVPR, pp. 4293–4302 (2016) Nam, H.; Han, B.: Learning multi-domain convolutional neural networks for visual tracking. In: CVPR, pp. 4293–4302 (2016)
51.
Zurück zum Zitat Girshick, R.; Donahue, J.; Darrell, T. et al.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: CVPR, pp. 580–587 (2014) Girshick, R.; Donahue, J.; Darrell, T. et al.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: CVPR, pp. 580–587 (2014)
52.
Zurück zum Zitat Bewley, A.; Ge, Z.; Ott, L. et al.: Simple online and realtime tracking. In: ICIP, pp. 3464–3468 (2016) Bewley, A.; Ge, Z.; Ott, L. et al.: Simple online and realtime tracking. In: ICIP, pp. 3464–3468 (2016)
Metadaten
Titel
Complexity Metric Methodology of Infrared Image Sequence for Single-Object Tracking
verfasst von
Feng Xie
Minzhou Dong
DongSheng Yang
Jie Yan
XiangZheng Cheng
Publikationsdatum
21.07.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
Arabian Journal for Science and Engineering / Ausgabe 2/2023
Print ISSN: 2193-567X
Elektronische ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-022-07090-z

Weitere Artikel der Ausgabe 2/2023

Arabian Journal for Science and Engineering 2/2023 Zur Ausgabe

Research Article-Computer Engineering and Computer Science

A Survey on Software-Defined Networking-Based 5G Mobile Core Architectures

RESEARCH ARTICLE - SPECIAL ISSUE - Frontiers in Parallel Programming Models for Fog and Edge Computing Infrastructures

Creating Security Modelling Framework Analysing in Internet of Things Using EC-GSM-IoT

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.