Skip to main content

2023 | OriginalPaper | Buchkapitel

A Unified Framework for Joint Moving Object Detection and Tracking in the Sky and Underwater

verfasst von : Xia Wu, Han Pan, Meng Xu, Zhongliang Jing, Min Bao

Erschienen in: Proceedings of the International Conference on Aerospace System Science and Engineering 2021

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The ability to detect and locate the moving object in a video is a fundamental procedure in applications of computer vision. However, these tracking methods still face some challenges, and are contradictory among different tasks. In this paper, a unified framework for joint moving object detection and tracking in the sky and underwater is proposed. This framework meets the requirements of two real applications: (i) tracking unmanned aerial vehicle (UAV) in the sky; and (ii) tracking unmanned underwater vehicle (UUV) in water. It consists of three key steps: (i) moving object detection by pixel classification; (ii) data association by blob detection; and (iii) object tracking by efficient convolution operator. Finally, analysis on the accuracy of the proposed framework is provided. Experimental results on real-world datasets and object tracking benchmark (OTB) demonstrate the advantage of the tracking method compared with some state-of-the-art trackers, in terms of accuracy and robustness. In addition, to the best of the authors’ knowledge, there is no previously published work for joint moving target detection and tracking in the sky and underwater.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhongliang J, Han P, Yuankai L, Peng D (2018) Non-cooperative target tracking: fusion and control. Algorithms and advances. Springer International Publishing, Berlin Zhongliang J, Han P, Yuankai L, Peng D (2018) Non-cooperative target tracking: fusion and control. Algorithms and advances. Springer International Publishing, Berlin
2.
Zurück zum Zitat Pan H, Jing Z, Qiao L, Li M (2018) Visible and infrared image fusion using \( \ell \)0-generalized total variation model. Sci China Inf Sci 61(4):049103MathSciNetCrossRef Pan H, Jing Z, Qiao L, Li M (2018) Visible and infrared image fusion using \( \ell \)0-generalized total variation model. Sci China Inf Sci 61(4):049103MathSciNetCrossRef
3.
Zurück zum Zitat Bolme DS, Beveridge JR, Draper BA, Lui YM (2010) Visual object tracking using adaptive correlation filters. In: IEEE computer society conference on computer vision and pattern recognition 2010, pp 2544–2550 Bolme DS, Beveridge JR, Draper BA, Lui YM (2010) Visual object tracking using adaptive correlation filters. In: IEEE computer society conference on computer vision and pattern recognition 2010, pp 2544–2550
4.
Zurück zum Zitat Henriques J, Caseiro R, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels 7575:702–715 Henriques J, Caseiro R, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels 7575:702–715
5.
Zurück zum Zitat Danelljan M, Häger G, Khan FS, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. In: 2015 IEEE international conference on computer vision (ICCV), 2015, pp 4310–4318 Danelljan M, Häger G, Khan FS, Felsberg M (2015) Learning spatially regularized correlation filters for visual tracking. In: 2015 IEEE international conference on computer vision (ICCV), 2015, pp 4310–4318
6.
Zurück zum Zitat Danelljan M, Hager G, Khan FS, Felsberg M (2017) Discriminative scale space tracking. IEEE Trans Pattern Anal Mach Intell 39(8):1561–1575CrossRef Danelljan M, Hager G, Khan FS, Felsberg M (2017) Discriminative scale space tracking. IEEE Trans Pattern Anal Mach Intell 39(8):1561–1575CrossRef
7.
Zurück zum Zitat Danelljan M, Robinson A, Shahbaz Khan F, Felsberg M (2016) Beyond correlation filters: learning continuous convolution operators for visual tracking. ECCV 9909:472–488 Danelljan M, Robinson A, Shahbaz Khan F, Felsberg M (2016) Beyond correlation filters: learning continuous convolution operators for visual tracking. ECCV 9909:472–488
8.
Zurück zum Zitat Galoogahi HK, Fagg A, Lucey S (2017) Learning background-aware correlation filters for visual tracking. In: IEEE international conference on computer vision (ICCV) 2017, pp 1144–1152 Galoogahi HK, Fagg A, Lucey S (2017) Learning background-aware correlation filters for visual tracking. In: IEEE international conference on computer vision (ICCV) 2017, pp 1144–1152
9.
Zurück zum Zitat Danelljan M, Bhat G, Khan FS, Felsberg M (2017) Eco: Efficient convolution operators for tracking. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 6931–6939 Danelljan M, Bhat G, Khan FS, Felsberg M (2017) Eco: Efficient convolution operators for tracking. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 6931–6939
10.
Zurück zum Zitat Gladh S, Danelljan M, Khan FS, Felsberg M (2016) Deep motion features for visual tracking. In: 2016 23rd international conference on pattern recognition (ICPR), 2016, pp 1243–1248 Gladh S, Danelljan M, Khan FS, Felsberg M (2016) Deep motion features for visual tracking. In: 2016 23rd international conference on pattern recognition (ICPR), 2016, pp 1243–1248
11.
Zurück zum Zitat Wu H, Li W, Li W, Liu G (2020) A real-time robust approach for tracking uavs in infrared videos. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR) workshops Wu H, Li W, Li W, Liu G (2020) A real-time robust approach for tracking uavs in infrared videos. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR) workshops
12.
Zurück zum Zitat Maki T et al. (2019) Autonomous tracking of sea turtles based on multibeam imaging sonar: toward robotic observation of marine life. In: 12th IFAC conference on control applications in marine systems, robotics, and vehicles CAMS 2019. IFAC-PapersOnLine, vol 52, no 21, pp 86–90 Maki T et al. (2019) Autonomous tracking of sea turtles based on multibeam imaging sonar: toward robotic observation of marine life. In: 12th IFAC conference on control applications in marine systems, robotics, and vehicles CAMS 2019. IFAC-PapersOnLine, vol 52, no 21, pp 86–90
13.
Zurück zum Zitat Jiang M, Feng X, Song S, Herrmann JM, Li S (2019) Underwater loop-closure detection for mechanical scanning imaging sonar by filtering the similarity matrix with probability hypothesis density filter. IEEE Access 99:1 Jiang M, Feng X, Song S, Herrmann JM, Li S (2019) Underwater loop-closure detection for mechanical scanning imaging sonar by filtering the similarity matrix with probability hypothesis density filter. IEEE Access 99:1
14.
Zurück zum Zitat Barnich O, Van Droogenbroeck M (2011) Vibe: a universal background subtraction algorithm for video sequences 20(6) Barnich O, Van Droogenbroeck M (2011) Vibe: a universal background subtraction algorithm for video sequences 20(6)
15.
Zurück zum Zitat Wu Y, Lim J, Yang M (2013) Online object tracking: a benchmark. In: IEEE conference on computer vision and pattern recognition 2013, pp 2411–2418 Wu Y, Lim J, Yang M (2013) Online object tracking: a benchmark. In: IEEE conference on computer vision and pattern recognition 2013, pp 2411–2418
16.
Zurück zum Zitat Bouwmans T (2011) Recent advanced statistical background modeling for foreground detection: a systematic survey. Recent Patents Comput Sci 4:147–176 Bouwmans T (2011) Recent advanced statistical background modeling for foreground detection: a systematic survey. Recent Patents Comput Sci 4:147–176
17.
Zurück zum Zitat Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. In: Proceedings. 1999 IEEE computer society conference on computer vision and pattern recognition (Cat. No PR00149), vol 2, pp 246–252 Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. In: Proceedings. 1999 IEEE computer society conference on computer vision and pattern recognition (Cat. No PR00149), vol 2, pp 246–252
18.
Zurück zum Zitat Lee D-S (2005) Effective gaussian mixture learning for video background subtraction. IEEE Trans Pattern Anal Mach Intell 27(5):827–832CrossRef Lee D-S (2005) Effective gaussian mixture learning for video background subtraction. IEEE Trans Pattern Anal Mach Intell 27(5):827–832CrossRef
19.
Zurück zum Zitat Kim K et al. (2005) Real-time foreground-background segmentation using codebook model. Real-Time Imag 11(3):172–185. Special issue on video object processing Kim K et al. (2005) Real-time foreground-background segmentation using codebook model. Real-Time Imag 11(3):172–185. Special issue on video object processing
20.
Zurück zum Zitat Krungkaew R, Kusakunniran W (2016) Foreground segmentation in a video by using a novel dynamic codebook. In: 2016 13th international conference on electrical engineering/electronics, computer, telecommunications and information technology (ECTI-CON), pp 1–6 Krungkaew R, Kusakunniran W (2016) Foreground segmentation in a video by using a novel dynamic codebook. In: 2016 13th international conference on electrical engineering/electronics, computer, telecommunications and information technology (ECTI-CON), pp 1–6
21.
Zurück zum Zitat Varghese A, Sreelekha G (2017) Sample-based integrated background subtraction and shadow detection. Ipsj Trans Comput Vis Appl 9(1):25CrossRef Varghese A, Sreelekha G (2017) Sample-based integrated background subtraction and shadow detection. Ipsj Trans Comput Vis Appl 9(1):25CrossRef
22.
Zurück zum Zitat Chang O, Constante P, Gordon A, Singaña M (2017) A novel deep neural network that uses space-time features for tracking and recognizing a moving object J Artif Intell Soft Comput Res (2), in press Chang O, Constante P, Gordon A, Singaña M (2017) A novel deep neural network that uses space-time features for tracking and recognizing a moving object J Artif Intell Soft Comput Res (2), in press
23.
Zurück zum Zitat Kang K, Li H, Yan J, Zeng X, Yang B, Xiao T, Zhang C, Wang Z, Wang R, Wang X, Ouyang W (2018) T-cnn: tubelets with convolutional neural networks for object detection from videos. IEEE Trans Circuits Syst Video Technol 28(10):2896–2907CrossRef Kang K, Li H, Yan J, Zeng X, Yang B, Xiao T, Zhang C, Wang Z, Wang R, Wang X, Ouyang W (2018) T-cnn: tubelets with convolutional neural networks for object detection from videos. IEEE Trans Circuits Syst Video Technol 28(10):2896–2907CrossRef
24.
Zurück zum Zitat Maddalena L, Petrosino A (2008) A self-organizing approach to background subtraction for visual surveillance applications. IEEE Trans Image Process 17(7):1168–1177MathSciNetCrossRef Maddalena L, Petrosino A (2008) A self-organizing approach to background subtraction for visual surveillance applications. IEEE Trans Image Process 17(7):1168–1177MathSciNetCrossRef
25.
Zurück zum Zitat Vijayan M, Raguraman P, Mohan R (2021) A fully residual convolutional neural network for background subtraction. Pattern Recognit Lett 146:63–69CrossRef Vijayan M, Raguraman P, Mohan R (2021) A fully residual convolutional neural network for background subtraction. Pattern Recognit Lett 146:63–69CrossRef
26.
Zurück zum Zitat Chen M, Wei X, Yang Q, Li Q, Wang G, Yang M (2018) Spatiotemporal gmm for background subtraction with superpixel hierarchy. IEEE Trans Pattern Anal Mach Intell 40(6):1518–1525CrossRef Chen M, Wei X, Yang Q, Li Q, Wang G, Yang M (2018) Spatiotemporal gmm for background subtraction with superpixel hierarchy. IEEE Trans Pattern Anal Mach Intell 40(6):1518–1525CrossRef
27.
Zurück zum Zitat Li XR, Jilkov VP (2010) Survey of maneuvering target tracking. Part ii: motion models of ballistic and space targets. IEEE Trans Aerosp Electron Syst 46(1):96–119 Li XR, Jilkov VP (2010) Survey of maneuvering target tracking. Part ii: motion models of ballistic and space targets. IEEE Trans Aerosp Electron Syst 46(1):96–119
28.
Zurück zum Zitat Bertinetto L, Valmadre J, Henriques JF, Vedaldi A, Torr P (2016) Fully-convolutional siamese networks for object tracking 2016:850–865 Bertinetto L, Valmadre J, Henriques JF, Vedaldi A, Torr P (2016) Fully-convolutional siamese networks for object tracking 2016:850–865
29.
Zurück zum Zitat Mueller M, Smith N, Ghanem B (2016) A benchmark and simulator for uav tracking Mueller M, Smith N, Ghanem B (2016) A benchmark and simulator for uav tracking
30.
Zurück zum Zitat Mandal M, Kumar LK, Vipparthi SK (2020) Mor-uav: a benchmark dataset and baselines for moving object recognition in uav videos. Assoc Comput Mach Mandal M, Kumar LK, Vipparthi SK (2020) Mor-uav: a benchmark dataset and baselines for moving object recognition in uav videos. Assoc Comput Mach
31.
Zurück zum Zitat Danelljan M, Bhat G, Khan FS, Felsberg M (2019) Atom: accurate tracking by overlap maximization. IEEE/CVF conference on computer vision and pattern recognition (CVPR) 2019, pp 4655–4664 Danelljan M, Bhat G, Khan FS, Felsberg M (2019) Atom: accurate tracking by overlap maximization. IEEE/CVF conference on computer vision and pattern recognition (CVPR) 2019, pp 4655–4664
32.
Zurück zum Zitat Fu C, Zhang Y, Huang Z, Duan R, Xie Z (2019) Part-based background-aware tracking for uav with convolutional features. IEEE Access 7:79 997–80 010 Fu C, Zhang Y, Huang Z, Duan R, Xie Z (2019) Part-based background-aware tracking for uav with convolutional features. IEEE Access 7:79 997–80 010
33.
Zurück zum Zitat Chopra S, Hadsell R, LeCun Y (2005) Learning a similarity metric discriminatively, with application to face verification. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 539–546 Chopra S, Hadsell R, LeCun Y (2005) Learning a similarity metric discriminatively, with application to face verification. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 539–546
34.
Zurück zum Zitat Modalavalasa N (2012) An efficient implementation of tracking using kalman filter for underwater robot application. Int J Comput Sci Eng Inf 2(2):67–78 Modalavalasa N (2012) An efficient implementation of tracking using kalman filter for underwater robot application. Int J Comput Sci Eng Inf 2(2):67–78
35.
Zurück zum Zitat Rao J, Dinesh U, Koteswara Rao S, Jagan B (2017) Active sonar target tracking using extended kalman filter. Int J Pure Appl Math 117(12):301–309 Rao J, Dinesh U, Koteswara Rao S, Jagan B (2017) Active sonar target tracking using extended kalman filter. Int J Pure Appl Math 117(12):301–309
36.
Zurück zum Zitat Kumar D (2021) Hybrid unscented kalman filter with rare features for underwater target tracking using passive sonar measurements. Optik - Int J Light Electron Opt 226(3):165813CrossRef Kumar D (2021) Hybrid unscented kalman filter with rare features for underwater target tracking using passive sonar measurements. Optik - Int J Light Electron Opt 226(3):165813CrossRef
37.
Zurück zum Zitat Jeong TT (2007) Particle phd filter multiple target tracking in sonar image. IEEE Trans Aerosp Electron Syst 43(1):409–416MathSciNetCrossRef Jeong TT (2007) Particle phd filter multiple target tracking in sonar image. IEEE Trans Aerosp Electron Syst 43(1):409–416MathSciNetCrossRef
38.
Zurück zum Zitat Xie S, Chen J, Luo J, Xie P, Tang W (2012) Detection and tracking of underwater object based on forward-scan sonar. In: Intelligent robotics and applications. Springer, Berlin, pp 341–347 Xie S, Chen J, Luo J, Xie P, Tang W (2012) Detection and tracking of underwater object based on forward-scan sonar. In: Intelligent robotics and applications. Springer, Berlin, pp 341–347
39.
Zurück zum Zitat Wang J, Shan T, Englot B (2019) Underwater terrain reconstruction from forward-looking sonar imagery. In: International conference on robotics and automation (ICRA) 2019, pp 3471–3477 Wang J, Shan T, Englot B (2019) Underwater terrain reconstruction from forward-looking sonar imagery. In: International conference on robotics and automation (ICRA) 2019, pp 3471–3477
41.
Zurück zum Zitat Lukežic A, Vojíc T, Zajc LC, Matas J, Kristan M (2017) Discriminative correlation filter with channel and spatial reliability. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), 2017, pp 4847–4856 Lukežic A, Vojíc T, Zajc LC, Matas J, Kristan M (2017) Discriminative correlation filter with channel and spatial reliability. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), 2017, pp 4847–4856
42.
Zurück zum Zitat Li Y, Fu C, Ding F, Huang Z, Lu G (2020) Autotrack: towards high-performance visual tracking for uav with automatic spatio-temporal regularization. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2020, pp 11 920–11 929 Li Y, Fu C, Ding F, Huang Z, Lu G (2020) Autotrack: towards high-performance visual tracking for uav with automatic spatio-temporal regularization. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2020, pp 11 920–11 929
43.
Zurück zum Zitat Huang Z, Fu C, Li Y, Lin F, Lu P (2019) Learning aberrance repressed correlation filters for real-time uav tracking. In: ICCV Huang Z, Fu C, Li Y, Lin F, Lu P (2019) Learning aberrance repressed correlation filters for real-time uav tracking. In: ICCV
Metadaten
Titel
A Unified Framework for Joint Moving Object Detection and Tracking in the Sky and Underwater
verfasst von
Xia Wu
Han Pan
Meng Xu
Zhongliang Jing
Min Bao
Copyright-Jahr
2023
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-16-8154-7_17

    Premium Partner