Skip to main content
Erschienen in: Neural Computing and Applications 5/2017

19.04.2016 | Computational Intelligence for Vision and Robotics

AURORA: autonomous real-time on-board video analytics

verfasst von: Plamen Angelov, Pouria Sadeghi-Tehran, Christopher Clarke

Erschienen in: Neural Computing and Applications | Ausgabe 5/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we describe the design and implementation of a computationally efficient system for detecting moving objects on a moving platform which can be deployed on small, lightweight, low-cost and power-efficient hardware. The primary application of the payload system is that of performing real-time on-board autonomous object detection of moving objects from videos stream taken from a camera mounted to an unmanned aerial vehicle (UAV). The implemented object detection algorithms utilise recursive density estimation and evolving local means clustering to perform change and object detection of moving objects without prior knowledge. Furthermore, experiments are presented which demonstrate that the introduced system is able to detect, by on-board processing, any moving objects from a UAV in real time while at the same time sending only important data to a control station located on the ground with minimal time to set up and become operational.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Angelov P (2012) Anomalous system state identification. Patent application, GB1208542.9 Angelov P (2012) Anomalous system state identification. Patent application, GB1208542.9
2.
Zurück zum Zitat Angelov P (2012) Autonomous learning systems: from data streams to knowledge in real time. Wiley, New YorkCrossRef Angelov P (2012) Autonomous learning systems: from data streams to knowledge in real time. Wiley, New YorkCrossRef
3.
Zurück zum Zitat Angelov P, Sadeghi-Tehran P, Ramezani R (2011) A real-time approach to autonomous novelty detection and object tracking in video stream. Int J Intell Syst 26:189–205CrossRefMATH Angelov P, Sadeghi-Tehran P, Ramezani R (2011) A real-time approach to autonomous novelty detection and object tracking in video stream. Int J Intell Syst 26:189–205CrossRefMATH
4.
Zurück zum Zitat Angelov P, Wilding A (2015) RTSDE: recursive total-sum-distances-based density estimation approach and its application for autonomous real-time video analytics. In: Symposium Series on Computational Intelligence Angelov P, Wilding A (2015) RTSDE: recursive total-sum-distances-based density estimation approach and its application for autonomous real-time video analytics. In: Symposium Series on Computational Intelligence
5.
Zurück zum Zitat Baruah RD, Angelov P (2012) Evolving local means method for clustering of streaming data. In: IEEE World congress on computational intelligence, pp 2161–2168 Baruah RD, Angelov P (2012) Evolving local means method for clustering of streaming data. In: IEEE World congress on computational intelligence, pp 2161–2168
6.
Zurück zum Zitat Bouguet JY (2001) Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corp 5(1–10):4 Bouguet JY (2001) Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corp 5(1–10):4
7.
Zurück zum Zitat Clarke C (2014) Smartphone application for real-time object detection. Master’s thesis, School of Computing and Communications, Lancaster University Clarke C (2014) Smartphone application for real-time object detection. Master’s thesis, School of Computing and Communications, Lancaster University
8.
Zurück zum Zitat Farin D, de With PHN, Effelsberg WA (2004) Video-object segmentation using multi-sprite background subtraction. IEEE Int Conf Multimed Expo, ICME ’04 1:343–346 Farin D, de With PHN, Effelsberg WA (2004) Video-object segmentation using multi-sprite background subtraction. IEEE Int Conf Multimed Expo, ICME ’04 1:343–346
9.
Zurück zum Zitat Fauske E, Eliassen LM, Bakken RH (2009) A comparison of learning based background subtraction techniques implemented in CUDA. In: NAIS, pp 181–192 Fauske E, Eliassen LM, Bakken RH (2009) A comparison of learning based background subtraction techniques implemented in CUDA. In: NAIS, pp 181–192
10.
Zurück zum Zitat Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(11):381–395MathSciNetCrossRef Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(11):381–395MathSciNetCrossRef
11.
Zurück zum Zitat Gao T, Liu ZG, Yue SH, Mei JQ (2009) Traffic video-based moving vehicle detection and tracking in the complex environment. Int J Cybern Syst 40(7):569–588CrossRef Gao T, Liu ZG, Yue SH, Mei JQ (2009) Traffic video-based moving vehicle detection and tracking in the complex environment. Int J Cybern Syst 40(7):569–588CrossRef
12.
Zurück zum Zitat Gelgon M, Bouthemy PA (2000) A region-level motion based graph representation and labeling for tracking a spatial image partition. Pattern Recognit 33:725–740CrossRef Gelgon M, Bouthemy PA (2000) A region-level motion based graph representation and labeling for tracking a spatial image partition. Pattern Recognit 33:725–740CrossRef
13.
Zurück zum Zitat Hayman E, Eklundh JO (2003) Statistical background subtraction for a mobile observer. In: IEEE international conference on computer vision. IEEE, pp 67–74 Hayman E, Eklundh JO (2003) Statistical background subtraction for a mobile observer. In: IEEE international conference on computer vision. IEEE, pp 67–74
14.
Zurück zum Zitat Huwer S, Niemann H (2000) Adaptive change detection for real-time surveillance applications. In: Third IEEE international workshop on visual surveillance. IEEE, pp 37–46 Huwer S, Niemann H (2000) Adaptive change detection for real-time surveillance applications. In: Third IEEE international workshop on visual surveillance. IEEE, pp 37–46
15.
Zurück zum Zitat Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground–background segmentation using codebook model. Real-Time Imaging 11(3):172–185CrossRef Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground–background segmentation using codebook model. Real-Time Imaging 11(3):172–185CrossRef
16.
Zurück zum Zitat Li L, Huang W, Tian Q (2004) A self-organizing approach to background subtraction for visual surveillance applications. IEEE Trans Image Process 13(11):1459–1472CrossRef Li L, Huang W, Tian Q (2004) A self-organizing approach to background subtraction for visual surveillance applications. IEEE Trans Image Process 13(11):1459–1472CrossRef
17.
Zurück zum Zitat Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef
18.
Zurück zum Zitat Morris G., Angelov P (2014) Real-time novelty detection in video using background subtraction techniques: state of the art. In: IEEE international conference on systems, man and cybernetics Morris G., Angelov P (2014) Real-time novelty detection in video using background subtraction techniques: state of the art. In: IEEE international conference on systems, man and cybernetics
19.
Zurück zum Zitat Murray D, Basu A (1994) Motion tracking with an active camera. IEEE Trans Pattern Anal Mach Intell 16:449–459CrossRef Murray D, Basu A (1994) Motion tracking with an active camera. IEEE Trans Pattern Anal Mach Intell 16:449–459CrossRef
20.
Zurück zum Zitat Price A, Pyke J, Ashiri D, Cornall T (2006) Real time object detection for an unmanned aerial vehicle using an FPGA based vision system. In: IEEE international conference on robotics and automation (ICRA), pp 2854–2859 Price A, Pyke J, Ashiri D, Cornall T (2006) Real time object detection for an unmanned aerial vehicle using an FPGA based vision system. In: IEEE international conference on robotics and automation (ICRA), pp 2854–2859
21.
Zurück zum Zitat Sadeghi-Tehran P, Angelov P (2015) ARTOD: autonomous real time objects detection by a moving camera using recursive density estimation. In: Novel applications of intelligent systems, vol 586. Springer, Berlin, pp 123–138 Sadeghi-Tehran P, Angelov P (2015) ARTOD: autonomous real time objects detection by a moving camera using recursive density estimation. In: Novel applications of intelligent systems, vol 586. Springer, Berlin, pp 123–138
22.
Zurück zum Zitat Sadlier DA, O’Connor NE (2010) Evaluation of a vehicle tracking system for multi-modal UAV-captured video data. SPIE Defense, Security, and Sensing 7668 Sadlier DA, O’Connor NE (2010) Evaluation of a vehicle tracking system for multi-modal UAV-captured video data. SPIE Defense, Security, and Sensing 7668
23.
Zurück zum Zitat Shi J, Tomasi C (1994) Good features to track. In: IEEE computer society conference on computer vision and pattern recognition, CVPR ’94. IEEE Computer Society Press, pp 593–600 Shi J, Tomasi C (1994) Good features to track. In: IEEE computer society conference on computer vision and pattern recognition, CVPR ’94. IEEE Computer Society Press, pp 593–600
24.
Zurück zum Zitat Stauffer C, Grimson, WEL (1999) Adaptive background mixture models for real-time tracking. In: IEEE computer society conference on computer vision and pattern recognition Stauffer C, Grimson, WEL (1999) Adaptive background mixture models for real-time tracking. In: IEEE computer society conference on computer vision and pattern recognition
25.
Zurück zum Zitat Sugaya Y, Kanatani K (2004) Extracting moving objects from a moving camera video sequence. In: Symposium on sensing via image information, pp 279–284 Sugaya Y, Kanatani K (2004) Extracting moving objects from a moving camera video sequence. In: Symposium on sensing via image information, pp 279–284
26.
Zurück zum Zitat Thornton S, Hoffelder M, Morris D (2008) Multi-sensor detection and tracking of humans for safe operations with unmanned ground vehicles. In: Proceedings of the 1st IEEE workshop on human detection from mobile platforms, 20 May 2008, Pasadena, CA, USA Thornton S, Hoffelder M, Morris D (2008) Multi-sensor detection and tracking of humans for safe operations with unmanned ground vehicles. In: Proceedings of the 1st IEEE workshop on human detection from mobile platforms, 20 May 2008, Pasadena, CA, USA
27.
Zurück zum Zitat Tsinko E (2010) Background subtraction with a Pan/Tilt Camera. Ph.D. thesis, The University of British Columbia Tsinko E (2010) Background subtraction with a Pan/Tilt Camera. Ph.D. thesis, The University of British Columbia
28.
Zurück zum Zitat Watanabe Y, Fabiani P, Le Besnerais G (2009) Simultaneous visual target tracking and navigation in a GPS-denied environment. Int Conf Adv Robot ICAR 2009:1–6 Watanabe Y, Fabiani P, Le Besnerais G (2009) Simultaneous visual target tracking and navigation in a GPS-denied environment. Int Conf Adv Robot ICAR 2009:1–6
29.
Zurück zum Zitat Zhang G, Jia J, Xiong W, Wong TT, Heng PA, Bao H (2007) Moving object extraction with a hand-held camera. In: IEEE 11th international conference on computer vision, ICCV 2007, pp 1–8 Zhang G, Jia J, Xiong W, Wong TT, Heng PA, Bao H (2007) Moving object extraction with a hand-held camera. In: IEEE 11th international conference on computer vision, ICCV 2007, pp 1–8
Metadaten
Titel
AURORA: autonomous real-time on-board video analytics
verfasst von
Plamen Angelov
Pouria Sadeghi-Tehran
Christopher Clarke
Publikationsdatum
19.04.2016
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 5/2017
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2315-7

Weitere Artikel der Ausgabe 5/2017

Neural Computing and Applications 5/2017 Zur Ausgabe

Computational Intelligence for Vision and Robotics

Evolving weighting schemes for the Bag of Visual Words