Skip to main content
Erschienen in: Soft Computing 5/2016

19.04.2015 | Focus

Image processing acceleration for intelligent unmanned aerial vehicle on mobile GPU

verfasst von: Dongwoon Jeon, Doo-Hyun Kim, Young-Guk Ha, Vladimir Tyan

Erschienen in: Soft Computing | Ausgabe 5/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we present an algorithm for providing visually-guided unmanned aerial vehicle (UAV) control using visual information that is processed on a mobile graphic processing unit (GPU). Most real-time machine vision applications for UAVs exploit low-resolution images because the shortage of computational resources comes from size, weight and power issue. This leads to the limitation that the data are insufficient to provide the UAV with intelligent behavior. However, GPUs have emerged as inexpensive parallel processors that are capable of providing high computational power in mobile environments. We present an approach for detecting and tracking lines that use a mobile GPU. Hough transform and clustering techniques were used for robust and fast tracking. We achieved accurate line detection and faster tracking performance using the mobile GPU as compared with an x86 i5 CPU. Moreover, the average results showed that the GPU provided approximately five times speedup as compared to an ARM quad-core Cortex-A15. We conducted a detailed analysis of the performance of proposed tracking and detection algorithm and obtained meaningful results that could be utilized in real flight.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Braak van den GJ, Nugteren C, Mesman B, Corporaal H (2011) Advances concepts for intelligent vision systems. Fast Hough transform on GPUs: exploration of algorithm trade-offs. Springer, Berlin Heidelberg Braak van den GJ, Nugteren C, Mesman B, Corporaal H (2011) Advances concepts for intelligent vision systems. Fast Hough transform on GPUs: exploration of algorithm trade-offs. Springer, Berlin Heidelberg
Zurück zum Zitat Campoy P, Correa J, Mondragon I, Martnez C, Olivares M, Mejas L, Artieda J (2009) Computer vision onboard UAVs for civilian tasks. J Intell Robotic Syst 54(1–3):105–135CrossRef Campoy P, Correa J, Mondragon I, Martnez C, Olivares M, Mejas L, Artieda J (2009) Computer vision onboard UAVs for civilian tasks. J Intell Robotic Syst 54(1–3):105–135CrossRef
Zurück zum Zitat Chen S, Jiang H (2011) Accelerating the Hough transform with CUDA on graphics processing units. In: Department of Computer Science, Arkansas State University Chen S, Jiang H (2011) Accelerating the Hough transform with CUDA on graphics processing units. In: Department of Computer Science, Arkansas State University
Zurück zum Zitat Duda R, Hart P (1972) Use of the Hough transformation to detect lines and curves in pictures. Commun ACM 15(1):11–15CrossRefMATH Duda R, Hart P (1972) Use of the Hough transformation to detect lines and curves in pictures. Commun ACM 15(1):11–15CrossRefMATH
Zurück zum Zitat Engel J, Sturm J, Cremers D (2012) Camera-based navigation of a low-cost quadrocopter. In: Intelligent robots and systems (IROS), 2012 IEEE/RSJ international conference on, pp 2815–2821 Engel J, Sturm J, Cremers D (2012) Camera-based navigation of a low-cost quadrocopter. In: Intelligent robots and systems (IROS), 2012 IEEE/RSJ international conference on, pp 2815–2821
Zurück zum Zitat Feng L, Xiangxu D, Chen BM, Lee Kai-Yew LT (2012) A robust real-time embedded vision system on an unmanned rotorcraft for ground target following. Ind Electron IEEE Trans 59(2):1038–1049CrossRef Feng L, Xiangxu D, Chen BM, Lee Kai-Yew LT (2012) A robust real-time embedded vision system on an unmanned rotorcraft for ground target following. Ind Electron IEEE Trans 59(2):1038–1049CrossRef
Zurück zum Zitat Gmez-Luna1a J, Gonzlez-Linaresb J, Benavidesa J, Zapatab E, Guilb N (2011) Parallelization of the generalized Hough transform on GPU. In: Computer Architecture and Electronics Department, University of Crdoba, Spain Gmez-Luna1a J, Gonzlez-Linaresb J, Benavidesa J, Zapatab E, Guilb N (2011) Parallelization of the generalized Hough transform on GPU. In: Computer Architecture and Electronics Department, University of Crdoba, Spain
Zurück zum Zitat Kaiser M, Gans N, Dixon W (2010) Vision-based estimation for guidance, navigation, and control of an aerial vehicle. Aerosp Electron Syst IEEE Trans 46(3):1064–1077CrossRef Kaiser M, Gans N, Dixon W (2010) Vision-based estimation for guidance, navigation, and control of an aerial vehicle. Aerosp Electron Syst IEEE Trans 46(3):1064–1077CrossRef
Zurück zum Zitat Kalman RE (1960) A new approach to linear filtering and prediction problems. J Fluids Eng 82(1):35–45 Kalman RE (1960) A new approach to linear filtering and prediction problems. J Fluids Eng 82(1):35–45
Zurück zum Zitat Lange S, Sunderhauf N, Protzel P (2009) A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments. In: Advanced robotics, ICAR 2009, international conference on, pp 22–26 Lange S, Sunderhauf N, Protzel P (2009) A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments. In: Advanced robotics, ICAR 2009, international conference on, pp 22–26
Zurück zum Zitat Mejias L, McNamara S, Lai J, Ford J (2010) Vision-based detection and tracking of aerial targets for UAV collision avoidance. In: Intelligent robots and systems (IROS), 2010 IEEE/RSJ international conference on, pp 87–92 Mejias L, McNamara S, Lai J, Ford J (2010) Vision-based detection and tracking of aerial targets for UAV collision avoidance. In: Intelligent robots and systems (IROS), 2010 IEEE/RSJ international conference on, pp 87–92
Zurück zum Zitat Mills S, Pridmore T, Hills M (2003) Tracking in a Hough space with the extended Kalman filter. In: Proceedings of the British machine conference. BMVA Press, pp 1–10 Mills S, Pridmore T, Hills M (2003) Tracking in a Hough space with the extended Kalman filter. In: Proceedings of the British machine conference. BMVA Press, pp 1–10
Zurück zum Zitat Olivares-Mendez M (2010) Fuzzy controller for UAV-landing task using 3D-position visual estimation. In: Comput. Vision Group, Univ. Politec. de Madrid, Madrid, Barcelona, Spain, pp 1–8 Olivares-Mendez M (2010) Fuzzy controller for UAV-landing task using 3D-position visual estimation. In: Comput. Vision Group, Univ. Politec. de Madrid, Madrid, Barcelona, Spain, pp 1–8
Zurück zum Zitat Oppenheim A, Schafer R, Buck J (1989) Discrete-time signal processing. Prentice-hall, Englewood CliffsMATH Oppenheim A, Schafer R, Buck J (1989) Discrete-time signal processing. Prentice-hall, Englewood CliffsMATH
Zurück zum Zitat Otsu N (1979) A threshold selection method from gray-level histogram. IEEE Trans Syst Man Cybern SMC–9(1):62–66MathSciNet Otsu N (1979) A threshold selection method from gray-level histogram. IEEE Trans Syst Man Cybern SMC–9(1):62–66MathSciNet
Zurück zum Zitat Sural S, Qian G, Pramanik S (2002) Segmentation and histogram generation using the HSV color space for image retrieval. In: Image processing proceedings, international conference on, IEEE, Vol. 2, pp II-589 Sural S, Qian G, Pramanik S (2002) Segmentation and histogram generation using the HSV color space for image retrieval. In: Image processing proceedings, international conference on, IEEE, Vol. 2, pp II-589
Zurück zum Zitat Tyan V, Jeon D (2014) Fast multi-line detection and tracking with CUDA for vision-based UAV autopilot. In: IMIS 2014. United Kingdom Tyan V, Jeon D (2014) Fast multi-line detection and tracking with CUDA for vision-based UAV autopilot. In: IMIS 2014. United Kingdom
Zurück zum Zitat Zhihai H, Iyer R, Chandler P (2006) Vision-based UAV flight control and obstacle avoidance. In: American control conference, pp 14–16 Zhihai H, Iyer R, Chandler P (2006) Vision-based UAV flight control and obstacle avoidance. In: American control conference, pp 14–16
Metadaten
Titel
Image processing acceleration for intelligent unmanned aerial vehicle on mobile GPU
verfasst von
Dongwoon Jeon
Doo-Hyun Kim
Young-Guk Ha
Vladimir Tyan
Publikationsdatum
19.04.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 5/2016
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-015-1656-y

Weitere Artikel der Ausgabe 5/2016

Soft Computing 5/2016 Zur Ausgabe