Skip to main content

2018 | OriginalPaper | Buchkapitel

Gestural Transmission of Tasking Information to an Airborne UAV

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A system is presented that enables an authorized person on ground to transmit mission information to an airborne UAV within line of sight by using gestural expressions of both arms without the need for additional devices on ground. A miniaturized processing board with a discrete GPU is used to detect the body movements via a high resolution onboard camera and to translate them into relevant tasking information. Individual task elements are transmitted consecutively, including numerical and non-numerical information. A context aware gesture recognition approach is implemented to enable the reuse of gestures for different contexts in order to maintain a small gesture set. The system further features a bidirectional communication which allows to dispatch visual feedbacks and to query missing information visually via a LED matrix. Two experiments with different briefing contents in a static and dynamic setup have been conducted to proof the feasibility under real-life conditions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
DJI Matrice 600 Pro.
 
2
Nvidia Jetson TX2 with Connect Tech Astro carrier and breakout board.
 
3
Sony FCB-EH6300.
 
4
Adafruit Flexible 8 × 32 NeoPixel RGB LED Matrix.
 
5
Arduino Mega 2560.
 
Literatur
2.
Zurück zum Zitat Monajjemi, M., Mohaimenianpour, S., Vaughan, R.: UAV, come to me. End-to-end, multi-scale situated HRI with an uninstrumented human and a distant UAV. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4410–4417 (2016). https://doi.org/10.1109/iros.2016.7759649 Monajjemi, M., Mohaimenianpour, S., Vaughan, R.: UAV, come to me. End-to-end, multi-scale situated HRI with an uninstrumented human and a distant UAV. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4410–4417 (2016). https://​doi.​org/​10.​1109/​iros.​2016.​7759649
3.
Zurück zum Zitat Monajjemi, V.M., et al.: HRI in the sky: creating and commanding teams of UAVs with a vision-mediated gestural interface. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 03 November 2013, pp. 617–623. IEEE (2013) Monajjemi, V.M., et al.: HRI in the sky: creating and commanding teams of UAVs with a vision-mediated gestural interface. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 03 November 2013, pp. 617–623. IEEE (2013)
4.
Zurück zum Zitat Wang, T., Wang, M.: Remote control method and terminal Patent US9493232B2 (2016) Wang, T., Wang, M.: Remote control method and terminal Patent US9493232B2 (2016)
5.
Zurück zum Zitat Nagi, J., et al.: HRI in the sky: controlling UAVs using face poses and hand gestures. In: HRI, pp. 252–253 (2014) Nagi, J., et al.: HRI in the sky: controlling UAVs using face poses and hand gestures. In: HRI, pp. 252–253 (2014)
7.
Zurück zum Zitat Cao, Z., et al.: Realtime multi-person 2D pose estimation using part affinity fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017) Cao, Z., et al.: Realtime multi-person 2D pose estimation using part affinity fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
8.
Zurück zum Zitat Wei, S.-E., et al.: Convolutional pose machines. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4724–4732 (2016) Wei, S.-E., et al.: Convolutional pose machines. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4724–4732 (2016)
9.
Zurück zum Zitat Simon, T., et al.: Hand keypoint detection in single images using multiview bootstrapping. arXiv preprint arXiv:1704.07809 (2017) Simon, T., et al.: Hand keypoint detection in single images using multiview bootstrapping. arXiv preprint arXiv:​1704.​07809 (2017)
13.
Zurück zum Zitat Liu, W., et al.: SphereFace. Deep hypersphere embedding for face recognition. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017) Liu, W., et al.: SphereFace. Deep hypersphere embedding for face recognition. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017)
14.
Zurück zum Zitat Godil, A., Grother, P., Ressler, S.: Human identification from body shape. In: Proceedings of the Fourth International Conference on 3-D Digital Imaging and Modeling, 3DIM 2003, pp. 386–392 (2003) Godil, A., Grother, P., Ressler, S.: Human identification from body shape. In: Proceedings of the Fourth International Conference on 3-D Digital Imaging and Modeling, 3DIM 2003, pp. 386–392 (2003)
15.
Zurück zum Zitat Bouchrika, I.: On using gait biometrics for re-identification in automated visual surveillance. In: Computer Vision: Concepts, Methodologies, Tools, and Applications, pp. 2363–2386. IGI Global (2018) Bouchrika, I.: On using gait biometrics for re-identification in automated visual surveillance. In: Computer Vision: Concepts, Methodologies, Tools, and Applications, pp. 2363–2386. IGI Global (2018)
16.
Zurück zum Zitat King, D.E.: Dlib-ml: a machine learning toolkit. J. Mach. Learn. Res. 10, 1755–1758 (2009) King, D.E.: Dlib-ml: a machine learning toolkit. J. Mach. Learn. Res. 10, 1755–1758 (2009)
17.
Zurück zum Zitat Shen, C., Kim, J., Wang, L.: A scalable dual approach to semidefinite metric learning. In: CVPR 2011, Providence, RI, USA, pp. 2601–2608. IEEE (2011) Shen, C., Kim, J., Wang, L.: A scalable dual approach to semidefinite metric learning. In: CVPR 2011, Providence, RI, USA, pp. 2601–2608. IEEE (2011)
18.
Zurück zum Zitat Berndt, D.J., Clifford, J.: Using dynamic time warping to find patterns in time series. In: Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining, vol. 10, pp. 359–370. AAAI Press, Seattle (1994) Berndt, D.J., Clifford, J.: Using dynamic time warping to find patterns in time series. In: Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining, vol. 10, pp. 359–370. AAAI Press, Seattle (1994)
19.
Zurück zum Zitat Gillian, N.E., Paradiso, J.A.: The gesture recognition toolkit. J. Mach. Learn. Res. 15(1), 3483–3487 (2014)MathSciNet Gillian, N.E., Paradiso, J.A.: The gesture recognition toolkit. J. Mach. Learn. Res. 15(1), 3483–3487 (2014)MathSciNet
21.
Zurück zum Zitat bin Abdul Rahman, N.A., Wei, K.C., See, J.: RGB-H-CBCR skin colour model for human face detection. Faculty of Information Technology, Multimedia University, vol. 4 (2007) bin Abdul Rahman, N.A., Wei, K.C., See, J.: RGB-H-CBCR skin colour model for human face detection. Faculty of Information Technology, Multimedia University, vol. 4 (2007)
22.
Zurück zum Zitat Quigley, M., et al.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software (2009) Quigley, M., et al.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software (2009)
23.
Zurück zum Zitat Munaro, M., et al.: OpenPTrack: people tracking for heterogeneous networks of color-depth cameras. In: IAS-13 Workshop Proceedings of the 1st International Workshop on 3D Robot Perception with Point Cloud Library, Padova, Italy, pp. 235–247 (2014) Munaro, M., et al.: OpenPTrack: people tracking for heterogeneous networks of color-depth cameras. In: IAS-13 Workshop Proceedings of the 1st International Workshop on 3D Robot Perception with Point Cloud Library, Padova, Italy, pp. 235–247 (2014)
Metadaten
Titel
Gestural Transmission of Tasking Information to an Airborne UAV
verfasst von
Alexander Schelle
Peter Stütz
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-92043-6_27

Neuer Inhalt