Hwai-Jung Hsu
Kuan-Ta Chen
ABSTRACT
Drones, as known as unmanned aerial vehicles (UAV), are aircrafts which can perform autonomous pilot. They can easily reach locations which are too difficult to reach or dangerous for human beings and collect images from bird's-eye view through aerial photography. Enabling drones to identify people on the ground is important for a variety of applications, such as surveillance, people search, and remote monitoring. Since faces are part of inherent identities of people, how well face recognition technologies can be used by drones becomes essential for future development of the above applications.
In this paper, we conduct empirical studies to evaluate several factors that may influence the performance of face detection and recognition techniques on drones. Our findings show that the current face recognition technologies are capable of recognizing faces on drones with some limits in distance and angle, especially when drones take pictures in high altitudes and the face image is taken from a long distance and with a large angle of depression. We also find that augmenting face models with 3D information may help to boost recognition performance in the case of large angles of depression.
- A. GAEszczak, T. P.Breckona, and J. Hana. Real-time People and Vehicle Detection from UAV Imagery. In IS&T/SPIE Electronic Imaging, pages 78780B-1-13, 2011.Google Scholar
- APM. APM Autopilot Suite, http://ardupilot.com/.Google Scholar
- F. Nex and F. Remondino. UAV for 3D mapping applications: a review. Applied Geomatics, 6(1):1--15, March 2014.Google ScholarCross Ref
- G. B. Huang, M. Ramesh and T. Berg and E. Learned-Miller. Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments. Technical Report 07-49, University of Massachusetts, Amherst, October 2007.Google Scholar
- GoPro, Inc. GoPro, http://gopro.com.Google Scholar
- International Civil Aviation Organization. CIR328 AN/190 Unmanned Aircraft Systems (UAS), 2011.Google Scholar
- Ira Kemelmacher-Shlizerman, Ronen Basri. 3D Face Reconstruction from a Single Image Using a Single Reference Face Shape. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(2):394--405, 2011. Google ScholarDigital Library
- Itseez. OpenCV, http://opencv.org/.Google Scholar
- J. Paneque-G A , alvez, M. K. McCall, B. M. Napoletano S. A. Wich, and L. P. Koh. Small Drones for Community-Based Forest Monitoring: An Assessment of Their Feasibility and Potential in Tropical Areas. Forests, 5(6):1481--1507, 2014.Google ScholarCross Ref
- P. Korshunov and W. T. Ooi. Video quality for face detection, recognition, and tracking. ACM Trans. Multimedia Comput. Commun. Appl., 7(3):14:1-14:21, Sept. 2011. Google ScholarDigital Library
- M. Bartholmai, E. Koeppe, and P. P. Neumann. Monitoring of Hazardous Scenarios using Multi-Sensor Devices. In Proceedings of SENSORDEVICES 2013, pages 9--13, 2013.Google Scholar
- Megvii, Inc. Face++, http://www.faceplusplus.com/.Google Scholar
- N. Davis, F. Pattaluga, and K. Panetta. Facial recognition using human visual system algorithms for robotic and UAV platforms. In Proceedings of TePRA 2013, pages 1--5, 2013.Google ScholarCross Ref
- N. Dijkshoorn et al. Amsterdam Oxford Joint Rescue Forces - Team Description Paper - Virtual Robot Competition - Rescue Simulation League - RoboCup 2011. In Proceedings of the 15th RoboCup Symposium, pages 1--8, 2011.Google Scholar
- N. Shachtman. Army Tracking Plan: Drones That Never Forget a Face, http://www.wired.com/2011/09/dronesnever-forget-a-face/.Google Scholar
- Neurotechnology. Basic Recommendation for Facial Recognition, http://www.neurotechnology.com/face-imagerecommendations-constraints.html.Google Scholar
- Orbeus, Inc. ReKognition API, https://rekognition.com/.Google Scholar
- P. Rudol and P. Doherty. Human Body Detection and Geolocalization for UAV Search and Rescue Missions Using Color and Thermal Imagery. In 2008 IEEE Aerospace Conference, pages 1--8, March 2008.Google Scholar
- P. Sinha, B. Balas, Y. Ostrovsky, and R. Russell. Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About. Proceedings of the IEEE, 94(11):1948--1962, 2006.Google ScholarCross Ref
- S. K. Zhou, R. Chellappa, and W. Zhao. Unconstrained Face Recognition, volume 5. Springer Science & Business Media, 2006.Google Scholar
- S. Zafeiriou, I. Kotsia, and M. Panti. Unconstrained face recognition. Face Recognition in Adverse Conditions, 2, 2014.Google Scholar
- Singular Inversions, Inc. FaceGen, http://www.facegen.com/.Google Scholar
- T. Wall and T. Monahan. Surveillance and violence from afar: The politics of drones and liminal securityGoogle Scholar
Index Terms
- Face Recognition on Drones: Issues and Limitations
Recommendations
Multi-Resolution Face Recognition with Drones
SSIP '20: Proceedings of the 2020 3rd International Conference on Sensors, Signal and Image ProcessingSmart cameras have recently seen a large diffusion and represent a low-cost solution for improving public security in many scenarios. Moreover, they are light enough to be lifted by a drone. Face recognition enabled by drones equipped with smart ...
Poster: A Multi-Drone Platform for Empowering Drones' Teamwork
MobiCom '15: Proceedings of the 21st Annual International Conference on Mobile Computing and NetworkingThe rapid development of UAV technology has opened up numerous applications. Further, cooperating drones\footnote{In this paper, we refer to all types of UAVs as drones.} possess a great potential in various areas of applications. Yet, there has not ...
Demonstration of wireless synchronisation methods in autonomously controlled fleet of drones
This paper describes methods used in synchronising the behaviour of multiple autonomous flight vehicles utilising custom external hardware and firmware injected into current aviation flight systems. To prove the reliability and consistency of an ...
Comments