Skip to main content

2022 | OriginalPaper | Buchkapitel

Human Detection in Drone Images Using YOLO for Search-and-Rescue Operations

verfasst von : Sergio Caputo, Giovanna Castellano, Francesco Greco, Corrado Mencar, Niccolò Petti, Gennaro Vessio

Erschienen in: AIxIA 2021 – Advances in Artificial Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Today, unmanned aerial vehicles, more commonly known as drones, can be equipped with high-resolution cameras and embedded GPUs powerful enough to provide effective and efficient aid to Search-and-Rescue (SAR) operations in remote and hostile environments. Locating victims, who may be unconscious or injured, as quickly as possible is critical to improving their chance of survival. Therefore, using drones as flying machines for computer vision can increase the detection rate while reducing rescue time. In this paper, we present the results of an experimental evaluation in which we used the latest, lightweight version of the YOLO detection algorithm, namely YOLOv5, to detect humans in danger using two new benchmark datasets specifically designed for SAR with drones. The results obtained are encouraging, as they are competitive with respect to the state-of-the-art in terms of detection accuracy, but with much faster detection time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Bochkovskiy, A., Wang, C.Y., Liao, H.Y.M.: Yolov4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934 (2020) Bochkovskiy, A., Wang, C.Y., Liao, H.Y.M.: Yolov4: optimal speed and accuracy of object detection. arXiv preprint arXiv:​2004.​10934 (2020)
4.
Zurück zum Zitat Castellano, G., Castiello, C., Mencar, C., Vessio, G.: Crowd detection in aerial images using spatial graphs and fully-convolutional neural networks. IEEE Access 8, 64534–64544 (2020)CrossRef Castellano, G., Castiello, C., Mencar, C., Vessio, G.: Crowd detection in aerial images using spatial graphs and fully-convolutional neural networks. IEEE Access 8, 64534–64544 (2020)CrossRef
6.
Zurück zum Zitat Cooper, D.C.: Fundamentals of Search and Rescue. Jones & Bartlett Learning, Burlington (2005) Cooper, D.C.: Fundamentals of Search and Rescue. Jones & Bartlett Learning, Burlington (2005)
7.
Zurück zum Zitat Eid, S.E., Dol, S.S.: Design and development of lightweight-high endurance unmanned aerial vehicle for offshore search and rescue operation. In: 2019 Advances in Science and Engineering Technology International Conferences (ASET), pp. 1–5. IEEE (2019) Eid, S.E., Dol, S.S.: Design and development of lightweight-high endurance unmanned aerial vehicle for offshore search and rescue operation. In: 2019 Advances in Science and Engineering Technology International Conferences (ASET), pp. 1–5. IEEE (2019)
8.
Zurück zum Zitat Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 580–587 (2014) Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 580–587 (2014)
10.
Zurück zum Zitat Karaca, Y., Cicek, M., Tatli, O., Sahin, A., Pasli, S., Beser, M.F., Turedi, S.: The potential use of unmanned aircraft systems (drones) in mountain search and rescue operations. Am. J. Emerg. Med. 36(4), 583–588 (2018)CrossRef Karaca, Y., Cicek, M., Tatli, O., Sahin, A., Pasli, S., Beser, M.F., Turedi, S.: The potential use of unmanned aircraft systems (drones) in mountain search and rescue operations. Am. J. Emerg. Med. 36(4), 583–588 (2018)CrossRef
11.
Zurück zum Zitat Kashihara, S., Wicaksono, M.A., Fall, D., Niswar, M.: Supportive information to find victims from aerial video in search and rescue operation. In: 2019 IEEE International Conference on Internet of Things and Intelligence System (IoTaIS), pp. 56–61. IEEE (2019) Kashihara, S., Wicaksono, M.A., Fall, D., Niswar, M.: Supportive information to find victims from aerial video in search and rescue operation. In: 2019 IEEE International Conference on Internet of Things and Intelligence System (IoTaIS), pp. 56–61. IEEE (2019)
12.
Zurück zum Zitat Kundid Vasić, M., Papić, V.: Multimodel deep learning for person detection in aerial images. Electronics 9(9), 1459 (2020)CrossRef Kundid Vasić, M., Papić, V.: Multimodel deep learning for person detection in aerial images. Electronics 9(9), 1459 (2020)CrossRef
13.
Zurück zum Zitat Li, W.H., Hong, F.T., Zheng, W.S.: Learning to learn relation for important people detection in still images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5003–5011 (2019) Li, W.H., Hong, F.T., Zheng, W.S.: Learning to learn relation for important people detection in still images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5003–5011 (2019)
15.
Zurück zum Zitat Lygouras, E., Santavas, N., Taitzoglou, A., Tarchanidis, K., Mitropoulos, A., Gasteratos, A.: Unsupervised human detection with an embedded vision system on a fully autonomous uav for search and rescue operations. Sensors 19(16), 3542 (2019)CrossRef Lygouras, E., Santavas, N., Taitzoglou, A., Tarchanidis, K., Mitropoulos, A., Gasteratos, A.: Unsupervised human detection with an embedded vision system on a fully autonomous uav for search and rescue operations. Sensors 19(16), 3542 (2019)CrossRef
16.
Zurück zum Zitat Martins, F., de Groot, M., Stokkel, X., Wiering, M.A.: Human detection and classification of landing sites for search and rescue drones. In: ESANN (2016) Martins, F., de Groot, M., Stokkel, X., Wiering, M.A.: Human detection and classification of landing sites for search and rescue drones. In: ESANN (2016)
17.
Zurück zum Zitat McGee, J., Mathew, S.J., Gonzalez, F.: Unmanned aerial vehicle and artificial intelligence for thermal target detection in search and rescue applications. In: 2020 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 883–891. IEEE (2020) McGee, J., Mathew, S.J., Gonzalez, F.: Unmanned aerial vehicle and artificial intelligence for thermal target detection in search and rescue applications. In: 2020 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 883–891. IEEE (2020)
18.
Zurück zum Zitat Mishra, B., Garg, D., Narang, P., Mishra, V.: Drone-surveillance for search and rescue in natural disaster. Comput. Commun. 156, 1–10 (2020)CrossRef Mishra, B., Garg, D., Narang, P., Mishra, V.: Drone-surveillance for search and rescue in natural disaster. Comput. Commun. 156, 1–10 (2020)CrossRef
19.
Zurück zum Zitat Murphy, S.O., Sreenan, C., Brown, K.N.: Autonomous unmanned aerial vehicle for search and rescue using software defined radio. In: 2019 IEEE 89th vehicular technology conference (VTC2019-Spring), pp. 1–6. IEEE (2019) Murphy, S.O., Sreenan, C., Brown, K.N.: Autonomous unmanned aerial vehicle for search and rescue using software defined radio. In: 2019 IEEE 89th vehicular technology conference (VTC2019-Spring), pp. 1–6. IEEE (2019)
20.
Zurück zum Zitat Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016) Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
21.
Zurück zum Zitat Rodin, C.D., de Lima, L.N., de Alcantara Andrade, F.A., Haddad, D.B., Johansen, T.A., Storvold, R.: Object classification in thermal images using convolutional neural networks for search and rescue missions with unmanned aerial systems. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2018) Rodin, C.D., de Lima, L.N., de Alcantara Andrade, F.A., Haddad, D.B., Johansen, T.A., Storvold, R.: Object classification in thermal images using convolutional neural networks for search and rescue missions with unmanned aerial systems. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2018)
22.
Zurück zum Zitat Sambolek, S., Ivasic-Kos, M.: Automatic person detection in search and rescue operations using deep cnn detectors. IEEE Access 9, 37905–37922 (2021)CrossRef Sambolek, S., Ivasic-Kos, M.: Automatic person detection in search and rescue operations using deep cnn detectors. IEEE Access 9, 37905–37922 (2021)CrossRef
23.
Zurück zum Zitat Waharte, S., Trigoni, N.: Supporting search and rescue operations with UAVs. In: 2010 International Conference on Emerging Security Technologies, pp. 142–147. IEEE (2010) Waharte, S., Trigoni, N.: Supporting search and rescue operations with UAVs. In: 2010 International Conference on Emerging Security Technologies, pp. 142–147. IEEE (2010)
24.
Zurück zum Zitat Xu, R., Lin, H., Lu, K., Cao, L., Liu, Y.: A forest fire detection system based on ensemble learning. Forests 12(2), 217 (2021)CrossRef Xu, R., Lin, H., Lu, K., Cao, L., Liu, Y.: A forest fire detection system based on ensemble learning. Forests 12(2), 217 (2021)CrossRef
25.
Zurück zum Zitat Zheng, Y., Zhang, X., Wang, F., Cao, T., Sun, M., Wang, X.: Detection of people with camouflage pattern via dense deconvolution network. IEEE Sig. Process. Lett. 26(1), 29–33 (2018)CrossRef Zheng, Y., Zhang, X., Wang, F., Cao, T., Sun, M., Wang, X.: Detection of people with camouflage pattern via dense deconvolution network. IEEE Sig. Process. Lett. 26(1), 29–33 (2018)CrossRef
Metadaten
Titel
Human Detection in Drone Images Using YOLO for Search-and-Rescue Operations
verfasst von
Sergio Caputo
Giovanna Castellano
Francesco Greco
Corrado Mencar
Niccolò Petti
Gennaro Vessio
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-031-08421-8_22