Skip to main content
Erschienen in: Neural Computing and Applications 17/2021

02.06.2020 | S. I : Hybridization of Neural Computing with Nature Inspired Algorithms

A hybrid approach for search and rescue using 3DCNN and PSO

verfasst von: Balmukund Mishra, Deepak Garg, Pratik Narang, Vipul Mishra

Erschienen in: Neural Computing and Applications | Ausgabe 17/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Search and rescue are essential applications of disaster management in which people are evacuated from the disaster-prone area to a safer place. This overall process of search and rescue can be more efficient if an automated system can quickly locate the human or area where rescue is required. To provide a faster and accurate search of those places, this paper proposes a novel approach to search and rescue using automated drone surveillance. In this paper, a complex scene classification problem is solved using the proposed 3DCNN model. The proposed model uses spatial as well as temporal features of the video for the classification of the scene as help or non-help in the natural disaster. Due to the unavailability of such kind of dataset, it is impossible to train the model. Therefore, it is essential to develop a dataset for search and rescue. The proposed dataset is a first and unique dataset for scene classification using drone surveillance. The major contribution of this paper is (1) a novel 3DCNN powered model for scene classification in drone surveillance, (2) to develop the required dataset for the training of scene classification model, and (3) particular swarm optimization (PSO)-based hyper-parameter tuning for getting the best value of multiple parameters used for training the model. Our hybridization of parameter tuning with PSO helps for the convergence of parameter values of proposed 3DCNN model, and the proposed scene classification model (3DCNN+PSO) is applied to the dataset. The proposed model gives an impressive performance to help situation identification with 98% training and 99% validation accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Banerjee B, Murino V (2017) Efficient pooling of image based cnn features for action recognition in videos. In: 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 2637–2641. IEEE Banerjee B, Murino V (2017) Efficient pooling of image based cnn features for action recognition in videos. In: 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 2637–2641. IEEE
2.
Zurück zum Zitat Barekatain M, Martí M, Shih H-F, Murray S, Nakayama K, Matsuo Y, Prendinger H.(2017) Okutama-action: an aerial view video dataset for concurrent human action detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 28–35 Barekatain M, Martí M, Shih H-F, Murray S, Nakayama K, Matsuo Y, Prendinger H.(2017) Okutama-action: an aerial view video dataset for concurrent human action detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 28–35
3.
Zurück zum Zitat Burney A, Syed TQ (2016) Crowd video classification using convolutional neural networks. In: International conference on frontiers of information technology (FIT), pp 247–251. IEEE Burney A, Syed TQ (2016) Crowd video classification using convolutional neural networks. In: International conference on frontiers of information technology (FIT), pp 247–251. IEEE
4.
Zurück zum Zitat Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448 Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448
5.
Zurück zum Zitat Junyou B (2007) Stock price forecasting using PSO-trained neural networks. In: IEEE congress on evolutionary computation, pp 2879–2885. IEEE Junyou B (2007) Stock price forecasting using PSO-trained neural networks. In: IEEE congress on evolutionary computation, pp 2879–2885. IEEE
6.
Zurück zum Zitat Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1725–1732 Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1725–1732
7.
Zurück zum Zitat Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of international conference on neural networks, ICNN’95, vol 4, pp 1942–1948. IEEE Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of international conference on neural networks, ICNN’95, vol 4, pp 1942–1948. IEEE
8.
Zurück zum Zitat Kollias D, Zafeiriou S (2019) Exploiting multi-CNN features in CNN-RNN based dimensional emotion recognition on the omg in-the-wild dataset. arXiv preprint arXiv:1910.01417 Kollias D, Zafeiriou S (2019) Exploiting multi-CNN features in CNN-RNN based dimensional emotion recognition on the omg in-the-wild dataset. arXiv preprint arXiv:​1910.​01417
9.
Zurück zum Zitat Mantovani RG, Horváth T, Cerri R, Vanschoren J, de Carvalho AC (2016) Hyper-parameter tuning of a decision tree induction algorithm. In: 5th Brazilian conference on intelligent systems (BRACIS), pp 37–42. IEEE Mantovani RG, Horváth T, Cerri R, Vanschoren J, de Carvalho AC (2016) Hyper-parameter tuning of a decision tree induction algorithm. In: 5th Brazilian conference on intelligent systems (BRACIS), pp 37–42. IEEE
10.
Zurück zum Zitat Mishra VK, Sengupta A (2014) MO-PSE: adaptive multi-objective particle swarm optimization based design space exploration in architectural synthesis for application specific processor design. Adv Eng Softw 67:111–124CrossRef Mishra VK, Sengupta A (2014) MO-PSE: adaptive multi-objective particle swarm optimization based design space exploration in architectural synthesis for application specific processor design. Adv Eng Softw 67:111–124CrossRef
11.
Zurück zum Zitat Murphy RR, Tadokoro S, Nardi D, Jacoff A, Fiorini P, Choset H, Erkmen AM (2008) Search and rescue robotics. Springer handbook of robotics. Springer, Berlin, pp 1151–1173 Murphy RR, Tadokoro S, Nardi D, Jacoff A, Fiorini P, Choset H, Erkmen AM (2008) Search and rescue robotics. Springer handbook of robotics. Springer, Berlin, pp 1151–1173
12.
Zurück zum Zitat Padierna LC, Carpio M, Rojas A, Puga H, Baltazar R, Fraire H (2017) Hyper-parameter tuning for support vector machines by estimation of distribution algorithms. In: Nature-inspired design of hybrid intelligent systems, pp 787–800. Springer, Berlin Padierna LC, Carpio M, Rojas A, Puga H, Baltazar R, Fraire H (2017) Hyper-parameter tuning for support vector machines by estimation of distribution algorithms. In: Nature-inspired design of hybrid intelligent systems, pp 787–800. Springer, Berlin
13.
Zurück zum Zitat Perera AG, Wei Law Y, Chahl J (2018) UAV-gesture: a dataset for uav control and gesture recognition. In: Proceedings of the European conference on computer vision (ECCV) Perera AG, Wei Law Y, Chahl J (2018) UAV-gesture: a dataset for uav control and gesture recognition. In: Proceedings of the European conference on computer vision (ECCV)
14.
15.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99 Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99
16.
Zurück zum Zitat Rojas-Domínguez A, Padierna LC, Valadez JMC, Puga-Soberanes HJ, Fraire HJ (2017) Optimal hyper-parameter tuning of SVM classifiers with application to medical diagnosis. IEEE Access 6:7164–7176CrossRef Rojas-Domínguez A, Padierna LC, Valadez JMC, Puga-Soberanes HJ, Fraire HJ (2017) Optimal hyper-parameter tuning of SVM classifiers with application to medical diagnosis. IEEE Access 6:7164–7176CrossRef
17.
Zurück zum Zitat Sheikhan M, Mohammadi N (2013) Time series prediction using PSO-optimized neural network and hybrid feature selection algorithm for IEEE load data. Neural Comput Appl 23(3–4):1185–1194CrossRef Sheikhan M, Mohammadi N (2013) Time series prediction using PSO-optimized neural network and hybrid feature selection algorithm for IEEE load data. Neural Comput Appl 23(3–4):1185–1194CrossRef
18.
Zurück zum Zitat Soleimani A, Nasrabadi NM (2018). Convolutional neural networks for aerial multi-label pedestrian detection. In: 21st international conference on information fusion (FUSION), pp 1005–1010. IEEE Soleimani A, Nasrabadi NM (2018). Convolutional neural networks for aerial multi-label pedestrian detection. In: 21st international conference on information fusion (FUSION), pp 1005–1010. IEEE
19.
Zurück zum Zitat Subasi A (2013) Classification of EMG signals using pso optimized SVM for diagnosis of neuromuscular disorders. Comput Biol Med 43(5):576–586CrossRef Subasi A (2013) Classification of EMG signals using pso optimized SVM for diagnosis of neuromuscular disorders. Comput Biol Med 43(5):576–586CrossRef
20.
Zurück zum Zitat Tian D, Shi Z (2018) MPSO: Modified particle swarm optimization and its applications. Swarm Evol Comput 41:49–68CrossRef Tian D, Shi Z (2018) MPSO: Modified particle swarm optimization and its applications. Swarm Evol Comput 41:49–68CrossRef
21.
Zurück zum Zitat Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRef Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRef
22.
Zurück zum Zitat Wang Y, Zhang H, Zhang G (2019) cPSO-CNN: an efficient pso-based algorithm for fine-tuning hyper-parameters of convolutional neural networks. Swarm Evol Comput 49:114–123CrossRef Wang Y, Zhang H, Zhang G (2019) cPSO-CNN: an efficient pso-based algorithm for fine-tuning hyper-parameters of convolutional neural networks. Swarm Evol Comput 49:114–123CrossRef
23.
Zurück zum Zitat Zhao Y, Peng Y (2017) Saliency-guided video classification via adaptively weighted learning. In: IEEE international conference on multimedia and expo (ICME), pp 847–852. IEEE Zhao Y, Peng Y (2017) Saliency-guided video classification via adaptively weighted learning. In: IEEE international conference on multimedia and expo (ICME), pp 847–852. IEEE
Metadaten
Titel
A hybrid approach for search and rescue using 3DCNN and PSO
verfasst von
Balmukund Mishra
Deepak Garg
Pratik Narang
Vipul Mishra
Publikationsdatum
02.06.2020
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 17/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05001-7

Weitere Artikel der Ausgabe 17/2021

Neural Computing and Applications 17/2021 Zur Ausgabe

Premium Partner