Skip to main content
Top
Published in: Multimedia Systems 1/2022

01-10-2021 | Original Research Paper

Employing data generation for visual weapon identification using Convolutional Neural Networks

Authors: Neelam Dwivedi, Dushyant Kumar Singh, Dharmender Singh Kushwaha

Published in: Multimedia Systems | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The use of weapons nowadays is becoming a leading cause of severe crimes in our society, which reluctantly results in dreadful consequences. The weapons used typically varies from knife, iron-rod, dagger, sabre to firearms like guns and bombs. Due to the unavailability of any proactive mechanism for avoiding heinous crimes using such weapons, an active surveillance performing real time weapon identification is proposed here, as a boon to societal security requirement. As part of it, this paper presents a novel approach based on Convolutional Neural Network (CNN) for identifying visual weapons. This proposed CNN model is initialized with the pre-trained Visual Geometry Group-16 (VGG-16) network weights. These weights are further fine-tuned by training this CNN model with comprehensive weapons (knives and handguns only) and non-weapon images. Weapon category images correspond to further classified classes of “isolated” and “handheld” weapons. However, weapon identification is challenging because of unavailability of diverse databases containing images with variations in shape, texture, scale, occlusion of weapon, etc. This paper reduces this limitation by presenting an algorithm for generating new images and other algorithm for preprocessing the images for quality enhancement. The accuracy achieved is 98.07% with original isolated images and 98.36% with its preprocessed images, while 98.42% with original handheld images and 98.80% with its preprocessed images. The preprocessed algorithm’s applicability is confirmed by the higher accuracy achieved by this model using preprocessed images. The accuracy achieved is on an average of ~7% higher than those achieved by other researchers with similar work. The improved result of weapon identification in terms of accuracy proves the appropriateness of the proposed research in being used commercially.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference National Crime Records Bureau. Ministry of Home Affairs. New Delhi, India National Crime Records Bureau. Ministry of Home Affairs. New Delhi, India
3.
go back to reference Velastin, S.A., Boghossian, B.A., Vicencio-Silva, M.A.: A motion-based image processing system for detecting potentially dangerous situations in underground railway stations. Transport. Res. Part C 14(2), 96–113 (2006)CrossRef Velastin, S.A., Boghossian, B.A., Vicencio-Silva, M.A.: A motion-based image processing system for detecting potentially dangerous situations in underground railway stations. Transport. Res. Part C 14(2), 96–113 (2006)CrossRef
4.
go back to reference Ainsworth, T.: Buyer beware. Secur. Oz 19, 18–26 (2002) Ainsworth, T.: Buyer beware. Secur. Oz 19, 18–26 (2002)
6.
go back to reference Singh, D.K., Kushwaha, D.S.: Tracking movements of humans in a real-time surveillance scene. In: Fifth International Conference on Soft Computing for Problem Solving, pp. 491–500 (2016) Singh, D.K., Kushwaha, D.S.: Tracking movements of humans in a real-time surveillance scene. In: Fifth International Conference on Soft Computing for Problem Solving, pp. 491–500 (2016)
7.
go back to reference Jalal, A., Kamal, S.: Real-time life logging via a depth silhouettebased human activity recognition system for smart home services. In: Eleventh IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 74–80 (2014) Jalal, A., Kamal, S.: Real-time life logging via a depth silhouettebased human activity recognition system for smart home services. In: Eleventh IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 74–80 (2014)
8.
go back to reference Kumar, T., Kushwaha, D.S.: Traffic surveillance and speed limit violation detection system. J. Intell. Fuzzy Syst. 32(5), 3761–3773 (2017)CrossRef Kumar, T., Kushwaha, D.S.: Traffic surveillance and speed limit violation detection system. J. Intell. Fuzzy Syst. 32(5), 3761–3773 (2017)CrossRef
9.
go back to reference Dixit, K.: UP: mela police bans licensed weapons during Kumbh, Times of India, 10 Jan 2019. Accessed 3 Aug 2021 Dixit, K.: UP: mela police bans licensed weapons during Kumbh, Times of India, 10 Jan 2019. Accessed 3 Aug 2021
10.
go back to reference Kumar, K.: Text query based summarized event searching interface system using deep learning over cloud. Multimed. Tools. Appl. 80(7), 11079–11094 (2021)CrossRef Kumar, K.: Text query based summarized event searching interface system using deep learning over cloud. Multimed. Tools. Appl. 80(7), 11079–11094 (2021)CrossRef
11.
go back to reference Kumar, K., Shrimankar, D.D.: Deep event learning boost-up approach: DELTA. Multimed. Tools Appl. 77(20), 26635–26655 (2018)CrossRef Kumar, K., Shrimankar, D.D.: Deep event learning boost-up approach: DELTA. Multimed. Tools Appl. 77(20), 26635–26655 (2018)CrossRef
12.
go back to reference Kumar, K., Shrimankar, D.D.: F-DES: fast and deep event summarization. IEEE Trans. Multimed. 20(2), 323–34 (2017)CrossRef Kumar, K., Shrimankar, D.D.: F-DES: fast and deep event summarization. IEEE Trans. Multimed. 20(2), 323–34 (2017)CrossRef
13.
go back to reference Kumar, K.: EVS-DK: event video skimming using deep keyframe. J. Vis. Commun. Image Represent. 58, 345–352 (2019)CrossRef Kumar, K.: EVS-DK: event video skimming using deep keyframe. J. Vis. Commun. Image Represent. 58, 345–352 (2019)CrossRef
14.
go back to reference Olmos, R., Tabik, S., Herrera, F.: Automatic handgun detection alarm in videos using deep learning. Neurocomputing 275, 66–72 (2018)CrossRef Olmos, R., Tabik, S., Herrera, F.: Automatic handgun detection alarm in videos using deep learning. Neurocomputing 275, 66–72 (2018)CrossRef
15.
go back to reference Tiwari, R.K., Verma, G.K.: A computer vision based framework for visual gun detection using Harris interest point detector. Procedia Comput. Sci. 54, 703–712 (2015)CrossRef Tiwari, R.K., Verma, G.K.: A computer vision based framework for visual gun detection using Harris interest point detector. Procedia Comput. Sci. 54, 703–712 (2015)CrossRef
16.
17.
go back to reference Maksimova, A., Matiolanski, A., Wassermann, J.: Fuzzy classification method for knife detection problem. In: International Conference on Multimedia Communications, Services and Security, pp. 159–169 (2014) Maksimova, A., Matiolanski, A., Wassermann, J.: Fuzzy classification method for knife detection problem. In: International Conference on Multimedia Communications, Services and Security, pp. 159–169 (2014)
18.
go back to reference Glowacz, A., Kmieć, M., Dziech, A.: Visual detection of knives in security applications using Active Appearance Models. Multimed. Tools Appl. 74(12), 4253–4267 (2015)CrossRef Glowacz, A., Kmieć, M., Dziech, A.: Visual detection of knives in security applications using Active Appearance Models. Multimed. Tools Appl. 74(12), 4253–4267 (2015)CrossRef
19.
go back to reference Cootes, T.F., Edwards, G.J., Taylor, C.J..: Active appearance models. In: European Conference on Computer Vision, pp. 484–498 (1998) Cootes, T.F., Edwards, G.J., Taylor, C.J..: Active appearance models. In: European Conference on Computer Vision, pp. 484–498 (1998)
20.
go back to reference Derpanis, K.G.: The Harris corner detector, York University, vol. 2 (2004) Derpanis, K.G.: The Harris corner detector, York University, vol. 2 (2004)
21.
go back to reference Glowacz, A., Kmieć, M., Dziech, A.: Towards robust visual knife detection in images: active appearance models initialised with shape-specific interest points. In: International Conference on Multimedia Communications, Services and Security, pp. 148–158 (2012) Glowacz, A., Kmieć, M., Dziech, A.: Towards robust visual knife detection in images: active appearance models initialised with shape-specific interest points. In: International Conference on Multimedia Communications, Services and Security, pp. 148–158 (2012)
22.
go back to reference Kmiec, M., Glowacz, A.: Object detection in security applications using dominant edge directions. Pattern Recogn. Lett. 52, 72–79 (2015)CrossRef Kmiec, M., Glowacz, A.: Object detection in security applications using dominant edge directions. Pattern Recogn. Lett. 52, 72–79 (2015)CrossRef
23.
go back to reference Kmiec, M., Glowacz, A.: An approach to robust visual knife detection. Mach. Graph. Vis. 20(2), 215–227 (2011) Kmiec, M., Glowacz, A.: An approach to robust visual knife detection. Mach. Graph. Vis. 20(2), 215–227 (2011)
24.
go back to reference Buckchash, H.: Raman, B.: A robust object detector: application to detection of visual knives. In: International Conference on Multimedia and Expo Workshops (ICMEW), pp. 633–638 (2017) Buckchash, H.: Raman, B.: A robust object detector: application to detection of visual knives. In: International Conference on Multimedia and Expo Workshops (ICMEW), pp. 633–638 (2017)
25.
go back to reference Grega, M., Matiolanski, A., Guzik, P, Leszczuk, M.: Automated detection of firearms and knives in a CCTV image. Sensors 16(1), 47 (2016)CrossRef Grega, M., Matiolanski, A., Guzik, P, Leszczuk, M.: Automated detection of firearms and knives in a CCTV image. Sensors 16(1), 47 (2016)CrossRef
26.
go back to reference Susarla, P., Agrawal, U., Jayagopi, D.B.: Human weapon activity recognition in surveillance videos using structural-rnn. In: Second Mediterranean Conference on Pattern Recognition and Artificial Intelligence, pp. 101–107 (2018) Susarla, P., Agrawal, U., Jayagopi, D.B.: Human weapon activity recognition in surveillance videos using structural-rnn. In: Second Mediterranean Conference on Pattern Recognition and Artificial Intelligence, pp. 101–107 (2018)
27.
go back to reference Lai, J., Maples, S.: Developing a real-time gun detection classifier. Stanford University, World Academy of Science, Trieste (2017) Lai, J., Maples, S.: Developing a real-time gun detection classifier. Stanford University, World Academy of Science, Trieste (2017)
28.
go back to reference Verma, G.K., Dhillon, A.: A handheld gun detection using faster r-cnn deep learning. In: Second International Conference on Computer and Communication Technology, pp. 84–88 (2017) Verma, G.K., Dhillon, A.: A handheld gun detection using faster r-cnn deep learning. In: Second International Conference on Computer and Communication Technology, pp. 84–88 (2017)
29.
go back to reference Egiazarov, A. ., Mavroeidis, V., Zennaro, F.M.., Vishi, K.: Firearm detection and segmentation using an ensemble of semantic neural networks. arXiv:2003.00805, 2020 Egiazarov, A. ., Mavroeidis, V., Zennaro, F.M.., Vishi, K.: Firearm detection and segmentation using an ensemble of semantic neural networks. arXiv:​2003.​00805, 2020
30.
go back to reference Dwivedi, N. , Singh, D.K., Kushwaha, D.S.: Weapon classification using deep convolutional neural network. In: IEEE Conference on Information and Communication Technology, pp. 1–5 (2019) Dwivedi, N. , Singh, D.K., Kushwaha, D.S.: Weapon classification using deep convolutional neural network. In: IEEE Conference on Information and Communication Technology, pp. 1–5 (2019)
31.
go back to reference Marquez, E.S., Hare, J.S., Niranjan, M.: Deep cascade learning. IEEE Trans. Neural Netw. Learn. Syst. 29(11), 5475–5485 (2018)MathSciNetCrossRef Marquez, E.S., Hare, J.S., Niranjan, M.: Deep cascade learning. IEEE Trans. Neural Netw. Learn. Syst. 29(11), 5475–5485 (2018)MathSciNetCrossRef
Metadata
Title
Employing data generation for visual weapon identification using Convolutional Neural Networks
Authors
Neelam Dwivedi
Dushyant Kumar Singh
Dharmender Singh Kushwaha
Publication date
01-10-2021
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 1/2022
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-021-00848-9

Other articles of this Issue 1/2022

Multimedia Systems 1/2022 Go to the issue