Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 4/2021

08-02-2021 | Research Article-Computer Engineering and Computer Science

Adaptive Technique for Brightness Enhancement of Automated Knife Detection in Surveillance Video with Deep Learning

Authors: Mai K. Galab, Ahmed Taha, Hala H. Zayed

Published in: Arabian Journal for Science and Engineering | Issue 4/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Detecting knives in surveillance videos are very urgent for public safety. In general, the research in identifying dangerous weapons is relatively new. Knife detection is a very challenging task because knives vary in size and shape. Besides, it easily reflects lights that reduce the visibility of knives in a video sequence. The reflection of light on the surface of the knife and the brightness on its surface makes the detection process extremely difficult, even impossible. This paper presents an adaptive technique for brightness enhancement of knife detection in surveillance systems. This technique overcomes the brightness problem that faces the steel weapons and improves the knife detection process. It suggests an automatic threshold to assess the level of frame brightness. Depending on this threshold, the proposed technique determines if the frame needs to enhance its brightness or not. Experimental results verify the efficiency of the proposed technique in detecting knives using the deep transfer learning approach. Moreover, the most four famous models of deep convolutional neural networks are tested to select the best in detecting knives. Finally, a comparison is made with the-state-of-the-art techniques, and the proposed technique proved its superiority.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Grega, M. et al.: Automated recognition of firearms in surveillance. In: IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), San Diego (2013) Grega, M. et al.: Automated recognition of firearms in surveillance. In: IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), San Diego (2013)
2.
go back to reference Kumar, R.T.; Verma, G.K.: A computer vision based framework for visual gun detection using SURF. In: Proceedings of International Conference on Electrical, Electronics, Signals, Communication and Optimization (EESCO,2015) (2015) Kumar, R.T.; Verma, G.K.: A computer vision based framework for visual gun detection using SURF. In: Proceedings of International Conference on Electrical, Electronics, Signals, Communication and Optimization (EESCO,2015) (2015)
3.
go back to reference Kumar, RT; Verma, G.K.: A computer vision based framework for visual gun detection using Harris Interest Point Detector. In: Eleventh International Multi-Conference on Information Processing-2015 (IMCIP-2015) in ElSevier, vol. 54, pp. 703–712 (2015) Kumar, RT; Verma, G.K.: A computer vision based framework for visual gun detection using Harris Interest Point Detector. In: Eleventh International Multi-Conference on Information Processing-2015 (IMCIP-2015) in ElSevier, vol. 54, pp. 703–712 (2015)
4.
go back to reference Dhulekar, P.A., et al.: Motion estimation for human activity surveillance. In: International Conference Emerging Trends & Innovation in ICT (ICEI,2017), Pune, India (2017) Dhulekar, P.A., et al.: Motion estimation for human activity surveillance. In: International Conference Emerging Trends & Innovation in ICT (ICEI,2017), Pune, India (2017)
5.
go back to reference Arslan, A.N.; Hempelmann, C.F., et al.: Threat assessment using visual hierarchy and conceptual firearms ontology. Opt. Eng. 54(5), 105–109 (2015)CrossRef Arslan, A.N.; Hempelmann, C.F., et al.: Threat assessment using visual hierarchy and conceptual firearms ontology. Opt. Eng. 54(5), 105–109 (2015)CrossRef
6.
go back to reference Darker, l. et al.: Can CCTV reliably detect gun crime?. In: Proceedings of IEEE, United States of America, United States of America (2007) Darker, l. et al.: Can CCTV reliably detect gun crime?. In: Proceedings of IEEE, United States of America, United States of America (2007)
7.
go back to reference Blechko, A. et al.: Skills in detecting gun carrying from CCTV. In: Proceedings of IEEE, Prague, Czech Republic (2009) Blechko, A. et al.: Skills in detecting gun carrying from CCTV. In: Proceedings of IEEE, Prague, Czech Republic (2009)
8.
go back to reference Darker, I.T.; Gale, A.G.; Blechko, A.: CCTV as an automated sensor for firearms detection: Human-derived performance as a precursor to automatic recognition. In: Proceedings of the International Society for Optical Engineering, (ISOE,2008), Cardiff, Wales, United Kingdom (2008) Darker, I.T.; Gale, A.G.; Blechko, A.: CCTV as an automated sensor for firearms detection: Human-derived performance as a precursor to automatic recognition. In: Proceedings of the International Society for Optical Engineering, (ISOE,2008), Cardiff, Wales, United Kingdom (2008)
9.
go back to reference Xiao, Z.; Lu, X.; Yan, J.; Wu, L.; Luyao: Automatic detection of concealed pistols using passive millimeter wave imaging. In: 2015 IEEE International Conference on Imaging Systems and Techniques (IST), 1–4, IEEE, 2015 Xiao, Z.; Lu, X.; Yan, J.; Wu, L.; Luyao: Automatic detection of concealed pistols using passive millimeter wave imaging. In: 2015 IEEE International Conference on Imaging Systems and Techniques (IST), 1–4, IEEE, 2015
10.
go back to reference Zywicki, M. et al.: Knife detection as a subset of object detection approach based on Haar cascades. In: Proceedings of 11th International Conference on Pattern Recognition and Information Processing, Minsk, Belarus (2011) Zywicki, M. et al.: Knife detection as a subset of object detection approach based on Haar cascades. In: Proceedings of 11th International Conference on Pattern Recognition and Information Processing, Minsk, Belarus (2011)
11.
go back to reference Kmiec, M.; Glowacz, A.: An approach to Robust Visual Knife Detection (MG&V,2011). Mach. Graphics Vis. 20(2), 215–227 (2011) Kmiec, M.; Glowacz, A.: An approach to Robust Visual Knife Detection (MG&V,2011). Mach. Graphics Vis. 20(2), 215–227 (2011)
12.
go back to reference Kmieć, M. et al.: Towards robust visual knife detection in images: active appearance models initialised with shape-specific interest points. In: Proceedings of International Conference on Multimedia Communications, Services and Security., Krakow, Poland (2012) Kmieć, M. et al.: Towards robust visual knife detection in images: active appearance models initialised with shape-specific interest points. In: Proceedings of International Conference on Multimedia Communications, Services and Security., Krakow, Poland (2012)
13.
go back to reference Maksimova, A.: Knife detection scheme based on possibilistic shell clustering. In: International Conference on Multimedia Communications, Services and Security, Springer, Berlin, Heidelberg (2013) Maksimova, A.: Knife detection scheme based on possibilistic shell clustering. In: International Conference on Multimedia Communications, Services and Security, Springer, Berlin, Heidelberg (2013)
14.
go back to reference Glowacz, A., et al.: Visual detection of knives in security applications using active appearance models. Multimed. Tools Appl. Springer 74(12), 4253–4267 (2015)CrossRef Glowacz, A., et al.: Visual detection of knives in security applications using active appearance models. Multimed. Tools Appl. Springer 74(12), 4253–4267 (2015)CrossRef
15.
go back to reference Maksimova, A., et al.: Fuzzy classification method for knife detection problem. Int. Conf. Multimed. Commun., Serv. Secu., Springer 429, 159–169 (2014) Maksimova, A., et al.: Fuzzy classification method for knife detection problem. Int. Conf. Multimed. Commun., Serv. Secu., Springer 429, 159–169 (2014)
16.
go back to reference Kmieć, M.; Glowacz, A.: Object detection in security applications using dominant edge directions. Pattern Recogn. Lett., in Elsevier 52, 72–79 (2015)CrossRef Kmieć, M.; Glowacz, A.: Object detection in security applications using dominant edge directions. Pattern Recogn. Lett., in Elsevier 52, 72–79 (2015)CrossRef
17.
go back to reference Grega, M., et al.: Automated detection of firearms and knives in a CCTV image. Sensors 16(1), 47–63 (2016)CrossRef Grega, M., et al.: Automated detection of firearms and knives in a CCTV image. Sensors 16(1), 47–63 (2016)CrossRef
18.
go back to reference Vajhala, R. et al.: Weapon detection in surveillance camera images, Department of Applied Signal Processing Blekinge Institute of Technology, Karlskrona, Sweden (2016) Vajhala, R. et al.: Weapon detection in surveillance camera images, Department of Applied Signal Processing Blekinge Institute of Technology, Karlskrona, Sweden (2016)
19.
go back to reference Buckchash, H.; Raman, B.: A robust object detector: Application to detection of visual knives. In: Proceedings of the IEEE International Conference on Multimedia and Expo Workshops (ICMEW) 2017 (2017) Buckchash, H.; Raman, B.: A robust object detector: Application to detection of visual knives. In: Proceedings of the IEEE International Conference on Multimedia and Expo Workshops (ICMEW) 2017 (2017)
20.
go back to reference LeCun, Y.; Kavukcuoglu, K.; Farabet, C.: Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE International Symposium on Circuits and Systems (2010) LeCun, Y.; Kavukcuoglu, K.; Farabet, C.: Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE International Symposium on Circuits and Systems (2010)
21.
go back to reference Yanming Guo, Yu.; Liu, A.O.; Lao, S.: Deep learning for visual understanding: A review. Neurocomputing 187, 27–48 (2016)CrossRef Yanming Guo, Yu.; Liu, A.O.; Lao, S.: Deep learning for visual understanding: A review. Neurocomputing 187, 27–48 (2016)CrossRef
22.
go back to reference Liua, W.; Wanga, Z.; Liua, X.; Ze, N.: A survey of deep neural network architectures and their applications. Neurocomputing 234, 11–26 (2017)CrossRef Liua, W.; Wanga, Z.; Liua, X.; Ze, N.: A survey of deep neural network architectures and their applications. Neurocomputing 234, 11–26 (2017)CrossRef
23.
go back to reference Haridas, R.; Jyothi, R.L.: Convolutional neural networks: A comprehensive survey. Int. J. Appl. Eng. Res. 14(3), 780–789 (2019)CrossRef Haridas, R.; Jyothi, R.L.: Convolutional neural networks: A comprehensive survey. Int. J. Appl. Eng. Res. 14(3), 780–789 (2019)CrossRef
24.
go back to reference Olmos, R.; Tabik, S.; Herrera, F.: Automatic handgun detection alarm in videos using deep learning. Neurocomputing 275, 66–72 (2018)CrossRef Olmos, R.; Tabik, S.; Herrera, F.: Automatic handgun detection alarm in videos using deep learning. Neurocomputing 275, 66–72 (2018)CrossRef
25.
go back to reference Verma, G.K.; Dhillon, A.: A handheld gun detection using Faster R-CNN deep learning. In: Proceedings of the 7th International Conference on Computer and Communication Technology, pp. 84–88 (2017) Verma, G.K.; Dhillon, A.: A handheld gun detection using Faster R-CNN deep learning. In: Proceedings of the 7th International Conference on Computer and Communication Technology, pp. 84–88 (2017)
26.
go back to reference Al-Shoukry, S.: An automatic hybrid approach to detect concealed weapons using deep learning. ARPN J. Eng. Appl. Sci. 12(16), 4736–4741 (2017) Al-Shoukry, S.: An automatic hybrid approach to detect concealed weapons using deep learning. ARPN J. Eng. Appl. Sci. 12(16), 4736–4741 (2017)
27.
go back to reference Castillo, A.; Tabik, S.; Pérez, F.: Brightness guided preprocessing for automatic cold steel weapon detection in surveillance videos with deep learning. Neurocomputing 330, 151–161 (2019)CrossRef Castillo, A.; Tabik, S.; Pérez, F.: Brightness guided preprocessing for automatic cold steel weapon detection in surveillance videos with deep learning. Neurocomputing 330, 151–161 (2019)CrossRef
28.
go back to reference Noever, DA.; Noever, SEM.: “Knife and Threat Detectors,” white paper (2020) Noever, DA.; Noever, SEM.: “Knife and Threat Detectors,” white paper (2020)
29.
go back to reference Zhong-Qiu, Z.; Peng, Z.; Shou-tao, X.; Xindo: Object detection with deep learning: A review. IEEE Trans. Neural Netw. Learning Syst. 30(11), 3212–3232 (2019)CrossRef Zhong-Qiu, Z.; Peng, Z.; Shou-tao, X.; Xindo: Object detection with deep learning: A review. IEEE Trans. Neural Netw. Learning Syst. 30(11), 3212–3232 (2019)CrossRef
30.
go back to reference Alom, M.Z.; Taha, T.M.; Yakopcic, C.; Westberg, S.: “The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches,”, pp. 1–39 (2018) Alom, M.Z.; Taha, T.M.; Yakopcic, C.; Westberg, S.: “The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches,”, pp. 1–39 (2018)
31.
go back to reference Torrey, L.; Shavlik, J.: Transfer learning. In: Appears in the Handbook of Research on Machine Learning Applications, published by IGI Global (2009) Torrey, L.; Shavlik, J.: Transfer learning. In: Appears in the Handbook of Research on Machine Learning Applications, published by IGI Global (2009)
32.
go back to reference Pan, S.J.; Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2009)CrossRef Pan, S.J.; Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2009)CrossRef
33.
go back to reference Nithya, M.D.K.: Comparison of contrast enhancement technique with partitioned iterated function system. Int. J. Sci. Eng. Res. 5(5), 167–172 (2014) Nithya, M.D.K.: Comparison of contrast enhancement technique with partitioned iterated function system. Int. J. Sci. Eng. Res. 5(5), 167–172 (2014)
34.
go back to reference Rahman, S.; Rahman, M.M.; Abdullah-Al-Wadud, M.; Al-Quaderi, G.D.; Shoyaib, M.: An adaptive gamma correction for image enhancement. EURASIP J. Image Video Process. SpringerOpen 2016(1), 1–13 (2016)CrossRef Rahman, S.; Rahman, M.M.; Abdullah-Al-Wadud, M.; Al-Quaderi, G.D.; Shoyaib, M.: An adaptive gamma correction for image enhancement. EURASIP J. Image Video Process. SpringerOpen 2016(1), 1–13 (2016)CrossRef
35.
go back to reference Pizer, S.M.; Johnston, R.E.; Eri, J.P.: Contrast-limited adaptive histogram equalization: speed and effectiveness. In: Proceedings of the First Conference on Visualization in Biomedical Computing, Atlanta, Georgia (1990). Pizer, S.M.; Johnston, R.E.; Eri, J.P.: Contrast-limited adaptive histogram equalization: speed and effectiveness. In: Proceedings of the First Conference on Visualization in Biomedical Computing, Atlanta, Georgia (1990).
36.
go back to reference Zuiderveld, K.: Contrast Limited Adaptive Histogram Equalization, p. 474–485. Academic Press Professional Inc, Singapore (1994) Zuiderveld, K.: Contrast Limited Adaptive Histogram Equalization, p. 474–485. Academic Press Professional Inc, Singapore (1994)
37.
go back to reference Reza, A.M.: Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement. J. VLSI Signal Process. Syst. Signal, Image Video Technol. Springer 38(1), 35–44 (2004)CrossRef Reza, A.M.: Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement. J. VLSI Signal Process. Syst. Signal, Image Video Technol. Springer 38(1), 35–44 (2004)CrossRef
42.
go back to reference Tom, F.: An introduction to ROC analysis. Pattern Recogn. Lett. 27(8), 861–874 (2006)CrossRef Tom, F.: An introduction to ROC analysis. Pattern Recogn. Lett. 27(8), 861–874 (2006)CrossRef
Metadata
Title
Adaptive Technique for Brightness Enhancement of Automated Knife Detection in Surveillance Video with Deep Learning
Authors
Mai K. Galab
Ahmed Taha
Hala H. Zayed
Publication date
08-02-2021
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 4/2021
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-05401-4

Other articles of this Issue 4/2021

Arabian Journal for Science and Engineering 4/2021 Go to the issue

Research Article-Computer Engineering and Computer Science

Design and Analysis of Pattern Matching Algorithms Based on QuRAM Processing

Research Article-Computer Engineering and Computer Science

Prolong Network Lifetime in the Wireless Sensor Networks: An Improved Approach

Research Article-Computer Engineering and Computer Science

Index Term Selection Heuristics for Arabic Text Retrieval

Research Article-Computer Engineering and Computer Science

Performance Evaluation of Lightweight Encryption Algorithms for IoT-Based Applications

Premium Partners