Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 11/2021

08-07-2020 | Original Article

Optimal Deep Learning based Convolution Neural Network for digital forensics Face Sketch Synthesis in internet of things (IoT)

Authors: Mohamed Elhoseny, Mahmoud Mohamed Selim, K. Shankar

Published in: International Journal of Machine Learning and Cybernetics | Issue 11/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The rapid development in 5G cellular and IoT technologies is expected to be deployed widespread in the next few years. At the same time, crime rates are also increasing to a greater extent while the investigation officers are held responsible to deal with a broad range of cyber and internet issues in investigations. Therefore, advanced IT technologies and IoT devices can be deployed to ease the investigation process, especially, the identification of suspects. At present, only a few research works has been conducted upon deep learning-based Face Sketch Synthesis (FSS) models, concerning its success in diverse application domains including conventional face recognition. This paper proposes a new IoT-enabled Optimal Deep Learning based Convolutional Neural Network (ODL-CNN) for FSS to assist in suspect identification process. The hyper parameter optimization of the DL-CNN model was performed using Improved Elephant Herd Optimization (IEHO) algorithm. In the beginning, the proposed method captures the surveillance videos using IoT-based cameras which are then fed into the proposed ODL-CNN model. The proposed method initially involves preprocessing in which the contrast enhancement process is carried out using Gamma correction method. Then, the ODL-CNN model draws the sketches of the input images following which it undergoes similarity assessment, with professional sketch being drawn as per the directions from eyewitnesses. When the similarity between both the sketches are high, the suspect gets identified. A comprehensive qualitative and quantitative examination was conducted to assess the effectiveness of the presented ODL-CNN model. A detailed simulation analysis pointed out the effective performance of ODL-CNN model with maximum average Peak Signal to Noise Ratio (PSNR) of 20.11dB, Average Structural Similarity (SSIM) of 0.64 and average accuracy of 90.10%.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Reyes A, Brittson R, O’Shea K, Steele J (2011) Cybercrime investigations: bridging the gaps between security professionals, law enforcement, and prosecutors. Elsevier, Amsterdam Reyes A, Brittson R, O’Shea K, Steele J (2011) Cybercrime investigations: bridging the gaps between security professionals, law enforcement, and prosecutors. Elsevier, Amsterdam
2.
go back to reference Brown CS (2015) Investigating and prosecuting cyber crime: forensic dependencies and barriers to justice. Int J Cyber Criminol 9(1):55 Brown CS (2015) Investigating and prosecuting cyber crime: forensic dependencies and barriers to justice. Int J Cyber Criminol 9(1):55
3.
go back to reference Klum S, Han H, Jain AK, Klare B, (2013) Sketch based face recognition: forensic vs. composite sketches. In: 2013 international conference on biometrics (ICB), IEEE, pp 1–8 Klum S, Han H, Jain AK, Klare B, (2013) Sketch based face recognition: forensic vs. composite sketches. In: 2013 international conference on biometrics (ICB), IEEE, pp 1–8
4.
5.
go back to reference Wang N, Gao X, Sun L, Li J (2018) Anchored neighborhood index for face sketch synthesis. IEEE Trans Circuits Syst Video Technol 28(9):2154-2163 Wang N, Gao X, Sun L, Li J (2018) Anchored neighborhood index for face sketch synthesis. IEEE Trans Circuits Syst Video Technol 28(9):2154-2163
6.
go back to reference Wang N, Gao X, Li J (2018) Random sampling for fast face sketch synthesis. Pattern Recognit 76:215–227CrossRef Wang N, Gao X, Li J (2018) Random sampling for fast face sketch synthesis. Pattern Recognit 76:215–227CrossRef
7.
go back to reference Wang N, Zhu M, Li J, Song B, Li Z (2017) Data-driven vs. model-driven: fast face sketch synthesis. Neurocomputing 257:214–221CrossRef Wang N, Zhu M, Li J, Song B, Li Z (2017) Data-driven vs. model-driven: fast face sketch synthesis. Neurocomputing 257:214–221CrossRef
8.
go back to reference Hwang B-W, Lee S-W (2003) Reconstruction of partially damaged face images based on a morphable face model. IEEE Trans Pattern Anal Mach Intell 25(3):365–372CrossRef Hwang B-W, Lee S-W (2003) Reconstruction of partially damaged face images based on a morphable face model. IEEE Trans Pattern Anal Mach Intell 25(3):365–372CrossRef
10.
go back to reference Wang Z-M, Tao J-H (2007) Reconstruction of partially occluded face by fast recursive PCA. In: Proceedings of the International Conference on Computational Intelligence and Security Workshops (2007) CISW 2007, IEEE, pp 304–307 Wang Z-M, Tao J-H (2007) Reconstruction of partially occluded face by fast recursive PCA. In: Proceedings of the International Conference on Computational Intelligence and Security Workshops (2007) CISW 2007, IEEE, pp 304–307
11.
go back to reference Burgos-Artizzu XP, Perona P, Dollár P (2013) Robust face landmark estimation under occlusion. In: Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), IEEE, pp 1513–1520 Burgos-Artizzu XP, Perona P, Dollár P (2013) Robust face landmark estimation under occlusion. In: Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), IEEE, pp 1513–1520
12.
go back to reference Mairal J, Bach F, Ponce J, Sapiro G (2009) Online dictionary learning for sparse coding. In: Proceedings of the Twenty-sixth Annual International Conference on Machine Learning, ACM, pp 689–696 Mairal J, Bach F, Ponce J, Sapiro G (2009) Online dictionary learning for sparse coding. In: Proceedings of the Twenty-sixth Annual International Conference on Machine Learning, ACM, pp 689–696
13.
go back to reference Li Y, Liu S, Yang J, Yang M-H (2017) Generative face completion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1, p 6 Li Y, Liu S, Yang J, Yang M-H (2017) Generative face completion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1, p 6
14.
go back to reference Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680 Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680
15.
go back to reference Mao X, Wang S, Zheng L, Huang Q (2018) Semantic invariant cross-domain image generation with generative adversarial networks. Neurocomputing 293:55–63CrossRef Mao X, Wang S, Zheng L, Huang Q (2018) Semantic invariant cross-domain image generation with generative adversarial networks. Neurocomputing 293:55–63CrossRef
16.
go back to reference Wang T-C, Liu M-Y, Zhu J-Y, Tao A, Kautz J, Catanzaro B, High-resolution image synthesis and semantic manipulation with conditional GANS, arXiv preprint arXiv:1711.11585 Wang T-C, Liu M-Y, Zhu J-Y, Tao A, Kautz J, Catanzaro B, High-resolution image synthesis and semantic manipulation with conditional GANS, arXiv preprint arXiv:1711.11585
17.
go back to reference Lu D, Chen Z, Wu QJ, Zhang X (2019) FCN based preprocessing for exemplar-based face sketch synthesis. Neurocomputing 365:113–124CrossRef Lu D, Chen Z, Wu QJ, Zhang X (2019) FCN based preprocessing for exemplar-based face sketch synthesis. Neurocomputing 365:113–124CrossRef
18.
go back to reference Ye L, Zhang B, Yang M, Lian W (2019) Triple-translation GAN with multi-layer sparse representation for face image synthesis. Neurocomputing 358:294–308CrossRef Ye L, Zhang B, Yang M, Lian W (2019) Triple-translation GAN with multi-layer sparse representation for face image synthesis. Neurocomputing 358:294–308CrossRef
19.
go back to reference Licheng J, Zhang S, Li L, Liu F, Ma W (2018) A modified convolutional neural network for face sketch synthesis. Pattern Recognit 76:125–136CrossRef Licheng J, Zhang S, Li L, Liu F, Ma W (2018) A modified convolutional neural network for face sketch synthesis. Pattern Recognit 76:125–136CrossRef
20.
go back to reference Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z et al. (2016) photo-realistic single image super-resolution using a generative adversarial network. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp, 21–26 Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z et al. (2016) photo-realistic single image super-resolution using a generative adversarial network. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp, 21–26
21.
go back to reference Lin G, Wu Q, Qiu L, Huang X (2018) Image super-resolution using a dilated convolutional neural network. Neurocomputing 275:1219–1230CrossRef Lin G, Wu Q, Qiu L, Huang X (2018) Image super-resolution using a dilated convolutional neural network. Neurocomputing 275:1219–1230CrossRef
22.
go back to reference Zhou F, Li X, Li Z (2018) High-frequency details enhancing densenet for super-resolution. Neurocomputing 290:34–42CrossRef Zhou F, Li X, Li Z (2018) High-frequency details enhancing densenet for super-resolution. Neurocomputing 290:34–42CrossRef
23.
go back to reference Wang GG, Deb S, Gao XZ, Coelho LDS (2016) A new metaheuristic optimisation algorithm motivated by elephant herding behaviour. Int J Bio-Inspired Comput 8(6):394–409CrossRef Wang GG, Deb S, Gao XZ, Coelho LDS (2016) A new metaheuristic optimisation algorithm motivated by elephant herding behaviour. Int J Bio-Inspired Comput 8(6):394–409CrossRef
24.
go back to reference Li J, Guo L, Li Y, Liu C (2019) Enhancing elephant herding optimization with novel individual updating strategies for large-scale optimization problems. Mathematics 7(5):395CrossRef Li J, Guo L, Li Y, Liu C (2019) Enhancing elephant herding optimization with novel individual updating strategies for large-scale optimization problems. Mathematics 7(5):395CrossRef
26.
go back to reference Wang X, Tang X (2009) Face photo-sketch synthesis and recognition. IEEE Trans Pattern Anal Mach Intell 31(11):1955–1967MathSciNetCrossRef Wang X, Tang X (2009) Face photo-sketch synthesis and recognition. IEEE Trans Pattern Anal Mach Intell 31(11):1955–1967MathSciNetCrossRef
27.
go back to reference Mart´ınez A, Benavente R (1998) The ar face database. In: Tech. Rep. 24, Computer 565 Vision Center, Bellatera Mart´ınez A, Benavente R (1998) The ar face database. In: Tech. Rep. 24, Computer 565 Vision Center, Bellatera
Metadata
Title
Optimal Deep Learning based Convolution Neural Network for digital forensics Face Sketch Synthesis in internet of things (IoT)
Authors
Mohamed Elhoseny
Mahmoud Mohamed Selim
K. Shankar
Publication date
08-07-2020
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 11/2021
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01168-6

Other articles of this Issue 11/2021

International Journal of Machine Learning and Cybernetics 11/2021 Go to the issue