Top

Scientific and Technical Information Processing

Published in:

01-12-2023

A Method for Deepfake Detection Using Convolutional Neural Networks

Author: S. S. Volkova

Published in: Scientific and Technical Information Processing | Issue 5/2023

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract—

This paper proposes a method of countering spoofing attacks by improving the resilience of face-based biometric authentication systems to digital face manipulation attacks on the biometric input module. The proposed method of digital face manipulation detection (deepfake detection) is based on a convolutional neural network trained on a large dataset containing various types of manipulations, images of different quality, and a large number of identities and as a result achieves an accuracy of at least 99%. Experiment results also indicate high performance of the proposed approach compared to other available methods tested on the same dataset. The method can be used to improve the security of biometric authentication systems by reducing the risk of unauthorized access.

previous article Intelligent System for Predicting the Feasibility of Using Computed Tomography

next article Formalization of the Structural Synthesis of Technical Systems at the Initial Stage of Design

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

General Prosecutor’s Office of the Russian Federation, Official site of the Portal of Legal Statistics of the General Prosecutor’s Office of the Russian Federation, 2021. http://crimestat.ru/analytics.

Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., and Niessner, M., Face2Face: Real-time face capture and reenactment of RGB videos, 2016 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 2016, IEEE, 2016, pp. 2387–2395. https://doi.org/10.1109/cvpr.2016.262

Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., and Ortega-Garcia, J., Deepfakes and beyond: A survey of face manipulation and fake detection, Inf. Fusion, 2020, vol. 64, pp. 131–148. https://doi.org/10.1016/j.inffus.2020.06.014CrossRef

Korshunova, I., Shi, W., Dambre, J., and Theis, L., Fast face-swap using convolutional neural networks, 2017 IEEE Int. Conf. on Computer Vision (ICCV), Venice, 2017, IEEE, 2017, pp. 3677–3685. https://doi.org/10.1109/iccv.2017.397

Agarwal, A., Singh, R., Vatsa, M., and Noore, A., SWAPPED! Digital face presentation attack detection via weighted local magnitude pattern, 2017 IEEE Int. Joint Conf. on Biometrics (IJCB), Denver, Colo., 2017, IEEE, 2017, pp. 659–665. https://doi.org/10.1109/btas.2017.8272754

Mo, H., Chen, B., and Luo, W., Fake faces identification via convolutional neural network, Proc. 6th ACM Workshop on Information Hiding and Multimedia Security, Innsbruck, Austria, 2018, New York: Association for Computing Machinery, 2018, pp. 43–47. https://doi.org/10.1145/3206004.3206009

Agarwal, S.F., Gu, Yu., He, M., Nagano, K., and Li, H., Protecting world leaders against deep fakes, CVPR Workshops, 2019.

Li, X., Yu, K., Ji, S., Wang, Ya., Wu, C., and Xue, H., Fighting against deepfake: Patch&pair convolutional neural networks (PPCNN), Companion Proc. Web Conf. 2020, Taipei, 2020, El Fallah Seghrouchni, A., Sukthankar, G., Liu, T.-Ya., and van Steen, M., Eds., New York: Association for Computing Machinery, 2020, pp. 88–89. https://doi.org/10.1145/3366424.3382711

Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., and Guo, B., Face X-ray for more general face forgery detection, 2020 IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), Seattle, 2020, IEEE, 2020, pp. 5001–5010. https://doi.org/10.1109/cvpr42600.2020.00505

10.

Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Niessner, M., FaceForensics++: Learning to detect manipulated facial images, 2019 IEEE/CVF Int. Conf. on Computer Vision (ICCV), https://doi.org/10.1109/ICCV.2019.00009, IEEE, 2019, pp. 1–11. 10.1109/ICCV.2019.00009

11.

Afchar, D., Nozick, V., Yamagishi, J., and Echizen, I., MesoNet: A compact facial video forgery detection network, 2018 IEEE Int. Workshop on Information Forensics and Security (WIFS), Hong Kong, 2018, IEEE, 2018, pp. 1–7. https://doi.org/10.1109/wifs.2018.8630761

12.

Ding, X., Raziei, Z., Larson, E., Olinick, E., Krueger, P., and Hahsler, M., Swapped face detection using deep learning and subjective assessment, EURASIP J. Inf. Secur., 2020, vol. 2020, no. 1, pp. 1–12. https://doi.org/10.1186/s13635-020-00109-8CrossRef

13.

Do, N.-T., Na, I.-S., and Kim, S.-H., Forensics face detection from GANs using convolutional neural network, Int. Symp. on Information Technology Convergence, South Korea: 2018.

14.

Hsu, C., Zhuang, Yi., and Lee, C., Deep fake image detection based on pairwise learning, Appl. Sci., 2020, vol. 10, no. 1, p. 370. https://doi.org/10.3390/app10010370CrossRef

15.

Fernando, T., Fookes, C., Denman, S., and Sridharan, S., Detection of fake and fraudulent faces via neural memory networks, IEEE Trans. Inf. Forensics Secur., 2021, vol. 16, pp. 1973–1988. https://doi.org/10.1109/tifs.2020.3047768CrossRef

16.

Jin, X., Ye, D., and Chen, Ch., Countering spoof: Towards detecting deepfake with multidimensional biological signals, Secur. Commun. Networks, 2021, vol. 2021, p. 6626974. https://doi.org/10.1155/2021/6626974CrossRef

17.

Lu, Yu., Liu, Ya., Fei, J., and Xia, Z., Channel-wise spatiotemporal aggregation technology for face video forensics, Secur. Commun. Networks, 2021, vol. 2021, pp. 1–13. https://doi.org/10.1155/2021/5524930CrossRef

18.

Wang, R., Juefei-Xu, F., Ma, L., Xie, X., Huang, Yi., Wang, J., and Liu, Ya., FakeSpotter: A simple yet robust baseline for spotting AI-synthesized fake faces, Proc. Twenty-Ninth Int. Joint Conf. on Artificial Intelligence, Int. Joint Conf. on Artificial Intelligence Organization, 2020, pp. 3444–3451. https://doi.org/10.24963/ijcai.2020/476

19.

Fernandes, S., Raj, S., Ewetz, R., Pannu, J., Kumar Jha, S., Ortiz, E., Vintila, I., and Salter, M., Detecting Deepfake Videos using Attribution-Based Confidence Metric, 2020 IEEE/CVF Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, 2020, IEEE, 2020, pp. 308–309. https://doi.org/10.1109/cvprw50498.2020.00162

20.

Khodabakhsh, A. and Busch, C., A generalizable deepfake detector based on neural conditional distribution modelling, 2020 Int. Conf. of the Biometrics Special Interest Group (BIOSIG), Darmstadt, 2020, IEEE, 2020, pp. 1–5.

21.

Volkova, S.S. and Bogdanov, A.S., A deep learning approach to face swap detection, Int. J. Open Inf. Technol., 2021, vol. 9, no. 10, pp. 16–20.

22.

Tarasiou, M. and Zafeiriou, S., Extracting deep local features to detect manipulated images of human faces, 2020 IEEE Int. Conf. on Image Processing (ICIP), Abu Dhabi, 2020, IEEE, 2020, pp. 1821–1825. https://doi.org/10.1109/icip40778.2020.9190714

23.

Tang, X., Du, D.K., He, Z., and Liu, J., PyramidBox: A context-assisted single shot face detector, Computer Vision–ECCV 2018, Ferrari, V., Hebert, M., Sminchisescu, C., and Weiss, Y., Eds., Lecture Notes in Computer Science, vol. 11213, Cham: Springer, 2018, pp. 812–828. https://doi.org/10.1007/978-3-030-01240-3_49CrossRef

24.

Xiong, X. and De la Torre, F., Supervised descent method and its applications to face alignment, 2013 IEEE Conf. on Computer Vision and Pattern Recognition, Portland, Ore., 2013, IEEE, 2013, pp. 532–539. https://doi.org/10.1109/cvpr.2013.75

25.

Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-Ch., MobileNetV2: Inverted residuals and linear bottlenecks, 2018 IEEE/CVF Conf. on Computer Vision and Pattern Recognition, Salt-Lake City, Utah, 2018, IEEE, 2018, pp. 4510–4520. https://doi.org/10.1109/cvpr.2018.00474

26.

Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Li, F.-F., ImageNet: A large-scale hierarchical image database, 2009 IEEE Conf. on Computer Vision and Pattern Recognition, Miami, 2009, IEEE, 2009, pp. 248–255. https://doi.org/10.1109/cvpr.2009.5206848

27.

Defazio, A. and Jelassi, S., Adaptivity without compromise: A momentumized, adaptive, dual averaged gradient method for stochastic optimization, J. Mach. Learn. Res., 2022, vol. 23, no. 1, p. 144.MathSciNet

28.

Duchi, J., Hazan, E., and Singer, Y., Adaptive subgradient methods for online learning and stochastic optimization, J. Mach. Learn. Res., 2011, vol. 12, no. 7, pp. 2121–2159.MathSciNet

29.

Kingma, D.P. and Ba, J., Adam: A method for stochastic optimization, 2015. https://doi.org/10.48550/arXiv.1412.6980

30.

Loshchilov, I. and Hutter, F., Stochastic gradient descent with warm restarts, Proc. 5th Int. Conf. on Learning Representations, 2017, pp. 1–16.

31.

Bayar, B. and Stamm, M.C., A deep learning approach to universal image manipulation detection using a new convolutional layer, Proc. 4th ACM Workshop on Information Hiding and Multimedia Security, Vigo, Spain, 2016, New York: Association for Computing Machinery, 2016, pp. 5–10. https://doi.org/10.1145/2909827.2930786

Title: A Method for Deepfake Detection Using Convolutional Neural Networks
Author: S. S. Volkova
Publication date: 01-12-2023
Publisher: Pleiades Publishing
Published in: Scientific and Technical Information Processing / Issue 5/2023
Print ISSN: 0147-6882
Electronic ISSN: 1934-8118
DOI: https://doi.org/10.3103/S0147688223050143

Springer Professional

Abstract—

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 5/2023

Trend Detection Using NLP as a Mechanism of Decision Support

Situational-Command Motion Control of an Autonomous Unmanned Aerial Vehicle Searching for Forest Fires in an Unstable Air Environment

Method of Training a Kernel Tree

The IACPaaS Platform for Developing Systems Based on Ontologies: A Decade of Use

Identification of Linguistic Indicators of Network Sociopolitical Discourse Using Text Mining

Efficient Bounded-Suboptimal Search for the Multiagent Pathfinding Problem

Premium Partner