Skip to main content
main-content
Top

Hint

Swipe to navigate through the chapters of this book

2021 | OriginalPaper | Chapter

CLH: Approach for Detecting Deep Fake Videos

Authors: Amrita Shivanand Hedge, M. N. Vinutha, Kona Supriya, S. Nagasundari, Prasad B. Honnavalli

Published in: Advances in Cyber Security

Publisher: Springer Singapore

share
SHARE

Abstract

Deep Fakes are the media that takes the person’s image in an existing photograph, audio recording, or video and replaces them with another person’s likeness by making use of synthetic intelligence and device mastering. In this era, everybody can get easy access to software packages and tools to create deep fake videos. Existing techniques are constructed with the usage of the lip synchronization, mouth features artifacts and are commonly designed for detection of single frames. The proposed model, CLH (CNN+LSTM hybrid model) considers various parameters such as eye blinking, blurriness, skin tone, skin color, changes in lighting, lip syncing, and position to detect the fake videos. The CLH model employs “Convolutional Neural Networks (CNN)” and “Long Short-Term Memory (LSTM)” for detecting a deep fake video. The original videos and deep fake (high quality + low quality) videos were used in training the model. Datasets such as Celeb-DF, face forensics ++, Deep fake TIMIT, and fake videos developed by Facebook were used to train and evaluate the model, so that an efficient model is constructed. The proposed CLH model achieved a high accuracy of more than 90% and a low false positive rate of less than 5%. The CLH model is also compared with other models on the market and analyzed to understand the significance of the work.
Literature
1.
go back to reference Afchar, D., Nozick, V., Yamagishi, J., Echizen, I.: MesoNet: a compact facial video forgery detection network. In: 2018 IEEE International Workshop on Information Forensics and Security (WIFS), pp. 1–7. IEEE, Hong Kong (2018) Afchar, D., Nozick, V., Yamagishi, J., Echizen, I.: MesoNet: a compact facial video forgery detection network. In: 2018 IEEE International Workshop on Information Forensics and Security (WIFS), pp. 1–7. IEEE, Hong Kong (2018)
2.
go back to reference Güera, D., Delp, E.J.: Deepfake video detection using recurrent neural networks. In: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6. IEEE, Auckland (2018) Güera, D., Delp, E.J.: Deepfake video detection using recurrent neural networks. In: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6. IEEE, Auckland (2018)
3.
go back to reference Korshunov, P., Marcel, S.: Vulnerability assessment and detection of deepfake videos. In: 2019 International Conference on Biometrics (ICB), pp. 1–6. IEEE, Crete (2019) Korshunov, P., Marcel, S.: Vulnerability assessment and detection of deepfake videos. In: 2019 International Conference on Biometrics (ICB), pp. 1–6. IEEE, Crete (2019)
4.
go back to reference Jafar, M.T., Ababneh, M., Al-Zoube, M., Elhassan, A.: Forensics and analysis of deepfake videos. In: 2020 11th International Conference on Information and Communication Systems (ICICS), pp. 053–058. IEEE, Irbid (2020) Jafar, M.T., Ababneh, M., Al-Zoube, M., Elhassan, A.: Forensics and analysis of deepfake videos. In: 2020 11th International Conference on Information and Communication Systems (ICICS), pp. 053–058. IEEE, Irbid (2020)
5.
go back to reference Dang, H., Liu, F., Stehouwer, J., Liu, X., Jain, A.K.: On the detection of digital face manipulation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern recognition, pp. 5781–5790. IEEE, Seattle (2020) Dang, H., Liu, F., Stehouwer, J., Liu, X., Jain, A.K.: On the detection of digital face manipulation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern recognition, pp. 5781–5790. IEEE, Seattle (2020)
6.
go back to reference Fernandes, S., et al.: Detecting deepfake videos using attribution-based confidence metric. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 308–309. IEEE, Seattle (2020) Fernandes, S., et al.: Detecting deepfake videos using attribution-based confidence metric. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 308–309. IEEE, Seattle (2020)
7.
go back to reference de Lima, O., Franklin, S., Basu, S., Karwoski, B., George, A.: Deepfake detection using spatiotemporal convolutional networks. arXiv preprint arXiv:​2006.​14749 (2020) de Lima, O., Franklin, S., Basu, S., Karwoski, B., George, A.: Deepfake detection using spatiotemporal convolutional networks. arXiv preprint arXiv:​2006.​14749 (2020)
8.
go back to reference Lyu, S.: Deepfake detection: current challenges and next steps. In: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), pp. 1–6. IEEE, London (2020) Lyu, S.: Deepfake detection: current challenges and next steps. In: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), pp. 1–6. IEEE, London (2020)
9.
go back to reference Li, Y., Yang, X., Sun, P., Qi, H., Lyu, S.: Celeb-DF: a large-scale challenging dataset for deepfake forensics. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3207–3216. IEEE, Seattle (2020) Li, Y., Yang, X., Sun, P., Qi, H., Lyu, S.: Celeb-DF: a large-scale challenging dataset for deepfake forensics. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3207–3216. IEEE, Seattle (2020)
13.
go back to reference Guarnera, L., Giudice, O., Battiato, S.: Deepfake detection by analyzing convolutional traces. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 666–667. IEEE, Seattle (2020) Guarnera, L., Giudice, O., Battiato, S.: Deepfake detection by analyzing convolutional traces. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 666–667. IEEE, Seattle (2020)
14.
go back to reference Mitra, A., Mohanty, S.P., Corcoran, P., Kougianos, E.: A novel machine learning based method for deepfake video detection in social media. In: 2020 IEEE International Symposium on Smart Electronic Systems (iSES) (Formerly iNiS), pp. 91–96. IEEE, Chennai (2020) Mitra, A., Mohanty, S.P., Corcoran, P., Kougianos, E.: A novel machine learning based method for deepfake video detection in social media. In: 2020 IEEE International Symposium on Smart Electronic Systems (iSES) (Formerly iNiS), pp. 91–96. IEEE, Chennai (2020)
16.
go back to reference Dolhansky, B., Howes, R., Pflaum, B., Baram, N., Ferrer, C.C.: The deepfake detection challenge (DFDC) preview dataset. arXiv preprint arXiv:​1910.​08854 (2019) Dolhansky, B., Howes, R., Pflaum, B., Baram, N., Ferrer, C.C.: The deepfake detection challenge (DFDC) preview dataset. arXiv preprint arXiv:​1910.​08854 (2019)
Metadata
Title
CLH: Approach for Detecting Deep Fake Videos
Authors
Amrita Shivanand Hedge
M. N. Vinutha
Kona Supriya
S. Nagasundari
Prasad B. Honnavalli
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-16-8059-5_33

Premium Partner