Skip to main content
Top
Published in: Pattern Recognition and Image Analysis 2/2021

01-04-2021 | APPLICATION PROBLEMS

Spoofed Facial Presentation Attack Detection by Multivariate Gradient Descriptor in Micro-Expression Region

Authors: Dhiman Karmakar, Puja Mukherjee, Madhura Datta

Published in: Pattern Recognition and Image Analysis | Issue 2/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Facial video presentation is a topic of interest in many security systems due to its non-intrusive nature. However, such systems are vulnerable to spoof attacks made by fake face videos and thereby gaining unauthorized access in the system. For a robust biometric system anti spoofing approaches like liveness detection ought to be implemented in order to counter the aforesaid print and replay attacks. This article proposes a novel approach of anti spoofing using Multivariate histogram of oriented gradients descriptor in the auto detected micro expression (μE) regions of human facial videos. Facial μE are very brief, spontaneous facial expressions that highlight the face of humans when they either unconsciously or deliberately conceal an emotion. The work emphasizes the variations in μE in fake and original video representation by a considerable amount and claims such a variance is a tool to combat against presentation attacks. In particular, the method automatically extracts the ROI of major changes in μE using the Multivariate orientation gradients parameter and thus proposes this descriptor as one of the most suitable tools to characterize the liveness. The entire implementation is carried out on the self-created Database for replay attacks. The result obtained is satisfactory and tested statistically significant.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference G. Pan, Z. Wu, and L. Sun, “Liveness detection for face recognition,” in Recent Advances in Face Recognition, Ed. by K. Delac, M. Grgic, and M. Stewart Bartlett (I-Tech, Vienna, 2008), pp. 236–252. G. Pan, Z. Wu, and L. Sun, “Liveness detection for face recognition,” in Recent Advances in Face Recognition, Ed. by K. Delac, M. Grgic, and M. Stewart Bartlett (I-Tech, Vienna, 2008), pp. 236–252.
2.
go back to reference S. Sirohey, A. Rosenfeld, and Z. Duric, “A method of detecting and tracking irises and eyelids in video,” Pattern Recognit. 35 (6), 1389–1401 (2002).CrossRef S. Sirohey, A. Rosenfeld, and Z. Duric, “A method of detecting and tracking irises and eyelids in video,” Pattern Recognit. 35 (6), 1389–1401 (2002).CrossRef
3.
go back to reference G. Odinokikh, Iu. Efimov, I. Solomatin, M. Korobkin, and I. Matveev, “Iris anti-spoofing solution for mobile biometric applications,” Pattern Recognit. Image Anal. 28, 670–675 (2018).CrossRef G. Odinokikh, Iu. Efimov, I. Solomatin, M. Korobkin, and I. Matveev, “Iris anti-spoofing solution for mobile biometric applications,” Pattern Recognit. Image Anal. 28, 670–675 (2018).CrossRef
4.
go back to reference M. Sivarathinabala, S. Abirami, and M. Deivamani, “A smart security system using multimodal features from videos,” Pattern Recognit. Image Anal. 29, 89–98 (2019).CrossRef M. Sivarathinabala, S. Abirami, and M. Deivamani, “A smart security system using multimodal features from videos,” Pattern Recognit. Image Anal. 29, 89–98 (2019).CrossRef
5.
go back to reference Ajian Liu, Jun Wan, Sergio Escalera, Hugo Jair Escalante, Zichang Tan, Qi Yuan, Kai Wang, Chi Lin, Guodong Guo, Isabelle Guyon, and Stan Z. Li, “Multi-modal face anti-spoofing attack detection challenge,” in CVPR2019 (IEEE, 2019). Ajian Liu, Jun Wan, Sergio Escalera, Hugo Jair Escalante, Zichang Tan, Qi Yuan, Kai Wang, Chi Lin, Guodong Guo, Isabelle Guyon, and Stan Z. Li, “Multi-modal face anti-spoofing attack detection challenge,” in CVPR2019 (IEEE, 2019).
6.
go back to reference Naser Zaeri, “Thermal face recognition under spatial variation conditions,” Pattern Recognit. Image Anal. 30, 108–124 (2020).CrossRef Naser Zaeri, “Thermal face recognition under spatial variation conditions,” Pattern Recognit. Image Anal. 30, 108–124 (2020).CrossRef
7.
go back to reference J. Galbally, S. Marcel, and J. Fierrez, “Biometric antispoofing methods: A survey in face recognition,” IEEE Access 2, 1530–1552 (2014).CrossRef J. Galbally, S. Marcel, and J. Fierrez, “Biometric antispoofing methods: A survey in face recognition,” IEEE Access 2, 1530–1552 (2014).CrossRef
8.
go back to reference G. Pan, Z. Wu, L. Sun, and S. Lao, “Eyeblink-based anti-spoofing in face recognition from a generic webcamera,” in 2007 IEEE 11th International Conference on Computer Vision (2007). G. Pan, Z. Wu, L. Sun, and S. Lao, “Eyeblink-based anti-spoofing in face recognition from a generic webcamera,” in 2007 IEEE 11th International Conference on Computer Vision (2007).
9.
go back to reference N. Buch, J. Orwell, and S. A. Velastin, “3D extended histogram of oriented gradients (3Dhog) for classification of road users in urban scenes,” in British Machine Vision Conference (2009). N. Buch, J. Orwell, and S. A. Velastin, “3D extended histogram of oriented gradients (3Dhog) for classification of road users in urban scenes,” in British Machine Vision Conference (2009).
10.
go back to reference R. Danescu, D. Borza, and R. Itu, “Detecting micro-expressions in real time using high-speed video sequences,” in Intelligent Video Surveillance (IntechOpen, 2018). R. Danescu, D. Borza, and R. Itu, “Detecting micro-expressions in real time using high-speed video sequences,” in Intelligent Video Surveillance (IntechOpen, 2018).
11.
go back to reference G. Kim, S. Eum, J. K. Suhr, D. I. Kim, K. R. Park, and J. Kim, “Face liveness detection based on texture and frequency analyses,” in 2012 5th IAPR International Conference on Biometrics (ICB) (2012), pp. 67–72. G. Kim, S. Eum, J. K. Suhr, D. I. Kim, K. R. Park, and J. Kim, “Face liveness detection based on texture and frequency analyses,” in 2012 5th IAPR International Conference on Biometrics (ICB) (2012), pp. 67–72.
12.
go back to reference Sooyeon Kim, Sunjin Yu, Kwangtaek Kim, and Yuseok Ban, “Face liveness detection using variable focusing,” in 2013 International Conference on Biometrics (ICB) (IEEE, 2013). Sooyeon Kim, Sunjin Yu, Kwangtaek Kim, and Yuseok Ban, “Face liveness detection using variable focusing,” in 2013 International Conference on Biometrics (ICB) (IEEE, 2013).
13.
go back to reference Respatyadi Hari Nugroho, Muhammad Nasrun, and Casi Setianingsih, “Lie detector with pupil dilation and eye blinks using Hough transform and frame difference method with fuzzy logic,” in 2017 International Conference on Control, Electronics, Renewable Energy, and Communications (ICCREC) (IEEE, 2017). Respatyadi Hari Nugroho, Muhammad Nasrun, and Casi Setianingsih, “Lie detector with pupil dilation and eye blinks using Hough transform and frame difference method with fuzzy logic,” in 2017 International Conference on Control, Electronics, Renewable Energy, and Communications (ICCREC) (IEEE, 2017).
14.
go back to reference Lin Sun, Gang Pan, Zhaohui Wu, and Shihong Lao, “Blinking-based live face detection using conditional random fields,” in ICB 2007: Advances in Biometrics (2007), pp. 252–260. Lin Sun, Gang Pan, Zhaohui Wu, and Shihong Lao, “Blinking-based live face detection using conditional random fields,” in ICB 2007: Advances in Biometrics (2007), pp. 252–260.
15.
go back to reference M. Pedone and J. Heikkila, “Local phase quantization descriptors for blur robust and illumination invariant recognition of color textures,” in ICPR (2012), pp. 2476–2479. M. Pedone and J. Heikkila, “Local phase quantization descriptors for blur robust and illumination invariant recognition of color textures,” in ICPR (2012), pp. 2476–2479.
16.
go back to reference A. Lagorio, M. Tistarelli, and M. Cadoni, “Liveness detection based on 3D face shape analysis,” in 2013 International Workshop on Biometrics and Forensics (IWBF) (IEEE, 2013). A. Lagorio, M. Tistarelli, and M. Cadoni, “Liveness detection based on 3D face shape analysis,” in 2013 International Workshop on Biometrics and Forensics (IWBF) (IEEE, 2013).
17.
go back to reference D. Wen, H. Han, and A. K. Jain, “Face spoof detection with image distortion analysis,” IEEE Trans. Inf. Forensics Secur. 10 (4), 746–761 (2015).CrossRef D. Wen, H. Han, and A. K. Jain, “Face spoof detection with image distortion analysis,” IEEE Trans. Inf. Forensics Secur. 10 (4), 746–761 (2015).CrossRef
18.
go back to reference S. Bharadwaj, T. Dhamecha, M. Vatsa, and R. Singh, “Computationally efficient face spoofing detection with motion magnification,” in 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (2013), pp. 105–110. S. Bharadwaj, T. Dhamecha, M. Vatsa, and R. Singh, “Computationally efficient face spoofing detection with motion magnification,” in 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (2013), pp. 105–110.
19.
go back to reference K. Kollreider, H. Fronthaler, M. I. Faraj, and J. Bigun, “Real-time face detection and motion analysis with application in liveness assessment,” IEEE Trans. Inf. Forensics Secur. 2 (3), 548–558 (2007).CrossRef K. Kollreider, H. Fronthaler, M. I. Faraj, and J. Bigun, “Real-time face detection and motion analysis with application in liveness assessment,” IEEE Trans. Inf. Forensics Secur. 2 (3), 548–558 (2007).CrossRef
20.
go back to reference Md Moniruzzaman and Mohammad S. Alam, “Wavelet decomposition-based efficient face liveness detection,” Proc. SPIE 9845 (2016). Md Moniruzzaman and Mohammad S. Alam, “Wavelet decomposition-based efficient face liveness detection,” Proc. SPIE 9845 (2016).
21.
go back to reference Zahid Akhtar and Gian Luca Foresti, “Face spoof attack recognition using discriminative image patches,” J. Electr. Comput. Eng. 2016, 4721849 (2016). Zahid Akhtar and Gian Luca Foresti, “Face spoof attack recognition using discriminative image patches,” J. Electr. Comput. Eng. 2016, 4721849 (2016).
22.
go back to reference M. Shreve, S. Godavarthy, V. Manohar, D. Goldgof, and S. Sarkar, “Towards macro- and micro-expression spotting in video using strain patterns,” in WACV (2009), pp. 1–6. M. Shreve, S. Godavarthy, V. Manohar, D. Goldgof, and S. Sarkar, “Towards macro- and micro-expression spotting in video using strain patterns,” in WACV (2009), pp. 1–6.
23.
go back to reference M. Shreve, S. Godavarthy, D. Goldgof, and S. Sarkar, “Macro- and micro-expression spotting in long videos using spatio-temporal strain,” in 2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG) (2011), pp. 51–56. M. Shreve, S. Godavarthy, D. Goldgof, and S. Sarkar, “Macro- and micro-expression spotting in long videos using spatio-temporal strain,” in 2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG) (2011), pp. 51–56.
24.
go back to reference S. Polikovsky, Y. Kameda, and Y. Ohta, “Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor,” in ICDP (2009), pp. 1–6. S. Polikovsky, Y. Kameda, and Y. Ohta, “Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor,” in ICDP (2009), pp. 1–6.
25.
go back to reference S. Park and D. Kim, “Subtle facial expression recognition using motion magnification,” Pattern Recognit. Lett. 30 (7), 708–716 (2009).CrossRef S. Park and D. Kim, “Subtle facial expression recognition using motion magnification,” Pattern Recognit. Lett. 30 (7), 708–716 (2009).CrossRef
26.
go back to reference A. Dahmouni, N. Aharrane, K. El Moutaouakil, and K. Satori, “A face recognition based biometric solution in education,” Pattern Recognit. Image Anal. 28 (4), 758–770 (2018).CrossRef A. Dahmouni, N. Aharrane, K. El Moutaouakil, and K. Satori, “A face recognition based biometric solution in education,” Pattern Recognit. Image Anal. 28 (4), 758–770 (2018).CrossRef
27.
go back to reference Patrick P. K. Chan, Weiwen Liu, Danni Chen, Daniel S. Yeung, Fei Zhang, Xizhao Wang, and Chien-Chang Hsu, “Face liveness detection using a flash against 2D spoofing attack,” IEEE Trans. Inf. Forensics Secur. 13 (2), 521–534 (2018).CrossRef Patrick P. K. Chan, Weiwen Liu, Danni Chen, Daniel S. Yeung, Fei Zhang, Xizhao Wang, and Chien-Chang Hsu, “Face liveness detection using a flash against 2D spoofing attack,” IEEE Trans. Inf. Forensics Secur. 13 (2), 521–534 (2018).CrossRef
28.
go back to reference Olarik Surinta and Thananchai Khamket, “Gender recognition from facial images using local gradient feature descriptors,” in 2019 14th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP) (IEEE, 2019). Olarik Surinta and Thananchai Khamket, “Gender recognition from facial images using local gradient feature descriptors,” in 2019 14th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP) (IEEE, 2019).
29.
go back to reference F. A. Pujol, M. J. Pujol, C. Rizo-Maestre, and M. Pujol, “Entropy-based face recognition and spoof detection for security applications,” Sustainability 12 (1), 85 (2019).CrossRef F. A. Pujol, M. J. Pujol, C. Rizo-Maestre, and M. Pujol, “Entropy-based face recognition and spoof detection for security applications,” Sustainability 12 (1), 85 (2019).CrossRef
30.
go back to reference Dhiman Karmakar and C. A. Murthy, “Face recognition using face-autocropping and facial feature points extraction,” in 2nd International Conference on Perception and Machine Intelligence (PerMin), CDAC, Kolkata, India (2015), pp. 116–122. Dhiman Karmakar and C. A. Murthy, “Face recognition using face-autocropping and facial feature points extraction,” in 2nd International Conference on Perception and Machine Intelligence (PerMin), CDAC, Kolkata, India (2015), pp. 116–122.
Metadata
Title
Spoofed Facial Presentation Attack Detection by Multivariate Gradient Descriptor in Micro-Expression Region
Authors
Dhiman Karmakar
Puja Mukherjee
Madhura Datta
Publication date
01-04-2021
Publisher
Pleiades Publishing
Published in
Pattern Recognition and Image Analysis / Issue 2/2021
Print ISSN: 1054-6618
Electronic ISSN: 1555-6212
DOI
https://doi.org/10.1134/S1054661821020097

Other articles of this Issue 2/2021

Pattern Recognition and Image Analysis 2/2021 Go to the issue

MATHEMATICAL THEORY OF PATTERN RECOGNITION

Nearest Convex Hull Classification Based on Linear Programming

Premium Partner