Skip to main content
Top

2021 | OriginalPaper | Chapter

Probing Fairness of Mobile Ocular Biometrics Methods Across Gender on VISOB 2.0 Dataset

Authors : Anoop Krishnan, Ali Almadan, Ajita Rattani

Published in: Pattern Recognition. ICPR International Workshops and Challenges

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recent research has questioned the fairness of face-based recognition and attribute classification methods (such as gender and race) for dark-skinned people and women. Ocular biometrics in the visible spectrum is an alternate solution over face biometrics, thanks to its accuracy, security, robustness against facial expression, and ease of use in mobile devices. With the recent COVID-19 crisis, ocular biometrics has a further advantage over face biometrics in the presence of a mask. However, fairness of ocular biometrics has not been studied till now. This first study aims to explore the fairness of ocular-based authentication and gender classification methods across males and females. To this aim, VISOB 2.0 dataset, along with its gender annotations, is used for the fairness analysis of ocular biometrics methods based on ResNet-50, MobileNet-V2 and lightCNN-29 models. Experimental results suggest the equivalent performance of males and females for ocular-based mobile user-authentication in terms of genuine match rate (GMR) at lower false match rates (FMRs) and an overall Area Under Curve (AUC). For instance, an AUC of 0.96 for females and 0.95 for males was obtained for lightCNN-29 on an average. However, males significantly outperformed females in deep learning based gender classification models based on ocular-region.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
2
The term “sex" would be more appropriate, but in consistency with the existing studies, the term “gender" is used in this paper.
 
3
The term “methods", “algorithms" and “models" are used interchangeably.
 
4
The term “recognition" and “user authentication" are used interchangeably.
 
5
The term “eye" and “ocular region" are used interchangeably.
 
Literature
1.
go back to reference Albiero, V., Zhang, K., Bowyer, K.W.: How does gender balance in training data affect face recognition accuracy? (2020) Albiero, V., Zhang, K., Bowyer, K.W.: How does gender balance in training data affect face recognition accuracy? (2020)
2.
go back to reference Almadan, A., Krishnan, A., Rattani, A.: Bwcface: open-set face recognition using body-worn camera (2020) Almadan, A., Krishnan, A., Rattani, A.: Bwcface: open-set face recognition using body-worn camera (2020)
3.
go back to reference Alonso-Fernandez, F., Diaz, K.H., Ramis, S., Perales, F.J., Bigun, J.: Soft-biometrics estimation in the era of facial masks. In: 2020 International Conference of the Biometrics Special Interest Group (BIOSIG), pp. 1–6 (2020) Alonso-Fernandez, F., Diaz, K.H., Ramis, S., Perales, F.J., Bigun, J.: Soft-biometrics estimation in the era of facial masks. In: 2020 International Conference of the Biometrics Special Interest Group (BIOSIG), pp. 1–6 (2020)
4.
go back to reference Buolamwini, J., Gebru, T.: Gender shades: intersectional accuracy disparities in commercial gender classification. In: ACM Conference on Fairness, Accountability, and Transparency, pp. 77–91 (2018) Buolamwini, J., Gebru, T.: Gender shades: intersectional accuracy disparities in commercial gender classification. In: ACM Conference on Fairness, Accountability, and Transparency, pp. 77–91 (2018)
5.
go back to reference Cavazos, J.G., Phillips, P.J., Castillo, C.D., O’Toole, A.J.: Accuracy comparison across face recognition algorithms: where are we on measuring race bias? (2019) Cavazos, J.G., Phillips, P.J., Castillo, C.D., O’Toole, A.J.: Accuracy comparison across face recognition algorithms: where are we on measuring race bias? (2019)
6.
go back to reference Damer, N., Grebe, J.H., Chen, C., Boutros, F., Kirchbuchner, F., Kuijper, A.: The effect of wearing a mask on face recognition performance: an exploratory study. arXiv preprint arXiv:2007.13521 (2020) Damer, N., Grebe, J.H., Chen, C., Boutros, F., Kirchbuchner, F., Kuijper, A.: The effect of wearing a mask on face recognition performance: an exploratory study. arXiv preprint arXiv:​2007.​13521 (2020)
7.
go back to reference De Marsico, M., Nappi, M., Riccio, D., Wechsler, H.: Mobile iris challenge evaluation (miche)-i, biometric iris dataset and protocols. Pattern Recogn. Lett 57, 17–23 (2015)CrossRef De Marsico, M., Nappi, M., Riccio, D., Wechsler, H.: Mobile iris challenge evaluation (miche)-i, biometric iris dataset and protocols. Pattern Recogn. Lett 57, 17–23 (2015)CrossRef
8.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition (2015) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition (2015)
9.
go back to reference Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017) Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:​1704.​04861 (2017)
11.
go back to reference Krishnan, A., Almadan, A., Rattani, A.: Understanding fairness of gender classification algorithms across gender-race groups. In: 19th IEEE International Conference on Machine Learning and Applications, pp. 1–8. IEEE, Miami (2020) Krishnan, A., Almadan, A., Rattani, A.: Understanding fairness of gender classification algorithms across gender-race groups. In: 19th IEEE International Conference on Machine Learning and Applications, pp. 1–8. IEEE, Miami (2020)
12.
go back to reference Krishnapriya, K.S., Albiero, V., Vangara, K., King, M.C., Bowyer, K.W.: Issues related to face recognition accuracy varying based on race and skin tone. IEEE Trans. Technol. Soc. 1(1), 8–20 (2020)CrossRef Krishnapriya, K.S., Albiero, V., Vangara, K., King, M.C., Bowyer, K.W.: Issues related to face recognition accuracy varying based on race and skin tone. IEEE Trans. Technol. Soc. 1(1), 8–20 (2020)CrossRef
13.
go back to reference Lovisotto, G., Malik, R., Sluganovic, I., Roeschlin, M., Trueman, P., Martinovic, I.: Mobile Biometrics in Financial Services: A Five Factor Framework. University of Oxford, Oxford (2017) Lovisotto, G., Malik, R., Sluganovic, I., Roeschlin, M., Trueman, P., Martinovic, I.: Mobile Biometrics in Financial Services: A Five Factor Framework. University of Oxford, Oxford (2017)
14.
go back to reference Muthukumar, V.: Color-theoretic experiments to understand unequal gender classification accuracy from face image. In: Conference on Computer Vision and Pattern Recognition Workshops (CVPRW (2019) Muthukumar, V.: Color-theoretic experiments to understand unequal gender classification accuracy from face image. In: Conference on Computer Vision and Pattern Recognition Workshops (CVPRW (2019)
15.
go back to reference Ngan, M.L., Grother, P.J., Hanaoka, K.K.: Ongoing face recognition vendor test (frvt) part 6a: face recognition accuracy with masks using pre-covid-19 algorithms (2020) Ngan, M.L., Grother, P.J., Hanaoka, K.K.: Ongoing face recognition vendor test (frvt) part 6a: face recognition accuracy with masks using pre-covid-19 algorithms (2020)
16.
go back to reference Nguyen, H., Reddy, N., Rattani, A., Derakhshani, R.: VISOB 2.0 - second international competition on mobile ocular biometric recognition. In: IAPR International Conference on Pattern Recognition, Rome, Italy, pp. 1–8 (2020) Nguyen, H., Reddy, N., Rattani, A., Derakhshani, R.: VISOB 2.0 - second international competition on mobile ocular biometric recognition. In: IAPR International Conference on Pattern Recognition, Rome, Italy, pp. 1–8 (2020)
17.
go back to reference Raja, K., Ramachandra, R., Busch, C.: Collaborative representation of blur invariant deep sparse features for periocular recognition from smartphones. Image Vision Comput. 101, 103979 (2020)CrossRef Raja, K., Ramachandra, R., Busch, C.: Collaborative representation of blur invariant deep sparse features for periocular recognition from smartphones. Image Vision Comput. 101, 103979 (2020)CrossRef
18.
go back to reference Rattani, A., Reddy, N., Derakhshani, R.: Convolutional neural networks for gender prediction from smartphone-based ocular images. IET Biometrics 7(5), 423–430 (2018)CrossRef Rattani, A., Reddy, N., Derakhshani, R.: Convolutional neural networks for gender prediction from smartphone-based ocular images. IET Biometrics 7(5), 423–430 (2018)CrossRef
20.
go back to reference Rattani, A., Derakhshani, R., Saripalle, S.K., Gottemukkula, V.: ICIP 2016 competition on mobile ocular biometric recognition. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 320–324. IEEE (2016) Rattani, A., Derakhshani, R., Saripalle, S.K., Gottemukkula, V.: ICIP 2016 competition on mobile ocular biometric recognition. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 320–324. IEEE (2016)
21.
go back to reference Reddy, N., Rattani, A., Derakhshani, R.: Comparison of deep learning models for biometric-based mobile user authentication. In: 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS), pp. 1–6 (2018) Reddy, N., Rattani, A., Derakhshani, R.: Comparison of deep learning models for biometric-based mobile user authentication. In: 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS), pp. 1–6 (2018)
22.
go back to reference Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.: Mobilenetv 2: inverted residuals and linear bottlenecks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4510–4520 (2018) Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.: Mobilenetv 2: inverted residuals and linear bottlenecks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 4510–4520 (2018)
23.
go back to reference Singh, R., Agarwal, A., Singh, M., Nagpal, S., Vatsa, M.: On the robustness of face recognition algorithms against attacks and bias (2020) Singh, R., Agarwal, A., Singh, M., Nagpal, S., Vatsa, M.: On the robustness of face recognition algorithms against attacks and bias (2020)
24.
go back to reference Wu, X., He, R., Sun, Z., Tan, T.: A light CNN for deep face representation with noisy labels. IEEE Trans. Inf. Forensics Secur. 13(11), 2884–2896 (2018)CrossRef Wu, X., He, R., Sun, Z., Tan, T.: A light CNN for deep face representation with noisy labels. IEEE Trans. Inf. Forensics Secur. 13(11), 2884–2896 (2018)CrossRef
Metadata
Title
Probing Fairness of Mobile Ocular Biometrics Methods Across Gender on VISOB 2.0 Dataset
Authors
Anoop Krishnan
Ali Almadan
Ajita Rattani
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-68793-9_16

Premium Partner