Abstract
We present a novel and computationally fast method for automatic human face authentication. Taking a 3D triangular facial mesh as input, the approach first automatically extracts the bilateral symmetry plane of the facial surface. The intersection between the symmetry plane and the facial surface, namely the symmetry profile, is then computed. Using both the mean curvature plot of the facial surface and the curvature plot of the symmetry profile curve, three essential points of the nose on the symmetry profile are automatically extracted. The three essential points uniquely determine a Face Intrinsic Coordinate System (FICS). Different faces are aligned based on the FICS. The symmetry profile, together with two transverse profiles, composes a compact representation, called the SFC representation, of a 3D face surface. The face authentication and recognition steps are finally performed by comparing the SFC representations of the faces. The proposed method was tested on 382 face surfaces, which come from 166 individuals and cover a wide ethnic and age variety. The equal error rate (EER) of face authentication on scans with variable facial expressions is 10.8%. For scans with normal expression, the ERR is 0.8%.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Benz, M., Laboureux, X., Maier, T., Nkenke, E., Seeger, S., Neukam, F., Häusler, G.: The symmetry of faces. In: Proceedings of Vision, Modeling and Visualization, pp. 43–50 (2002)
Besl, P., McKay, N.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)
Beumier, C., Acheroy, M.: Automatic 3D face authentication. Image Vis. Comput. 18(4), 315–321 (2000)
Beumier, C., Acheroy, M.: Automatic face verification from 3D and grey level clues. Pattern Recog. Lett. 22(12), 1321–1329 (2001)
Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25(9), 1063–1074 (2003)
Bowyer, K., Chang, K., Flynn, P.: A survey of 3D and multi-modal 3D+2D face recognition. Notre Dame CSE Technical Report (2004)
Bronstein, A., Bronstein, M., Kimmel, R.: Expression invariant 3D face recognition. In: Proceedings of the International Conference on Audio and Video Based Biomeasure Person Authentication, pp. 62–70 (2003)
Cartoux, J., Lapreste, J., Richetin, M.: Face authentification or recognition by profile extraction from range images. In: IEEE Computer Society Workshop on Interpretation of 3D Scenes, pp. 194–199 (1989)
Chang, K., Bowyer, K., Flynn, P.: Face recognition using 2D and 3D facial data. In: Proceedings of the Workshop in Multimodal User Authentication, pp. 25–32 (2003)
Chua, C., Han, F., Ho, Y.: 3D human face recognition using point signature. In: Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition, p. 233 (2000)
Hallinan, P., Gorden, G., Yuille, A., Giblin, P., Mumford, D.: Two and three-dimensional patterns of the face. Peters, Wellesley, MA (1999)
Hamann, B.: Curvature approximation for triangulated surfaces. In: Farin, G., Hagen, H., Notemeier, H., Knodel, W. (eds.) Geometric Modelling. Springer, Berlin Heidelberg New York, pp. 139–153 (1993)
Kazhdan, M., Chazelle, B., Dobkin, D., Funkhouser, T., Rusinkiewicz, S.: A reflective symmetry descriptor for 3D models. Algorithmica 38(1), 201–225 (2003)
Lee, M., Ranganath, S.: Pose-invariant face recognition using a 3D deformable model. Pattern Recog. 36(8), 1835–1846 (2003)
Liu, Y., Schmidt, K., Cohn, J., Weaver, R.: Facial asymmetry quantification for expression invariant human identification. Comput. Vis. Image Understand. 91(1–2), 138–159 (2003)
Minovic, P., Ishikawa, S., Kato, K.: Three-dimensional symmetry measurement of medical entities. In: Proceedings of the 11th International Conference on Pattern Recognition: Conference A: Computer Vision and Applications, pp. 457–460 (1992)
Moreno, A., Sánchez, Á., Vélez, J., Díaz, F.: Face recognition using 3D surface-extracted descriptors. In: Proceedings of the 7th Irish Conference on Machine Vision and Image Processing, Antrim, N. Ireland (2003)
O’Mara, D., Owens, R.: Measuring bilateral symmetry in three dimensional magnetic resonance images. In: Attikiouzel, Y. (ed.) 1996 IEEE Region Ten Conference: Digital Signal Processing Applications, IEEE Service Center, pp. 151–156 (1996)
Reisfeld, D., Wolfson, H., Yeshurun, Y.: Detection of interest points using symmetry. In: Proceedings of the International Conference on Computer Vision, pp. 62–65 (1990)
Turk, M., Pentland, A.: Face recognition using eigenfaces. In: Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 586–591 (1991)
Tuzikov, A., Colliot, O., Bloch, I.: Brain symmetry plane computation in MR images using inertia axes and optimization. In: Proceedings of the International Conference on Pattern Recognition, pp. 516–519 (2002)
Wu, Y., Pan, G., Wu, Z.: Face authentication based on multiple profiles extracted from range data. In: Kittler, J., Nixon, M. (eds.) International Conference on Audio- and Video-Based Biometric Person Authentication. Lecture notes in computer science, vol 2688. Springer, Berlin Heidelberg New York, pp. 515–522 (2003)
Zhao, W., Chellappa, R., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, L., Razdan, A., Farin, G. et al. 3D face authentication and recognition based on bilateral symmetry analysis. Visual Comput 22, 43–55 (2006). https://doi.org/10.1007/s00371-005-0352-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-005-0352-9