Skip to main content

2016 | OriginalPaper | Buchkapitel

Recent Advances on Cross-Domain Face Recognition

verfasst von : Xiaoxiang Liu, Xiaobo Sun, Ran He, Tieniu Tan

Erschienen in: Biometric Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Face recognition is a significant and pervasively applied computer vision task. With the specific application scenarios being explored gradually, general face recognition methods dealing with visible light images are unqualified. Cross-domain face recognition refers to a series of methods in response to face recognition problems whose inputs may come from multiple modalities, such as visible light images, sketch, near infrared images, 3D data, low-resolution images, thermal infrared images, or cross different ages, expressions, and ethnicities. Compared with general face recognition, cross-domain face recognition has not been widely explored and only few literatures systematically discuss this topic. Face recognition aiming at matching face images from photographs and other image modalities, which is usually called heterogeneous face recognition, has larger cross-domain gap and is a harder problem in this topic. This paper mainly investigates heterogeneous face databases, provides an up-to-date review of research efforts, and addresses common problems and related issues in cross-domain face recognition techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 1955–1967 (2009)CrossRef Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 1955–1967 (2009)CrossRef
2.
Zurück zum Zitat Zhang, W., Wang, X., Tang, X.: Coupled information-theoretic encoding for face photo-sketch recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 513–520 (2011) Zhang, W., Wang, X., Tang, X.: Coupled information-theoretic encoding for face photo-sketch recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 513–520 (2011)
3.
Zurück zum Zitat Li, S., Yi, D., Lei, Z., et al.: The casia nir-vis 2.0 face database. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2013) Li, S., Yi, D., Lei, Z., et al.: The casia nir-vis 2.0 face database. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2013)
4.
Zurück zum Zitat Socolinsky, D.A., Selinger, A.: Thermal face recognition in an operational scenario. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. II-1012–II-1019 (2004) Socolinsky, D.A., Selinger, A.: Thermal face recognition in an operational scenario. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. II-1012–II-1019 (2004)
5.
Zurück zum Zitat Kevin, X., Bowyer, W.: Visible-light, infrared face recognition. In: Workshop on Multimodal User Authentication, p. 48 (2003) Kevin, X., Bowyer, W.: Visible-light, infrared face recognition. In: Workshop on Multimodal User Authentication, p. 48 (2003)
6.
Zurück zum Zitat Socolinsky, D.A., Selinger, A.: A comparative analysis of face recognition performance with visible and thermal infrared imagery. Equinox Corp., Baltimore (2002) Socolinsky, D.A., Selinger, A.: A comparative analysis of face recognition performance with visible and thermal infrared imagery. Equinox Corp., Baltimore (2002)
7.
Zurück zum Zitat Espinosa-Dur, V., Faundez-Zanuy, M., Mekyska, J.: A new face database simultaneously acquired in visible, near-infrared and thermal spectrums. Cogn. Comput. 5(1), 119–135 (2013)CrossRef Espinosa-Dur, V., Faundez-Zanuy, M., Mekyska, J.: A new face database simultaneously acquired in visible, near-infrared and thermal spectrums. Cogn. Comput. 5(1), 119–135 (2013)CrossRef
8.
Zurück zum Zitat Tang, X., Wang, X.: Face photo recognition using sketch. In: IEEE International Conference on Image Processing, pp. I-257–I-260 (2002) Tang, X., Wang, X.: Face photo recognition using sketch. In: IEEE International Conference on Image Processing, pp. I-257–I-260 (2002)
9.
Zurück zum Zitat Liu, Q., Tang, X., Jin, H., et al.: A nonlinear approach for face sketch synthesis and recognition. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1005–1010 (2005) Liu, Q., Tang, X., Jin, H., et al.: A nonlinear approach for face sketch synthesis and recognition. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1005–1010 (2005)
10.
Zurück zum Zitat Uhl Jr., R.G., Lobo, N.D.V., Kwon, Y.H.: Recognizing a facial image from a police sketch. In: IEEE Conference on Applications of Computer Vision Workshop, pp. 129–137 (1994) Uhl Jr., R.G., Lobo, N.D.V., Kwon, Y.H.: Recognizing a facial image from a police sketch. In: IEEE Conference on Applications of Computer Vision Workshop, pp. 129–137 (1994)
11.
Zurück zum Zitat Li, Y., Savvides, M., Bhagavatula, V.: Illumination tolerant face recognition using a novel facefrom sketch synthesis approach and advanced correlation filters. In: IEEE Conference on Acoustics, Speech, and Signal Processing, pp. 357–360 (2006) Li, Y., Savvides, M., Bhagavatula, V.: Illumination tolerant face recognition using a novel facefrom sketch synthesis approach and advanced correlation filters. In: IEEE Conference on Acoustics, Speech, and Signal Processing, pp. 357–360 (2006)
12.
Zurück zum Zitat Lei, Z., Liao, S., Jain, A.K., et al.: Coupled discriminant analysis for heterogeneous face recognition. IEEE Trans. Inf. Forensics Secur. 7(6), 1707–1716 (2012)CrossRef Lei, Z., Liao, S., Jain, A.K., et al.: Coupled discriminant analysis for heterogeneous face recognition. IEEE Trans. Inf. Forensics Secur. 7(6), 1707–1716 (2012)CrossRef
13.
Zurück zum Zitat Choi, J., Hu, S., Young, S.S., et al.: Thermal to visible face recognition. In: SPIE Defense, Security, Sensing. International Society for Optics, Photonics, pp. 83711L–83711L-10 (2012) Choi, J., Hu, S., Young, S.S., et al.: Thermal to visible face recognition. In: SPIE Defense, Security, Sensing. International Society for Optics, Photonics, pp. 83711L–83711L-10 (2012)
14.
Zurück zum Zitat Bourlai, T., Ross, A., Chen, C., et al.: A study on using mid-wave infrared images for face recognition. In: SPIE Defense, Security, and Sensing. International Society for Optics and Photonics, pp. 83711K–83711K-13 (2012) Bourlai, T., Ross, A., Chen, C., et al.: A study on using mid-wave infrared images for face recognition. In: SPIE Defense, Security, and Sensing. International Society for Optics and Photonics, pp. 83711K–83711K-13 (2012)
15.
Zurück zum Zitat Klare, B.F., Jain, A.K.: Heterogeneous face recognition using kernel prototype similarities. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1410–1422 (2013)CrossRef Klare, B.F., Jain, A.K.: Heterogeneous face recognition using kernel prototype similarities. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1410–1422 (2013)CrossRef
16.
Zurück zum Zitat Hu, S., Choi, J., Chan, A.L., et al.: Thermal-to-visible face recognition using partial least squares. JOSA A 32(3), 431–442 (2015)CrossRef Hu, S., Choi, J., Chan, A.L., et al.: Thermal-to-visible face recognition using partial least squares. JOSA A 32(3), 431–442 (2015)CrossRef
17.
Zurück zum Zitat Peng, C., Gao, X., Wang, N., et al.: Graphical Representation for Heterogeneous Face Recognition. arXiv preprint arXiv:1503.00488 (2015) Peng, C., Gao, X., Wang, N., et al.: Graphical Representation for Heterogeneous Face Recognition. arXiv preprint arXiv:​1503.​00488 (2015)
18.
Zurück zum Zitat Rama, A., Tarres, F., Onofrio, D., et al.: Mixed 2D-3D Information for pose estimation and facerecognition. In: IEEE Conference on Acoustics, Speech and Signal Processing, vol. 2, pp. II-211–II-217 (2006) Rama, A., Tarres, F., Onofrio, D., et al.: Mixed 2D-3D Information for pose estimation and facerecognition. In: IEEE Conference on Acoustics, Speech and Signal Processing, vol. 2, pp. II-211–II-217 (2006)
19.
Zurück zum Zitat Riccio, D., Dugelay, J.L.: Geometric invariants for 2D/3D face recognition. Pattern Recogn. Lett. 28(14), 1907–1914 (2007)CrossRef Riccio, D., Dugelay, J.L.: Geometric invariants for 2D/3D face recognition. Pattern Recogn. Lett. 28(14), 1907–1914 (2007)CrossRef
20.
Zurück zum Zitat Yang, W., Yi, D., Lei, Z., et al.: 2D3D face matching using CCA. In: IEEE Conference on Automatic Face & Gesture Recognition, pp. 1–6 (2008) Yang, W., Yi, D., Lei, Z., et al.: 2D3D face matching using CCA. In: IEEE Conference on Automatic Face & Gesture Recognition, pp. 1–6 (2008)
21.
Zurück zum Zitat Wang, X., Ly, V., Guo, G., et al.: A new approach for 2d–3d heterogeneous face recognition. In: IEEE International Symposium on Multimedia, pp. 301–304 (2013) Wang, X., Ly, V., Guo, G., et al.: A new approach for 2d–3d heterogeneous face recognition. In: IEEE International Symposium on Multimedia, pp. 301–304 (2013)
22.
Zurück zum Zitat Huang, D., Ardabilian, M., Wang, Y., et al.: Oriented gradient maps based automatic asymmetric 3D-2D face recognition. In: International Conference on Biometrics, pp. 125–131 (2012) Huang, D., Ardabilian, M., Wang, Y., et al.: Oriented gradient maps based automatic asymmetric 3D-2D face recognition. In: International Conference on Biometrics, pp. 125–131 (2012)
23.
Zurück zum Zitat Kakadiaris, I.A., Toderici, G., Evangelopoulos, G., et al.: 3D–2D face recognition with pose and illumination normalization. Comput. Vis. Image Underst. (2016) Kakadiaris, I.A., Toderici, G., Evangelopoulos, G., et al.: 3D–2D face recognition with pose and illumination normalization. Comput. Vis. Image Underst. (2016)
24.
Zurück zum Zitat Zhang, Q., Zhou, F., Yang, F., et al.: Face super-resolution via semi-kernel partial least squares and dictionaries coding. In: IEEE Conference on Digital Signal Processing, pp. 590–594 (2015) Zhang, Q., Zhou, F., Yang, F., et al.: Face super-resolution via semi-kernel partial least squares and dictionaries coding. In: IEEE Conference on Digital Signal Processing, pp. 590–594 (2015)
25.
Zurück zum Zitat Li, B., Chang, H., Shan, S., et al.: Low-resolution face recognition via coupled locality preserving mappings. IEEE Sig. Process. Lett. 17(1), 20–23 (2010)CrossRef Li, B., Chang, H., Shan, S., et al.: Low-resolution face recognition via coupled locality preserving mappings. IEEE Sig. Process. Lett. 17(1), 20–23 (2010)CrossRef
26.
Zurück zum Zitat Biswas, S., Bowyer, K.W., Flynn, P.J.: Multidimensional scaling for matching low-resolution face images. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 2019–2030 (2012)CrossRef Biswas, S., Bowyer, K.W., Flynn, P.J.: Multidimensional scaling for matching low-resolution face images. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 2019–2030 (2012)CrossRef
27.
Zurück zum Zitat Shi, J., Qi, C.: From local geometry to global structure: learning latent subspace for low-resolution face image recognition. IEEE Sig. Process. Lett. 22(5), 554–558 (2015)CrossRef Shi, J., Qi, C.: From local geometry to global structure: learning latent subspace for low-resolution face image recognition. IEEE Sig. Process. Lett. 22(5), 554–558 (2015)CrossRef
28.
Zurück zum Zitat Wang, X., Hu, H., Gu, J.: Pose robust low-resolution face recognition via coupled kernel-based enhanced discriminant analysis. IEEE/CAA J. Autom. Sin. 3(2), 203–212 (2016)MathSciNetCrossRef Wang, X., Hu, H., Gu, J.: Pose robust low-resolution face recognition via coupled kernel-based enhanced discriminant analysis. IEEE/CAA J. Autom. Sin. 3(2), 203–212 (2016)MathSciNetCrossRef
29.
Zurück zum Zitat Liu, X., Song, L., Wu, X., Tan, T.: Transferring deep representation for NIR-VIS heterogeneous face recognition. In: International Conference on Biometrics (2016) Liu, X., Song, L., Wu, X., Tan, T.: Transferring deep representation for NIR-VIS heterogeneous face recognition. In: International Conference on Biometrics (2016)
30.
Zurück zum Zitat Ngiam, J., Khosla, A., Kim, M., et al.: Multimodal deep learning. In: International Conference on Machine Learning, pp. 689–696 (2011) Ngiam, J., Khosla, A., Kim, M., et al.: Multimodal deep learning. In: International Conference on Machine Learning, pp. 689–696 (2011)
31.
Zurück zum Zitat Pan, S.J., Tsang, I.W., Kwok, J.T., et al.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Netw. 22(2), 199–210 (2011)CrossRef Pan, S.J., Tsang, I.W., Kwok, J.T., et al.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Netw. 22(2), 199–210 (2011)CrossRef
32.
Zurück zum Zitat Srivastava, N., Salakhutdinov, R.R.: Multimodal learning with deep boltzmann machines. In: Advances in Neural Information Processing Systems, pp. 2222–2230 (2012) Srivastava, N., Salakhutdinov, R.R.: Multimodal learning with deep boltzmann machines. In: Advances in Neural Information Processing Systems, pp. 2222–2230 (2012)
33.
Zurück zum Zitat Tang, X., Wang, X.: Face sketch synthesis and recognition. In: IEEE Conference on Computer Vision, pp. 687–694 (2003) Tang, X., Wang, X.: Face sketch synthesis and recognition. In: IEEE Conference on Computer Vision, pp. 687–694 (2003)
34.
Zurück zum Zitat Wang, R., Yang, J., Yi, D., Li, S.Z.: An analysis-by-synthesis method for heterogeneous face biometrics. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 319–326. Springer, Heidelberg (2009). doi:10.1007/978-3-642-01793-3_33 CrossRef Wang, R., Yang, J., Yi, D., Li, S.Z.: An analysis-by-synthesis method for heterogeneous face biometrics. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 319–326. Springer, Heidelberg (2009). doi:10.​1007/​978-3-642-01793-3_​33 CrossRef
35.
Zurück zum Zitat Yi, D., Lei, Z., Li, S.Z.: Shared representation learning for heterogeneous face recognition. In: IEEE Conference and Workshops on Automatic Face and Gesture Recognition, vol. 1, pp. 1–7 (2015) Yi, D., Lei, Z., Li, S.Z.: Shared representation learning for heterogeneous face recognition. In: IEEE Conference and Workshops on Automatic Face and Gesture Recognition, vol. 1, pp. 1–7 (2015)
36.
Zurück zum Zitat Dhamecha, T.I., Sharma, P., Singh, R., et al.: On effectiveness of histogram of oriented gradient features for visible to near infrared face matching. In: International Conference on Pattern Recognition, pp. 1788–1793 (2014) Dhamecha, T.I., Sharma, P., Singh, R., et al.: On effectiveness of histogram of oriented gradient features for visible to near infrared face matching. In: International Conference on Pattern Recognition, pp. 1788–1793 (2014)
37.
Zurück zum Zitat Klare, B.F., Li, Z., Jain, A.K.: Matching forensic sketches to mug shot photos. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 639–646 (2011)CrossRef Klare, B.F., Li, Z., Jain, A.K.: Matching forensic sketches to mug shot photos. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 639–646 (2011)CrossRef
38.
Zurück zum Zitat Li, S.Z., Zhang, L., Liao, S.C., et al.: A near-infrared image based face recognition system. In: FG, pp. 455–460 (2006) Li, S.Z., Zhang, L., Liao, S.C., et al.: A near-infrared image based face recognition system. In: FG, pp. 455–460 (2006)
39.
Zurück zum Zitat Juefei-Xu, F., Pal, D., Savvides, M.: NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 141–150 (2015) Juefei-Xu, F., Pal, D., Savvides, M.: NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 141–150 (2015)
Metadaten
Titel
Recent Advances on Cross-Domain Face Recognition
verfasst von
Xiaoxiang Liu
Xiaobo Sun
Ran He
Tieniu Tan
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46654-5_17