Skip to main content

2018 | OriginalPaper | Buchkapitel

Heterogeneous Face Matching Using ZigZag Pattern of Local Extremum Logarithm Difference: ZZPLELD

verfasst von : Hiranmoy Roy, Debotosh Bhattacharjee

Erschienen in: Advanced Computing and Systems for Security

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A novel methodology for matching of heterogeneous faces, such as sketch-photo and near-infrared (NIR)-visible (VIS) images is proposed here. For heterogeneous face recognition, more emphasis is given to the edge features, which are invariant in different modality images. Since edges are sensitive to illuminations, we present an illumination-invariant image representation called local extremum logarithm difference (LELD). LELD provides illumination-invariant edge features in coarse level. Therefore, a local zigzag binary pattern LZZBP is presented to capture the local variation of LELD, and we call it a zigzag pattern of local extremum logarithm difference (ZZPLELD). We tested the proposed methodology on different sketch-photo and NIR-VIS benchmark databases. In the case of viewed sketches, the rank-1 recognition accuracy of 96.35% is achieved on CUFSF database. In the case of NIR-VIS matching, the rank-1 accuracy of 99.39% is achieved and which is superior to other state-of-the-art methods. We also tested ZZPLELD on illumination variation Extended Yale B database, and rank-1 recognition accuracy of 94.51% is achieved.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Li, S., Chu, R., Liao, S., Zhang, L.: Illumination invariant face recognition using NIR images. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 627–639 (2007)CrossRef Li, S., Chu, R., Liao, S., Zhang, L.: Illumination invariant face recognition using NIR images. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 627–639 (2007)CrossRef
2.
Zurück zum Zitat Li, S.: Encyclopaedia of Biometrics. Springer (2009) Li, S.: Encyclopaedia of Biometrics. Springer (2009)
3.
Zurück zum Zitat Tang, X., Wang, X.: Face sketch recognition. IEEE Trans. Circuits Syst. Video Technol. 14(1), 50–57 (2004)CrossRef Tang, X., Wang, X.: Face sketch recognition. IEEE Trans. Circuits Syst. Video Technol. 14(1), 50–57 (2004)CrossRef
4.
Zurück zum Zitat Chen, J., Yi, D., Yang, J., Zhao, G., Li, S., Pietikainen, M.: Learning mappings for face synthesis from near infrared to visual light images. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 156–163 (2009) Chen, J., Yi, D., Yang, J., Zhao, G., Li, S., Pietikainen, M.: Learning mappings for face synthesis from near infrared to visual light images. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 156–163 (2009)
5.
Zurück zum Zitat Gao, X., Zhong, J., Li, J., Tian, C.: Face sketch synthesis algorithm on e-hmm and selective ensemble. IEEE Trans. Circuits Syst. Video Technol. 18(4), 487–496 (2008)CrossRef Gao, X., Zhong, J., Li, J., Tian, C.: Face sketch synthesis algorithm on e-hmm and selective ensemble. IEEE Trans. Circuits Syst. Video Technol. 18(4), 487–496 (2008)CrossRef
6.
Zurück zum Zitat Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 1955–1967 (2009)CrossRef Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 1955–1967 (2009)CrossRef
7.
Zurück zum Zitat Li, J., Hao, P., Zhang, C., Dou, M.: Hallucinating faces from thermal infrared images. In: Proceedings IEEE International Conference on Image Processing, pp. 465–468 (2008) Li, J., Hao, P., Zhang, C., Dou, M.: Hallucinating faces from thermal infrared images. In: Proceedings IEEE International Conference on Image Processing, pp. 465–468 (2008)
8.
Zurück zum Zitat Gao, X., Wang, N., Tao, D., Li, X.: Face sketchphoto synthesis and retrieval using sparse representation. IEEE Trans. Circuits Syst. Video Technol. 22(8), 1213–1226 (2012)CrossRef Gao, X., Wang, N., Tao, D., Li, X.: Face sketchphoto synthesis and retrieval using sparse representation. IEEE Trans. Circuits Syst. Video Technol. 22(8), 1213–1226 (2012)CrossRef
9.
Zurück zum Zitat Wang, N., Li, J., Tao, D., Li, X., Gao, X.: Heterogeneous image transformation. Elsevier J. Pattern Recognit. Lett. 34, 77–84 (2013)CrossRef Wang, N., Li, J., Tao, D., Li, X., Gao, X.: Heterogeneous image transformation. Elsevier J. Pattern Recognit. Lett. 34, 77–84 (2013)CrossRef
10.
Zurück zum Zitat Wang, N., Tao, D., Gao, X., Li, X., Li, J.: Transductive face sketch-photo synthesis. IEEE Trans. Neural Netw. 24(9), 1364–1376 (2013)CrossRef Wang, N., Tao, D., Gao, X., Li, X., Li, J.: Transductive face sketch-photo synthesis. IEEE Trans. Neural Netw. 24(9), 1364–1376 (2013)CrossRef
11.
Zurück zum Zitat Peng, C., Gao, X., Wang, N., Tao, D., Li, X., Li, J.: Multiple representation-based face sketch-photo synthesis. IEEE Trans. Neural Netw. xx x, 1–13 (2016) Peng, C., Gao, X., Wang, N., Tao, D., Li, X., Li, J.: Multiple representation-based face sketch-photo synthesis. IEEE Trans. Neural Netw. xx x, 1–13 (2016)
12.
Zurück zum Zitat Lin, D., Tang, X.: Inter-modality face recognition. In: Proceedings of European Conference on Computer Vision, pp. 13–26 (2006)CrossRef Lin, D., Tang, X.: Inter-modality face recognition. In: Proceedings of European Conference on Computer Vision, pp. 13–26 (2006)CrossRef
13.
Zurück zum Zitat Yi, D., Liu, R., Chu, R., Lei, Z., Li, S.: Face matching between near infrared and visible light images. In: Proceedings of International Conference on Biometrics, pp. 523–530 (2007) Yi, D., Liu, R., Chu, R., Lei, Z., Li, S.: Face matching between near infrared and visible light images. In: Proceedings of International Conference on Biometrics, pp. 523–530 (2007)
14.
Zurück zum Zitat Lei, Z., Li, S.: Coupled spectral regression for matching heterogeneous faces. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1123–1128 (2009) Lei, Z., Li, S.: Coupled spectral regression for matching heterogeneous faces. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1123–1128 (2009)
15.
Zurück zum Zitat Sharma, A., Jacobs, D.: Bypassing synthesis: Pls for face recognition with pose, low-resolution and sketch. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 593–600 (2011) Sharma, A., Jacobs, D.: Bypassing synthesis: Pls for face recognition with pose, low-resolution and sketch. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 593–600 (2011)
16.
Zurück zum Zitat Mignon, A., Jurie, F.: Cmml: a new metric learning approach for cross modal matching. In: Proceedings of Asian Conference on Computer Vision, pp. 1–14 (2012) Mignon, A., Jurie, F.: Cmml: a new metric learning approach for cross modal matching. In: Proceedings of Asian Conference on Computer Vision, pp. 1–14 (2012)
17.
Zurück zum Zitat Lei, Z., Liao, S., Jain, A.K., Li, S.Z.: Coupled discriminant analysis for heterogeneous face recognition. IEEE Trans. Inf. Forensics Secur. 7(6), 1707–1716 (2012)CrossRef Lei, Z., Liao, S., Jain, A.K., Li, S.Z.: Coupled discriminant analysis for heterogeneous face recognition. IEEE Trans. Inf. Forensics Secur. 7(6), 1707–1716 (2012)CrossRef
18.
Zurück zum Zitat Kan, M., Shan, S., Zhang, H., Lao, S., Chen, X.: Multi-view discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 188–194 (2016)CrossRef Kan, M., Shan, S., Zhang, H., Lao, S., Chen, X.: Multi-view discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 188–194 (2016)CrossRef
19.
Zurück zum Zitat Liao, S., Yi, D., Lei, Z., Qin, R., Li, S.: Heterogeneous face recognition from local structure of normalized appeaarance shared representation learning for heterogeneous face recognition. In: Proceedings of IAPR International Conference on Biometrics (2009) Liao, S., Yi, D., Lei, Z., Qin, R., Li, S.: Heterogeneous face recognition from local structure of normalized appeaarance shared representation learning for heterogeneous face recognition. In: Proceedings of IAPR International Conference on Biometrics (2009)
20.
Zurück zum Zitat Klare, B.F., Li, Z., Jain, A.K.: Matching forensic sketches to mug shot photos. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 639–646 (2011)CrossRef Klare, B.F., Li, Z., Jain, A.K.: Matching forensic sketches to mug shot photos. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 639–646 (2011)CrossRef
21.
Zurück zum Zitat Zhang, W., Wang, X., Tang, X.: Coupled information-theoretic encoding for face photo-sketch recognition. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 513–520 (2011) Zhang, W., Wang, X., Tang, X.: Coupled information-theoretic encoding for face photo-sketch recognition. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 513–520 (2011)
22.
Zurück zum Zitat Bhatt, H.S., Bharadwaj, S., Singh, R., Vatsa, M.: Memetically optimized mcwld for matching sketches with digital face images. IEEE Trans. Inf. Forensics Secur. 7(5), 1522–1535 (2012)CrossRef Bhatt, H.S., Bharadwaj, S., Singh, R., Vatsa, M.: Memetically optimized mcwld for matching sketches with digital face images. IEEE Trans. Inf. Forensics Secur. 7(5), 1522–1535 (2012)CrossRef
23.
Zurück zum Zitat Klare, B.F., Jain, A.K.: Heterogeneous face recognition using kernel prototype similarities. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1410–1422 (2013)CrossRef Klare, B.F., Jain, A.K.: Heterogeneous face recognition using kernel prototype similarities. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1410–1422 (2013)CrossRef
24.
Zurück zum Zitat Zhu, J., Zheng, W., Lai, J., Li, S.: Matching nir face to vis face using transduction. IEEE Trans. Inf. Forensics Secur. 9(3), 501–514 (2014)CrossRef Zhu, J., Zheng, W., Lai, J., Li, S.: Matching nir face to vis face using transduction. IEEE Trans. Inf. Forensics Secur. 9(3), 501–514 (2014)CrossRef
25.
Zurück zum Zitat Gong, D., Li, Z., Liu, J., Qiao, Y.: Multi-feature canonical correlation analysis for face photo-sketch image retrieval. In: Proceedings of ACM International Conference on Multimedia, pp. 617–620 (2013) Gong, D., Li, Z., Liu, J., Qiao, Y.: Multi-feature canonical correlation analysis for face photo-sketch image retrieval. In: Proceedings of ACM International Conference on Multimedia, pp. 617–620 (2013)
26.
Zurück zum Zitat Roy, H., Bhattacharjee, D.: Heterogeneous face matching using geometric edge-texture feature (getf) and multiple fuzzy-classifier system. Elsevier J. Appl. Soft Comput. 46, 967–979 (2016)CrossRef Roy, H., Bhattacharjee, D.: Heterogeneous face matching using geometric edge-texture feature (getf) and multiple fuzzy-classifier system. Elsevier J. Appl. Soft Comput. 46, 967–979 (2016)CrossRef
27.
Zurück zum Zitat Roy, H., Bhattacharjee, D.: Local-gravity-face (LG-face) for illumination-invariant and heterogeneous face recognition. IEEE Trans. Inf. Forensics Secur. 11(7), 1412–1424 (2016)CrossRef Roy, H., Bhattacharjee, D.: Local-gravity-face (LG-face) for illumination-invariant and heterogeneous face recognition. IEEE Trans. Inf. Forensics Secur. 11(7), 1412–1424 (2016)CrossRef
28.
Zurück zum Zitat Roy, H., Bhattacharjee, D.: Face sketch-photo matching using the local gradient fuzzy pattern. IEEE J. Intell. Syst. 31(3), 30–39 (2016)CrossRef Roy, H., Bhattacharjee, D.: Face sketch-photo matching using the local gradient fuzzy pattern. IEEE J. Intell. Syst. 31(3), 30–39 (2016)CrossRef
29.
Zurück zum Zitat Roy, H., Bhattacharjee, D.: Face sketch-photo recognition using local gradient checksum: LGCS. Springer Int. J. Mach. Learn. Cybern. xx(x), 1–13 (2016) Roy, H., Bhattacharjee, D.: Face sketch-photo recognition using local gradient checksum: LGCS. Springer Int. J. Mach. Learn. Cybern. xx(x), 1–13 (2016)
30.
Zurück zum Zitat Peng, C., Gao, X., Wang, N., Li, J.: Graphical representation for heterogeneous face recognition. IEEE Trans. Pattern Anal. Mach. Intell. xx(x), 1–13 (2016) Peng, C., Gao, X., Wang, N., Li, J.: Graphical representation for heterogeneous face recognition. IEEE Trans. Pattern Anal. Mach. Intell. xx(x), 1–13 (2016)
31.
Zurück zum Zitat Sinha, P., Balas, B., Ostrovsky, Y., Russell, R.: Face recognition by humans: Ninetenn results all computer vision researchers should know about. Proc. IEEE, 94 (2006)CrossRef Sinha, P., Balas, B., Ostrovsky, Y., Russell, R.: Face recognition by humans: Ninetenn results all computer vision researchers should know about. Proc. IEEE, 94 (2006)CrossRef
32.
Zurück zum Zitat Lai, Z., Dai, D., Ren, C., Huang, K.: Multiscale logarithm difference edgemaps for face recognition against varying lighting conditions. IEEE Trans. Image Process. 24(6), 1735–1747 (2015)MathSciNetCrossRef Lai, Z., Dai, D., Ren, C., Huang, K.: Multiscale logarithm difference edgemaps for face recognition against varying lighting conditions. IEEE Trans. Image Process. 24(6), 1735–1747 (2015)MathSciNetCrossRef
33.
Zurück zum Zitat Ojala, T., Pietikinen, M., Menp, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRef Ojala, T., Pietikinen, M., Menp, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRef
34.
Zurück zum Zitat Land, E.H., McCann, J.J.: Lightness and Retinex theory. J. Opt. Soc. Am. 61(1), 1–11 (1971)CrossRef Land, E.H., McCann, J.J.: Lightness and Retinex theory. J. Opt. Soc. Am. 61(1), 1–11 (1971)CrossRef
35.
Zurück zum Zitat Horn, B.K.P.: Robot Vision. MIT Press, Cambridge (2011) Horn, B.K.P.: Robot Vision. MIT Press, Cambridge (2011)
36.
Zurück zum Zitat Zhang, T., Tang, Y.Y., Fang, B., Shang, Z., Liu, X.: Face recognition under varying illumination using gradientfaces. IEEE Trans. Image Process. 18(11), 2599–2606 (2009)MathSciNetCrossRef Zhang, T., Tang, Y.Y., Fang, B., Shang, Z., Liu, X.: Face recognition under varying illumination using gradientfaces. IEEE Trans. Image Process. 18(11), 2599–2606 (2009)MathSciNetCrossRef
37.
Zurück zum Zitat An, G., Wu, J., Ruan, Q.: An illumination normalization model for face recognition under varied lighting conditions. Elsevier J. Pattern Recognit. Lett. 31, 1056–1067 (2010)CrossRef An, G., Wu, J., Ruan, Q.: An illumination normalization model for face recognition under varied lighting conditions. Elsevier J. Pattern Recognit. Lett. 31, 1056–1067 (2010)CrossRef
38.
Zurück zum Zitat Belhumeur, P., Georghiades, A., Kriegman, D.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Learn. 23(6), 643–660 (2001)CrossRef Belhumeur, P., Georghiades, A., Kriegman, D.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Learn. 23(6), 643–660 (2001)CrossRef
39.
Zurück zum Zitat Lee, K.C., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Learn. 27(5), 684–698 (2005)CrossRef Lee, K.C., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Learn. 27(5), 684–698 (2005)CrossRef
40.
Zurück zum Zitat Li, S.Z., Lei, Z., Ao, M.: The hfb face database for heterogeneous face biometrics research. In: Proceedings of IEEE International Workshop on Object Tracking and Classification Beyond and in the Visible Spectrum, Miami (2009) Li, S.Z., Lei, Z., Ao, M.: The hfb face database for heterogeneous face biometrics research. In: Proceedings of IEEE International Workshop on Object Tracking and Classification Beyond and in the Visible Spectrum, Miami (2009)
41.
Zurück zum Zitat Fan, C.N., Zhang, F.Y.: Homomorphic filtering based illumination normalization method for face recognition. Elsevier J. Pattern Recognit. Lett. 32, 1468–1479 (2011)CrossRef Fan, C.N., Zhang, F.Y.: Homomorphic filtering based illumination normalization method for face recognition. Elsevier J. Pattern Recognit. Lett. 32, 1468–1479 (2011)CrossRef
Metadaten
Titel
Heterogeneous Face Matching Using ZigZag Pattern of Local Extremum Logarithm Difference: ZZPLELD
verfasst von
Hiranmoy Roy
Debotosh Bhattacharjee
Copyright-Jahr
2018
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-8180-4_8

Premium Partner