Skip to main content
Top

2017 | OriginalPaper | Chapter

Face Composite Sketch Recognition by BoVW-Based Discriminative Representations

Authors : Yenisel Plasencia-Calaña, Heydi Méndez-Vázquez, Rainer Larin Fonseca

Published in: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Face sketches are one of the main sources used for criminal investigation. In this paper, we propose a new approach for the recognition of facial composite sketches. We propose the use of discriminative representations as a way to bridge the modality gap between sketches and mug-shot photos. The intermediate representation is based on the bag-of-visual-words (BoVW) approach using dense SIFT features on multiple scales. Next, a discriminative representation is computed on top of the intermediate representation. Experimental results show that the discriminative representations outperform state-of-the-art approaches for this task in composite sketch datasets for both a close-set scenario as well as an open-set recognition scenario.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRef
2.
go back to reference Chen, D., Cao, X., Wang, L., Wen, F., Sun, J.: Bayesian face revisited: a joint formulation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 566–579. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33712-3_41 CrossRef Chen, D., Cao, X., Wang, L., Wen, F., Sun, J.: Bayesian face revisited: a joint formulation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 566–579. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33712-3_​41 CrossRef
3.
go back to reference Duin, R., Juszczak, P., Paclik, P., Pekalska, E., de Ridder, D., Tax, D., Verzakov, S.: PR-Tools4.1, a matlab toolbox for pattern recognition. Technical report, Information and Communication Theory Group: Delft University of Technology, The Netherlands (2007). http://www.prtools.org/ Duin, R., Juszczak, P., Paclik, P., Pekalska, E., de Ridder, D., Tax, D., Verzakov, S.: PR-Tools4.1, a matlab toolbox for pattern recognition. Technical report, Information and Communication Theory Group: Delft University of Technology, The Netherlands (2007). http://​www.​prtools.​org/​
4.
go back to reference Han, H., Klare, B., Bonnen, K., Jain, A.K.: Matching composite sketches to face photos: a component-based approach. IEEE Trans. Inf. Forensics Secur. 8(1), 191–204 (2013)CrossRef Han, H., Klare, B., Bonnen, K., Jain, A.K.: Matching composite sketches to face photos: a component-based approach. IEEE Trans. Inf. Forensics Secur. 8(1), 191–204 (2013)CrossRef
5.
go back to reference Klare, B., Jain, A.K.: Sketch-to-photo matching: a feature-based approach. SPIE Defense, Security, and Sensing, vol. 7667 (2010) Klare, B., Jain, A.K.: Sketch-to-photo matching: a feature-based approach. SPIE Defense, Security, and Sensing, vol. 7667 (2010)
6.
go back to reference Klare, B., Jain, A.K.: Heterogeneous face recognition using kernel prototype similarities. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1410–1422 (2013)CrossRef Klare, B., Jain, A.K.: Heterogeneous face recognition using kernel prototype similarities. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1410–1422 (2013)CrossRef
7.
go back to reference Klum, S., Han, H., Jain, A.K., Klare, B.: Sketch based face recognition: forensic vs. composite sketches. In: International Conference on Biometrics, ICB 2013, Madrid, Spain, 4–7 June 2013, pp. 1–8 (2013) Klum, S., Han, H., Jain, A.K., Klare, B.: Sketch based face recognition: forensic vs. composite sketches. In: International Conference on Biometrics, ICB 2013, Madrid, Spain, 4–7 June 2013, pp. 1–8 (2013)
8.
go back to reference Klum, S., Han, H., Klare, B., Jain, A.K.: The facesketchid system: matching facial composites to mugshots. IEEE Trans. Inf. Forensics Secur. 9(12), 2248–2263 (2014)CrossRef Klum, S., Han, H., Klare, B., Jain, A.K.: The facesketchid system: matching facial composites to mugshots. IEEE Trans. Inf. Forensics Secur. 9(12), 2248–2263 (2014)CrossRef
9.
go back to reference Köstinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012, pp. 2288–2295 (2012) Köstinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012, pp. 2288–2295 (2012)
10.
go back to reference Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006, vol. 2. pp. 2169–2178. IEEE Computer Society, Washington, DC (2006) Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006, vol. 2. pp. 2169–2178. IEEE Computer Society, Washington, DC (2006)
11.
go back to reference Mittal, P., Jain, A., Singh, R., Vatsa, M.: Boosting local descriptors for matching composite and digital face images. In: 2013 IEEE International Conference on Image Processing, pp. 2797–2801, September 2013 Mittal, P., Jain, A., Singh, R., Vatsa, M.: Boosting local descriptors for matching composite and digital face images. In: 2013 IEEE International Conference on Image Processing, pp. 2797–2801, September 2013
12.
go back to reference Mittal, P., Jain, A., Goswami, G., Singh, R., Vatsa, M.: Recognizing composite sketches with digital face images via SSD dictionary. In: IEEE International Joint Conference on Biometrics, IJCB 2014, Clearwater, FL, USA, 29 September–2 October 2014, pp. 1–6 (2014) Mittal, P., Jain, A., Goswami, G., Singh, R., Vatsa, M.: Recognizing composite sketches with digital face images via SSD dictionary. In: IEEE International Joint Conference on Biometrics, IJCB 2014, Clearwater, FL, USA, 29 September–2 October 2014, pp. 1–6 (2014)
13.
go back to reference Mittal, P., Vatsa, M., Singh, R.: Composite sketch recognition via deep network - a transfer learning approach. In: International Conference on Biometrics, ICB 2015, Phuket, Thailand, 19–22 May 2015, pp. 251–256 (2015) Mittal, P., Vatsa, M., Singh, R.: Composite sketch recognition via deep network - a transfer learning approach. In: International Conference on Biometrics, ICB 2015, Phuket, Thailand, 19–22 May 2015, pp. 251–256 (2015)
14.
go back to reference Vedaldi, A., Fulkerson, B.: VLFeat: an open and portable library of computer vision algorithms. In: Proceedings of the 18th ACM International Conference on Multimedia, MM 2010, pp. 1469–1472. ACM, New York (2010) Vedaldi, A., Fulkerson, B.: VLFeat: an open and portable library of computer vision algorithms. In: Proceedings of the 18th ACM International Conference on Multimedia, MM 2010, pp. 1469–1472. ACM, New York (2010)
15.
go back to reference Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 1955–1967 (2009)CrossRef Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 1955–1967 (2009)CrossRef
16.
go back to reference Yuen, P.C., Man, C.H.: Human face image searching system using sketches. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 37(4), 493–504 (2007)CrossRef Yuen, P.C., Man, C.H.: Human face image searching system using sketches. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 37(4), 493–504 (2007)CrossRef
Metadata
Title
Face Composite Sketch Recognition by BoVW-Based Discriminative Representations
Authors
Yenisel Plasencia-Calaña
Heydi Méndez-Vázquez
Rainer Larin Fonseca
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-52277-7_25

Premium Partner