Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Clustering Latent Sensor Distribution on Body Map for Generating Body Schema Read chapter Read first chapter

2017 | OriginalPaper | Chapter

Depth-Based Frontal View Generation for Pose Invariant Face Recognition with Consumer RGB-D Sensors

Authors : Giorgia Pitteri, Matteo Munaro, Emanuele Menegatti

Published in: Intelligent Autonomous Systems 14

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this work, we propose to exploit depth information to build a pose-invariant face recognition algorithm from RGB-D data. Our approach first estimates the head pose and then generates a frontal view for those faces that are rotated with respect to the frame of the camera. Then, some interest points of the face are detected by means of a Random Forest applied to the RGB image and they are used as keypoints where to compute feature descriptors. Around these points and their 3D counterpart, we extract both 2D and 3D local descriptors, which are then concatenated and classified by means of a Support Vector Machine trained in “one-versus-all” fashion. In order to validate the accuracy of the system with data from consumer RGB-D sensors, we created the IAS-Lab RGB-D Face Dataset, a new public dataset in which RGB-D data are acquired with a second generation Microsoft Kinect. The reported experiments show that the depth-aided approach we propose allows to improve the recognition rate up to 50 %.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Synchronous Dataflow and Visual Programming for Prototyping Robotic Algorithms
next chapter Lighting- and Occlusion-Robust View-Based Teaching/Playback for Model-Free Robot Programming
Footnotes
Literature
1.
Lu, X.: Image analysis for face recognition. Personal notes, May, vol. 5 (2003)
2.
Delac, K., Grgic, M., Grgic, S.: Statistics in face recognition: analyzing probability distributions of PCA, ICA and LDA performance results. In: Image and Signal Processing and Analysis, pp. 289–294 (2005)
3.
Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: CVPR, pp. 4295–4304 (2015)
4.
Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Worek, W.: Preliminary face recognition grand challenge results. In: 7th International Conference on Automatic Face and Gesture Recognition, pp. 15–24 (2006)
5.
Turk, M., Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–86 (1991)CrossRef
6.
Hua, G., Akbarzadeh, A.: A robust elastic and partial matching metric for face recognition. In: IEEE 12th ICCV, pp. 2082–2089 (2009)
7.
Taigman, Y., Wolf, L., Hassner, T. et al.: Multiple one-shots for utilizing class label information. In: BMVC, pp. 1–12 (2009)
8.
Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)MathSciNetCrossRef
9.
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
10.
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-Up Robust Features (SURF). Comput. Vis. Image Underst. 110, 346–359 (2008)
11.
Vu, N.-S., Dee, H.M., Caplier, A.: Face recognition using the POEM descriptor. Pattern Recogn. 45(7), 2478–2488 (2012)CrossRef
12.
Chu, B., Romdhani, S., Chen, L.: 3D-aided face recognition robust to expression and pose variations. In: CVPR, pp. 1907–1914. IEEE (2014)
13.
Bowyer, K.W., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition. Comput. Vis. Image Underst. 101(1), 1–15 (2006)CrossRef
14.
Fanelli, G., Gall, J., Van Gool, L.: Real time head pose estimation with random regression forests. In: 2011 CVPR, pp. 617–624 (2011)
15.
Munaro, M., Fossati, A., Basso, A., Menegatti, E., Van Gool, L.: One-shot person re-identification with a consumer depth camera. In: Person Re-Identification, pp. 161–181. Springer (2014)
16.
Dantone, M., Gall, J., Fanelli, G., Van Gool, L.: Real-time facial feature detection using conditional regression forests. In: CVPR, pp. 2578–2585. IEEE (2012)
17.
Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (FPFH) for 3D registration. In: ICRA, pp. 3212–3217. IEEE (2009)
18.
Hsu, C.-W., Lin, C.-J.: A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Netw. 13(2), 415–425 (2002)CrossRef
19.
Fanelli, G., Dantone, M., Gall, J., Fossati, A., Van Gool, L.: Random forests for real time 3D face analysis. Int. J. Comput. Vis. 101(3), 437–458 (2013)CrossRef
Metadata
Title
Depth-Based Frontal View Generation for Pose Invariant Face Recognition with Consumer RGB-D Sensors
Authors
Giorgia Pitteri
Matteo Munaro
Emanuele Menegatti
Copyright Year
2017
Book
Intelligent Autonomous Systems 14

Print ISBN: 978-3-319-48035-0

Electronic ISBN: 978-3-319-48036-7

Copyright Year: 2017

DOI
https://doi.org/10.1007/978-3-319-48036-7_67

Premium Partner

    Image Credits