Skip to main content
Top
Published in: KI - Künstliche Intelligenz 4/2019

08-05-2019 | Technical Contribution

Reg3DFacePtCd: Registration of 3D Point Clouds Using a Common Set of Landmarks for Alignment of Human Face Images

Published in: KI - Künstliche Intelligenz | Issue 4/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The present work proposes a new method Reg3DFacePtCd for registration of point clouds. The key contribution of the present method is that an unknown face in 3D point cloud form is given to the system and is registered to the already existing known 3D face point clouds using a fast 3D face registration method. The novelty of the present technique is that at first the alignment and registration parameters are found out by initially registering eight key points of the unknown source model to that of the known model. Next, the rest of the point clouds of the unknown model are registered to that of the known model using the same parameters found as above. The main method used for alignment is iterative closest point (ICP) using point-based technique followed by registration in the least squares sense. Mainly there are two significant contributions. Firstly, we have developed a new mathematical model facial landmark point based model across poses to obtain the target or the known model to which all the unknown models will be registered. Secondly, a novel way to accelerate point cloud matching by reducing the number of points has been proposed. Using a small number of points necessarily would speed up the registration process but may inculcate errors. So, to determine the registration quality of the fundamental eight key points on which the entire registration process is based, a new robust metric namely ICV (ICP certainty vector) consisting of several key components have been used. Finally, we have addressed several important face registration issues like pre-processing, convergence and quality of registration of the entire facial point cloud based on the eight key points. Extensive experimentation on Frav3D, GavabDB, and the Bosphorus databases on a high-performance computing environment show the novelty and robustness of the method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

KI - Künstliche Intelligenz

The Scientific journal "KI – Künstliche Intelligenz" is the official journal of the division for artificial intelligence within the "Gesellschaft für Informatik e.V." (GI) – the German Informatics Society - with constributions from troughout the field of artificial intelligence.

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Liu Y, Zhou W, Yang Z, Deng J, Liu L (2014) Globally consistent rigid registration. Graph Models 76(5):542–553CrossRef Liu Y, Zhou W, Yang Z, Deng J, Liu L (2014) Globally consistent rigid registration. Graph Models 76(5):542–553CrossRef
2.
go back to reference Kakadiaris IA, Passalis G, Toderici G, Murtuza MN, Lu Y, Karampatziakis N, Theoharis T (2007) Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans Pattern Anal Mach Intell 29(4):640–649CrossRef Kakadiaris IA, Passalis G, Toderici G, Murtuza MN, Lu Y, Karampatziakis N, Theoharis T (2007) Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans Pattern Anal Mach Intell 29(4):640–649CrossRef
3.
go back to reference Papatheodorou T, Rueckert D (2005). Evaluation of 3D face recognition using registration and pca. In: 5th international conference on audio and video-based biometric person authentication (AVBPA 2005), pp 997–1009 Papatheodorou T, Rueckert D (2005). Evaluation of 3D face recognition using registration and pca. In: 5th international conference on audio and video-based biometric person authentication (AVBPA 2005), pp 997–1009
4.
go back to reference Salah AA, Alyuz N, Akarun L (2008) Registration of three-dimensional face scans with average face models. J Electron Imaging 17(1):1–14 Salah AA, Alyuz N, Akarun L (2008) Registration of three-dimensional face scans with average face models. J Electron Imaging 17(1):1–14
5.
go back to reference Liu X (2009) Discriminative face alignment. IEEE Trans Pattern Anal Mach Intell 31(11):1941–1954CrossRef Liu X (2009) Discriminative face alignment. IEEE Trans Pattern Anal Mach Intell 31(11):1941–1954CrossRef
6.
go back to reference Yang F, Huang J, Metaxas D (2011) Sparse shape registration for occluded facial feature localization. In: Face and gesture. IEEE, pp 272–277 Yang F, Huang J, Metaxas D (2011) Sparse shape registration for occluded facial feature localization. In: Face and gesture. IEEE, pp 272–277
8.
go back to reference Qu C, Monari E, Schuchert T, Beyerer J (2015) Adaptive contour fitting for pose-invariant 3D face shape reconstruction. In: Xie X, Jones MW, Tam GKL (eds) Proceedings of the British machine vision conference (BMVC). BMVA Press, pp 87.1–87.12 Qu C, Monari E, Schuchert T, Beyerer J (2015) Adaptive contour fitting for pose-invariant 3D face shape reconstruction. In: Xie X, Jones MW, Tam GKL (eds) Proceedings of the British machine vision conference (BMVC). BMVA Press, pp 87.1–87.12
9.
go back to reference Perakis P (2010) 3D facial landmark detection & face registration a 3D facial landmark model & 3D local shape descriptors approach. CGL Technical Report, No. TP-2010-01 Perakis P (2010) 3D facial landmark detection & face registration a 3D facial landmark model & 3D local shape descriptors approach. CGL Technical Report, No. TP-2010-01
10.
go back to reference Passalis G, Perakis P, Theoharis T, Kakadiaris IA (2011) Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Trans Pattern Anal Mach Intell 33(10):1938–1951CrossRef Passalis G, Perakis P, Theoharis T, Kakadiaris IA (2011) Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Trans Pattern Anal Mach Intell 33(10):1938–1951CrossRef
11.
go back to reference Nair P, Cavallaro A (2008) Registration and retrieval of 3D faces using a point distribution model. In: IEEE international conference on shape modeling and applications Nair P, Cavallaro A (2008) Registration and retrieval of 3D faces using a point distribution model. In: IEEE international conference on shape modeling and applications
12.
go back to reference Amberg B, Knothe R, Vetter T (2008) Expression invariant 3D face recognition with a morphable model. In: IEEE international conference on automatic face & gesture recognition Amberg B, Knothe R, Vetter T (2008) Expression invariant 3D face recognition with a morphable model. In: IEEE international conference on automatic face & gesture recognition
13.
go back to reference Wang X, Ruan Q, Jin Y, An G (2014) Three-dimensional face recognition under expression variation. EURASIP J Image Video Process 2014(1):51CrossRef Wang X, Ruan Q, Jin Y, An G (2014) Three-dimensional face recognition under expression variation. EURASIP J Image Video Process 2014(1):51CrossRef
14.
go back to reference Stormer A, Rigoll G (2008) A multi-step alignment scheme for face recognition in range images. In: 15th IEEE international conference on image processing Stormer A, Rigoll G (2008) A multi-step alignment scheme for face recognition in range images. In: 15th IEEE international conference on image processing
15.
go back to reference Lee B, Lee DD (2016) Learning anisotropic ICP (LA-ICP) for robust and efficient 3D registration. In: IEEE international conference on robotics and automation (ICRA) Lee B, Lee DD (2016) Learning anisotropic ICP (LA-ICP) for robust and efficient 3D registration. In: IEEE international conference on robotics and automation (ICRA)
16.
go back to reference Ping Y, Bowyer KW (2007) A fast algorithm for ICP-based 3D shape biometrics. Comput Vis Image Underst 107(3):195–202CrossRef Ping Y, Bowyer KW (2007) A fast algorithm for ICP-based 3D shape biometrics. Comput Vis Image Underst 107(3):195–202CrossRef
17.
go back to reference Lu X, Colbry D, Jain AK (2004) Three-dimensional model based face recognition. In: Proceedings of ICPR Lu X, Colbry D, Jain AK (2004) Three-dimensional model based face recognition. In: Proceedings of ICPR
18.
go back to reference Lu X, Jain AK, Colbry D (2006) Matching 2.5D Face Scans to 3D Models. IEEE Trans Pattern Anal Mach Intell 28(1):31–43CrossRef Lu X, Jain AK, Colbry D (2006) Matching 2.5D Face Scans to 3D Models. IEEE Trans Pattern Anal Mach Intell 28(1):31–43CrossRef
19.
go back to reference Hermans J, Smeets D, Vandermeulen D, Suetens P (2011) Robust point set registration using EM-ICP with information-theoretically optimal outlier handling. In: CVPR. IEEE, pp 2465–2472 Hermans J, Smeets D, Vandermeulen D, Suetens P (2011) Robust point set registration using EM-ICP with information-theoretically optimal outlier handling. In: CVPR. IEEE, pp 2465–2472
20.
go back to reference Pavlov AL, Ovchinnikov GW, Derbyshev DY, Tsetserukou D, Oseledets IV (2018) AA-ICP: iterative closest point with anderson acceleration. In: IEEE international conference on robotics and automation, ICRA, pp 1–6 Pavlov AL, Ovchinnikov GW, Derbyshev DY, Tsetserukou D, Oseledets IV (2018) AA-ICP: iterative closest point with anderson acceleration. In: IEEE international conference on robotics and automation, ICRA, pp 1–6
22.
go back to reference Gilani SZ, Shafait F, Mian A (2013) Biologically significant facial landmarks: how significant are they for gender classification? In: International conference on digital image computing: techniques and applications (DICTA), Hobart, TAS, pp 1–8 Gilani SZ, Shafait F, Mian A (2013) Biologically significant facial landmarks: how significant are they for gender classification? In: International conference on digital image computing: techniques and applications (DICTA), Hobart, TAS, pp 1–8
23.
go back to reference Mora H, Mora PJM, Garcia-Garcia A, Martinez Gonzalez P (2016) Computational analysis of distance operators for the iterative closest point algorithm. PLoS One 11(10):1–19CrossRef Mora H, Mora PJM, Garcia-Garcia A, Martinez Gonzalez P (2016) Computational analysis of distance operators for the iterative closest point algorithm. PLoS One 11(10):1–19CrossRef
24.
go back to reference Liu Y, Martin RR, Chen L, Ren X, Li L (2016 first online) Rigid registration. In: Ikeuchi K (ed) Computer vision. Springer, Boston, MA Liu Y, Martin RR, Chen L, Ren X, Li L (2016 first online) Rigid registration. In: Ikeuchi K (ed) Computer vision. Springer, Boston, MA
25.
go back to reference Besl PJ, McKay ND (1992) Method for registration of 3-D shapes. In: Sensor fusion IV: control paradigms and data structures, vol 1611. International society for optics and photonics Besl PJ, McKay ND (1992) Method for registration of 3-D shapes. In: Sensor fusion IV: control paradigms and data structures, vol 1611. International society for optics and photonics
26.
go back to reference Kaiser M, Stormer A, Arsic D, Rigoll G (2009) Non-rigid registration of 3D facial surfaces with robust outlier detection. In: Workshop on applications of computer vision Kaiser M, Stormer A, Arsic D, Rigoll G (2009) Non-rigid registration of 3D facial surfaces with robust outlier detection. In: Workshop on applications of computer vision
27.
go back to reference Bouaziz S, Pauly M (2013) Dynamic 2D/3D registration for the kinect. SIGGRPAH 2013 Course Note Bouaziz S, Pauly M (2013) Dynamic 2D/3D registration for the kinect. SIGGRPAH 2013 Course Note
28.
go back to reference Robert Li H, Summer W, Pauly M (2008) Global correspondence optimization for non-rigid registration of depth scans. In: Eurographics symposium on geometry processing Robert Li H, Summer W, Pauly M (2008) Global correspondence optimization for non-rigid registration of depth scans. In: Eurographics symposium on geometry processing
29.
go back to reference Naveen S, Rugmini KP, Moni RS (2016) 3D face reconstruction by pose correction, patch cloning and texture wrapping. In: International conference on communication systems and networks, pp 112–116 Naveen S, Rugmini KP, Moni RS (2016) 3D face reconstruction by pose correction, patch cloning and texture wrapping. In: International conference on communication systems and networks, pp 112–116
30.
go back to reference Naveen S, Moni RS (2015) A robust novel method for face recognition from 2D depth images using DWT and DCT fusion. Proc Comput Sci 46:1518–1528CrossRef Naveen S, Moni RS (2015) A robust novel method for face recognition from 2D depth images using DWT and DCT fusion. Proc Comput Sci 46:1518–1528CrossRef
31.
go back to reference Conde C, Serrano A, Cabello E (2006) Multimodal 2D, 2.5 D and 3D face verification. In: IEEE international conference on image processing, pp 2061–2064 Conde C, Serrano A, Cabello E (2006) Multimodal 2D, 2.5 D and 3D face verification. In: IEEE international conference on image processing, pp 2061–2064
32.
go back to reference Nair P, Cavallaro A (2009) 3D face detection, landmark localization, and registration using a point distribution model. IEEE Trans Multimed 11(4):611–623CrossRef Nair P, Cavallaro A (2009) 3D face detection, landmark localization, and registration using a point distribution model. IEEE Trans Multimed 11(4):611–623CrossRef
33.
go back to reference Mahoora MH, Mottalebb MA (2009) Face recognition based on 3D ridge images obtained from range data. In: Pattern recognition, pp 445–451CrossRef Mahoora MH, Mottalebb MA (2009) Face recognition based on 3D ridge images obtained from range data. In: Pattern recognition, pp 445–451CrossRef
34.
go back to reference Maes C, Fabry T, Keustermans J, Smeets D, Suetens P, Vandermeulen D (2010) Feature detection on 3D face surfaces for pose normalisation and recognition. In: 4th IEEE international conference on biometrics: theory applications and systems, pp 1–6 Maes C, Fabry T, Keustermans J, Smeets D, Suetens P, Vandermeulen D (2010) Feature detection on 3D face surfaces for pose normalisation and recognition. In: 4th IEEE international conference on biometrics: theory applications and systems, pp 1–6
35.
go back to reference Bouaziz S, Tagliasachhi A, Pauly M (2013) Sparse iterative closest point. In: Eurographics symposium on geometry processing Bouaziz S, Tagliasachhi A, Pauly M (2013) Sparse iterative closest point. In: Eurographics symposium on geometry processing
36.
go back to reference Sagawa R, Akasaka K, Yagi Y, Hammer H, Gool LV (2009) Elastic convolved ICP for the registration of deformable objects. In: 12th IEEE international conference on computer vision workshops, Japan Sagawa R, Akasaka K, Yagi Y, Hammer H, Gool LV (2009) Elastic convolved ICP for the registration of deformable objects. In: 12th IEEE international conference on computer vision workshops, Japan
37.
go back to reference Hu Y, Liu W (2013) 3D face recognition based on MPU implicits. IEICE Trans Inf Syst 96(9):2174–2176CrossRef Hu Y, Liu W (2013) 3D face recognition based on MPU implicits. IEICE Trans Inf Syst 96(9):2174–2176CrossRef
38.
39.
go back to reference Li F, Stoddart D, Hitchens C (2017) Method to automatically register scattered point clouds based on principal pose estimation. Opt Eng 56(4):1–10 Li F, Stoddart D, Hitchens C (2017) Method to automatically register scattered point clouds based on principal pose estimation. Opt Eng 56(4):1–10
Metadata
Title
Reg3DFacePtCd: Registration of 3D Point Clouds Using a Common Set of Landmarks for Alignment of Human Face Images
Publication date
08-05-2019
Published in
KI - Künstliche Intelligenz / Issue 4/2019
Print ISSN: 0933-1875
Electronic ISSN: 1610-1987
DOI
https://doi.org/10.1007/s13218-019-00593-2

Other articles of this Issue 4/2019

KI - Künstliche Intelligenz 4/2019 Go to the issue

Technical Contribution

SocRob@Home

Premium Partner