Skip to main content
Top

2016 | OriginalPaper | Chapter

Nose Tip Detection and Face Localization from Face Range Image Based on Multi-angle Energy

Authors : Jian Liu, Quan Zhang, Chaojing Tang

Published in: E-Learning and Games

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a novel method to detect nose tip and localize face from face range image. The nose tip detection procedure of the method is based on the idea of Multi-angle Energy (ME) and works in scale-space. The face localization procedure of the method is based on the position of the nose tip and a modified version of Multi-angle Energy. The scale-space is established by robust smoothing the input face range image. In the nose tip detection procedure, for each scale of the scale-space, we compute the Multi-angle Energy for each point of the face range image. For the points whose values of ME are not equal to zero, hierarchical clustering method is used to cluster them into several clusters. In the obtained first h largest clusters, we can find a nose tip candidate by using a cascading scheme. For all scales of the scale-space, we get a series of nose tip candidates. We apply hierarchical clustering again for them. Nose tip can be found in the largest cluster. In the face localization procedure, we present a modified version of ME. With the modified ME, we use a similar cascading scheme to detect one endocanthion for the input face range image. Based on the distance between nose tip and endocanthion, face localization is achieved by using a sphere which is centered on the nose tip to crop the face region. We evaluate our method on two well-known 3D face databases, namely FRGC v2.0 and BOSPHORUS, and compare our method with other state-of-the-art methods. The experimental results show that the nose tip detection rates of our method are higher than those of the state-of-the-art methods. The face localization results are fine and can adapt to the face scale variance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chang, K.I., Bowyer, W., Flynn, P.J.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1695–1700 (2006)CrossRef Chang, K.I., Bowyer, W., Flynn, P.J.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1695–1700 (2006)CrossRef
2.
go back to reference Colbry, D., Stockman, G., Jain, A.: Detection of anchor points for 3D face verification. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, CVPR Workshops, p. 118. IEEE (2005) Colbry, D., Stockman, G., Jain, A.: Detection of anchor points for 3D face verification. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, CVPR Workshops, p. 118. IEEE (2005)
3.
go back to reference Colombo, A., Cusano, C., Schettini, R.: 3D face detection using curvature analysis. Pattern Recogn. 39(3), 444–455 (2006)CrossRefMATH Colombo, A., Cusano, C., Schettini, R.: 3D face detection using curvature analysis. Pattern Recogn. 39(3), 444–455 (2006)CrossRefMATH
4.
go back to reference Faltemier, T.C., Bowyer, K.W., Flynn, P.J.: A region ensemble for 3-D face recognition. IEEE Trans. Inf. Forensics Secur. 3(1), 62–73 (2008)CrossRef Faltemier, T.C., Bowyer, K.W., Flynn, P.J.: A region ensemble for 3-D face recognition. IEEE Trans. Inf. Forensics Secur. 3(1), 62–73 (2008)CrossRef
5.
go back to reference Garcia, D.: Robust smoothing of gridded data in one and higher dimensions with missing values. Comput. Stat. Data Anal. 54(4), 1167–1178 (2010)MathSciNetCrossRefMATH Garcia, D.: Robust smoothing of gridded data in one and higher dimensions with missing values. Comput. Stat. Data Anal. 54(4), 1167–1178 (2010)MathSciNetCrossRefMATH
6.
go back to reference Guo, J., Mei, X., Tang, K.: Automatic landmark annotation and dense correspondence registration for 3D human facial images. BMC Bioinform. 14(1), 232 (2013)CrossRef Guo, J., Mei, X., Tang, K.: Automatic landmark annotation and dense correspondence registration for 3D human facial images. BMC Bioinform. 14(1), 232 (2013)CrossRef
7.
go back to reference Jordan, K., Mordohai, P.: A quantitative evaluation of surface normal estimation in point clouds. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), pp. 4220–4226. IEEE (2014) Jordan, K., Mordohai, P.: A quantitative evaluation of surface normal estimation in point clouds. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), pp. 4220–4226. IEEE (2014)
8.
go back to reference Ju, Q.: Robust binary neural networks based 3D face detection and accurate face registration. Int. J. Comput. Intell. Syst. 6(4), 669–683 (2013)CrossRef Ju, Q.: Robust binary neural networks based 3D face detection and accurate face registration. Int. J. Comput. Intell. Syst. 6(4), 669–683 (2013)CrossRef
9.
go back to reference Li, D., Pedrycz, W.: A central profile-based 3D face pose estimation. Pattern Recogn. 47(2), 525–534 (2014)CrossRef Li, D., Pedrycz, W.: A central profile-based 3D face pose estimation. Pattern Recogn. 47(2), 525–534 (2014)CrossRef
10.
go back to reference Li, Y., Wang, Y., Wang, B., Sui, L.: Nose tip detection on three-dimensional faces using pose-invariant differential surface features. IET Comput. Vis. 9(1), 75–84 (2014)CrossRef Li, Y., Wang, Y., Wang, B., Sui, L.: Nose tip detection on three-dimensional faces using pose-invariant differential surface features. IET Comput. Vis. 9(1), 75–84 (2014)CrossRef
11.
go back to reference Liu, J., Zhang, Q., Zhang, C., Tang, C.: Robust nose tip detection for face range images based on local features in scale-space. In: 2015 International Conference on 3D Imaging (IC3D), pp. 1–8. IEEE (2015) Liu, J., Zhang, Q., Zhang, C., Tang, C.: Robust nose tip detection for face range images based on local features in scale-space. In: 2015 International Conference on 3D Imaging (IC3D), pp. 1–8. IEEE (2015)
12.
go back to reference Liu, P., Wang, Y., Zhang, Z.: Representing 3D face from point cloud to face-aligned spherical depth map. Int. J. Pattern Recogn. Artif. Intell. 26(01), 1255003 (2012)MathSciNetCrossRef Liu, P., Wang, Y., Zhang, Z.: Representing 3D face from point cloud to face-aligned spherical depth map. Int. J. Pattern Recogn. Artif. Intell. 26(01), 1255003 (2012)MathSciNetCrossRef
13.
go back to reference Mian, A., Bennamoun, M., Owens, R.: Automatic 3D face detection, normalization and recognition. In: Third International Symposium on v3D Data Processing, Visualization, and Transmission, pp. 735–742. IEEE (2006) Mian, A., Bennamoun, M., Owens, R.: Automatic 3D face detection, normalization and recognition. In: Third International Symposium on v3D Data Processing, Visualization, and Transmission, pp. 735–742. IEEE (2006)
14.
go back to reference Mian, A.S., Bennamoun, M., Owens, R.: An efficient multimodal 2D–3D hybrid approach to automatic face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29(11), 1927–1943 (2007)CrossRef Mian, A.S., Bennamoun, M., Owens, R.: An efficient multimodal 2D–3D hybrid approach to automatic face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29(11), 1927–1943 (2007)CrossRef
15.
go back to reference Nair, P., Cavallaro, A.: 3-D face detection, landmark localization, and registration using a point distribution model. IEEE Trans. Multimedia 11(4), 611–623 (2009)CrossRef Nair, P., Cavallaro, A.: 3-D face detection, landmark localization, and registration using a point distribution model. IEEE Trans. Multimedia 11(4), 611–623 (2009)CrossRef
16.
go back to reference Pears, N., Heseltine, T., Romero, M.: From 3D point clouds to pose-normalised depth maps. Int. J. Comput. Vis. 89(2–3), 152–176 (2010)CrossRef Pears, N., Heseltine, T., Romero, M.: From 3D point clouds to pose-normalised depth maps. Int. J. Comput. Vis. 89(2–3), 152–176 (2010)CrossRef
17.
go back to reference Peng, X., Bennamoun, M., Mian, A.S.: A training-free nose tip detection method from face range images. Pattern Recogn. 44(3), 544–558 (2011)CrossRefMATH Peng, X., Bennamoun, M., Mian, A.S.: A training-free nose tip detection method from face range images. Pattern Recogn. 44(3), 544–558 (2011)CrossRefMATH
18.
go back to reference Perakis, P., Passalis, G., Theoharis, T., Kakadiaris, I.A.: 3D facial landmark detection under large yaw and expression variations. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1552–1564 (2013)CrossRef Perakis, P., Passalis, G., Theoharis, T., Kakadiaris, I.A.: 3D facial landmark detection under large yaw and expression variations. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1552–1564 (2013)CrossRef
19.
go back to reference Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, pp. 947–954. IEEE (2005) Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, pp. 947–954. IEEE (2005)
20.
go back to reference Rokach, L., Maimon, O.: Clustering methods. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 321–352. Springer, Berlin (2005)CrossRef Rokach, L., Maimon, O.: Clustering methods. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 321–352. Springer, Berlin (2005)CrossRef
21.
go back to reference Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BIOID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008)CrossRef Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BIOID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008)CrossRef
22.
go back to reference Segundo, M.P., Silva, L., Bellon, O.R.P., Queirolo, C.: Automatic face segmentation and facial landmark detection in range images. IEEE Trans. Syst. Man Cybern. B Cybern. 40(5), 1319–1330 (2010)CrossRef Segundo, M.P., Silva, L., Bellon, O.R.P., Queirolo, C.: Automatic face segmentation and facial landmark detection in range images. IEEE Trans. Syst. Man Cybern. B Cybern. 40(5), 1319–1330 (2010)CrossRef
23.
go back to reference Werghi, N., Rahayem, M., Kjellander, J.: An ordered topological representation of 3D triangular mesh facial surface: concept and applications. EURASIP J. Adv. Sig. Process. 2012(1), 1–20 (2012)CrossRef Werghi, N., Rahayem, M., Kjellander, J.: An ordered topological representation of 3D triangular mesh facial surface: concept and applications. EURASIP J. Adv. Sig. Process. 2012(1), 1–20 (2012)CrossRef
24.
go back to reference Xu, C., Tan, T., Wang, Y., Quan, L.: Combining local features for robust nose location in 3D facial data. Pattern Recogn. Lett. 27(13), 1487–1494 (2006)CrossRef Xu, C., Tan, T., Wang, Y., Quan, L.: Combining local features for robust nose location in 3D facial data. Pattern Recogn. Lett. 27(13), 1487–1494 (2006)CrossRef
Metadata
Title
Nose Tip Detection and Face Localization from Face Range Image Based on Multi-angle Energy
Authors
Jian Liu
Quan Zhang
Chaojing Tang
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-40259-8_12

Premium Partner