Skip to main content
Top

2013 | OriginalPaper | Chapter

Facial Expression Recognition Using Diffeomorphic Image Registration Framework

Authors : Bartlomiej W. Papiez, Bogdan J. Matuszewski, Lik-Kwan Shark, Wei Quan

Published in: Mathematical Methodologies in Pattern Recognition and Machine Learning

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a new method for facial expression modelling and recognition based on diffeomorphic image registration parameterised via stationary velocity fields in the log-Euclidean framework. The validation and comparison are done using different statistical shape models (SSM) built using the Point Distribution Model (PDM), velocity fields and deformation fields. The obtained results show that the facial expression representation based on stationary velocity fields can be successfully utilised in facial expression recognition, and this parameterisation produces a higher recognition rate than the facial expression representation based on deformation fields.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Arsigny, V., Commowick, O., Pennec, X., Ayache, N.: A Log-Euclidean framework for statistics on diffeomorphisms. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) Proceedings of the 9th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Part I. Lecture Notes in Computer Science, 4190, 924–931. Springer (2006). ISBN 3-540-44707-5 Arsigny, V., Commowick, O., Pennec, X., Ayache, N.: A Log-Euclidean framework for statistics on diffeomorphisms. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) Proceedings of the 9th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Part I. Lecture Notes in Computer Science, 4190, 924–931. Springer (2006). ISBN 3-540-44707-5
2.
go back to reference Ashburner, J.: A fast diffeomorphic image registration algorithm. NeuroImage 38(1), 95–113 (2007)CrossRef Ashburner, J.: A fast diffeomorphic image registration algorithm. NeuroImage 38(1), 95–113 (2007)CrossRef
3.
go back to reference Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real time face detection and facial expression recognition: development and applications to human computer interaction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2003 (CVPRW ’03). doi:10.1109/CVPRW.2003.10057 Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real time face detection and facial expression recognition: development and applications to human computer interaction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2003 (CVPRW ’03). doi:10.1109/CVPRW.2003.10057
4.
go back to reference Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer New York, Inc., Secaucus (2006) Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer New York, Inc., Secaucus (2006)
5.
go back to reference Bossa, M., Hernandez, M., Olmos, S.: Contributions to 3D diffeomorphic atlas estimation: application to brain images. In: Ayache, N., Ourselin, S., Maeder, A.J. (eds.) Proceedings of the 10th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Part I. Lecture Notes in Computer Science, 4791, 667–674. Springer (2007). ISBN 978-3-540-75756-6 Bossa, M., Hernandez, M., Olmos, S.: Contributions to 3D diffeomorphic atlas estimation: application to brain images. In: Ayache, N., Ourselin, S., Maeder, A.J. (eds.) Proceedings of the 10th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Part I. Lecture Notes in Computer Science, 4791, 667–674. Springer (2007). ISBN 978-3-540-75756-6
6.
go back to reference Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models – their training and application. Comput. Vision Image Understand. 61, 38–59 (1995)CrossRef Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models – their training and application. Comput. Vision Image Understand. 61, 38–59 (1995)CrossRef
7.
go back to reference Fasel, B., Luettin, J.: Automatic facial expression analysis: A survey. Pattern Recogn. 36(1), 259–275 (2003)MATHCrossRef Fasel, B., Luettin, J.: Automatic facial expression analysis: A survey. Pattern Recogn. 36(1), 259–275 (2003)MATHCrossRef
8.
go back to reference Geng, X., Christensen, G.E., Gu, H., Ross, T.J., Yang, Y.: Implicit reference-based group-wise image registration and its application to structural and functional MRI. Neuroimage 47(4), 1341–1351 (2009)CrossRef Geng, X., Christensen, G.E., Gu, H., Ross, T.J., Yang, Y.: Implicit reference-based group-wise image registration and its application to structural and functional MRI. Neuroimage 47(4), 1341–1351 (2009)CrossRef
9.
go back to reference Han, X., Hibbard, L.S., Willcut, V.: An efficient inverse-consistent diffeomorphic image registration method for prostate adaptive radiotherapy. In: Madabhushi, A., Dowling, J., Yan, P., Fenster, A., Abolmaesumi, P., Hata, N. (eds.) Prostate Cancer Imaging. Computer-Aided Diagnosis, Prognosis, and Intervention – International Workshop, Held in Conjunction with MICCAI 2010, Beijing. Lecture Notes in Computer Science, 6367, 34–41. Springer (2010). ISBN 978-3-642-15988-6 Han, X., Hibbard, L.S., Willcut, V.: An efficient inverse-consistent diffeomorphic image registration method for prostate adaptive radiotherapy. In: Madabhushi, A., Dowling, J., Yan, P., Fenster, A., Abolmaesumi, P., Hata, N. (eds.) Prostate Cancer Imaging. Computer-Aided Diagnosis, Prognosis, and Intervention – International Workshop, Held in Conjunction with MICCAI 2010, Beijing. Lecture Notes in Computer Science, 6367, 34–41. Springer (2010). ISBN 978-3-642-15988-6
10.
go back to reference Hsieh, C.K., Lai, S.H., Chen, Y.C.: An optical flow-based approach to robust face recognition under expression variations. IEEE Trans. Image Process. 19(1), 233–240 (2010)MathSciNetCrossRef Hsieh, C.K., Lai, S.H., Chen, Y.C.: An optical flow-based approach to robust face recognition under expression variations. IEEE Trans. Image Process. 19(1), 233–240 (2010)MathSciNetCrossRef
11.
go back to reference Kobayashi, H., Hara, F.: Facial interaction between animated 3D face robot and human beings. In: Proceedings of the IEEE International Systems, Man, and Cybernetics Computational Cybernetics and Simulation Conference, 4, 3732–3737 (1997). doi:10.1109/ICSMC.1997.633250CrossRef Kobayashi, H., Hara, F.: Facial interaction between animated 3D face robot and human beings. In: Proceedings of the IEEE International Systems, Man, and Cybernetics Computational Cybernetics and Simulation Conference, 4, 3732–3737 (1997). doi:10.1109/ICSMC.1997.633250CrossRef
12.
go back to reference Matuszewski, B.J., Quan, W., Shark, L.-K. Facial expression recognition. In: Albert, M (ed.) Biometrics – Unique and Diverse Applications in Nature, Science, and Technology. InTech, Rijeka (2011). doi:10.5772/16033, ISBN 978-953-307-187-9 Matuszewski, B.J., Quan, W., Shark, L.-K. Facial expression recognition. In: Albert, M (ed.) Biometrics – Unique and Diverse Applications in Nature, Science, and Technology. InTech, Rijeka (2011). doi:10.5772/16033, ISBN 978-953-307-187-9
13.
go back to reference Matuszewski, B.J., Quan, W., Shark, L.-K.: High-resolution comprehensive 3-d dynamic database for facial articulation analysis. In: Proceedings of the IEEE International Computer Vision Workshops (ICCV Workshops) Conference, pp. 2128–2135 (2011) Matuszewski, B.J., Quan, W., Shark, L.-K.: High-resolution comprehensive 3-d dynamic database for facial articulation analysis. In: Proceedings of the IEEE International Computer Vision Workshops (ICCV Workshops) Conference, pp. 2128–2135 (2011)
14.
go back to reference Pantic, M., Member, S., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: The state of the art. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1424–1445 (2000)CrossRef Pantic, M., Member, S., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: The state of the art. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1424–1445 (2000)CrossRef
15.
go back to reference Papiez, B.W., Matuszewski, B.J.: Direct inverse deformation field approach to pelvic-area symmetric image registration. In: Proceedings of the Conference on Medical Image Understanding and Analysis (MIUA’2011), pp. 193–197. British Machine Vision Association Press (2011) Papiez, B.W., Matuszewski, B.J.: Direct inverse deformation field approach to pelvic-area symmetric image registration. In: Proceedings of the Conference on Medical Image Understanding and Analysis (MIUA’2011), pp. 193–197. British Machine Vision Association Press (2011)
16.
go back to reference Papiez, B.W., Matuszewski, B.J., Shark, L.-K., Quan, W.: Facial expression recognition using Log-Euclidean statistical shape models. In: Carmona, P.L., Sánchez, J.S., Fred, A.L.N. (eds.) Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods (ICPRAM 2012), Vilamoura, Algarve, 1, 351–359. SciTePress (2012). ISBN 978-989-8425-98-0 Papiez, B.W., Matuszewski, B.J., Shark, L.-K., Quan, W.: Facial expression recognition using Log-Euclidean statistical shape models. In: Carmona, P.L., Sánchez, J.S., Fred, A.L.N. (eds.) Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods (ICPRAM 2012), Vilamoura, Algarve, 1, 351–359. SciTePress (2012). ISBN 978-989-8425-98-0
17.
go back to reference Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: 3-D facial expression representation using B-spline statistical shape model. In: Proceeding of the Vision, Video and Graphics Workshop, Warwich. British Machine Vision Association Press (2007) Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: 3-D facial expression representation using B-spline statistical shape model. In: Proceeding of the Vision, Video and Graphics Workshop, Warwich. British Machine Vision Association Press (2007)
18.
go back to reference Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: Low dimensional surface parameterisation with applications in biometrics. In: Proceedings of the International Conference on Medical Information Visualisation – BioMedical Visualisation, pp. 15–22. IEEE Computer Society, Silver Spring (2007) Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: Low dimensional surface parameterisation with applications in biometrics. In: Proceedings of the International Conference on Medical Information Visualisation – BioMedical Visualisation, pp. 15–22. IEEE Computer Society, Silver Spring (2007)
19.
go back to reference Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: Facial expression biometrics using statistical shape models. EURASIP J. Adv. Signal Process. 2009, 15:4–15:4 (2009) Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: Facial expression biometrics using statistical shape models. EURASIP J. Adv. Signal Process. 2009, 15:4–15:4 (2009)
20.
go back to reference Quan, W., Matuszewski, B.J., Shark, L.-K.: Improved 3-D facial representation through statistical shape model. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2010), Hong Kong, pp. 2433–2436. IEEE (2010). ISBN 978-1-4244-7994-8 Quan, W., Matuszewski, B.J., Shark, L.-K.: Improved 3-D facial representation through statistical shape model. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2010), Hong Kong, pp. 2433–2436. IEEE (2010). ISBN 978-1-4244-7994-8
21.
go back to reference Shan, C., Gong, S., McOwan, P.W.: Robust facial expression recognition using local binary patterns. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2005), Genoa, 2, 370–373. IEEE (2005) Shan, C., Gong, S., McOwan, P.W.: Robust facial expression recognition using local binary patterns. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2005), Genoa, 2, 370–373. IEEE (2005)
22.
go back to reference Song, J.H., Christensen, G.E., Hawley, J.A., Wei, Y., Kuhl, J.G.: Evaluating image registration using NIREP. In: Fischer, B., Dawant, B.M., Lorenz, C. (eds.) Proceedings of the 4th International Workshop on Biomedical Image Registration (WBIR 2010), Lbeck. Lecture Notes in Computer Science, 6204, 140–150. Springer (2010). ISBN 978-3-642-14365-6 Song, J.H., Christensen, G.E., Hawley, J.A., Wei, Y., Kuhl, J.G.: Evaluating image registration using NIREP. In: Fischer, B., Dawant, B.M., Lorenz, C. (eds.) Proceedings of the 4th International Workshop on Biomedical Image Registration (WBIR 2010), Lbeck. Lecture Notes in Computer Science, 6204, 140–150. Springer (2010). ISBN 978-3-642-14365-6
23.
go back to reference Tian, Y.L., Kanade, T., Cohn, J.F.: Facial expression analysis. In: Handbook of Face Recognition. Springer, Berlin (2011) Tian, Y.L., Kanade, T., Cohn, J.F.: Facial expression analysis. In: Handbook of Face Recognition. Springer, Berlin (2011)
24.
go back to reference Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Symmetric log-domain diffeomorphic registration: A demons-based approach. In: Proceedings of the 11th International Conference on Medical Image Computing and Computer-Assisted Intervention – Part I. MICCAI ’08, pp. 754–761 (2008) Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Symmetric log-domain diffeomorphic registration: A demons-based approach. In: Proceedings of the 11th International Conference on Medical Image Computing and Computer-Assisted Intervention – Part I. MICCAI ’08, pp. 754–761 (2008)
25.
go back to reference Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic demons: Efficient non-parametric image registration. NeuroImage 45(1, Supp.1), S61–S72 (2009) Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic demons: Efficient non-parametric image registration. NeuroImage 45(1, Supp.1), S61–S72 (2009)
26.
go back to reference Wang, J., Yin, L.: Static topographic modeling for facial expression recognition and analysis. Comput. Vision Image Understand. 108(1–2), 19–34 (2007)CrossRef Wang, J., Yin, L.: Static topographic modeling for facial expression recognition and analysis. Comput. Vision Image Understand. 108(1–2), 19–34 (2007)CrossRef
27.
go back to reference Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.J.: A 3D facial expression database for facial behavior research. In: Seventh IEEE International Conference on Automatic Face and Gesture Recognition (FG 2006), Southampton, pp. 211–216. IEEE Computer Society (2006). ISBN 0-7695-2503-2 Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.J.: A 3D facial expression database for facial behavior research. In: Seventh IEEE International Conference on Automatic Face and Gesture Recognition (FG 2006), Southampton, pp. 211–216. IEEE Computer Society (2006). ISBN 0-7695-2503-2
Metadata
Title
Facial Expression Recognition Using Diffeomorphic Image Registration Framework
Authors
Bartlomiej W. Papiez
Bogdan J. Matuszewski
Lik-Kwan Shark
Wei Quan
Copyright Year
2013
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-5076-4_12