Skip to main content

2013 | OriginalPaper | Buchkapitel

Facial Expression Recognition Using Diffeomorphic Image Registration Framework

verfasst von : Bartlomiej W. Papiez, Bogdan J. Matuszewski, Lik-Kwan Shark, Wei Quan

Erschienen in: Mathematical Methodologies in Pattern Recognition and Machine Learning

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a new method for facial expression modelling and recognition based on diffeomorphic image registration parameterised via stationary velocity fields in the log-Euclidean framework. The validation and comparison are done using different statistical shape models (SSM) built using the Point Distribution Model (PDM), velocity fields and deformation fields. The obtained results show that the facial expression representation based on stationary velocity fields can be successfully utilised in facial expression recognition, and this parameterisation produces a higher recognition rate than the facial expression representation based on deformation fields.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arsigny, V., Commowick, O., Pennec, X., Ayache, N.: A Log-Euclidean framework for statistics on diffeomorphisms. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) Proceedings of the 9th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Part I. Lecture Notes in Computer Science, 4190, 924–931. Springer (2006). ISBN 3-540-44707-5 Arsigny, V., Commowick, O., Pennec, X., Ayache, N.: A Log-Euclidean framework for statistics on diffeomorphisms. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) Proceedings of the 9th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2006), Copenhagen, Part I. Lecture Notes in Computer Science, 4190, 924–931. Springer (2006). ISBN 3-540-44707-5
2.
Zurück zum Zitat Ashburner, J.: A fast diffeomorphic image registration algorithm. NeuroImage 38(1), 95–113 (2007)CrossRef Ashburner, J.: A fast diffeomorphic image registration algorithm. NeuroImage 38(1), 95–113 (2007)CrossRef
3.
Zurück zum Zitat Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real time face detection and facial expression recognition: development and applications to human computer interaction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2003 (CVPRW ’03). doi:10.1109/CVPRW.2003.10057 Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real time face detection and facial expression recognition: development and applications to human computer interaction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2003 (CVPRW ’03). doi:10.1109/CVPRW.2003.10057
4.
Zurück zum Zitat Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer New York, Inc., Secaucus (2006) Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer New York, Inc., Secaucus (2006)
5.
Zurück zum Zitat Bossa, M., Hernandez, M., Olmos, S.: Contributions to 3D diffeomorphic atlas estimation: application to brain images. In: Ayache, N., Ourselin, S., Maeder, A.J. (eds.) Proceedings of the 10th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Part I. Lecture Notes in Computer Science, 4791, 667–674. Springer (2007). ISBN 978-3-540-75756-6 Bossa, M., Hernandez, M., Olmos, S.: Contributions to 3D diffeomorphic atlas estimation: application to brain images. In: Ayache, N., Ourselin, S., Maeder, A.J. (eds.) Proceedings of the 10th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2007), Brisbane, Part I. Lecture Notes in Computer Science, 4791, 667–674. Springer (2007). ISBN 978-3-540-75756-6
6.
Zurück zum Zitat Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models – their training and application. Comput. Vision Image Understand. 61, 38–59 (1995)CrossRef Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models – their training and application. Comput. Vision Image Understand. 61, 38–59 (1995)CrossRef
7.
Zurück zum Zitat Fasel, B., Luettin, J.: Automatic facial expression analysis: A survey. Pattern Recogn. 36(1), 259–275 (2003)MATHCrossRef Fasel, B., Luettin, J.: Automatic facial expression analysis: A survey. Pattern Recogn. 36(1), 259–275 (2003)MATHCrossRef
8.
Zurück zum Zitat Geng, X., Christensen, G.E., Gu, H., Ross, T.J., Yang, Y.: Implicit reference-based group-wise image registration and its application to structural and functional MRI. Neuroimage 47(4), 1341–1351 (2009)CrossRef Geng, X., Christensen, G.E., Gu, H., Ross, T.J., Yang, Y.: Implicit reference-based group-wise image registration and its application to structural and functional MRI. Neuroimage 47(4), 1341–1351 (2009)CrossRef
9.
Zurück zum Zitat Han, X., Hibbard, L.S., Willcut, V.: An efficient inverse-consistent diffeomorphic image registration method for prostate adaptive radiotherapy. In: Madabhushi, A., Dowling, J., Yan, P., Fenster, A., Abolmaesumi, P., Hata, N. (eds.) Prostate Cancer Imaging. Computer-Aided Diagnosis, Prognosis, and Intervention – International Workshop, Held in Conjunction with MICCAI 2010, Beijing. Lecture Notes in Computer Science, 6367, 34–41. Springer (2010). ISBN 978-3-642-15988-6 Han, X., Hibbard, L.S., Willcut, V.: An efficient inverse-consistent diffeomorphic image registration method for prostate adaptive radiotherapy. In: Madabhushi, A., Dowling, J., Yan, P., Fenster, A., Abolmaesumi, P., Hata, N. (eds.) Prostate Cancer Imaging. Computer-Aided Diagnosis, Prognosis, and Intervention – International Workshop, Held in Conjunction with MICCAI 2010, Beijing. Lecture Notes in Computer Science, 6367, 34–41. Springer (2010). ISBN 978-3-642-15988-6
10.
Zurück zum Zitat Hsieh, C.K., Lai, S.H., Chen, Y.C.: An optical flow-based approach to robust face recognition under expression variations. IEEE Trans. Image Process. 19(1), 233–240 (2010)MathSciNetCrossRef Hsieh, C.K., Lai, S.H., Chen, Y.C.: An optical flow-based approach to robust face recognition under expression variations. IEEE Trans. Image Process. 19(1), 233–240 (2010)MathSciNetCrossRef
11.
Zurück zum Zitat Kobayashi, H., Hara, F.: Facial interaction between animated 3D face robot and human beings. In: Proceedings of the IEEE International Systems, Man, and Cybernetics Computational Cybernetics and Simulation Conference, 4, 3732–3737 (1997). doi:10.1109/ICSMC.1997.633250CrossRef Kobayashi, H., Hara, F.: Facial interaction between animated 3D face robot and human beings. In: Proceedings of the IEEE International Systems, Man, and Cybernetics Computational Cybernetics and Simulation Conference, 4, 3732–3737 (1997). doi:10.1109/ICSMC.1997.633250CrossRef
12.
Zurück zum Zitat Matuszewski, B.J., Quan, W., Shark, L.-K. Facial expression recognition. In: Albert, M (ed.) Biometrics – Unique and Diverse Applications in Nature, Science, and Technology. InTech, Rijeka (2011). doi:10.5772/16033, ISBN 978-953-307-187-9 Matuszewski, B.J., Quan, W., Shark, L.-K. Facial expression recognition. In: Albert, M (ed.) Biometrics – Unique and Diverse Applications in Nature, Science, and Technology. InTech, Rijeka (2011). doi:10.5772/16033, ISBN 978-953-307-187-9
13.
Zurück zum Zitat Matuszewski, B.J., Quan, W., Shark, L.-K.: High-resolution comprehensive 3-d dynamic database for facial articulation analysis. In: Proceedings of the IEEE International Computer Vision Workshops (ICCV Workshops) Conference, pp. 2128–2135 (2011) Matuszewski, B.J., Quan, W., Shark, L.-K.: High-resolution comprehensive 3-d dynamic database for facial articulation analysis. In: Proceedings of the IEEE International Computer Vision Workshops (ICCV Workshops) Conference, pp. 2128–2135 (2011)
14.
Zurück zum Zitat Pantic, M., Member, S., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: The state of the art. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1424–1445 (2000)CrossRef Pantic, M., Member, S., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: The state of the art. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1424–1445 (2000)CrossRef
15.
Zurück zum Zitat Papiez, B.W., Matuszewski, B.J.: Direct inverse deformation field approach to pelvic-area symmetric image registration. In: Proceedings of the Conference on Medical Image Understanding and Analysis (MIUA’2011), pp. 193–197. British Machine Vision Association Press (2011) Papiez, B.W., Matuszewski, B.J.: Direct inverse deformation field approach to pelvic-area symmetric image registration. In: Proceedings of the Conference on Medical Image Understanding and Analysis (MIUA’2011), pp. 193–197. British Machine Vision Association Press (2011)
16.
Zurück zum Zitat Papiez, B.W., Matuszewski, B.J., Shark, L.-K., Quan, W.: Facial expression recognition using Log-Euclidean statistical shape models. In: Carmona, P.L., Sánchez, J.S., Fred, A.L.N. (eds.) Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods (ICPRAM 2012), Vilamoura, Algarve, 1, 351–359. SciTePress (2012). ISBN 978-989-8425-98-0 Papiez, B.W., Matuszewski, B.J., Shark, L.-K., Quan, W.: Facial expression recognition using Log-Euclidean statistical shape models. In: Carmona, P.L., Sánchez, J.S., Fred, A.L.N. (eds.) Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods (ICPRAM 2012), Vilamoura, Algarve, 1, 351–359. SciTePress (2012). ISBN 978-989-8425-98-0
17.
Zurück zum Zitat Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: 3-D facial expression representation using B-spline statistical shape model. In: Proceeding of the Vision, Video and Graphics Workshop, Warwich. British Machine Vision Association Press (2007) Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: 3-D facial expression representation using B-spline statistical shape model. In: Proceeding of the Vision, Video and Graphics Workshop, Warwich. British Machine Vision Association Press (2007)
18.
Zurück zum Zitat Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: Low dimensional surface parameterisation with applications in biometrics. In: Proceedings of the International Conference on Medical Information Visualisation – BioMedical Visualisation, pp. 15–22. IEEE Computer Society, Silver Spring (2007) Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: Low dimensional surface parameterisation with applications in biometrics. In: Proceedings of the International Conference on Medical Information Visualisation – BioMedical Visualisation, pp. 15–22. IEEE Computer Society, Silver Spring (2007)
19.
Zurück zum Zitat Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: Facial expression biometrics using statistical shape models. EURASIP J. Adv. Signal Process. 2009, 15:4–15:4 (2009) Quan, W., Matuszewski, B.J., Shark, L.-K., Ait-Boudaoud, D.: Facial expression biometrics using statistical shape models. EURASIP J. Adv. Signal Process. 2009, 15:4–15:4 (2009)
20.
Zurück zum Zitat Quan, W., Matuszewski, B.J., Shark, L.-K.: Improved 3-D facial representation through statistical shape model. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2010), Hong Kong, pp. 2433–2436. IEEE (2010). ISBN 978-1-4244-7994-8 Quan, W., Matuszewski, B.J., Shark, L.-K.: Improved 3-D facial representation through statistical shape model. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2010), Hong Kong, pp. 2433–2436. IEEE (2010). ISBN 978-1-4244-7994-8
21.
Zurück zum Zitat Shan, C., Gong, S., McOwan, P.W.: Robust facial expression recognition using local binary patterns. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2005), Genoa, 2, 370–373. IEEE (2005) Shan, C., Gong, S., McOwan, P.W.: Robust facial expression recognition using local binary patterns. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2005), Genoa, 2, 370–373. IEEE (2005)
22.
Zurück zum Zitat Song, J.H., Christensen, G.E., Hawley, J.A., Wei, Y., Kuhl, J.G.: Evaluating image registration using NIREP. In: Fischer, B., Dawant, B.M., Lorenz, C. (eds.) Proceedings of the 4th International Workshop on Biomedical Image Registration (WBIR 2010), Lbeck. Lecture Notes in Computer Science, 6204, 140–150. Springer (2010). ISBN 978-3-642-14365-6 Song, J.H., Christensen, G.E., Hawley, J.A., Wei, Y., Kuhl, J.G.: Evaluating image registration using NIREP. In: Fischer, B., Dawant, B.M., Lorenz, C. (eds.) Proceedings of the 4th International Workshop on Biomedical Image Registration (WBIR 2010), Lbeck. Lecture Notes in Computer Science, 6204, 140–150. Springer (2010). ISBN 978-3-642-14365-6
23.
Zurück zum Zitat Tian, Y.L., Kanade, T., Cohn, J.F.: Facial expression analysis. In: Handbook of Face Recognition. Springer, Berlin (2011) Tian, Y.L., Kanade, T., Cohn, J.F.: Facial expression analysis. In: Handbook of Face Recognition. Springer, Berlin (2011)
24.
Zurück zum Zitat Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Symmetric log-domain diffeomorphic registration: A demons-based approach. In: Proceedings of the 11th International Conference on Medical Image Computing and Computer-Assisted Intervention – Part I. MICCAI ’08, pp. 754–761 (2008) Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Symmetric log-domain diffeomorphic registration: A demons-based approach. In: Proceedings of the 11th International Conference on Medical Image Computing and Computer-Assisted Intervention – Part I. MICCAI ’08, pp. 754–761 (2008)
25.
Zurück zum Zitat Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic demons: Efficient non-parametric image registration. NeuroImage 45(1, Supp.1), S61–S72 (2009) Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic demons: Efficient non-parametric image registration. NeuroImage 45(1, Supp.1), S61–S72 (2009)
26.
Zurück zum Zitat Wang, J., Yin, L.: Static topographic modeling for facial expression recognition and analysis. Comput. Vision Image Understand. 108(1–2), 19–34 (2007)CrossRef Wang, J., Yin, L.: Static topographic modeling for facial expression recognition and analysis. Comput. Vision Image Understand. 108(1–2), 19–34 (2007)CrossRef
27.
Zurück zum Zitat Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.J.: A 3D facial expression database for facial behavior research. In: Seventh IEEE International Conference on Automatic Face and Gesture Recognition (FG 2006), Southampton, pp. 211–216. IEEE Computer Society (2006). ISBN 0-7695-2503-2 Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.J.: A 3D facial expression database for facial behavior research. In: Seventh IEEE International Conference on Automatic Face and Gesture Recognition (FG 2006), Southampton, pp. 211–216. IEEE Computer Society (2006). ISBN 0-7695-2503-2
Metadaten
Titel
Facial Expression Recognition Using Diffeomorphic Image Registration Framework
verfasst von
Bartlomiej W. Papiez
Bogdan J. Matuszewski
Lik-Kwan Shark
Wei Quan
Copyright-Jahr
2013
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-5076-4_12

Neuer Inhalt