Skip to main content
Top

2018 | OriginalPaper | Chapter

Static Posed Versus Genuine Smile Recognition

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recognition of a posed or fake smile is a vital and challenging research topic and a growing interest has been observed from the computer vision and machine learning community. The state-of-the-art algorithms related to this field focus on the facial expressions dynamics, while several psychologists suggest that the main difference between posed and spontaneous smile should be observed in different muscles contractions in the upper part of the face. Therefore, in this work we evaluate the accuracy of recognition based only on the face appearance using the High-Dimensional Local Binary Patterns. The smile authenticity is analyzed on the set of images extracted at the smile apex phase from the UvA-NEMO database. The obtained results indicate that the analyzed algorithms can spot a fake smile much better than a human, but worse than systems that incorporate the facial dynamics.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Calder, A.J., Young, A.W.: Understanding the recognition of facial identity and facial expression? Nat. Rev. Neurosci. 6, 641–651 (2005)CrossRef Calder, A.J., Young, A.W.: Understanding the recognition of facial identity and facial expression? Nat. Rev. Neurosci. 6, 641–651 (2005)CrossRef
2.
go back to reference Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3025–3032 (2013) Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3025–3032 (2013)
3.
go back to reference Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. Int. J. Wavelets Multiresolut. Inf. Process. 02(02), 121–132 (2004)CrossRef Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. Int. J. Wavelets Multiresolut. Inf. Process. 02(02), 121–132 (2004)CrossRef
4.
go back to reference Dibeklioglu, H., Salah, A., Gevers, T.: Recognition of genuine smiles. IEEE Trans. Multimedia 17(3), 279–294 (2015)CrossRef Dibeklioglu, H., Salah, A., Gevers, T.: Recognition of genuine smiles. IEEE Trans. Multimedia 17(3), 279–294 (2015)CrossRef
5.
go back to reference Dibeklioğlu, H., Salah, A.A., Gevers, T.: Are you really smiling at me? Spontaneous versus posed enjoyment smiles. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 525–538. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33712-3_38 CrossRef Dibeklioğlu, H., Salah, A.A., Gevers, T.: Are you really smiling at me? Spontaneous versus posed enjoyment smiles. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 525–538. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33712-3_​38 CrossRef
6.
go back to reference Duchenne, G.B.: The mechanism of human facial expression or an electro-physiological analysis of the expression of emotions. Cambridge University Press (1990). Original work published 1862 Duchenne, G.B.: The mechanism of human facial expression or an electro-physiological analysis of the expression of emotions. Cambridge University Press (1990). Original work published 1862
7.
go back to reference Ekman, P., Davidson, R.J., Friesen, W.V.: The Duchenne smile: emotional expression and brain physiology: II. J. Person. Soc. Psychol. 58(2), 342–353 (1990)CrossRef Ekman, P., Davidson, R.J., Friesen, W.V.: The Duchenne smile: emotional expression and brain physiology: II. J. Person. Soc. Psychol. 58(2), 342–353 (1990)CrossRef
8.
go back to reference Ekman, P., Friesen, W.: Facial Action Coding System: Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978) Ekman, P., Friesen, W.: Facial Action Coding System: Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
9.
go back to reference Ekman, P., Friesen, W.V.: Felt, false, and miserable smiles. J. Nonverbal Behav. 6(4), 238–252 (1982)CrossRef Ekman, P., Friesen, W.V.: Felt, false, and miserable smiles. J. Nonverbal Behav. 6(4), 238–252 (1982)CrossRef
10.
go back to reference Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: Multi-PIE. Image Vis. Comput. 28(5), 807–813 (2010)CrossRef Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: Multi-PIE. Image Vis. Comput. 28(5), 807–813 (2010)CrossRef
11.
go back to reference Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4295–4304 (2015) Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4295–4304 (2015)
12.
go back to reference Hoque, M.E., McDuff, D., Picard, R.: Exploring temporal patterns in classifying frustrated and delighted smiles (extended abstract). In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 505–511 (2015) Hoque, M.E., McDuff, D., Picard, R.: Exploring temporal patterns in classifying frustrated and delighted smiles (extended abstract). In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 505–511 (2015)
13.
go back to reference Kawulok, M., Nalepa, J., Nurzynska, K., Smolka, B.: In search of truth: analysis of smile intensity dynamics to detect deception. In: Montes-y-Gómez, M., Escalante, H.J., Segura, A., Murillo, J.D. (eds.) IBERAMIA 2016. LNCS, vol. 10022, pp. 325–337. Springer, Cham (2016). doi:10.1007/978-3-319-47955-2_27 CrossRef Kawulok, M., Nalepa, J., Nurzynska, K., Smolka, B.: In search of truth: analysis of smile intensity dynamics to detect deception. In: Montes-y-Gómez, M., Escalante, H.J., Segura, A., Murillo, J.D. (eds.) IBERAMIA 2016. LNCS, vol. 10022, pp. 325–337. Springer, Cham (2016). doi:10.​1007/​978-3-319-47955-2_​27 CrossRef
14.
go back to reference Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874 (2014) Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874 (2014)
15.
go back to reference Li, H.D., Xu, Q.S., Liang, Y.Z.: Random frog: an efficient reversible jump Markov chain Monte Carlo-like approach for variable selection with applications to gene selection and disease classification. Analytica Chimica Acta 740, 20–26 (2012)CrossRef Li, H.D., Xu, Q.S., Liang, Y.Z.: Random frog: an efficient reversible jump Markov chain Monte Carlo-like approach for variable selection with applications to gene selection and disease classification. Analytica Chimica Acta 740, 20–26 (2012)CrossRef
16.
go back to reference Liu, H., Wu, P.: Comparison of methods for smile deceit detection by training AU6 and AU12 simultaneously. In: 2012 19th IEEE International Conference on Image Processing, pp. 1805–1808 (2012) Liu, H., Wu, P.: Comparison of methods for smile deceit detection by training AU6 and AU12 simultaneously. In: 2012 19th IEEE International Conference on Image Processing, pp. 1805–1808 (2012)
17.
go back to reference Martinez, B., Valstar, M.F.: Advances, challenges, and opportunities in automatic facial expression recognition. In: Kawulok, M., Celebi, M.E., Smolka, B. (eds.) Advances in Face Detection and Facial Image Analysis, pp. 63–100. Springer, Cham (2016). doi:10.1007/978-3-319-25958-1_4 Martinez, B., Valstar, M.F.: Advances, challenges, and opportunities in automatic facial expression recognition. In: Kawulok, M., Celebi, M.E., Smolka, B. (eds.) Advances in Face Detection and Facial Image Analysis, pp. 63–100. Springer, Cham (2016). doi:10.​1007/​978-3-319-25958-1_​4
18.
go back to reference Mathias, M., Benenson, R., Pedersoli, M., Gool, L.: Face detection without bells and whistles. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 720–735. Springer, Cham (2014). doi:10.1007/978-3-319-10593-2_47 Mathias, M., Benenson, R., Pedersoli, M., Gool, L.: Face detection without bells and whistles. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 720–735. Springer, Cham (2014). doi:10.​1007/​978-3-319-10593-2_​47
19.
go back to reference Ojala, T., Pietikainen, M., Harwood, D.: Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, vol. 1 - Conference A: Computer Vision amp; Image Processing, vol. 1, pp. 582–585 (1994) Ojala, T., Pietikainen, M., Harwood, D.: Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, vol. 1 - Conference A: Computer Vision amp; Image Processing, vol. 1, pp. 582–585 (1994)
20.
go back to reference Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRefMATH Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRefMATH
21.
go back to reference Porter, S., Korva, N., Baker, A.: Secrets of the human face: new insights into the face and covert emotions. Psychol. Aotearoa 3(2), 94–99 (2011) Porter, S., Korva, N., Baker, A.: Secrets of the human face: new insights into the face and covert emotions. Psychol. Aotearoa 3(2), 94–99 (2011)
22.
go back to reference Schmidt, K.L., Ambadar, Z., Cohn, J.F., Reed, L.I.: Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling. J. Nonverbal Behav. 30(1), 37–52 (2006)CrossRef Schmidt, K.L., Ambadar, Z., Cohn, J.F., Reed, L.I.: Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling. J. Nonverbal Behav. 30(1), 37–52 (2006)CrossRef
23.
go back to reference Suwa, M., Sugie, N., Fujimora, K.: A preliminary note on pattern recognition of human emotional expression. In: International Joint Conference on Pattern Recognition, pp. 408–410 (1978) Suwa, M., Sugie, N., Fujimora, K.: A preliminary note on pattern recognition of human emotional expression. In: International Joint Conference on Pattern Recognition, pp. 408–410 (1978)
24.
go back to reference Tracy, J.L., Randles, D., Steckler, C.M.: The nonverbal communication of emotions. Curr. Opin. Behav. Sci. 3, 25–30 (2015)CrossRef Tracy, J.L., Randles, D., Steckler, C.M.: The nonverbal communication of emotions. Curr. Opin. Behav. Sci. 3, 25–30 (2015)CrossRef
25.
go back to reference Valstar, M.F., Pantic, M., Ambadar, Z., Cohn, J.F.: Spontaneous vs. posed facial behavior: automatic analysis of brow actions. In: Proceedings of the 8th International Conference on Multimodal Interfaces, pp. 162–170 (2006) Valstar, M.F., Pantic, M., Ambadar, Z., Cohn, J.F.: Spontaneous vs. posed facial behavior: automatic analysis of brow actions. In: Proceedings of the 8th International Conference on Multimodal Interfaces, pp. 162–170 (2006)
26.
go back to reference Weker, M.M.: Smile and lie? Why we are able to distinguish false smiles from genuine ones. In: Evers, D., Fuller, M., Runehov, A., Sæther, K.-W. (eds.) Issues in Science and Theology: Do Emotions Shape the World?. ISRPESSST, pp. 59–71. Springer, Cham (2016). doi:10.1007/978-3-319-26769-2_5 CrossRef Weker, M.M.: Smile and lie? Why we are able to distinguish false smiles from genuine ones. In: Evers, D., Fuller, M., Runehov, A., Sæther, K.-W. (eds.) Issues in Science and Theology: Do Emotions Shape the World?. ISRPESSST, pp. 59–71. Springer, Cham (2016). doi:10.​1007/​978-3-319-26769-2_​5 CrossRef
27.
go back to reference Wu, P., Liu, H., Zhang, X.: Spontaneous versus posed smile recognition using discriminative local spatial-temporal descriptors. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1240–1244 (2014) Wu, P., Liu, H., Zhang, X.: Spontaneous versus posed smile recognition using discriminative local spatial-temporal descriptors. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1240–1244 (2014)
Metadata
Title
Static Posed Versus Genuine Smile Recognition
Authors
Krystian Radlak
Natalia Radlak
Bogdan Smolka
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-59162-9_44

Premium Partner