Skip to main content
Top

2020 | OriginalPaper | Chapter

Physiologically-Inspired Neural Circuits for the Recognition of Dynamic Faces

Authors : Michael Stettler, Nick Taubert, Tahereh Azizpour, Ramona Siebert, Silvia Spadacenta, Peter Dicke, Peter Thier, Martin A. Giese

Published in: Artificial Neural Networks and Machine Learning – ICANN 2020

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Dynamic faces are essential for the communication of humans and non-human primates. However, the exact neural circuits of their processing remain unclear. Based on previous models for cortical neural processes involved for social recognition (of static faces and dynamic bodies), we propose two alternative neural models for the recognition of dynamic faces: (i) an example-based mechanism that encodes dynamic facial expressions as sequences of learned keyframes using a recurrent neural network (RNN), and (ii) a norm-based mechanism, relying on neurons that represent differences between the actual facial shape and the neutral facial pose. We tested both models exploiting highly controlled facial monkey expressions, generated using a photo-realistic monkey avatar that was controlled by motion capture data from monkeys. We found that both models account for the recognition of normal and temporally reversed facial expressions from videos. However, if tested with expression morphs, and with expressions of reduced strength, both models made quite different prediction, the norm-based model showing an almost linear variation of the neuron activities with the expression strength and the morphing level for cross-expression morphs, while the example based model did not generalize well to such stimuli. These predictions can be tested easily in electrophysiological experiments, exploiting the developed stimulus set.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Business + Economics & Engineering + Technology"

Online-Abonnement

Springer Professional "Business + Economics & Engineering + Technology" gives you access to:

  • more than 102.000 books
  • more than 537 journals

from the following subject areas:

  • Automotive
  • Construction + Real Estate
  • Business IT + Informatics
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Mechanical Engineering + Materials
  • Insurance + Risk


Secure your knowledge advantage now!

Springer Professional "Engineering + Technology"

Online-Abonnement

Springer Professional "Engineering + Technology" gives you access to:

  • more than 67.000 books
  • more than 390 journals

from the following specialised fileds:

  • Automotive
  • Business IT + Informatics
  • Construction + Real Estate
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Mechanical Engineering + Materials





 

Secure your knowledge advantage now!

Springer Professional "Business + Economics"

Online-Abonnement

Springer Professional "Business + Economics" gives you access to:

  • more than 67.000 books
  • more than 340 journals

from the following specialised fileds:

  • Construction + Real Estate
  • Business IT + Informatics
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Insurance + Risk



Secure your knowledge advantage now!

Literature
1.
go back to reference Barraclough, N.E., Perrett, D.I.: From single cells to social perception. Philos. Trans. R. Soc. B: Biol. Sci. 366(1571), 1739–1752 (2011)CrossRef Barraclough, N.E., Perrett, D.I.: From single cells to social perception. Philos. Trans. R. Soc. B: Biol. Sci. 366(1571), 1739–1752 (2011)CrossRef
2.
go back to reference Ghazanfar, A.A., Chandrasekaran, C., Morrill, R.J.: Dynamic, rhythmic facial expressions and the superior temporal sulcus of macaque monkeys: implications for the evolution of audiovisual speech. Eur. J. Neurosci. 31(10), 1807–1817 (2010)CrossRef Ghazanfar, A.A., Chandrasekaran, C., Morrill, R.J.: Dynamic, rhythmic facial expressions and the superior temporal sulcus of macaque monkeys: implications for the evolution of audiovisual speech. Eur. J. Neurosci. 31(10), 1807–1817 (2010)CrossRef
3.
go back to reference Mosher, C.P., Zimmerman, P.E., Gothard, K.M.: Neurons in the monkey amygdala detect eye contact during naturalistic social interactions. Curr. Biol. 24(20), 2459–2464 (2014)CrossRef Mosher, C.P., Zimmerman, P.E., Gothard, K.M.: Neurons in the monkey amygdala detect eye contact during naturalistic social interactions. Curr. Biol. 24(20), 2459–2464 (2014)CrossRef
4.
go back to reference Leopold, D.A., Bondar, I.V., Giese, M.A.: Norm-based face encoding by single neurons in the monkey inferotemporal cortex. Nature 442(7102), 572–575 (2006)CrossRef Leopold, D.A., Bondar, I.V., Giese, M.A.: Norm-based face encoding by single neurons in the monkey inferotemporal cortex. Nature 442(7102), 572–575 (2006)CrossRef
5.
go back to reference Giese, M.A., Leopold, D.A.: Physiologically inspired neural model for the encoding of face spaces. Neurocomputing 65, 93–101 (2005)CrossRef Giese, M.A., Leopold, D.A.: Physiologically inspired neural model for the encoding of face spaces. Neurocomputing 65, 93–101 (2005)CrossRef
6.
go back to reference Caggiano, V., Fleischer, F., Pomper, J.K., Giese, M.A., Thier, P.: Mirror neurons in monkey premotor area F5 show tuning for critical features of visual causality perception. Curr. Biol. 26(22), 3077–3082 (2016)CrossRef Caggiano, V., Fleischer, F., Pomper, J.K., Giese, M.A., Thier, P.: Mirror neurons in monkey premotor area F5 show tuning for critical features of visual causality perception. Curr. Biol. 26(22), 3077–3082 (2016)CrossRef
7.
go back to reference Fleischer, F., Caggiano, V., Thier, P., Giese, M.A.: Physiologically inspired model for the visual recognition of transitive hand actions. J. Neurosci. 33(15), 6563–6580 (2013)CrossRef Fleischer, F., Caggiano, V., Thier, P., Giese, M.A.: Physiologically inspired model for the visual recognition of transitive hand actions. J. Neurosci. 33(15), 6563–6580 (2013)CrossRef
8.
go back to reference Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., Poggio, T.: Robust object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 411–426 (2007)CrossRef Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., Poggio, T.: Robust object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 411–426 (2007)CrossRef
9.
go back to reference Giese, M.A., Poggio, T.: Neural mechanisms for the recognition of biological movements. Nat. Rev. Neurosci. 4(3), 179–192 (2003)CrossRef Giese, M.A., Poggio, T.: Neural mechanisms for the recognition of biological movements. Nat. Rev. Neurosci. 4(3), 179–192 (2003)CrossRef
10.
go back to reference Lange, J., Lappe, M.: A model of biological motion perception from configural form cues. J. Neurosci. 26(11), 2894–2906 (2006)CrossRef Lange, J., Lappe, M.: A model of biological motion perception from configural form cues. J. Neurosci. 26(11), 2894–2906 (2006)CrossRef
11.
go back to reference Jhuang, H., Serre, T., Wolf, L., Poggio, T.: A biologically inspired system for action recognition. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8. IEEE (2007) Jhuang, H., Serre, T., Wolf, L., Poggio, T.: A biologically inspired system for action recognition. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8. IEEE (2007)
12.
go back to reference Haxby, J.V., Hoffman, E.A., Gobbini, M.I.: The distributed human neural system for face perception. Trends Cogn. Sci. 4(6), 223–233 (2000)CrossRef Haxby, J.V., Hoffman, E.A., Gobbini, M.I.: The distributed human neural system for face perception. Trends Cogn. Sci. 4(6), 223–233 (2000)CrossRef
13.
go back to reference Valentine, T., Lewis, M.B., Hills, P.J.: Face-space: a unifying concept in face recognition research. Q. J. Exp. Psychol. 69(10), 1996–2019 (2016)CrossRef Valentine, T., Lewis, M.B., Hills, P.J.: Face-space: a unifying concept in face recognition research. Q. J. Exp. Psychol. 69(10), 1996–2019 (2016)CrossRef
14.
go back to reference Leopold, D.A., Rhodes, G.: A comparative view of face perception. J. Comp. Psychol. 124(3), 233 (2010)CrossRef Leopold, D.A., Rhodes, G.: A comparative view of face perception. J. Comp. Psychol. 124(3), 233 (2010)CrossRef
15.
go back to reference Li, S., Deng, W.: Deep facial expression recognition: a survey. IEEE Trans. Affect. Comput. (2020) Li, S., Deng, W.: Deep facial expression recognition: a survey. IEEE Trans. Affect. Comput. (2020)
16.
go back to reference Schrimpf, M., et al.: Brain-score: which artificial neural network for object recognition is most brain-like? BioRxiv, p. 407007 (2018) Schrimpf, M., et al.: Brain-score: which artificial neural network for object recognition is most brain-like? BioRxiv, p. 407007 (2018)
17.
go back to reference Jones, J.P., Palmer, L.A.: The two-dimensional spatial structure of simple receptive fields in cat striate cortex. J. Neurophysiol. 58(6), 1187–1211 (1987)CrossRef Jones, J.P., Palmer, L.A.: The two-dimensional spatial structure of simple receptive fields in cat striate cortex. J. Neurophysiol. 58(6), 1187–1211 (1987)CrossRef
18.
go back to reference Amari, S.: Dynamics of pattern formation in lateral-inhibition type neural fields. Biol. Cybern. 27(2), 77–87 (1977)MathSciNetCrossRef Amari, S.: Dynamics of pattern formation in lateral-inhibition type neural fields. Biol. Cybern. 27(2), 77–87 (1977)MathSciNetCrossRef
19.
go back to reference Ratté, S., Lankarany, M., Rho, Y.-A., Patterson, A., Prescott, S.A.: Subthreshold membrane currents confer distinct tuning properties that enable neurons to encode the integral or derivative of their input. Front. Cell. Neurosci. 8, 452 (2015) Ratté, S., Lankarany, M., Rho, Y.-A., Patterson, A., Prescott, S.A.: Subthreshold membrane currents confer distinct tuning properties that enable neurons to encode the integral or derivative of their input. Front. Cell. Neurosci. 8, 452 (2015)
20.
go back to reference Taubert, N., Christensen, A., Endres, D., Giese, M.A.: Online simulation of emotional interactive behaviors with hierarchical Gaussian process dynamical models. In: Proceedings of the ACM Symposium on Applied Perception, pp. 25–32 (2012) Taubert, N., Christensen, A., Endres, D., Giese, M.A.: Online simulation of emotional interactive behaviors with hierarchical Gaussian process dynamical models. In: Proceedings of the ACM Symposium on Applied Perception, pp. 25–32 (2012)
21.
go back to reference Barron, J.L., Fleet, D.J., Beauchemin, S.S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12(1), 43–77 (1994)CrossRef Barron, J.L., Fleet, D.J., Beauchemin, S.S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12(1), 43–77 (1994)CrossRef
22.
go back to reference Siebert, R., Taubert, N., Spadacenta, S., Dicke, P.W., Giese, M.A., Thier, P.: A naturalistic dynamic monkey head avatar elicits species-typical reactions and overcomes the uncanny valley. Eneuro 7(4) (2020) Siebert, R., Taubert, N., Spadacenta, S., Dicke, P.W., Giese, M.A., Thier, P.: A naturalistic dynamic monkey head avatar elicits species-typical reactions and overcomes the uncanny valley. Eneuro 7(4) (2020)
Metadata
Title
Physiologically-Inspired Neural Circuits for the Recognition of Dynamic Faces
Authors
Michael Stettler
Nick Taubert
Tahereh Azizpour
Ramona Siebert
Silvia Spadacenta
Peter Dicke
Peter Thier
Martin A. Giese
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-61609-0_14

Premium Partner