Skip to main content

2020 | OriginalPaper | Buchkapitel

Physiologically-Inspired Neural Circuits for the Recognition of Dynamic Faces

verfasst von : Michael Stettler, Nick Taubert, Tahereh Azizpour, Ramona Siebert, Silvia Spadacenta, Peter Dicke, Peter Thier, Martin A. Giese

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2020

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Dynamic faces are essential for the communication of humans and non-human primates. However, the exact neural circuits of their processing remain unclear. Based on previous models for cortical neural processes involved for social recognition (of static faces and dynamic bodies), we propose two alternative neural models for the recognition of dynamic faces: (i) an example-based mechanism that encodes dynamic facial expressions as sequences of learned keyframes using a recurrent neural network (RNN), and (ii) a norm-based mechanism, relying on neurons that represent differences between the actual facial shape and the neutral facial pose. We tested both models exploiting highly controlled facial monkey expressions, generated using a photo-realistic monkey avatar that was controlled by motion capture data from monkeys. We found that both models account for the recognition of normal and temporally reversed facial expressions from videos. However, if tested with expression morphs, and with expressions of reduced strength, both models made quite different prediction, the norm-based model showing an almost linear variation of the neuron activities with the expression strength and the morphing level for cross-expression morphs, while the example based model did not generalize well to such stimuli. These predictions can be tested easily in electrophysiological experiments, exploiting the developed stimulus set.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Barraclough, N.E., Perrett, D.I.: From single cells to social perception. Philos. Trans. R. Soc. B: Biol. Sci. 366(1571), 1739–1752 (2011)CrossRef Barraclough, N.E., Perrett, D.I.: From single cells to social perception. Philos. Trans. R. Soc. B: Biol. Sci. 366(1571), 1739–1752 (2011)CrossRef
2.
Zurück zum Zitat Ghazanfar, A.A., Chandrasekaran, C., Morrill, R.J.: Dynamic, rhythmic facial expressions and the superior temporal sulcus of macaque monkeys: implications for the evolution of audiovisual speech. Eur. J. Neurosci. 31(10), 1807–1817 (2010)CrossRef Ghazanfar, A.A., Chandrasekaran, C., Morrill, R.J.: Dynamic, rhythmic facial expressions and the superior temporal sulcus of macaque monkeys: implications for the evolution of audiovisual speech. Eur. J. Neurosci. 31(10), 1807–1817 (2010)CrossRef
3.
Zurück zum Zitat Mosher, C.P., Zimmerman, P.E., Gothard, K.M.: Neurons in the monkey amygdala detect eye contact during naturalistic social interactions. Curr. Biol. 24(20), 2459–2464 (2014)CrossRef Mosher, C.P., Zimmerman, P.E., Gothard, K.M.: Neurons in the monkey amygdala detect eye contact during naturalistic social interactions. Curr. Biol. 24(20), 2459–2464 (2014)CrossRef
4.
Zurück zum Zitat Leopold, D.A., Bondar, I.V., Giese, M.A.: Norm-based face encoding by single neurons in the monkey inferotemporal cortex. Nature 442(7102), 572–575 (2006)CrossRef Leopold, D.A., Bondar, I.V., Giese, M.A.: Norm-based face encoding by single neurons in the monkey inferotemporal cortex. Nature 442(7102), 572–575 (2006)CrossRef
5.
Zurück zum Zitat Giese, M.A., Leopold, D.A.: Physiologically inspired neural model for the encoding of face spaces. Neurocomputing 65, 93–101 (2005)CrossRef Giese, M.A., Leopold, D.A.: Physiologically inspired neural model for the encoding of face spaces. Neurocomputing 65, 93–101 (2005)CrossRef
6.
Zurück zum Zitat Caggiano, V., Fleischer, F., Pomper, J.K., Giese, M.A., Thier, P.: Mirror neurons in monkey premotor area F5 show tuning for critical features of visual causality perception. Curr. Biol. 26(22), 3077–3082 (2016)CrossRef Caggiano, V., Fleischer, F., Pomper, J.K., Giese, M.A., Thier, P.: Mirror neurons in monkey premotor area F5 show tuning for critical features of visual causality perception. Curr. Biol. 26(22), 3077–3082 (2016)CrossRef
7.
Zurück zum Zitat Fleischer, F., Caggiano, V., Thier, P., Giese, M.A.: Physiologically inspired model for the visual recognition of transitive hand actions. J. Neurosci. 33(15), 6563–6580 (2013)CrossRef Fleischer, F., Caggiano, V., Thier, P., Giese, M.A.: Physiologically inspired model for the visual recognition of transitive hand actions. J. Neurosci. 33(15), 6563–6580 (2013)CrossRef
8.
Zurück zum Zitat Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., Poggio, T.: Robust object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 411–426 (2007)CrossRef Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., Poggio, T.: Robust object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 411–426 (2007)CrossRef
9.
Zurück zum Zitat Giese, M.A., Poggio, T.: Neural mechanisms for the recognition of biological movements. Nat. Rev. Neurosci. 4(3), 179–192 (2003)CrossRef Giese, M.A., Poggio, T.: Neural mechanisms for the recognition of biological movements. Nat. Rev. Neurosci. 4(3), 179–192 (2003)CrossRef
10.
Zurück zum Zitat Lange, J., Lappe, M.: A model of biological motion perception from configural form cues. J. Neurosci. 26(11), 2894–2906 (2006)CrossRef Lange, J., Lappe, M.: A model of biological motion perception from configural form cues. J. Neurosci. 26(11), 2894–2906 (2006)CrossRef
11.
Zurück zum Zitat Jhuang, H., Serre, T., Wolf, L., Poggio, T.: A biologically inspired system for action recognition. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8. IEEE (2007) Jhuang, H., Serre, T., Wolf, L., Poggio, T.: A biologically inspired system for action recognition. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8. IEEE (2007)
12.
Zurück zum Zitat Haxby, J.V., Hoffman, E.A., Gobbini, M.I.: The distributed human neural system for face perception. Trends Cogn. Sci. 4(6), 223–233 (2000)CrossRef Haxby, J.V., Hoffman, E.A., Gobbini, M.I.: The distributed human neural system for face perception. Trends Cogn. Sci. 4(6), 223–233 (2000)CrossRef
13.
Zurück zum Zitat Valentine, T., Lewis, M.B., Hills, P.J.: Face-space: a unifying concept in face recognition research. Q. J. Exp. Psychol. 69(10), 1996–2019 (2016)CrossRef Valentine, T., Lewis, M.B., Hills, P.J.: Face-space: a unifying concept in face recognition research. Q. J. Exp. Psychol. 69(10), 1996–2019 (2016)CrossRef
14.
Zurück zum Zitat Leopold, D.A., Rhodes, G.: A comparative view of face perception. J. Comp. Psychol. 124(3), 233 (2010)CrossRef Leopold, D.A., Rhodes, G.: A comparative view of face perception. J. Comp. Psychol. 124(3), 233 (2010)CrossRef
15.
Zurück zum Zitat Li, S., Deng, W.: Deep facial expression recognition: a survey. IEEE Trans. Affect. Comput. (2020) Li, S., Deng, W.: Deep facial expression recognition: a survey. IEEE Trans. Affect. Comput. (2020)
16.
Zurück zum Zitat Schrimpf, M., et al.: Brain-score: which artificial neural network for object recognition is most brain-like? BioRxiv, p. 407007 (2018) Schrimpf, M., et al.: Brain-score: which artificial neural network for object recognition is most brain-like? BioRxiv, p. 407007 (2018)
17.
Zurück zum Zitat Jones, J.P., Palmer, L.A.: The two-dimensional spatial structure of simple receptive fields in cat striate cortex. J. Neurophysiol. 58(6), 1187–1211 (1987)CrossRef Jones, J.P., Palmer, L.A.: The two-dimensional spatial structure of simple receptive fields in cat striate cortex. J. Neurophysiol. 58(6), 1187–1211 (1987)CrossRef
18.
Zurück zum Zitat Amari, S.: Dynamics of pattern formation in lateral-inhibition type neural fields. Biol. Cybern. 27(2), 77–87 (1977)MathSciNetCrossRef Amari, S.: Dynamics of pattern formation in lateral-inhibition type neural fields. Biol. Cybern. 27(2), 77–87 (1977)MathSciNetCrossRef
19.
Zurück zum Zitat Ratté, S., Lankarany, M., Rho, Y.-A., Patterson, A., Prescott, S.A.: Subthreshold membrane currents confer distinct tuning properties that enable neurons to encode the integral or derivative of their input. Front. Cell. Neurosci. 8, 452 (2015) Ratté, S., Lankarany, M., Rho, Y.-A., Patterson, A., Prescott, S.A.: Subthreshold membrane currents confer distinct tuning properties that enable neurons to encode the integral or derivative of their input. Front. Cell. Neurosci. 8, 452 (2015)
20.
Zurück zum Zitat Taubert, N., Christensen, A., Endres, D., Giese, M.A.: Online simulation of emotional interactive behaviors with hierarchical Gaussian process dynamical models. In: Proceedings of the ACM Symposium on Applied Perception, pp. 25–32 (2012) Taubert, N., Christensen, A., Endres, D., Giese, M.A.: Online simulation of emotional interactive behaviors with hierarchical Gaussian process dynamical models. In: Proceedings of the ACM Symposium on Applied Perception, pp. 25–32 (2012)
21.
Zurück zum Zitat Barron, J.L., Fleet, D.J., Beauchemin, S.S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12(1), 43–77 (1994)CrossRef Barron, J.L., Fleet, D.J., Beauchemin, S.S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12(1), 43–77 (1994)CrossRef
22.
Zurück zum Zitat Siebert, R., Taubert, N., Spadacenta, S., Dicke, P.W., Giese, M.A., Thier, P.: A naturalistic dynamic monkey head avatar elicits species-typical reactions and overcomes the uncanny valley. Eneuro 7(4) (2020) Siebert, R., Taubert, N., Spadacenta, S., Dicke, P.W., Giese, M.A., Thier, P.: A naturalistic dynamic monkey head avatar elicits species-typical reactions and overcomes the uncanny valley. Eneuro 7(4) (2020)
Metadaten
Titel
Physiologically-Inspired Neural Circuits for the Recognition of Dynamic Faces
verfasst von
Michael Stettler
Nick Taubert
Tahereh Azizpour
Ramona Siebert
Silvia Spadacenta
Peter Dicke
Peter Thier
Martin A. Giese
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-61609-0_14