Elsevier

NeuroImage

Volume 18, Issue 1, January 2003, Pages 156-168
NeuroImage

Regular Article
Dissociable Neural Pathways Are Involved in the Recognition of Emotion in Static and Dynamic Facial Expressions

https://doi.org/10.1006/nimg.2002.1323Get rights and content

Abstract

Facial expressions of emotion powerfully influence social behavior. The distributed network of brain regions thought to decode these social signals has been empirically defined using static, usually photographic, displays of such expressions. Facial emotional expressions are however highly dynamic signals that encode the emotion message in facial action patterns. This study sought to determine whether the encoding of facial expressions of emotion by static or dynamic displays is associated with different neural correlates for their decoding. We used positron emission tomography to compare patterns of brain activity in healthy men and women during the explicit judgment of emotion intensity in static and dynamic facial expressions of anger and happiness. Compared to judgments of spatial orientation for moving neutral facial expressions, the judgment of anger in dynamic expressions was associated with increased right-lateralized activity in the medial, superior, middle, and inferior frontal cortex and cerebellum, while judgments of happiness were associated with relative activation of the cuneus, temporal cortex, and the middle, medial, and superior frontal cortex. In contrast, the perception of anger or happiness in static facial expressions activated a motor, prefrontal, and parietal cortical network previously shown to be involved in motor imagery. The direct contrast of dynamic and static expressions indicated differential activation of visual area V5, superior temporal sulcus, periamygdaloid cortex, and cerebellum for dynamic angry expressions and differential activation of area V5, extrastriate cortex, brain stem, and middle temporal cortical activations for dynamic happy expressions. Thus, a distribution of neural activations is related to the analysis of emotion messages in the nearly constant biological motion of the face and differ for angry and happy expressions. Static displays of facial emotional expression may represent noncanonical stimuli that are processed for emotion content by mental strategies and neural events distinct from their more ecologically relevant dynamic counterparts.

References (80)

  • H. Hill et al.

    Categorizing sex and identity from the biological motion of faces

    Curr. Biol.

    (2001)
  • G.W. Humphreys et al.

    Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence

    Neuropsychologia

    (1993)
  • M. Jeannerod et al.

    Mental motor imagery: A window into the representational stages of action

    Curr. Opin. Neurobiol.

    (1995)
  • M. Jeannerod et al.

    Mental imaging of motor activity in humans

    Curr. Opin. Neurobiol.

    (1999)
  • C.G. Kohler et al.

    Emotion recognition deficit in schizophrenia: Association with symptompology and cognition

    Biol. Psych.

    (2000)
  • E.K. Miller

    The prefrontal cortex: Complex neural properties for complex behavior

    Neuron

    (1999)
  • M.L. Phillips et al.

    Investigation of facial recognition memory and happy and sad facial expression perception: An fMRI study

    Psychiatry Res. Neuroimag.

    (1998)
  • M.L. Phillips et al.

    A differential neural response to threatening and non-threatening negative facial expressions in paranoid and non-paranoid schizophrenics

    Psychiatry Res. Neuroimag.

    (1999)
  • C.J. Price et al.

    Cognitive conjunction: A new approach to brain activation experiments

    NeuroImage

    (1997)
  • J. Zacks et al.

    Imagined transformations of bodies: An fMRI investigation

    Neuropsychologia

    (1999)
  • R. Adolphs et al.

    Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala

    Nature

    (1994)
  • R. Adolphs et al.

    A role for somatosensory cortices in the visual recognition of emotion as revealed by three-dimensional lesion mapping

    J. Neurosci.

    (2000)
  • J. Archer et al.

    Face processing in psychiatric conditions

    Br. J. Clin. Psychol.

    (1992)
  • J. Archer et al.

    Movement, face processing and schizophrenia: Evidence of a differential deficit in expression analysis

    Br. J. Clin. Psychol.

    (1994)
  • J. Aronoff et al.

    Which are the stimuli in facial displays of anger and happiness? Configurational bases of emotion recognition

    J. Pers. Soc. Psychol.

    (1992)
  • F. Barceló et al.

    Prefrontal modulation of visual processing in humans

    Nat. Neurosci.

    (2000)
  • G.S. Berns et al.

    Predictability modulates human brain response to reward

    J. Neurosci.

    (2001)
  • F. Binkofski et al.

    Broca's region subserves imagery of motion: A combined cytoarchitectonic and fMRI study

    Hum. Brain Mapp.

    (2000)
  • R.J.R. Blair et al.

    Dissociable neural responses to facial expressions of sadness and anger

    Brain

    (1999)
  • E. Bonda et al.

    Neural correlates of mental transformations of the body-in-space

    Proc. Natl. Acad. Sci. USA

    (1995)
  • E. Bonda et al.

    Specific involvement of human parietal systems and the amygdala in the perception of biological motion

    J. Neurosci.

    (1996)
  • J.C. Borod et al.

    Perception of facial emotion in schizophrenia and right brain-damaged patients

    J. Nerv. Ment. Dis.

    (1993)
  • A.J. Calder et al.

    Neuropsychology of fear and loathing

    Nature Rev.

    (2001)
  • D. Chawla et al.

    The physiological basis of attentional modulation in extrastriate visual areas

    Nature Neurosci.

    (1999)
  • S.R. Cherry et al.

    Improved detection of focal cerebral blood-flow changes using 3-dimensional positron emission tomography

    J. Cereb. Blood Flow Metab.

    (1993)
  • M.S. Cohen et al.

    Changes in cortical activity during mental rotation: A mapping study using functional MRI

    Brain

    (1996)
  • H.D. Critchley et al.

    The functional neuroanatomy of social behaviour: Changes in cerebral blood flow when people with autistic disorder process facial expressions

    Brain

    (2000)
  • H. Critchley et al.

    Explicit and implicit neural mechanisms for processing of social information from facial expressions: a functional magnetic resonance imaging study

    Hum. Brain. Mapp.

    (2000)
  • R. Desimone

    Face-selective cells in the temporal cortex of monkeys

    J. Cogn. Neurosci.

    (1991)
  • Cited by (265)

    View all citing articles on Scopus
    View full text