Neural processing of emotional valence of facial expressions

Cognitive Brain Research, 2001

We identified human brain regions involved in the perception of sad, frightened, happy, angry, and neutral facial expressions using functional magnetic resonance imaging (fMRI). Twenty-one healthy right-handed adult volunteers (11 men, 10 women; aged 18-45; mean age 21.6 years) participated in four separate runs, one for each of the four emotions. Participants viewed blocks of emotionally expressive faces alternating with blocks of neutral faces and scrambled images. In comparison with scrambled images, neutral faces activated the fusiform gyri, the right lateral occipital gyrus, the right superior temporal sulcus, the inferior frontal gyri, and the amygdala / entorhinal cortex. In comparisons of emotional and neutral faces, we found that (1) emotional faces elicit increased activation in a subset of cortical regions involved in neutral face processing and in areas not activated by neutral faces; (2) differences in activation as a function of emotion category were most evident in the frontal lobes; (3) men showed a differential neural response depending upon the emotion expressed but women did not.

Journal of Neurophysiology

We measured regional cerebral blood flow (rCBF) using positron emission tomography (PET) to determine which brain regions are involved in the assessment of facial emotion. We asked right-handed normal subjects to assess the signalers’ emotional state based on facial gestures and to assess the facial attractiveness, as well as to discriminate the background color of the facial stimuli, and compared the activity produced by each condition. The right inferior frontal cortex showed significant activation during the assessment of facial emotion in comparison with the other two tests. The activated area was located within a triangular area of the inferior frontal cortex in the right cerebral hemisphere. These results, together with those of previous imaging and clinical studies, suggest that the right inferior frontal cortex processes emotional communicative signals that could be visual or auditory and that there is a hemispheric asymmetry in the inferior frontal cortex in relation to the...

Cognitive Brain Research, 2001

A parallel neural network has been proposed for processing various types of information conveyed by faces including emotion. Using functional magnetic resonance imaging (fMRI), we tested the effect of the explicit attention to the emotional expression of the faces on the neuronal activity of the face-responsive regions. Delayed match to sample procedure was adopted. Subjects were required to match the visually presented pictures with regard to the contour of the face pictures, facial identity, and emotional expressions by valence (happy and fearful expressions) and arousal (fearful and sad expressions). Contour matching of the non-face scrambled pictures was used as a control condition. The face-responsive regions that responded more to faces than to non-face stimuli were the bilateral lateral fusiform gyrus (LFG), the right superior temporal sulcus (STS), and the bilateral intraparietal sulcus (IPS). In these regions, general attention to the face enhanced the activities of the bilateral LFG, the right STS, and the left IPS compared with attention to the contour of the facial image. Selective attention to facial emotion specifically enhanced the activity of the right STS compared with attention to the face per se. The results suggest that the right STS region plays a special role in facial emotion recognition within distributed face-processing systems. This finding may support the notion that the STS is involved in social perception.

Cognitive, Affective, & Behavioral Neuroscience, 2006

There is considerable debate regarding the extent to which limbic regions respond differentially to items with different valences (positive or negative) or to different stimulus types (pictures or words). In the present event-related fMRI study, 21 participants viewed words and pictures that were neutral, negative, or positive. Negative and positive items were equated on arousal. The participants rated each item for whether it depicted or described something animate or inanimate or something common or uncommon. For both pictures and words, the amygdala, dorsomedial prefrontal cortex (PFC), and ventromedial PFC responded equally to all high-arousal items, regardless of valence. Laterality effects in the amygdala were based on the stimulus type (word left, picture bilateral). Valence effects were most apparent when the individuals processed pictures, and the results revealed a lateral/medial distinction within the PFC: The lateral PFC responded differentially to negative items, whereas the medial PFC was more engaged during the processing of positive pictures.

Human Brain …, 2000

The processing of changing nonverbal social signals such as facial expressions is poorly understood, and it is unknown if different pathways are activated during effortful (explicit), compared to implicit, processing of facial expressions. Thus we used fMRI to determine which brain areas subserve processing of high-valence expressions and if distinct brain areas are activated when facial expressions are processed explicitly or implicitly. Nine healthy volunteers were scanned (1.5T GE Signa with ANMR, TE/TR 40/3,000 ms) during two similar experiments in which blocks of mixed happy and angry facial expressions ("on" condition) were alternated with blocks of neutral faces (control "off" condition). Experiment 1 examined explicit processing of expressions by requiring subjects to attend to, and judge, facial expression. Experiment 2 examined implicit processing of expressions by requiring subjects to attend to, and judge, facial gender, which was counterbalanced in both experimental conditions. Processing of facial expressions significantly increased regional blood oxygenation level-dependent (BOLD) activity in fusiform and middle temporal gyri, hippocampus, amygdalohippocampal junction, and pulvinar nucleus. Explicit processing evoked significantly more activity in temporal lobe cortex than implicit processing, whereas implicit processing evoked significantly greater activity in amygdala region. Mixed high-valence facial expressions are processed within temporal lobe visual cortex, thalamus, and amygdalohippocampal complex. Also, neural substrates for explicit and implicit processing of facial expressions are dissociable: explicit processing activates temporal lobe cortex, whereas implicit processing activates amygdala region. Our findings confirm a neuroanatomical dissociation between conscious and unconscious processing of emotional information. Hum. Brain Mapping 9: 93-105, 2000.

Emotion, 2010

The circumplex model of affect construes all emotions as linear combinations of 2 independent neurophysiological dimensions, valence and arousal. We used functional magnetic resonance imaging to identify the neural networks subserving valence and arousal, and we assessed, in 10 participants, the associations of the BOLD (blood oxygen level-dependent) response, an indirect index of neural activity, with ratings of valence and arousal during the emotional experiences induced by the presentation of evocative sentences. Unpleasant emotional experience was associated with increased BOLD signal intensities in the supplementary motor, anterior midcingulate, right dorsolateral prefrontal, occipitotemporal, inferior parietal, and cerebellar cortices. Highly arousing emotions were associated with increased BOLD signal intensities in the left thalamus, globus pallidus, caudate, parahippocampal gyrus, amygdala, premotor cortex, and cerebellar vermis. Separate analyses using a finite impulse response model confirmed these results and revealed that pleasant emotions engaged an additional network that included the midbrain, ventral striatum, and caudate nucleus, all portions of a reward circuit. These findings suggest the existence of distinct networks subserving the valence and arousal dimensions of emotions, with midline and medial temporal lobe structures mediating arousal and dorsal cortical areas and mesolimbic pathways mediating valence.

Objective: We aimed to study the neural processing of emotion-denoting words based on a circumplex model of affect, which posits that all emotions can be described as a linear combination of two neurophysiological dimensions, valence and arousal. Based on the circumplex model, we predicted a linear relationship between neural activity and incremental changes in these two affective dimensions. Methods: Using functional magnetic resonance imaging, we assessed in 10 subjects the correlations of BOLD (blood oxygen level dependent) signal with ratings of valence and arousal during the presentation of emotion-denoting words. Results: Valence ratings correlated positively with neural activity in the left insular cortex and inversely with neural activity in the right dorsolateral prefrontal and precuneus cortices. The absolute value of valence ratings (reflecting the positive and negative extremes of valence) correlated positively with neural activity in the left dorsolateral and medial prefrontal cortex (PFC), dorsal anterior cingulate cortex, posterior cingulate cortex, and right dorsal PFC, and inversely with neural activity in the left medial temporal cortex and right amygdala. Arousal ratings and neural activity correlated positively in the left parahippocampus and dorsal anterior cingulate cortex, and inversely in the left dorsolateral PFC and dorsal cerebellum. Conclusion: We found evidence for two neural networks subserving the affective dimensions of valence and arousal. These findings clarify inconsistencies from prior imaging studies of affect by suggesting that two underlying neurophysiological systems, valence and arousal, may subserve the processing of affective stimuli, consistent with the circumplex model of affect. Hum Brain Mapp 30:883-895, 2009. V V C 2008 Wiley-Liss, Inc. in Wiley InterScience (www. interscience.wiley.com). V V C 2008 Wiley-Liss, Inc. r Human Brain Mapping 30:883-895 (2009) r r fMRI Study of the Affective Circumplex r r 885 r

Neuroimage, 2001

Considerable evidence indicates that processing facial expression involves both subcortical (amygdala and basal ganglia) and cortical (occipito-temporal, orbitofrontal, and prefrontal cortex) structures. However, the specificity of these regions for single types of emotions and for the cognitive demands of expression processing, is still unclear. This functional magnetic resonance imaging (fMRI) study investigated the neural correlates of incidental and explicit processing of the emotional content of faces expressing either disgust or happiness. Subjects were examined while they were viewing neutral, disgusted, or happy faces. The incidental task required subjects to decide about face gender, the explicit task to decide about face expression. In the control task subjects were requested to detect a white square in a greyscale mosaic stimulus. Results showed that the left inferior frontal cortex and the bilateral occipito-temporal junction responded equally to all face conditions. Several cortical and subcortical regions were modulated by task type, and by facial expression. Right neostriatum and left amygdala were activated when subjects made explicit judgements of disgust, bilateral orbitofrontal cortex when they made judgement of happiness, and right frontal and insular cortex when they made judgements about any emotion.

Psychophysiology, 1998

Functional activity in the visual cortex was assessed using functional magnetic resonance imaging technology while participants viewed a series of pleasant, neutral, or unpleasant pictures. Coronal images at four different locations in the occipital cortex were acquired during each of eight 12-s picture presentation periods~on! and 12-s interpicture interval off !. The extent of functional activation was larger in the right than the left hemisphere and larger in the occipital than in the occipitoparietal regions during processing of all picture contents compared with the interpicture intervals. More importantly, functional activity was significantly greater in all sampled brain regions when processing emotional pleasant or unpleasant! pictures than when processing neutral stimuli. In Experiment 2, a hypothesis that these differences were an artifact of differential eye movements was ruled out. Whereas both emotional and neutral pictures produced activity centered on the calcarine fissure~Area 17!, only emotional pictures also produced sizable clusters bilaterally in the occipital gyrus, in the right fusiform gyrus, and in the right inferior and superior parietal lobules.

Neuroscience, 2008

Reading the facial expression of other people is a fundamental skill for social interaction. Human facial expressions of emotions are readily recognized but may also evoke the same experiential emotional state in the observer. We used event-related functional magnetic resonance imaging and multi-channel electroencephalography to determine in 14 right-handed healthy volunteers (29؎ 6 years) which brain structures mediate the perception of such a shared experiential emotional state. Statistical parametric mapping showed that an area in the dorsal medial frontal cortex was specifically activated during the perception of emotions that reflected the seen happy and sad emotional face expressions. This area mapped to the pre-supplementary motor area which plays a central role in control of behavior. Low resolution brain electromagnetic tomography-based analysis of the encephalographic data revealed that the activation was detected 100 ms after face presentation onset lasting until 740 ms. Our observation substantiates recently emerging evidence suggesting that the subjective perception of an experiential emotional state-empathy-is mediated by the involvement of the dorsal medial frontal cortex.

Brain Research, 2011

Recognition and processing of emotional facial expression are crucial for social behavior and employ higher-order cognitive and visual working processes. In neuropsychiatric disorders, impaired emotion recognition most frequently concerned three specific emotions, i.e., anger, fear, and disgust. As incorrect processing of (neutral) facial stimuli per se might also underlie a v a i l a b l e a t w w w . s c i e n c e d i r e c t . c o m w w w . e l s e v i e r . c o m / l o c a t e / b r a i n r e s

American Journal of Psychiatry, 1999

Objective: To assist in the development of a model for the psychopathology of emotions, the present study sought to identify the neural circuits associated with the evaluation of visual stimuli for emotional valence. Method: Seventeen healthy individuals were shown three sets of emotionally laden pictures carrying pleasant, unpleasant, and neutral content. While subjects evaluated the picture set for emotional valence, regional cerebral blood flow was measured with the use of [ 15 O] water positron emission tomography. Subjective ratings of the emotional valence of the picture sets were recorded. Data were analyzed by comparing the images acquired during the neutral condition with the unpleasant and pleasant image sets and the unpleasant and pleasant conditions with each other. Results: Processing of pleasant stimuli was associated with increased blood flow in the dorsal-lateral, orbital, and medial frontal cortex relative to the unpleasant condition and in the cingulate, precuneus, and visual cortex relative to the neutral condition. Evaluation of unpleasant stimuli activated the amygdala, visual cortex, and cerebellum relative to the pleasant condition and the nucleus accumbens, precuneus, and visual cortex relative to the neutral condition. Conclusions: Observing and assigning emotional value to unpleasant stimuli produced activations in subcortical limbic regions, whereas evaluation of pleasant stimuli produced activations in cortical limbic areas. These findings are consistent with the notion of a subcortical and archaic danger recognition system and a system detecting pleasantness in events and situations that is phylogenetically younger, involving primarily the prefrontal cortex.

2018

Valence and arousal are psychological constructs that powerfully explain variance in brain function and behavior. However, different experimenters make different choices about how to implement and model experimental manipulations along these dimensions, as there are options when it comes to choosing theoretical assumptions regarding the nature of these variables. This paper demonstrates how choosing between two widely accepted theories of affect to model a single fMRI dataset markedly changes the functional brain activity associated with the affective manipulation. Furthermore, combining the functional maps yielded from both models uncovers organized patterns of activity that would have gone undetected using either model alone: (a) valence is represented along a gradient in the right fusiform gyrus and (b) distinct locations within the amygdala respond to arousal and negative valence. More generally, these data highlight the contingency between theoretical assumptions and empirical ...

Neuroimage, 2003

Previous studies have shown that during the presentation of emotionally loaded visual stimuli, activity increases in the visual and limbic cortices. This study focuses on empathic reactions induced by presenting pictures of situations and facial expressions from a “third party” point of view only. We measured regional changes in blood flow (rCBF) in nine healthy subjects while they were looking at neutral, positive, or negative emotional pictures of low (facial expressions) and high (persons in real-life situations) social complexity. A significant rCBF increase occurred in the right posterior fusiform gyrus during presentation of emotional pictures of both low and high social complexity. We also observed an interaction between emotionality and social complexity in the left inferior occipital gyrus for situations, where emotionality produced a significantly larger rCBF increase for situations than faces. No significant rCBF changes were observed in the amygdala or other parts of the limbic system. A significant rCBF decrease was found in the right inferior medial prefrontal cortex during presentation of the emotional pictures. This is discussed with respect to the “default mode of the brain” theory. We suggest that there is a neural network in the posterior fusiform and inferior occipital gyrus specialized in identifying emotionally important visual clues. Messages from this and other areas converge to the medial prefrontal cortex, to be evaluated in terms of relevance for attention. We believe that this is a crucial part of a network used in normal empathic reactions and social interactions.

Neuroimage, 2002

Neuroimaging studies with positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have begun to describe the functional neuroanatomy of emotion. Taken separately, specific studies vary in task dimensions and in type(s) of emotion studied and are limited by statistical power and sensitivity. By examining findings across studies, we sought to determine if common or segregated patterns of activations exist across various emotional tasks. We reviewed 55 PET and fMRI activation studies (yielding 761 individual peaks) which investigated emotion in healthy subjects. Peak activation coordinates were transformed into a standard space and plotted onto canonical 3-D brain renderings. We divided the brain into 20 nonoverlapping regions, and characterized each region by its responsiveness across individual emotions (positive, negative, happiness, fear, anger, sadness, disgust), to different induction methods (visual, auditory, recall/imagery), and in emotional tasks with and without cognitive demand. Our review yielded the following summary observations: (1) The medial prefrontal cortex had a general role in emotional processing; (2) fear specifically engaged the amygdala; (3) sadness was associated with activity in the subcallosal cingulate; (4) emotional induction by visual stimuli activated the occipital cortex and the amygdala; (5) induction by emotional recall/imagery recruited the anterior cingulate and insula; (6) emotional tasks with cognitive demand also involved the anterior cingulate and insula. This review provides a critical comparison of findings across individual studies and suggests that separate brain regions are involved in different aspects of emotion.