Substantial evidence indicates that subjective value is adapted to the statistics of reward expected within a given temporal context. However, how these contextual expectations are learned is poorly understood. To examine such learning, we exploited a recent observation that participants performing a gambling task adjust their preferences as a function of context. We show that, in the absence of contextual cues providing reward information, an average reward expectation was learned from recent past experience. Learning dependent on contextual cues emerged when two contexts alternated at a fast rate, whereas both cue-independent and cue-dependent forms of learning were apparent when two contexts alternated at a slower rate. Motivated by these behavioral findings, we reanalyzed a previous fMRI data set to probe the neural substrates of learning contextual reward expectations. We observed a form of reward prediction error related to average reward such that, at option presentation, activity in ventral tegmental area/substantia nigra and ventral striatum correlated positively and negatively, respectively, with the actual and predicted value of options. Moreover, an inverse correlation between activity in ventral tegmental area/substantia nigra (but not striatum) and predicted option value was greater in participants showing enhanced choice adaptation to context. The findings help understanding the mechanisms underlying learning of contextual reward expectation.

Dopamine plays a key role in motivation. Phasic dopamine response reflects a reinforcement prediction error (RPE), whereas tonic dopamine activity is postulated to represent an average reward that mediates motivational vigor. However, it has been hard to find evidence concerning the neural encoding of average reward that is uncorrupted by influences of RPEs. We circumvented this difficulty in a novel visual search task where we measured participants' button pressing vigor in a context where information (underlying an RPE) about future average reward was provided well before the average reward itself. Despite no instrumental consequence, participants' pressing force increased for greater current average reward, consistent with a form of Pavlovian effect on motivational vigor. We recorded participants' brain activity during task performance with fMRI. Greater average reward was associated with enhanced activity in dopaminergic midbrain to a degree that correlated with the relationship between average reward and pressing vigor. Interestingly, an opposite pattern was observed in subgenual cingulate cortex, a region implicated in negative mood and motivational inhibition. These findings highlight a crucial role for dopaminergic midbrain in representing aspects of average reward and motivational vigor.

This study assessed the impact of serotonin transporter genotype (5-HTTLPR) on regional responses to emotional faces in the amygdala and subgenual cingulate cortex (sgACC), while subjects performed a gender discrimination task. Although we found no evidence for greater amygdala reactivity or reduced amygdala–sgACC coupling in short variant 5-HTTLPR homozygotes (s/s), we observed an interaction between genotype and emotion in sgACC. Only long variant homozygotes (la/la) exhibited subgenual deactivation to fearful versus neutral faces, whereas the effect in s/s subjects was in the other direction. This absence of subgenual deactivation in s/s subjects parallels a recent finding in depressed subjects [Grimm, S., Boesiger, P., Beck, J., Schuepbach, D., Bermpohl, F., Walter, M., et al. Altered negative BOLD responses in the default-mode network during emotion processing in depressed subjects. Neuropsychopharmacology, 34, 932–943, 2009]. Taken together, the findings suggest that subgenual cingulate activity may play an important role in regulating the impact of aversive stimuli, potentially conferring greater resilience to the effects of aversive stimuli in la/la subjects. Using dynamic causal modeling of functional magnetic resonance imaging data, we explored the effects of genotype on effective connectivity and emotion-specific changes in coupling across a network of regions implicated in social processing. Viewing fearful faces enhanced bidirectional excitatory coupling between the amygdala and the fusiform gyrus, and increased the inhibitory influence of the amygdala over the sgACC, although this modulation of coupling did not differ between the genotype groups. The findings are discussed in relation to the role of sgACC and serotonin in moderating responses to aversive stimuli [Dayan, P., & Huys, Q. J., Serotonin, inhibition, and negative mood. PLoS Comput Biol, 4, e4, 2008; Mayberg, H. S., Liotti, M., Brannan, S. K., McGinnis, S., Mahurin, R. K., Jerabek, P. A., et al. Reciprocal limbic–cortical function and negative mood: Converging PET findings in depression and normal sadness. Am J Psychiatry, 156, 675–682, 1999].

Real-world decision-making often involves social considerations. Consequently, the social value of stimuli can induce preferences in choice behavior. However, it is unknown how financial and social values are integrated in the brain. Here, we investigated how smiling and angry face stimuli interacted with financial reward feedback in a stochastically rewarded decision-making task. Subjects reliably preferred the smiling faces despite equivalent reward feedback, demonstrating a socially driven bias. We fit a Bayesian reinforcement learning model to factor the effects of financial rewards and emotion preferences in individual subjects, and regressed model predictions on the trial-by-trial fMRI signal. Activity in the subcallosal cingulate and the ventral striatum, both involved in reward learning, correlated with financial reward feedback, whereas the differential contribution of social value activated dorsal temporo-parietal junction and dorsal anterior cingulate cortex, previously proposed as components of a mentalizing network. We conclude that the impact of social stimuli on value-based decision processes is mediated by effects in brain regions partially separable from classical reward circuitry.

Regions of the occipital and temporal lobes, including a region in the fusiform gyrus (FG), have been proposed to constitute a “core” visual representation system for faces, in part because they show face selectivity and face repetition suppression. But recent fMRI studies of developmental prosopagnosics (DPs) raise questions about whether these measures relate to face processing skills. Although DPs manifest deficient face processing, most studies to date have not shown unequivocal reductions of functional responses in the proposed core regions. We scanned 15 DPs and 15 non-DP control participants with fMRI while employing factor analysis to derive behavioral components related to face identification or other processes. Repetition suppression specific to facial identities in FG or to expression in FG and STS did not show compelling relationships with face identification ability. However, we identified robust relationships between face selectivity and face identification ability in FG across our sample for several convergent measures, including voxel-wise statistical parametric mapping, peak face selectivity in individually defined “fusiform face areas” (FFAs), and anatomical extents (cluster sizes) of those FFAs. None of these measures showed associations with behavioral expression or object recognition ability. As a group, DPs had reduced face-selective responses in bilateral FFA when compared with non-DPs. Individual DPs were also more likely than non-DPs to lack expected face-selective activity in core regions. These findings associate individual differences in face processing ability with selectivity in core face processing regions. This confirms that face selectivity can provide a valid marker for neural mechanisms that contribute to face identification ability.

“Regret aversion” is proposed to explain a tendency to avoid future choices that have induced past regret. However, regret might also motivate us to repeat previous regret-related choices to make up for their previous selection, a behavior resembling “chasing” in the context of gambling. In the current experiment, we acquired fMRI brain data while participants placed monetary bets on repeated gambles. Behaviorally, participants showed a tendency to repeat previously regret-related choices (operationalized as those leading to an outcome worse than what might have been), an effect restricted to early runs of the task. At gamble outcome, we show a reduction in ventral striatal activity for regret-related relative to relief-related outcomes. Critically, this modulation was only seen when subjects were responsible for the bet choice. Activity in dorsal striatum was associated with an influence of previous regret on participants' subsequent choices, which is evident in increased activity when regret-related choices were repeated, relative to avoided, on the next trial. Our findings indicate that regret can lead to choice repetition as if seeking to make up for our mistakes and in so doing may lead to subsequent chasing behavior.

The lateral occipital complex (LOC) is a set of areas in the human occipito-temporal cortex responding to objects as opposed to low-level control stimuli. Conventional functional magnetic resonance imaging (fMRI) analysis methods based on regional averages could not detect signals discriminative of different types of objects in this region. Here, we examined fMRI signals using multivariate pattern recognition (support vector classification) to systematically explore the nature of object-related information available in fine-grained activity patterns in the LOC. Distributed fMRI signals from the LOC allowed for above-chance discrimination not only of the category but also of within-category exemplars of everyday man-made objects, and such exemplar-specific information generalized across changes in stimulus size and viewpoint, particularly in posterior subregions. Object identity could also be predicted from responses of the early visual cortex, even significantly across the changes in size and viewpoint used here. However, a dissociation was observed between these two regions of interest in the degree of discrimination for objects relative to size: In the early visual cortex, two different sizes of the same object were even better discriminated than two different objects (in accordance with measures of pixelwise stimulus similarity), whereas the opposite was true in the LOC. These findings provide the first evidence that direct evoked fMRI activity patterns in the LOC can be different for individual object exemplars (within a single category). We propose that pattern recognition methods as used here may provide an alternative approach to study mechanisms of neuronal representation based on aspects of the fMRI response independent of those assessed in adaptation paradigms.

We compared the contribution of featural information and second-order spatial relations (spacing between features) in face processing. A fully factorial design has the same or different “features” (eyes, mouth, and nose) across two successive displays, whereas, orthogonally, the second-order spatial relations between those features were the same or different. The range of such changes matched the possibilities within the population of natural face images. Behaviorally, we found that judging whether two successive faces depicted the same person was dominated by features, although second-order spatial relations also contributed. This influence of spatial relations correlated, for individual subjects, with their skill at recognition of faces (as famous, or as previously exposed) in separate behavioral tests. Using the same repetition design in functional magnetic resonance imaging, we found feature-dependent effects in the lateral occipital and right fusiform regions. In addition, there were spatial relation effects in the bilateral inferior occipital gyrus and right fusiform that correlated with individual differences in (separately measured) behavioral sensitivity to those changes. The results suggest that featural and second-order spatial relation aspects of faces make distinct contributions to behavioral discrimination and recognition, with features contributing most to face discrimination and second-order spatial relational aspects correlating best with recognition skills. Distinct neural responses to these aspects were found with functional magnetic resonance imaging, particularly when individual skills were taken into account for the impact of second-order spatial relations.

The element of surprise, a necessary condition for the experience of humor, often derives from the fact that the alternative interpretation/resolution offered by the punch line of a joke is physically or socially forbidden. Children's humor typifies violation of physical norms, whereas adult humor typically pushes the boundaries of social norms. Excess norm violation, to the point of offending, can attenuate the experience of humor/mirth. To examine the neural basis of regulation of affective experience of humor by social norms, we scanned 16 normal subjects while they viewed a series of cartoons that varied in funniness and social acceptability. Behavioral results indicated two separate groups of subjects, those who found the cartoons less offensive and those who found them more offensive. In the group that found the jokes more offensive, there was a negative correlation between funniness and social inappropriateness. In this group, the corresponding Humor by Social inappropriateness interaction during functional magnetic resonance imaging revealed enhanced activation in the right hippocampus along with relative deactivation in the ventral medial prefrontal cortex (VMPFC). By contrast, the Funniness by Social appropriateness interaction resulted in activation in the VMPFC and relative deactivation in the right hippocampus. These results suggest that the regulation of humor by social norms involves reciprocal response patterns between VMPFC and hippocampus regions implicated in contextual regulation of behavior and memory, respectively.

Cognitive strategies used in volitional emotion regulation include self-distraction and reappraisal (reinterpretation). There is debate as to what the psychological and neurobiological mechanisms underlying these strategies are. For example, it is unclear whether self-distraction and reappraisal, although distinct at a phenomenological level, are also mediated by distinct neural processes. This is partly because imaging studies on reappraisal and self-distraction have been performed in different emotional contexts and are difficult to compare. We have therefore investigated the neural correlates of self-distraction, as indexed by a thought suppression task, in an anticipatory anxiety paradigm previously employed by us to study reappraisal. Brain activity was measured by functional magnetic resonance imaging. We show that self-distraction recruits the left lateral prefrontal cortex. Based on a review of the existing data, we develop a process model of cognitive emotion regulation. The model posits that both self-distraction and reappraisal attenuate emotional reactions through replacement of emotional by neutral mental contents but achieve replacement in different ways. This is associated with a dependence of self-distraction on a left prefrontal production function, whereas reappraisal depends on a right prefrontal higher order monitoring process.

By testing the facial fear-recognition ability of 341 men in the general population, we show that 8.8% have deficits akin to those seen with acquired amygdala damage. Using psychological tests and functional magnetic resonance imaging (fMRI) we tested the hypothesis that poor fear recognition would predict deficits in other domains of social cognition and, in response to socially relevant stimuli, abnormal activation in brain regions that putatively reflect engagement of the “social brain.” On tests of “theory of mind” ability, 25 “low fear scorers” (LFS) performed significantly worse than 25 age- and IQ-matched “normal (good) fear scorers” (NFS). In fMRI, we compared evoked activity during a gender judgement task to neutral faces portraying different head and eye gaze orientations in 12 NFS and 12 LFS subjects. Despite identical between-group accuracy in gender discrimination, LFS demonstrated significantly reduced activation in amygdala, fusiform gyrus, and anterior superior temporal cortices when viewing faces with direct versus averted gaze. In a functional connectivity analysis, NFS show enhanced connectivity between the amygdala and anterior temporal cortex in the context of direct gaze; this enhanced coupling is absent in LFS. We suggest that important individual differences in social cognitive skills are expressed within the healthy male population, which appear to have a basis in a compromised neural system that underpins social information processing.

Attention can enhance processing for relevant information and suppress this for ignored stimuli. However, some residual processing may still arise without attention. Here we presented overlapping outline objects at study, with subjects attending to those in one color but not the other. Attended objects were subsequently recognized on a surprise memory test, whereas there was complete amnesia for ignored items on such direct explicit testing; yet reliable behavioral priming effects were found on indirect testing. Event-related fMRI examined neural responses to previously attended or ignored objects, now shown alone in the same or mirror-reversed orientation as before, intermixed with new items. Repetition-related decreases in fMRI responses for objects previously attended and repeated in the same orientation were found in the right posterior fusiform, lateral occipital, and left inferior frontal cortex. More anterior fusiform regions also showed some repetition decreases for ignored objects, irrespective of orientation. View-specific repetition decreases were found in the striate cortex, particularly for previously attended items. In addition, previously ignored objects produced some fMRI response increases in the bilateral lingual gyri, relative to new objects. Selective attention at exposure can thus produce several distinct long-term effects on processing of stimuli repeated later, with neural response suppression stronger for previously attended objects, and some response enhancement for previously ignored objects, with these effects arising in different brain areas. Although repetition decreases may relate to positive priming phenomena, the repetition increases for ignored objects shown here for the first time might relate to processes that can produce “negative priming” in some behavioral studies. These results reveal quantitative and qualitative differences between neural substrates of long-term repetition effects for attended versus unattended objects.

The ability to volitionally regulate emotions helps to adapt behavior to changing environmental demands and can alleviate subjective distress. We show that a cognitive strategy of detachment attenuates subjective and physiological measures of anticipatory anxiety for pain and reduces reactivity to receipt of pain itself. Using functional magnetic resonance imaging, we locate the potential site and source of this modulation of anticipatory anxiety in the medial prefrontal/anterior cingulate and anterolateral prefrontal cortex, respectively.

In two experiments, we examined event-related potentials (ERPs) elicited in an old/new recognition memory test by emotionally neutral visual objects that, at encoding, had been associated with neutrally, negatively, or positively valenced background contexts. In Experiment 2, subjects also judged the context in which the item had been studied. In Experiment 1, “left parietal” old/new ERP effects were elicited by correctly recognized items. Items encoded in emotional contexts, but not those studied in neutral contexts, elicited additional effects early in the recording epoch over lateral temporal scalp and, later, over left temporo-frontal scalp. In Experiment 2, “left parietal” and “right frontal” ERP effects were elicited by recognized items that attracted correct source judgments. Additional effects, an early lateral temporal positivity and a late-onset, left-sided positivity, were elicited by items studied in emotionally valenced contexts and attracting correct source judgments. Together, the findings indicate that retrieval processing is influenced by the emotional valence of the context in which an item is encoded, regardless of whether contextual information is task relevant.

Inductive inference underlies much of human cognition. The essential component of induction is hypothesis selection based on some criterion of relevance. The purpose of this study was to determine the neural substrate of inductive inference, particularly hypothesis selection, using fMRI. Ten volunteers were shown stimuli consisting of novel animals under two task conditions, and asked to judge whether all the animals in the set were the same type of animal. In one condition, subjects were given a rule that specified the criteria for “same type of animal.” In the other condition, subjects had to infer the rule without instruction. The two conditions were further factored into easy and difficult components. Rule inference was specifically associated with bilateral hippocampal activation while the task by difficulty interaction was associated with activation in right lateral orbital prefrontal cortex. We interpret the former in terms of semantic encoding of novel stimuli, and the latter in terms of hypothesis selection. Thus, we show an anatomical dissociation between task implementation and task difficulty that may correspond to a critical psychological distinction in the processes necessary for inductive inference.