Research on visual face perception has revealed a region in the ventral anterior temporal lobes, often referred to as the anterior temporal face patch (ATFP), which responds strongly to images of faces. To date, the selectivity of the ATFP has been examined by contrasting responses to faces against a small selection of categories. Here, we assess the selectivity of the ATFP in humans with a broad range of visual control stimuli to provide a stronger test of face selectivity in this region. In Experiment 1, participants viewed images from 20 stimulus categories in an event-related fMRI design. Faces evoked more activity than all other 19 categories in the left ATFP. In the right ATFP, equally strong responses were observed for both faces and headless bodies. To pursue this unexpected finding, in Experiment 2, we used multivoxel pattern analysis to examine whether the strong response to face and body stimuli reflects a common coding of both classes or instead overlapping but distinct representations. On a voxel-by-voxel basis, face and whole-body responses were significantly positively correlated in the right ATFP, but face and body-part responses were not. This finding suggests that there is shared neural coding of faces and whole bodies in the right ATFP that does not extend to individual body parts. In contrast, the same approach revealed distinct face and body representations in the right fusiform gyrus. These results are indicative of an increasing convergence of distinct sources of person-related perceptual information proceeding from the posterior to the anterior temporal cortex.

Recent studies indicate that medial-temporal lobe (MTL) damage, either from focal lesions or neurodegenerative disease (e.g., semantic dementia), impairs perception as well as long-term declarative memory. Notably, however, these two patient groups show different performance for meaningful versus unfamiliar stimuli. In amnesics with nonprogressive MTL lesions, the use of meaningful stimuli, compared with unfamiliar items, boosted discrimination performance. In semantic dementia, a condition characterized by progressive deterioration of conceptual knowledge in the context of anterolateral temporal lobe damage, performance for meaningful stimuli was equivalent to that for unfamiliar items. To further investigate these findings, we scanned healthy volunteers while they performed odd-one-out discriminations involving familiar (i.e., meaningful/famous) and unfamiliar (i.e., novel) objects and faces and a baseline task of size oddity. Outside the scanner, volunteers' recognition memory was assessed. We found above baseline activity in the perirhinal cortex and hippocampus for all object and face discriminations and above baseline activity in the temporal pole for all face discriminations. The comparison of meaningful, relative to novel, faces and objects, revealed increased activity in the perirhinal cortex and hippocampus. In the temporal pole, we also found activity related to meaningfulness for faces but not for objects. Importantly, these meaningfulness effects were evident even for discriminations that were not subsequently well remembered, suggesting that the difference between meaningful and novel stimuli reflects perceptual or conceptual processes rather than solely incidental encoding into long-term memory. The results provide further evidence that the MTL is recruited during complex perceptual discrimination and additionally suggest that these structures are recruited in semantic processing of objects and faces.

Lesion and neuroimaging studies suggest that orbito-frontal cortex (OFC) supports temporal aspects of episodic memory. However, it is unclear whether OFC contributes to the encoding and/or retrieval of temporal context and whether it is selective for temporal relative to nontemporal (spatial) context memory. We addressed this issue with two complimentary studies: functional magnetic resonance imaging to measure OFC activity associated with successful temporal and spatial context memory during encoding and retrieval in healthy young participants, and a neuropsychological investigation to measure changes in spatial and temporal context memory in OFC lesion patients. Imaging results revealed that OFC contributed to encoding and retrieval of associations between objects and their temporal but not their spatial contexts. Consistent with this, OFC patients exhibited impairments in temporal but not spatial source memory accuracy. These results suggest that OFC plays a critical role in the formation and subsequent retrieval of temporal context.

Previous studies have suggested differences in the neural substrates of recognition memory when the contributions of perceptual and semantic information are manipulated. In a within-subjects design PET study, we investigated the neural correlates of the following factors: material type (objects or faces), semantic knowledge (familiar or unfamiliar items), and perceptual similarity at study and test (identical or different pictures). There was consistent material-specific lateralization in frontal and temporal lobe regions when the retrieval of different types of nonverbal stimuli was compared, with objects activating bilateral areas and faces preferentially activating the right hemisphere. Retrieval of memories for nameable, familiar items was associated with increased activation in the left ventrolateral prefrontal cortex, while memory for unfamiliar items involved occipital regions. Recognition memory for different pictures of the same item at study and test produced blood flow increase in left inferior temporal cortex. These results have implications for our understanding of the neural correlates of perceptual and semantic contributions to recognition memory.