fMRI studies of recognition memory have often been interpreted to mean that the hippocampus selectively subserves recollection and that adjacent regions selectively subserve familiarity. Yet, many of these studies have confounded recollection and familiarity with strong and weak memories. In a source memory experiment, we compared correct source judgments (which reflect recollection) and incorrect source judgments (often thought to reflect familiarity) while equating for old–new memory strength by including only high-confidence hits in the analysis. Hippocampal activity associated with both correct source judgments and incorrect source judgments exceeded the activity associated with forgotten items and did so to a similar extent. Further, hippocampal activity was greater for high-confidence old decisions relative to forgotten items even when source decisions were at chance. These results identify a recollection signal in the hippocampus and may identify a familiarity signal as well. Similar results were obtained in the parahippocampal gyrus. Unlike in the medial temporal lobe, activation in prefrontal cortex increased differentially in association with source recollection.

Remembering and knowing are states of awareness that accompany the retrieval of facts, faces, and experiences from our past. Although originally intended to separate episodic from semantic memory, the dominant view today is that recollection-based decisions underlie remember responses, whereas familiarity-based decisions underlie know responses. Many functional magnetic resonance imaging (fMRI) studies as well as lesion studies have relied on the remember/know procedure to identify the neural correlates of recollection and familiarity. An implicit assumption of this approach is that know responses, which are thought to tap familiarity-based decisions, are devoid of recollection. We investigated this issue by using a source memory procedure and found that the accuracy of source recollection was significantly above chance for studied words that were declared to be old and known. Critically, this held true even when the source decision was made before the old/new decision (i.e., even after successful recollection had just occurred). Our results show that although recollection and familiarity may be different processes, the remember/know paradigm does not probe them directly. As such, dissociations involving remember/know judgments in fMRI studies and in studies involving amnesic patients should not be construed as dissociations between recollection and familiarity.