We used functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) to measure neural changes associated with training configural processing in congenital prosopagnosia, a condition in which face identification abilities are not properly developed in the absence of brain injury or visual problems. We designed a task that required discriminating faces by their spatial configuration and, after extensive training, prosopagnosic MZ significantly improved at face identification. Event-related potential results revealed that although the N170 was not selective for faces before training, its selectivity after training was normal. fMRI demonstrated increased functional connectivity between ventral occipital temporal face-selective regions (right occipital face area and right fusiform face area) that accompanied improvement in face recognition. Several other regions showed fMRI activity changes with training; the majority of these regions increased connectivity with face-selective regions. Together, the neural mechanisms associated with face recognition improvements involved strengthening early face-selective mechanisms and increased coordination between face-selective and nonselective regions, particularly in the right hemisphere.

Neuropsychological, event-related potential (ERP), and functional magnetic resonance imaging (fMRI) methods were combined to provide a comprehensive description of performance and neurobiological profiles for K.W., a case of congenital prosopagnosia. We demonstrate that K.W.'s visual perception is characterized by almost unprecedented inability to identify faces, a large bias toward local features, and an extreme deficit in global/configural processing that is not confined to faces. This pattern could be appropriately labeled congenital integrative prosopagnosia , and accounts for some, albeit not all, cases of face recognition impairments without identifiable brain lesions. Absence of face selectivity is evident in both biological markers of face processing, fMRI (the fusiform face area [FFA]), and ERPs (N170). Nevertheless, these two neural signatures probably manifest different perceptual mechanisms. Whereas the N170 is triggered by the occurrence of physiognomic stimuli in the visual field, the deficient face-selective fMRI activation in the caudal brain correlates with the severity of global processing deficits. This correlation suggests that the FFA might be associated with global/configural computation, a crucial part of face identification.

In some individuals, a visually presented letter or number automatically evokes the perception of a specific color, an experience known as color-grapheme synesthesia. It has been suggested that parietal binding mechanisms play a role in the phenomenon. We used a noninvasive stimulation technique, transcranial magnetic stimulation (TMS), to determine whether the posterior parietal lobe is critical for the integration of color and shape in color-grapheme synesthesia, as it appears to be for normal color-shape binding. Using a color-naming task with colored letters that were either congruent or incongruent with the synesthetic photism, we demonstrate that inhibition of the right posterior parietal lobe with repetitive TMS transiently attenuates synesthetic binding. These findings suggest that synesthesia (the induction of color from shape) relies on similar mechanisms as found in normal perception (where the perception of color is induced by wavelength).

Recent studies indicate that auditory tone presentation and auditory alerting can temporarily ameliorate visuospatial attention deficits in patients with unilateral neglect [Frassinetti, F., Pavani, F., & Ladavas, E. Acoustical vision of neglected stimuli: Interaction among spatially converging audiovisual inputs in neglect patients. Journal of Cognitive Neuroscience, 14, 62–69, 2002; Robertson, I. H., Mattingley, J. B., Rorden, C., & Driver, J. Phasic alerting of neglect patients overcomes their spatial deficit in visual awareness. Nature, 395, 169–172, 1998]. The current study investigated proposed mechanisms of cross-modal interaction to determine conditions in which auditory stimulation affects spatial and nonspatially lateralized attention deficits in a patient with hemispatial neglect. In Experiment 1, a target was presented among related distracters (conjunction search) while a tone was presented either bilaterally or in a congruent or incongruent spatial location with respect to the visual target. Whereas the results suggest a benefit of both general alerting and cross-modal spatial integration on visual search efficiency, the most significant improvement occurred when the target and tone were both presented in contralesional space. In Experiment 2, the effect of auditory alerting on selective attention was examined in a rapid serial visual search procedure with visual targets embedded in a stream of distracters presented at central fixation. When two targets were presented without an alerting tone, the patient missed the second target for up to 1000 msec after the first target appeared (a finding known as the “attentional blink” [AB] and, on average, about 400–500 msec in normals). An alerting tone presented at a fixed temporal location significantly reduced the AB in a tone-duration-dependent manner. Experiment 3 examined the effect of cross-modal space on selective attention in an AB paradigm in which T2 occurred randomly to the left or right of T1 with a spatially congruent or incongruent tone. Discrimination of T2 in contralesional space significantly improved when the tone was presented in the same location, and was impaired when the tone was presented on the ipsilesional side. The findings are discussed as they relate to cross-modal interactions and their influence on spatial and nonspatially lateralized attention deficits in neglect.

Although configural processing is considered a hallmark of normal face perception in humans, there is ample evidence that processing face components also contributes to face recognition and identification. Indeed, most contemporary models posit a dual-code view in which face identification relies on the analysis of individual face components as well as the spatial relations between them. We explored the interplay between processing face configurations and inner face components by recording the N170, an event-related potential component that manifests early detection of faces. In contrast to a robust N170 effect elicited by line-drawn schematic faces compared to line-drawn schematic objects, no N170 effect was found if a pair of small objects substituted for the eyes in schematic faces. However, if a pair of two miniaturized faces substituted for the eyes, the N170 effect was restored. Additional experiments ruled out an explanation on the basis of miniaturized faces attracting attention independent of their location in a face-like configuration and show that global and local face characteristics compete for processing resources when in conflict. The results are discussed as they relate to normal and abnormal face processing.

In synesthesia, certain stimuli (“inducers”) may give rise to perceptual experience in additional modalities not normally associated with them (“concurrent”). For example, color-grapheme synesthetes automatically perceive achromatic numbers as colored (e.g., 7 is turquoise). Although synesthetes know when a given color matches the one evoked by a certain number, colors do not automatically give rise to any sort of number experience. The behavioral consequences of synesthesia have been documented using Stroop-like paradigms, usually using color judgments. Owing to the unidirectional nature of the synesthetic experience, little has been done to obtain performance measures that could indicate whether bidirectional cross-activation occurs in synesthesia. Here it is shown that colors do implicitly evoke numerical magnitudes in color-grapheme synesthetes, but not in nonsynesthetic participants. It is proposed that bidirectional co-activation of brain areas is responsible for the links between color and magnitude processing in color-grapheme synesthesia and that unidirectional models of synesthesia might have to be revised.

Electrophysiological recordings in monkeys have now revealed several brain regions that contain bimodal visuotactile neurons capable of responding to either tactile or visual stimuli placed on or near the hands, arms, and face. These cells have now been found in frontal, parietal, and subcortical areas of the monkey brain, suggesting a cortical network of neurons that preferentially represent near peripersonal space. The degree to which the visual responses of such cells rely on input from the primary visual cortex and the extent to which they may contribute to visual perception is not completely understood. Nonetheless, recent neuropsychological studies suggest that a similar representation of near space may be bimodally coded in humans as well. Given the accumulating evidence for specialized processing of visual stimuli placed near the hands and arms, we hypothesized that arm position may be capable of modulating human visual ability. Here we report the case of WM, who lost his ability to see in his left visual hemifield after sustaining damage to his right primary visual cortex. Interestingly, the placement of WM's left arm into his “blind” field resulted in significantly better detection of left visual field stimuli compared to when his hand was placed in his lap at midline. Moreover, we found this attenuation to be confined to stimuli presented within reaching distance (unless a tool that extended WM's reach was held while he performed the test). These findings are highly consistent with the characteristics of the bimodal visuo-tactile neurons that have been described in monkeys. Thus, it seems that arm position can modulate human visual ability, even after damage to the primary visual cortex. This study provides an exciting bridge between monkey neurophysiology and human visual capacity while also offering a novel approach for improving visual defects acquired via cortical injury.

There is substantial evidence that the primate cortex is grossly divided into two functional streams, an occipital-parietal-frontal pathway that processes “where” and an occipital-temporal-frontal pathway that processes “what” (Ungerleider and Mishkin, 1982). In humans, bilateral occipital-parietal damage results in severe spatial deficits and a neuropsychological disorder known as Balint's syndrome in which a single object can be perceived (simultanagnosia) but its location is unknown (Balint, 1995). The data reported here demonstrate that spatial information for visual features that cannot be explicitly located is represented normally below the level of spatial awareness even with large occipital-parietal lesions. They also demonstrate that parietal damage does not affect preattentive spatial coding of feature locations or complex spatial relationships between parts of a stimulus despite explicit spatial deficits and simultanagnosia.

Preattentive processes such as perceptual grouping are thought to be important in the initial guidance of visual attention and may also operate in unilateral neglect by contributing to the definition of a task-appropriate reference frame. We explored this question with a visual search task in which patients with unilateral visual neglect (5 with right-, 2 with left-hemisphere damage) searched a diamond-shaped matrix for a conjunction target that shared one feature with each of two distractor elements. Additional grouping stimuli appeared as flanks either on the left, right, or both sides of the central matrix, and significantly changed performance in the search task. As expected, when flanks appeared only on the ipsilesional side a decrement in search performance was observed, but the further addition of contralesional flanks actually reduced the decrement and returned performance to near baseline levels. These data suggest that flanking stimuli on the neglected contralesional side of visual space can influence the reference frame by grouping with task-relevant stimuli, and that this preattentive influence can be preserved in patients with unilateral visual neglect.

Patients with hemispatial neglect fail to respond to stimuli on one side of space. We assessed to what extent the complexity and number of visual stimuli on both sides determine the severity of neglect. Patients with neglect were required to find specified targets in a cluttered visual field. Two sets of stimuli were used. One set produced effortless and parallel search performance in normal controls; the other set was more complex and produced serial search performance in normal controls. Both sets of stimuli resulted in a serial performance pattern in the patients. Their baseline search performance on both sides was similar when all stimulus items were restricted to one side. A pronounced difference between the two sides was evident when stimuli appeared on both sides. Search for targets on the intact side of space was unaffected by distractors on the neglected side, whereas search for targets on the neglected side was slowed disproportionately by distractors on the intact side. The slowing on the neglected side was more severe during the more demanding search task and when more items were present on the intact side. The results indicate that neglect is associated with an inability to move attention from objects on the intact side to items on the neglected side.