Visual search is a fundamental human behavior, providing a gateway to understanding other sensory domains as well as the role of search in higher-order cognition. Search has been proposed to include two component processes: inefficient search (Search) and efficient search (Pop-out). According to extant research, these two processes map onto two separable neural systems located in the frontal and parietal association cortices. In this study, we use intracranial recordings from 23 participants to delineate the neural correlates of Search and Pop-out with an unprecedented combination of spatiotemporal resolution and coverage across cortical and subcortical structures. First, we demonstrate a role for the medial temporal lobe in visual search, on par with engagement in frontal and parietal association cortex. Second, we show a gradient of increasing engagement over anatomical space from dorsal to ventral lateral frontal cortex. Third, we confirm previous intracranial work demonstrating nearly complete overlap in neural engagement across cortical regions in Search and Pop-out. We further demonstrate Pop-out selectivity, manifesting as activity increase in Pop-out as compared to Search, in a distributed set of sites including frontal cortex. This result is at odds with the view that Pop-out is implemented in low-level visual cortex or parietal cortex alone. Finally, we affirm a central role for the right lateral frontal cortex in Search.

Anticipation, monitoring, and evaluation of the outcome of one's actions are at the core of proactive control. Individuals with lesions to OFC often demonstrate behaviors that indicate a lack of recognition or concern for the negative effects of their actions. Altered action timing has also been reported in these patients. We investigated the role of OFC in predicting and monitoring the sensory outcomes of self-paced actions. We studied patients with focal OFC lesions ( n = 15) and healthy controls ( n = 20) while they produced actions that infrequently evoked unexpected outcomes. Participants performed a self-paced, random generation task where they repeatedly pressed right and left buttons that were associated with specific sensory outcomes: a 1- and 2-kHz tone, respectively. Occasional unexpected action outcomes occurred (mismatch) that inverted the learned button–tone association (match). We analyzed ERPs to the expected and unexpected outcomes as well as action timing. Neither group showed post-mismatch slowing of button presses, but OFC patients had a higher number of fast button presses, indicating that they were inferior to controls at producing regularly timed actions. Mismatch trials elicited enhanced N2b-P3a responses across groups as indicated by the significant main effect of task condition. Planned within-group analyses showed, however, that patients did not have a significant condition effect, suggesting that the result of the omnibus analysis was driven primarily by the controls. Altogether, our findings indicate that monitoring of action timing and the sensory outcomes of self-paced actions as indexed by ERPs is impacted by OFC damage.

How does the human brain prioritize different visual representations in working memory (WM)? Here, we define the oscillatory mechanisms supporting selection of “where” and “when” features from visual WM storage and investigate the role of pFC in feature selection. Fourteen individuals with lateral pFC damage and 20 healthy controls performed a visuospatial WM task while EEG was recorded. On each trial, two shapes were presented sequentially in a top/bottom spatial orientation. A retro-cue presented mid-delay prompted which of the two shapes had been in either the top/bottom spatial position or first/second temporal position. We found that cross-frequency coupling between parieto-occipital alpha (α; 8–12 Hz) oscillations and topographically distributed gamma (γ; 30–50 Hz) activity tracked selection of the distinct cued feature in controls. This signature of feature selection was disrupted in patients with pFC lesions, despite intact α–γ coupling independent of feature selection. These findings reveal a pFC-dependent parieto-occipital α–γ mechanism for the rapid selection of visual WM representations.

Previous research provided evidence for the critical importance of the PFC and BG for reactive motor inhibition, that is, when actions are cancelled in response to external signals. Less is known about the role of the PFC and BG in proactive motor inhibition, referring to preparation for an upcoming stop signal. In this study, patients with unilateral lesions to the BG or lateral PFC performed in a cued go/no-go task, whereas their EEG was recorded. The paradigm called for cue-based preparation for upcoming, lateralized no-go signals. Based on previous findings, we focused on EEG indices of cognitive control (prefrontal beta), motor preparation (sensorimotor mu/beta, contingent negative variation [CNV]), and preparatory attention (occipital alpha, CNV). On a behavioral level, no differences between patients and controls were found, suggesting an intact ability to proactively prepare for motor inhibition. Patients showed an altered preparatory CNV effect, but no other differences in electrophysiological activity related to proactive and reactive motor inhibition. Our results suggest a context-dependent role of BG and PFC structures in motor inhibition, being critical in reactive, unpredictable contexts, but less so in situations where one can prepare for stopping on a short timescale.

Little is known about language impairment in brain tumor patients, especially in the presurgical phase. Impairment in this population may be missed because standardized tests fail to capture mild deficits. Additionally, neuroplasticity may also contribute to minimizing language impairments. We examined 14 presurgical patients with brain tumors in the language-dominant hemisphere using magnetoencephalography (MEG) while they performed a demanding picture–word interference task, that is, participants name pictures while ignoring distractor words. Brain tumor patients had behavioral picture-naming effects typically observed in healthy controls. The MEG responses also showed the expected pattern in its timing and amplitude modulation typical of controls, but with an altered spatial distribution of right hemisphere sources, in contrast to the classic left hemisphere source found in healthy individuals. This finding supports tumor-induced neural reorganization of language before surgery. Crucially, the use of electrophysiology allowed us to show the “same” neuronal response in terms of its timing and amplitude modulation in the right hemisphere, supporting the hypothesis that the processes performed by the right hemisphere following reorganization are similar in nature to those (previously) performed by the left hemisphere. We also identified one participant with a fast-growing tumor affecting large parts of critical language areas and underlying ventral and dorsal white matter tracts who showed a deviant pattern in behavior and in the MEG event-related responses. In conclusion, our results attest to the validity of using a demanding picture-naming task in presurgical patients and provide evidence for neuroplasticity, with the right hemisphere performing similar computations as the left hemisphere typically performs.

Two primary functions attributed to the hippocampus and prefrontal cortex (PFC) network are retaining the temporal and spatial associations of events and detecting deviant events. It is unclear, however, how these two functions converge into one mechanism. Here, we tested whether increased activity with perceiving salient events is a deviant detection signal or contains information about the event associations by reflecting the magnitude of deviance (i.e., event saliency). We also tested how the deviant detection signal is affected by the degree of anticipation. We studied regional neural activity when people watched a movie that had varying saliency of a novel or an anticipated flow of salient events. Using intracranial electroencephalography from 10 patients, we observed that high-frequency activity (50–150 Hz) in the hippocampus, dorsolateral PFC, and medial OFC tracked event saliency. We also observed that medial OFC activity was stronger when the salient events were anticipated than when they were novel. These results suggest that dorsolateral PFC and medial OFC, as well as the hippocampus, signify the saliency magnitude of events, reflecting the hierarchical structure of event associations.

When we respond to a stimulus, our decisions are based not only on external stimuli but also on our ongoing performance. If the response deviates from our goals, monitoring and decision-making brain areas interact so that future behavior may change. By taking advantage of natural variation in error salience, as measured by the RT taken to correct an error (RT EC ), here we argue that an evidence accumulation framework provides a potential underlying mechanism for this variable process of error identification and correction, as evidenced by covariation of frontal monitoring and parietal decision-making processes. We study two early EEG signals linked to monitoring within medial PFC—the error-related negativity (ERN) and frontocentral theta activity—and a third EEG signal, the error positivity (Pe), that is thought to share the same parietal substrates as a signal (the P3b) proposed to reflect evidence accumulation. As predicted, our data show that on slow RT EC trials, frontal monitoring resources are less strongly employed, and the latency of the Pe is longer. Critically, the speed of the RT EC also covaries with the magnitude of subsequent neural (intertrial alpha power) and behavioral (post-error slowing) adjustments following the correction. These results are synthesized to describe a timing diagram for adaptive decision-making after errors and support a potential evidence accumulation mechanism in which error signaling is followed by rapid behavioral adjustments.

Behavioral inhibition and performance monitoring are critical cognitive functions supported by distributed neural networks including the pFC. We examined neurophysiological correlates of motor response inhibition and action monitoring in patients with focal orbitofrontal (OFC) lesions ( n = 12) after resection of a primary intracranial tumor or contusion because of traumatic brain injury. Healthy participants served as controls ( n = 14). Participants performed a visual stop signal task. We analyzed behavioral performance as well as event-related brain potentials and oscillations. Inhibition difficulty was adjusted individually to yield an equal amount of successful inhibitions across participants. RTs of patients and controls did not differ significantly in go trials or in failed stop trials, and no differences were observed in estimated stop signal RT. However, electrophysiological response patterns during task performance distinguished the groups. Patients with OFC lesions had enhanced P3 amplitudes to congruent condition go signals and to stop signals. In stop trials, patients had attenuated N2 and error-related negativity, but enhanced error positivity. Patients also showed enhanced and prolonged post-error beta band increases for stop errors. This effect was particularly evident in patients whose lesion extended to the subgenual cingulate cortex. In summary, although response inhibition was not impaired, the diminished stop N2 and ERN support a critical role of the OFC in action monitoring. Moreover, the increased stop P3, error positivity, and post-error beta response indicate that OFC injury affected action outcome evaluation and support the notion that the OFC is relevant for the processing of abstract reinforcers such as performing correctly in the task.

Novelty processing was studied in patients with lesions centered in either OFC or lateral pFC (LPFC). An auditory novelty oddball ERP paradigm was applied with environmental sounds serving as task irrelevant novel stimuli. Lesions to the LPFC as well as the OFC resulted in a reduction of the frontal Novelty P3 response, supporting a key role of both frontal subdivisions in novelty processing. The posterior P3b to target sounds was unaffected in patients with frontal lobe lesions in either location, indicating intact posterior cortical target detection mechanisms. LPFC patients displayed an enhanced sustained negative slow wave (NSW) to novel sounds not observed in OFC patients, indicating prolonged resource allocation to task-irrelevant stimuli after LPFC damage. Both patient groups displayed an enhanced NSW to targets relative to controls. However, there was no difference in behavior between patients and controls suggesting that the enhanced NSW to targets may index an increased resource allocation to response requirements enabling comparable performance in the frontal lesioned patients. The current findings indicate that the LPFC and OFC have partly shared and partly differential contributions to the cognitive subcomponents of novelty processing.

People are able to adapt their behavior to changing environmental contingencies by rapidly inhibiting or modifying their actions. Response inhibition is often studied in the stop-signal paradigm that requires the suppression of an already prepared motor response. Less is known about situations calling for a change of motor plans such that the prepared response has to be withheld but another has to be executed instead. In the present study, we investigated whether electrophysiological data can provide evidence for distinct inhibitory mechanisms when stopping or changing a response. Participants were instructed to perform in a choice RT task with two classes of embedded critical trials: Stop signals called for the inhibition of any response, whereas change signals required participants to inhibit the prepared response and execute another one instead. Under both conditions, we observed differences in go-stimulus processing, suggesting a faster response preparation in failed compared with successful inhibitions. In contrast to stop-signal trials, changing a response did not elicit the inhibition-related frontal N2 and did not modulate the parietal mu power decrease. The results suggest that compared with changing a response, additional frontal and parietal regions are engaged when having to inhibit a response.

Selective processing of task-relevant stimuli is critical for goal-directed behavior. We used electrocorticography to assess the spatio-temporal dynamics of cortical activation during a simple phonological target detection task, in which subjects press a button when a prespecified target syllable sound is heard. Simultaneous surface potential recordings during this task revealed a highly ordered temporal progression of high gamma (HG, 70–200 Hz) activity across the lateral hemisphere in less than 1 sec. The sequence demonstrated concurrent regional sensory processing of speech syllables in the posterior superior temporal gyrus (STG) and speech motor cortex, and then transitioned to sequential task-dependent processing from prefrontal cortex (PFC), to the final motor response in the hand sensorimotor cortex. STG activation was modestly enhanced for target over nontarget sounds, supporting a selective gain mechanism in early sensory processing, whereas PFC was entirely selective to targets, supporting its role in guiding response behavior. These results reveal that target detection is not a single cognitive event, but rather a process of progressive target selectivity that involves large-scale rapid parallel and serial processing in sensory, cognitive, and motor structures to support goal-directed human behavior.

Human electrophysiological research is generally restricted to scalp EEG, magneto-encephalography, and intracranial electrophysiology. Here we examine a unique patient cohort that has undergone decompressive hemicraniectomy, a surgical procedure wherein a portion of the calvaria is removed for several months during which time the scalp overlies the brain without intervening bone. We quantify the differences in signals between electrodes over areas with no underlying skull and scalp EEG electrodes over the intact skull in the same subjects. Signals over the hemicraniectomy have enhanced amplitude and greater task-related power at higher frequencies (60–115 Hz) compared with signals over skull. We also provide evidence of a metric for trial-by-trial EMG/EEG coupling that is effective over the hemicraniectomy but not intact skull at frequencies >60 Hz. Taken together, these results provide evidence that the hemicraniectomy model provides a means for studying neural dynamics in humans with enhanced spatial and temporal resolution.

Lesion and neuroimaging studies suggest that orbito-frontal cortex (OFC) supports temporal aspects of episodic memory. However, it is unclear whether OFC contributes to the encoding and/or retrieval of temporal context and whether it is selective for temporal relative to nontemporal (spatial) context memory. We addressed this issue with two complimentary studies: functional magnetic resonance imaging to measure OFC activity associated with successful temporal and spatial context memory during encoding and retrieval in healthy young participants, and a neuropsychological investigation to measure changes in spatial and temporal context memory in OFC lesion patients. Imaging results revealed that OFC contributed to encoding and retrieval of associations between objects and their temporal but not their spatial contexts. Consistent with this, OFC patients exhibited impairments in temporal but not spatial source memory accuracy. These results suggest that OFC plays a critical role in the formation and subsequent retrieval of temporal context.

The ACC, the dorsolateral prefrontal cortex (DLPFC), and the parietal cortex near/along the intraparietal sulcus (IPS) are members of a network subserving attentional control. Our recent study revealed that these regions participate in both response anticipation and conflict processing. However, little is known about the relative contribution of these regions in attentional control and how the dynamic interactions among these regions are modulated by detection of predicted versus unpredicted targets and conflict processing. Here, we examined effective connectivity using dynamic causal modeling among these three regions during a flanker task with or without a target onset cue. We compared various models in which different connections among ACC, DLPFC, and IPS were modulated by bottom–up stimulus-driven surprise and top–down conflict processing using Bayesian model selection procedures. The most optimal of these models incorporated contextual modulation that allowed processing of unexpected (surprising) targets to mediate the influence of the IPS over ACC and DLPFC and conflict processing to mediate the influence of ACC and DLPFC over the IPS. This result suggests that the IPS plays an initiative role in this network in the processing of surprise targets, whereas ACC and DLPFC interact with each other to resolve conflict through attentional modulation implemented via the IPS.

We used the P300 component to investigate how changes in local context influenced the ability to detect target stimuli. Local context was defined as the occurrence of a short predictive series of stimuli before delivery of a target event. EEG was recorded in 12 subjects during auditory and visual sessions. Stimuli were presented in the center of the auditory and visual field and consisted of 15% targets (1000 Hz tone or downward facing triangle) and 85% of equal amounts of three types of standards (1500, 2000, and 2500 Hz tones or triangles facing left, upward, and right). Recording blocks consisted of targets preceded by either randomized sequences of standards or by sequences including a three-standard predictive sequence signaling the occurrence of a subsequent target event. Subjects pressed a button in response to targets. Peak target P300 (P3b) amplitude and latency were evaluated for targets after predictive and nonpredictive sequences using conventional averaging and a novel single-trial analysis procedure. Reaction times were shorter for predictable targets than for nonpredicted targets. P3b latency was shorter for predicted targets than for nonpredictive targets, and there were no significant P3b amplitude differences between predicted and random targets, as determined by both conventional averaging and single-trial analysis. Comparable effects on amplitude and latency were observed in both the auditory and visual modalities. The results indicate that local context has differential effects on P3b amplitude and latency, and exerts modality-independent effects on cognitive processing.

Social inequalities have profound effects on the physical and mental health of children. Children from low socioeconomic status (SES) backgrounds perform below children from higher SES backgrounds on tests of intelligence and academic achievement, and recent findings indicate that low SES (LSES) children are impaired on behavioral measures of prefrontal function. However, the influence of socioeconomic disparity on direct measures of neural activity is unknown. Here, we provide electrophysiological evidence indicating that prefrontal function is altered in LSES children. We found that prefrontal-dependent electrophysiological measures of attention were reduced in LSES compared to high SES (HSES) children in a pattern similar to that observed in patients with lateral prefrontal cortex (PFC) damage. These findings provide neurophysiological evidence that social inequalities are associated with alterations in PFC function in LSES children. There are a number of factors associated with LSES rearing conditions that may have contributed to these results such as greater levels of stress and lack of access to cognitively stimulating materials and experiences. Targeting specific prefrontal processes affected by socioeconomic disparity could be helpful in developing intervention programs for LSES children.

We used event-related potentials (ERPs) and gamma band oscillatory responses (GBRs) to examine whether intermodal attention operates early in the auditory, visual, and tactile modalities. To control for the effects of spatial attention, we spatially coregistered all stimuli and varied the attended modality across counterbalanced blocks in an intermodal selection task. In each block, participants selectively responded to either auditory, visual, or vibrotactile stimuli from the stream of intermodal events. Auditory and visual ERPs were modulated at the latencies of early cortical processing, but attention manifested later for tactile ERPs. For ERPs, auditory processing was modulated at the latency of the Na (29 msec), which indexes early cortical or thalamocortical processing and the subsequent P1 (90 msec) ERP components. Visual processing was modulated at the latency of the early phase of the C1 (62–72 msec) thought to be generated in the primary visual cortex and the subsequent P1 and N1 (176 msec). Tactile processing was modulated at the latency of the N160 (165 msec) likely generated in the secondary association cortex. Intermodal attention enhanced early sensory GBRs for all three modalities: auditory (onset 57 msec), visual (onset 47 msec), and tactile (onset 27 msec). Together, these results suggest that intermodal attention enhances neural processing relatively early in the sensory stream independent from differential effects of spatial and intramodal selective attention.

The superior temporal sulcus (STS) is the chameleon of the human brain. Several research areas claim the STS as the host brain region for their particular behavior of interest. Some see it as one of the core structures for theory of mind. For others, it is the main region for audiovisual integration. It plays an important role in biological motion perception, but is also claimed to be essential for speech processing and processing of faces. We review the foci of activations in the STS from multiple functional magnetic resonance imaging studies, focusing on theory of mind, audiovisual integration, motion processing, speech processing, and face processing. The results indicate a differentiation of the STS region in an anterior portion, mainly involved in speech processing, and a posterior portion recruited by cognitive demands of all these different research areas. The latter finding argues against a strict functional subdivision of the STS. In line with anatomical evidence from tracer studies, we propose that the function of the STS varies depending on the nature of network coactivations with different regions in the frontal cortex and medial-temporal lobe. This view is more in keeping with the notion that the same brain region can support different cognitive operations depending on task-dependent network connections, emphasizing the role of network connectivity analysis in neuroimaging.

Mistakes are common to all forms of behavior but there is disagreement about what causes errors. We recorded electrophysiological and behavioral measures in a letter discrimination task to examine whether deficits in preparatory attention predicted subsequent response errors. Error trials were characterized by decreased frontal-central preparatory attention event-related potentials (ERPs) prior to stimulus presentation and decreased extrastriate sensory ERPs during visual processing. These findings indicate that transient lapses in a prefrontal-extrastriate preparatory attention network can lead to response errors.

The role of the orbitofrontal cortex in social behavior remains a puzzle. Various theories of the social functions of the orbitofrontal cortex focus on the role of this area in either emotional processing or its involvement in online monitoring of behavior (i.e., self-monitoring). The present research attempts to integrate these two theories by examining whether improving the self-monitoring of patients with orbitofrontal damage is associated with the generation of emotions needed to guide interpersonal behavior. Patients with orbitofrontal damage, patients with lateral prefrontal damage, and healthy controls took part in an interpersonal task. After completing the task, participants' self-monitoring was increased by showing them a videotape of their task performance. In comparison to healthy controls and patients with lateral prefrontal damage, orbitofrontal damage was associated with objectively inappropriate social behavior. Although patients with orbitofrontal damage were aware of social norms of intimacy, they were unaware that their task performance violated these norms. The embarrassment typically associated with inappropriate social behavior was elicited in these patients only after their self-monitoring increased from viewing their videotaped performance. These findings suggest that damage to the orbitofrontal cortex impairs self-insight that may preclude the generation of helpful emotional information. The results highlight the role of the orbitofrontal cortex in the interplay of self-monitoring and emotional processing and suggest avenues for neurorehabilitation of patients with social deficits subsequent to orbitofrontal damage.