Visual search is a fundamental human behavior, providing a gateway to understanding other sensory domains as well as the role of search in higher-order cognition. Search has been proposed to include two component processes: inefficient search (Search) and efficient search (Pop-out). According to extant research, these two processes map onto two separable neural systems located in the frontal and parietal association cortices. In this study, we use intracranial recordings from 23 participants to delineate the neural correlates of Search and Pop-out with an unprecedented combination of spatiotemporal resolution and coverage across cortical and subcortical structures. First, we demonstrate a role for the medial temporal lobe in visual search, on par with engagement in frontal and parietal association cortex. Second, we show a gradient of increasing engagement over anatomical space from dorsal to ventral lateral frontal cortex. Third, we confirm previous intracranial work demonstrating nearly complete overlap in neural engagement across cortical regions in Search and Pop-out. We further demonstrate Pop-out selectivity, manifesting as activity increase in Pop-out as compared to Search, in a distributed set of sites including frontal cortex. This result is at odds with the view that Pop-out is implemented in low-level visual cortex or parietal cortex alone. Finally, we affirm a central role for the right lateral frontal cortex in Search.

Two primary functions attributed to the hippocampus and prefrontal cortex (PFC) network are retaining the temporal and spatial associations of events and detecting deviant events. It is unclear, however, how these two functions converge into one mechanism. Here, we tested whether increased activity with perceiving salient events is a deviant detection signal or contains information about the event associations by reflecting the magnitude of deviance (i.e., event saliency). We also tested how the deviant detection signal is affected by the degree of anticipation. We studied regional neural activity when people watched a movie that had varying saliency of a novel or an anticipated flow of salient events. Using intracranial electroencephalography from 10 patients, we observed that high-frequency activity (50–150 Hz) in the hippocampus, dorsolateral PFC, and medial OFC tracked event saliency. We also observed that medial OFC activity was stronger when the salient events were anticipated than when they were novel. These results suggest that dorsolateral PFC and medial OFC, as well as the hippocampus, signify the saliency magnitude of events, reflecting the hierarchical structure of event associations.