The timing of semantic processing during object recognition in the brain is a topic of ongoing discussion. One way of addressing this question is by applying multivariate pattern analysis to human electrophysiological responses to object images of different semantic categories. However, although multivariate pattern analysis can reveal whether neuronal activity patterns are distinct for different stimulus categories, concerns remain on whether low-level visual features also contribute to the classification results. To circumvent this issue, we applied a cross-decoding approach to magnetoencephalography data from stimuli from two different modalities: images and their corresponding written words. We employed items from three categories and presented them in a randomized order. We show that if the classifier is trained on words, pictures are classified between 150 and 430 msec after stimulus onset, and when training on pictures, words are classified between 225 and 430 msec. The topographical map, identified using a searchlight approach for cross-modal activation in both directions, showed left lateralization, confirming the involvement of linguistic representations. These results point to semantic activation of pictorial stimuli occurring at ∼150 msec, whereas for words, the semantic activation occurs at ∼230 msec.

Recent neuroimaging evidence suggests that the frequency of entrained oscillations in auditory cortices influences the perceived duration of speech segments, impacting word perception [Kösem, A., Bosker, H. R., Takashima, A., Meyer, A., Jensen, O., & Hagoort, P. Neural entrainment determines the words we hear. Current Biology , 28 , 2867–2875, 2018]. We further tested the causal influence of neural entrainment frequency during speech processing, by manipulating entrainment with continuous transcranial alternating current stimulation (tACS) at distinct oscillatory frequencies (3 and 5.5 Hz) above the auditory cortices. Dutch participants listened to speech and were asked to report their percept of a target Dutch word, which contained a vowel with an ambiguous duration. Target words were presented either in isolation (first experiment) or at the end of spoken sentences (second experiment). We predicted that the tACS frequency would influence neural entrainment and therewith how speech is perceptually sampled, leading to a perceptual overestimation or underestimation of the vowel's duration. Whereas results from Experiment 1 did not confirm this prediction, results from Experiment 2 suggested a small effect of tACS frequency on target word perception: Faster tACS leads to more long-vowel word percepts, in line with the previous neuroimaging findings. Importantly, the difference in word perception induced by the different tACS frequencies was significantly larger in Experiment 1 versus Experiment 2, suggesting that the impact of tACS is dependent on the sensory context. tACS may have a stronger effect on spoken word perception when the words are presented in continuous speech as compared to when they are isolated, potentially because prior (stimulus-induced) entrainment of brain oscillations might be a prerequisite for tACS to be effective.

Alpha oscillations (8–14 Hz) are proposed to represent an active mechanism of functional inhibition of neuronal processing. Specifically, alpha oscillations are associated with pulses of inhibition repeating every ∼100 msec. Whether alpha phase, similar to alpha power, is under top–down control remains unclear. Moreover, the sources of such putative top–down phase control are unknown. We designed a cross-modal (visual/auditory) attention study in which we used magnetoencephalography to record the brain activity from 34 healthy participants. In each trial, a somatosensory cue indicated whether to attend to either the visual or auditory domain. The timing of the stimulus onset was predictable across trials. We found that, when visual information was attended, anticipatory alpha power was reduced in visual areas, whereas the phase adjusted just before the stimulus onset. Performance in each modality was predicted by the phase of the alpha oscillations previous to stimulus onset. Alpha oscillations in the left pFC appeared to lead the adjustment of alpha phase in visual areas. Finally, alpha phase modulated stimulus-induced gamma activity. Our results confirm that alpha phase can be top–down adjusted in anticipation of predictable stimuli and improve performance. Phase adjustment of the alpha rhythm might serve as a neurophysiological resource for optimizing visual processing when temporal predictions are possible and there is considerable competition between target and distracting stimuli.

Previous work revealed that visual semantic information conveyed by gestures can enhance degraded speech comprehension, but the mechanisms underlying these integration processes under adverse listening conditions remain poorly understood. We used MEG to investigate how oscillatory dynamics support speech–gesture integration when integration load is manipulated by auditory (e.g., speech degradation) and visual semantic (e.g., gesture congruency) factors. Participants were presented with videos of an actress uttering an action verb in clear or degraded speech, accompanied by a matching (mixing gesture + “mixing”) or mismatching (drinking gesture + “walking”) gesture. In clear speech, alpha/beta power was more suppressed in the left inferior frontal gyrus and motor and visual cortices when integration load increased in response to mismatching versus matching gestures. In degraded speech, beta power was less suppressed over posterior STS and medial temporal lobe for mismatching compared with matching gestures, showing that integration load was lowest when speech was degraded and mismatching gestures could not be integrated and disambiguate the degraded signal. Our results thus provide novel insights on how low-frequency oscillatory modulations in different parts of the cortex support the semantic audiovisual integration of gestures in clear and degraded speech: When speech is clear, the left inferior frontal gyrus and motor and visual cortices engage because higher-level semantic information increases semantic integration load. When speech is degraded, posterior STS/middle temporal gyrus and medial temporal lobe are less engaged because integration load is lowest when visual semantic information does not aid lexical retrieval and speech and gestures cannot be integrated.

Using magnetoencephalography, the current study examined gamma activity associated with language prediction. Participants read high- and low-constraining sentences in which the final word of the sentence was either expected or unexpected. Although no consistent gamma power difference induced by the sentence-final words was found between the expected and unexpected conditions, the correlation of gamma power during the prediction and activation intervals of the sentence-final words was larger when the presented words matched with the prediction compared with when the prediction was violated or when no prediction was available. This suggests that gamma magnitude relates to the match between predicted and perceived words. Moreover, the expected words induced activity with a slower gamma frequency compared with that induced by unexpected words. Overall, the current study establishes that prediction is related to gamma power correlations and a slowing of the gamma frequency.

Readers and listeners actively predict upcoming words during language processing. These predictions might serve to support the unification of incoming words into sentence context and thus rely on interactions between areas in the language network. In the current magnetoencephalography study, participants read sentences that varied in contextual constraints so that the predictability of the sentence-final words was either high or low. Before the sentence-final words, we observed stronger alpha power suppression for the highly compared with low constraining sentences in the left inferior frontal cortex, left posterior temporal region, and visual word form area. Importantly, the temporal and visual word form area alpha power correlated negatively with left frontal gamma power for the highly constraining sentences. We suggest that the correlation between alpha power decrease in temporal language areas and left prefrontal gamma power reflects the initiation of an anticipatory unification process in the language network.

Selective attention is reflected neurally in changes in the power of posterior neural oscillations in the alpha (8–12 Hz) and gamma (40–100 Hz) bands. Although a neural mechanism that allows relevant information to be selectively processed has its advantages, it may lead to lucrative or dangerous information going unnoticed. Neural systems are also in place for processing rewarding and punishing information. Here, we examine the interaction between selective attention (left vs. right) and stimulus's learned value associations (neutral, punished, or rewarded) and how they compete for control of posterior neural oscillations. We found that both attention and stimulus–value associations influenced neural oscillations. Whereas selective attention had comparable effects on alpha and gamma oscillations, value associations had dissociable effects on these neural markers of attention. Salient targets (associated with positive and negative outcomes) hijacked changes in alpha power—increasing hemispheric alpha lateralization when salient targets were attended, decreasing it when they were being ignored. In contrast, hemispheric gamma-band lateralization was specifically abolished by negative distractors. Source analysis indicated occipital generators of both attentional and value effects. Thus, posterior cortical oscillations support both the ability to selectively attend while at the same time retaining the ability to remain sensitive to valuable features in the environment. Moreover, the versatility of our attentional system to respond separately to salient from merely positively valued stimuli appears to be carried out by separate neural processes reflected in different frequency bands.

Flexible control over currently relevant sensory representations is an essential feature of primate cognition. We investigated the neurophysiological bases of such flexible control in humans during an intermodal working memory task in which participants retained visual or tactile sequences. Using magnetoencephalography, we first show that working memory retention engages early visual and somatosensory areas, as reflected in the sustained load-dependent suppression of alpha and beta oscillations. Next, we identify three components that are also load dependent but modality independent: medial prefrontal theta synchronization, frontoparietal gamma synchronization, and sustained parietal event-related fields. Critically, these domain-general components predict (across trials and within load conditions) the modality-specific suppression of alpha and beta oscillations, with largely unique contributions per component. Thus, working memory engages multiple complementary frontoparietal components that have discernible neuronal dynamics and that flexibly modulate retention-related activity in sensory areas in a manner that tracks the current contents of working memory.

It has been proposed that long-term memory encoding is not only dependent on engaging task-relevant regions but also on disengaging task-irrelevant regions. In particular, oscillatory alpha activity has been shown to be involved in shaping the functional architecture of the working brain because it reflects the functional disengagement of specific regions in attention and memory tasks. We here ask if such allocation of resources by alpha oscillations generalizes to long-term memory encoding in a cross-modal setting in which we acquired the ongoing brain activity using magnetoencephalography. Participants were asked to encode pictures while ignoring simultaneously presented words and vice versa. We quantified the brain activity during rehearsal reflecting subsequent memory in the different attention conditions. The key finding was that successful long-term memory encoding is reflected by alpha power decreases in the sensory region of the to-be-attended modality and increases in the sensory region of the to-be-ignored modality to suppress distraction during rehearsal period. Our results corroborate related findings from attention studies by demonstrating that alpha activity is also important for the allocation of resources during long-term memory encoding in the presence of distracters.

Effective processing of sensory input in daily life requires attentional selection and amplification of relevant input and, just as importantly, attenuation of irrelevant information. It has been proposed that top–down modulation of oscillatory alpha band activity (8–14 Hz) serves to allocate resources to various regions, depending on task demands. In previous work, we showed that contralateral somatosensory alpha activity decreases to facilitate processing of an anticipated target stimulus in a tactile discrimination task. In the current study, we asked whether somatosensory alpha activity is also modulated when expecting incoming distracting stimuli on the nonattended side. We hypothesized that an ipsilateral increase of alpha to suppress distracters would be required for optimal task performance. We recorded magneto-encephalography while subjects performed a tactile stimulus discrimination task where a cue directed attention either to their left or right hand. Distracters were presented simultaneously to the unattended hand. We found that alpha power contralateral to the attended hand decreased, whereas ipsilateral alpha power increased. In addition, posterior alpha power showed a general increase. Importantly, these three alpha components all contributed to discrimination performance. This study further extends the notion that alpha band activity is involved in shaping the functional architecture of the working brain by determining the engagement and disengagement of specific regions: Contralateral alpha decreases to facilitate stimulus detection, whereas ipsilateral alpha increases when active suppression of distracters is required. Importantly, the ipsilateral alpha increase is crucial for optimal task performance.

Because the human visual system is continually being bombarded with inputs, it is necessary to have effective mechanisms for filtering out irrelevant information. This is partly achieved by the allocation of attention, allowing the visual system to process relevant input while blocking out irrelevant input. What is the physiological substrate of attentional allocation? It has been proposed that alpha activity reflects functional inhibition. Here we asked if inhibition by alpha oscillations has behavioral consequences for suppressing the perception of unattended input. To this end, we investigated the influence of alpha activity on motion processing in two attentional conditions using magneto-encephalography. The visual stimuli used consisted of two random-dot kinematograms presented simultaneously to the left and right visual hemifields. Subjects were cued to covertly attend the left or right kinematogram. After 1.5 sec, a second cue tested whether subjects could report the direction of coherent motion in the attended (80%) or unattended hemifield (20%). Occipital alpha power was higher contralateral to the unattended side than to the attended side, thus suggesting inhibition of the unattended hemifield. Our key finding is that this alpha lateralization in the 20% invalidly cued trials did correlate with the perception of motion direction: Subjects with pronounced alpha lateralization were worse at detecting motion direction in the unattended hemifield. In contrast, lateralization did not correlate with visual discrimination in the attended visual hemifield. Our findings emphasize the suppressive nature of alpha oscillations and suggest that processing of inputs outside the field of attention is weakened by means of increased alpha activity.