Growing evidence suggests that semantic knowledge is represented in distributed neural networks that include modality-specific structures. Here, we examined the processes underlying the acquisition of words from different semantic categories to determine whether the emergence of visual- and action-based categories could be tracked back to their acquisition. For this, we applied correspondence analysis (CA) to ERPs recorded at various moments during acquisition. CA is a multivariate statistical technique typically used to reveal distance relationships between words of a corpus. Applied to ERPs, it allows isolating factors that best explain variations in the data across time and electrodes. Participants were asked to learn new action and visual words by associating novel pseudowords with the execution of hand movements or the observation of visual images. Words were probed before and after training on two consecutive days. To capture processes that unfold during lexical access, CA was applied on the 100–400 msec post-word onset interval. CA isolated two factors that organized the data as a function of test sessions and word categories. Conventional ERP analyses further revealed a category-specific increase in the negativity of the ERPs to action and visual words at the frontal and occipital electrodes, respectively. The distinct neural processes underlying action and visual words can thus be tracked back to the acquisition of word-referent relationships and may have its origin in association learning. Given current evidence for the flexibility of language-induced sensory-motor activity, we argue that these associative links may serve functions beyond word understanding, that is, the elaboration of situation models.

The brain areas involved in visual word processing rapidly become lateralized to the left cerebral hemisphere. It is often assumed this is because, in the vast majority of people, cortical structures underlying language production are lateralized to the left hemisphere. An alternative hypothesis, however, might be that the early stages of visual word processing are lateralized to the left hemisphere because of intrinsic hemispheric differences in processing low-level visual information as required for distinguishing fine-grained visual forms such as letters. If the alternative hypothesis was correct, we would expect posterior occipito-temporal processing stages still to be lateralized to the left hemisphere for participants with right hemisphere dominance for the frontal lobe processes involved in language production. By analyzing event-related potentials of native readers of French with either left hemisphere or right hemisphere dominance for language production (determined using a verb generation task), we were able to show that the posterior occipito-temporal areas involved in visual word processing are lateralized to the same hemisphere as language production. This finding could suggest top-down influences in the development of posterior visual word processing areas.

A recently emerging view sees language understanding as closely linked to sensory and motor processes. The present study investigates this issue by examining the influence of processing action verbs and concrete nouns on the execution of a reaching movement. Fine-grained analyses of movement kinematics revealed that relative to nouns, processing action verbs significantly affects overt motor performance. Within 200 msec after onset, processing action verbs interferes with a concurrent reaching movement. By contrast, the same words assist reaching movement when processed before movement onset. The cross-talk between language processes and overt motor behavior provides unambiguous evidence that action words and motor action share common cortical representations and could thus suggest that cortical motor regions are indeed involved in action word retrieval.

Event-related brain potentials (ERPs) to words, pseudowords, and nonwords were recorded in three different tasks. A letter search task was used in Experiment 1. Performance was affected by whether the target letter occurred in a word, a pseudoword, or a random nonword. ERP results corroborated the behavioral results, showing small but reliable ERP differences between the three stimulus types. Words and pseudowords differed from nonwords at posterior sites, whereas words differed from pseudowords and nonwords at anterior sites. Since deciding whether the target letter was present or absent co-occurred with stimulus processing in Experiment 1, a delayed letter search task was used in Experiment 2. ERPs to words and pseudowords were similar and differed from ERPs to nonwords, suggesting a primary role of orthographic and phonological processing in the delayed letter search task. To increase semantic processing, a categorization task was used in Experiment 3. Early differences between ERPs to words and pseudowords at left posterior and anterior locations suggested a rapid activation of lexico-semantic information. These findings suggest that the use of ERPs in a multiple task design makes it possible to track the time course and the activation of multiple sources of linguistic information when processing words, pseudowords, and nonwords. The task-dependent nature of the effects suggests that the language system can use multiple sources of linguistic information in flexible and adaptive ways.