To investigate form-related activity in motion-sensitive cortical areas, we recorded cell responses to animate implied motion in macaque middle temporal (MT) and medial superior temporal (MST) cortex and investigated these areas using fMRI in humans. In the single-cell studies, we compared responses with static images of human or monkey figures walking or running left or right with responses to the same human and monkey figures standing or sitting still. We also investigated whether the view of the animate figure (facing left or right) that elicited the highest response was correlated with the preferred direction for moving random dot patterns. First, figures were presented inside the cell's receptive field. Subsequently, figures were presented at the fovea while a dynamic noise pattern was presented at the cell's receptive field location. The results show that MT neurons did not discriminate between figures on the basis of the implied motion content. Instead, response preferences for implied motion correlated with preferences for low-level visual features such as orientation and size. No correlation was found between the preferred view of figures implying motion and the preferred direction for moving random dot patterns. Similar findings were obtained in a smaller population of MST cortical neurons. Testing human MT+ responses with fMRI further corroborated the notion that low-level stimulus features might explain implied motion activation in human MT+. Together, these results suggest that prior human imaging studies demonstrating animate implied motion processing in area MT+ can be best explained by sensitivity for low-level features rather than sensitivity for the motion implied by animate figures.

Viewing static pictures of running humans evokes neural activity in the dorsal motion-sensitive cortex. To establish whether this response arises from direction-selective neurons that are also involved in real motion processing, we measured the visually evoked potential to implied motion following adaptation to static or moving random dot patterns. The implied motion response was defined as the difference between evoked potentials to pictures with and without implied motion. Interaction between real and implied motion was found as a modulation of this difference response by the preceding motion adaptation. The amplitude of the implied motion response was significantly reduced after adaptation to motion in the same direction as the implied motion, compared to motion in the opposite direction. At 280 msec after stimulus onset, the average difference in amplitude reduction between opposite and same adapted direction was 0.5 μV on an average implied motion amplitude of 2.0 μV. These results indicate that the response to implied motion arises from direction-selective motion-sensitive neurons. This is consistent with interactions between real and implied motion processing at a neuronal level.

Viewing static photographs of objects in motion evokes higher fMRI activation in the human medial temporal complex (MT+) than looking at similar photographs without this implied motion. As MT+ is traditionally thought to be involved in motion perception (and not in form perception), this finding suggests feedback from object-recognition areas onto MT+. To investigate this hypothesis, we recorded extracranial potentials evoked by the sight of photographs of biological agents with and without implied motion. The difference in potential between responses to pictures with and without implied motion was maximal between 260 and 400 msec after stimulus onset. Source analysis of this difference revealed one bilateral, symmetrical dipole pair in the occipital lobe. This area also showed a response to real motion, but approximately 100 msec earlier than the implied motion response. The longer latency of the implied motion response in comparison to the real motion response is consistent with a feedback projection onto MT+ following object recognition in higher-level temporal areas.

We show that under natural viewing, the responses of cells in the temporal lobe of the macaque to the sight of static head and body postures is controlled by the sight of immediately preceding actions. Cells in the anterior part of the superior temporal sulcus responded vigorously to the sight of a face or body posture that followed a particular body action, but not when it followed other actions. The effective action or posture presented in isolation or in different sequences failed to produce a response. Our results demonstrate that cells in the temporal cortex could support the formation of expectations about impending behavior of others.