Glass patterns are moirés created from a sparse random-dot field paired with its spatially shifted copy. Because discrimination of these patterns is not based on local features, they have been used extensively to study global integration processes. Here, we investigated whether 4- to 5.5-month-old infants are sensitive to the global structure of Glass patterns by measuring visual-evoked potentials. Although we found strong responses to the appearance of the constituent dots, we found sensitivity to the global structure of the Glass patterns in the infants only over a very limited range of spatial separation. In contrast, we observed robust responses in the infants when we connected the dot pairs of the Glass pattern with lines. Moreover, both infants and adults showed differential responses to exchanges between line patterns portraying different global structures. A control study varying luminance contrast in adults suggests that infant sensitivity to global structure is not primarily limited by reduced element visibility. Together our results suggest that the insensitivity to structure in conventional Glass patterns is due to inefficiencies in extracting the local orientation cues generated by the dot pairs. Once the local orientations are made unambiguous or when the interpolation span is small, infants can integrate these signals over the image.
Early visual mechanisms with spatially localized receptive fields are tuned for features such as orientation, disparity, and direction of motion. However, our visual experience is mainly made up of coherent scenes, objects, and textures and not local features. The processes by which local features are integrated into perceptual groupings has been a subject of intensive research (Sasaki, 2007). There is a general consensus that the global integration of local features involves specialized mechanisms in extrastriate visual areas such as human middle temporal complex/medial superior temporal cortex and V3A in the case of coherent motion in random-dot displays (Smith, Wall, Williams, & Singh, 2006; Koyama et al., 2005; Braddick et al., 2001; Morrone et al., 2000; Rees, Friston, & Koch, 2000; Tootell et al., 1995, 1997) and in occipito-temporal and ventral areas such as LOC and V4 in the case of orientation cues (Ostwald, Lam, Li, & Kourtzi, 2008; Altmann, Bulthoff, & Kourtzi, 2003; Braddick, O'Brien, Wattam-Bell, Atkinson, & Turner, 2000). Because global integration tasks tap higher level visual processing mechanisms, they have been used as behavioral probes of the development of extrastriate cortical areas in humans (for reviews, see Braddick & Atkinson, 2007; Norcia & Pei, 2007).
Sensitivity to the global coherence of orientation-defined textures (Pei, Pettet, & Norcia, 2007; Norcia et al., 2005), collinear structure of orientation-defined contours (Norcia et al., 2005; Gerhardstein, Kovacs, Ditre, & Feher, 2004), and orientation of luminance-defined Gestalt groupings (Quinn, Bhatt, Brush, Grimes, & Sharpnack, 2002) has been found to be present in infants as young as 2 to 3 months of age, which would suggest that global form integration is present at a very early age. However, relative to adults, infants lack the bias for detecting closure cues (Gerhardstein et al., 2004) and have higher orientation coherence thresholds in textures (Pei et al., 2007).
To evaluate how global sensitivity in infants is dependent of the strength of local orientation cues, we measured their sensitivity to Glass patterns, moirés made from random dots paired with their spatially shifted copies (Glass & Switkes, 1976; Glass, 1969). Glass patterns are useful in that sensitivity to them requires first the detection of the local elements followed by a “local” integration of dots into oriented dipoles and finally a “global” integration of many dipoles into texture flows (Kurki, Laurinen, Peromaa, & Saarinen, 2003; Dakin & Bex, 2001). Developmental immaturities in any of these processing stages may limit performance. Although different global organizations of Glass patterns (e.g., the random, rotation, or translation fields depicted in Figure 1) are readily distinguishable by adults, these patterns are locally indistinguishable. Because of their well-controlled hierarchical nature, Glass patterns have been extensively used to study feature integration (see references in Pei, Pettet, Vildavski, & Norcia, 2005; Smith, Bair, & Movshon, 2002).
To characterize visual integration of local elements into global wholes during development, we recorded visual-evoked potentials (VEPs) to Glass patterns in infants and adults using a temporal tagging method that independently “labels” responses to local elements and global structure separately. Using this method, we measured sensitivity of infants and adults to conventional Glass patterns whose local orientation features were defined by dot pairs and to line patterns whose local orientation features were defined explicitly by connecting the dots of an underlying Glass pattern. By this manipulation, we investigated how the ambiguity of local orientation signals affected global integration. Infant and adult sensitivities were measured as a function of dot-pair separation in conventional Glass patterns and as a function of line length in connected Glass patterns. Lastly, we evaluated how the visibility of local elements affected global integration. Because infants have lower contrast sensitivity than adults, we varied luminance contrast of Glass patterns and measured VEP sensitivity and coherence thresholds in adults to determine if decreasing luminance contrast decreases sensitivity to the global structure of Glass patterns. If it did, then limitations on global integration in infants could be a consequence of immaturities in low-level contrast processing mechanisms.
We found that 4- to 5.5-month-old infants were sensitive to the presentation of the local dots. However, they were only sensitive to global structure when the dot pairs were physically connected or were in proximity. Global sensitivity to Glass patterns in adults was largely invariant with luminance contrast, suggesting that the limitations in detecting the global structure of Glass patterns is not likely due to immaturities in the contrast sensitivity of early visual filters. We propose that the poor infant sensitivity to Glass patterns is due to immaturities at several levels of visual processing, including nonclassical receptive field properties in early cortical areas.
Fourteen adults and 51 full-term infants between the age of 4 and 6 months of age (mean age = 4.8 ± 0.6 months) participated in this study. Adult participants had visual acuity of better than 6/6 in each eye, with correction, if needed and stereoacuity of 40 arc sec or better on the Titmus and Randot stereoacuity tests. Acuity was measured using the Bailey–Lovie chart, which has five letters per line and equal log increments in the letter sizes across lines. Informed consent was obtained before experimentation directly from the adults and from a parent of the infant participants under a protocol that was approved by Smith Kettlewell Eye Research institutional review board.
Apparatus and Stimuli
Stimuli were presented by a Power Macintosh G4 computer on a Westinghouse LCD monitor with a resolution of 1024 × 768 and a refresh rate of 60 Hz. The mean luminance was 160 cd/m2. The viewing distance was about 70 cm. Two kinds of test patterns were used in this study: Glass patterns composed of conventional dot pairs and similar patterns composed of line segments whose length matched the dot separations of the Glass patterns (Figure 1).
The Glass pattern conditions in Experiments 1, 2, and 4 comprised randomly placed white squares (12.4 × 12.4 min) paired with their copy displaced by 49.6 min (end-to-end; Figure 2). The corresponding line patterns were composed of line segments with an aspect ratio of 4:1 (12.4 × 49.6 min; “line pattern” conditions). For Experiment 3, dot pairs and line segments had lengths of 24.8, 37.2, and 49.6 min for infants and 24.8, 49.6, and 124.0 min for adults. The dots of the Glass patterns covered 4% of the screen area of 32° × 32° or approximately 0.47 dot pairs per deg2 of visual angle. Luminance contrast (Michelson definition: Lmax − Lmin / Lmax + Lmin) was 90% in Experiments 1–3 and varied from 1% to 90% in Experiment 4.
In all experiments, the global structure of the Glass and line patterns was updated at 1.0 Hz. In Experiment 1, the elements periodically alternated between globally random and globally horizontal states or between co-circular and horizontal global states every 500 msec. For horizontal patterns, all dot pairs/lines were aligned horizontally (Figure 1, middle panels). For the random pattern, the dot pairs/lines were randomly oriented (Figure 1, top panels). For the co-circular pattern, the dot pairs/lines were aligned tangentially along a set of imaginary circles with random radii. In Experiments 2–4, the patterns periodically alternated between co-circular (500 msec) and horizontal (500 msec) patterns (Figure 1, middle and bottom panels). A new set of dots or lines were presented every 50 msec (20 Hz).
VEP Recording and Analysis
Cortical electrical activity was recorded with Glass gold-cup surface electrodes placed on the scalp with a conductive gel (10–20; D. O. Weaver, Aurora, CO) at six sites over occipital areas. Electrode impedance was maintained below approximately 10 kΩ. The EEG was amplified by a factor of 50,000 (adults) or 20,000 (infants) using a Grass Model 12 amplifier with analog filter settings of 0.3–100 Hz, measured at −6 dB points. The EEG was digitized to a nominal 16-bit accuracy at a sampling rate of 776 Hz. The horizontal synch signal from the video card was used to clock the analog-to-digital converter (13 samples per video frame). The display was updated during the vertical blanking interval, and the vertical synch signal was provided via a digital input line to the data acquisition routine for exact synchronization of the data acquisition to the display. If the display was interrupted with a mouse input, both display and data acquisition program loops will reset to a previous point that was at least 1 sec before the mouse press. A spectral analysis was performed for individual observers using an adaptive filter (Tang & Norcia, 1995).
Our experimental design allows the clear separation of responses to local and global aspects of our stimuli. Significant responses (i.e., greater than zero) at the dot update rate (20 Hz) were used to index sensitivity to the presentation of the local elements. Responses to the first three harmonics of the global update rate (1–3 Hz) were selected for quantitative analysis to indicate sensitivity to global structure (Figure 3) to reflect the symmetry in the waveforms. Our stimulation protocol echoes the design of Braddick, Wattam-Bell, & Atkinson (1986), who used two temporal frequencies to independently tag phase and orientation of gratings.1
Odd harmonic responses (1, 3, 5 Hz, etc.) indicate that the evoked response differs after transitions between the two texture flows, whereas even harmonic responses (e.g., 2, 4, 6 Hz, etc.) indicate that the responses are equivalent. Responses that are dominated by low-frequency components (1–2 Hz) are more sustained than responses where the largest peaks are at the higher harmonics (e.g., 3 Hz and higher). Because the noise spectra of the background EEG have an approximately 1/f profile, responses at higher harmonics may sometimes be a better indicator of the presence of significant responses than the lower harmonic components because of better signal-to-noise ratio.
For each participant and condition, the real and the imaginary spectral coefficients were averaged separately across trials, and then the amplitude and the phase of the response were calculated (vector average). Similarly, we computed vector averages across participants for each condition by coherently averaging the spectral coefficients. The vector average approaches zero in the limit for EEG noise (VEP absent), and therefore zero amplitude is the appropriate theoretical and empirical floor against which we test for significant responses.
We then converted the complex values of our responses to scalar values for statistical analysis. This was done by computing projected amplitudes (Hou, Pettet, & Norcia, 2008), which are the projection of the amplitudes of individual responses onto the average vector. Projected amplitudes were analyzed using planned two-tailed one-sample t tests and repeated measure ANOVAs. Our planned t tests (Experiments 1–4) provided a direct test of what response components are reliably different from zero. We computed mean vector amplitudes, which consider the reliability of the amplitude and the phase of the response component (Victor & Mast, 1991). If the response components had random phases across participants due to nonevoked responses, then its vector mean would be zero. Complementary, the ANOVAs provide a comparison between conditions, which we used to determine whether our parameters (distance/length in Experiment 3 or contrast Experiment 4) changed sensitivities to the local and global structure of our patterns.
Adults were instructed to avoid eye blinks and to fixate at the center of the screen. Infants sat on a parent's lap in front of the computer screen. To control infant fixation and accommodation, we suspended a small noisy toy on a string at the center of the screen. By observing the centration of reflection of the video monitor in the infant's pupil, we were able to control fixation to lie within approximately 4° of the 32° × 32° display area (Allen, Tyler, & Norcia, 1996). Trials were interrupted if the infants lost fixation. Data were rejected from 1 sec before interruption and recording resumed 1 sec after the experimenter indicated that the infant had regained fixation. For each stimulus condition, we collected 10 trials for adults and 4–7 trials for the infants. Each trial is 10 sec buffered by an extra second at the beginning and end of the trial, in which the stimulus was present but responses were not recorded. Conditions were presented in random order, with 1–3 trials of a given condition run as a block.
Experiment 1: Sensitivity to Organized versus Random Glass and Line Patterns
In the first experiment, we measured sensitivity of adults and infants to the local (at 20 Hz) and global (at 1–3 Hz) structure of Glass and line patterns using stimuli whose global structure alternated between globally horizontal and random (Figure 4A and B). Data are presented from the Oz–Cz derivation because responses were maximal for both the 20- and the 1- to 3-Hz response components. We found that although infants were sensitive to the local update of both Glass and line patterns, they were sensitive to the changes in global structure of line pattern, but not Glass patterns. Meanwhile, adult responses showed sensitivity to changes in the local and global structure of both Glass and line patterns.
Adult and infant responses for the local element update rate (20 Hz) were significantly different from zero (two-tailed one-sample t tests; ps < .05) for both dot and line patterns (Figure 4). This indicates that the infants had at least encoded the presentation of local dots in our conditions.
Figure 4 shows that infant responses were only significant at the global update rate (1 Hz) for line patterns, t(17) = 3.187, p = .005, but not for conventional Glass patterns; no other responses were significantly different from zero (ps > .30). Adult responses were reliably different from zero at 1–3 Hz (p > .05) for line patterns and were reliably different from zero only at 1 Hz, t(12) = 3.093, p = .009, for Glass patterns. These results suggest that 4- to 5.5-month-old infants are sensitive to global structure, but only if the local element orientation is made explicit (Figure 4B).
Experiment 2: Sensitivity to Different Texture Flows in Glass and Line Patterns
Before concluding that responses at the global update reflect truly reflect global processing, we also considered the possible role of occasional junctions from overlapping line segments in random line patterns that could serve as a local cue between the coherent and the incoherent textures (Figure 1, top–middle panels). To eliminate these junctions and to test explicitly for the differential encoding to two different global organizations, we presented dot and line patterns that alternated between a horizontal global pattern and a co-circular one (Figure 1, middle–bottom panels). Beyond controlling for local junction cues, these patterns test for mechanisms that can discriminate two different global configurations.
We found that both infant- and adult-evoked responses discriminated organized flows that differed only their global structure (Figure 5). These results suggest that infants are truly sensitive to global structure—if line patterns are used. Secondly, the selective responses to line patterns in Experiment 1 were not due to the incidental presence of local junctions formed by overlapping line segments. Not surprisingly, infants once more failed to show sensitivity to global structure in the dot-based patterns.
In infants, responses at the global update were significant for line patterns at 3 Hz, t(11) = 3.691, p = .004, but not at any other harmonic (ps > .05). Infant global responses to Glass patterns were not reliably different from zero (ps > .10). In adults, responses to the global structure of line-based patterns were reliable across the first three harmonics (1–3 Hz; Figure 5A) of the global update rate (ps < .05). Adult responses to dot-based patterns were reliable at the second harmonic (2 Hz), t(12) = 3.070, p = .010.
The response spectra differed in detail for stimuli that had a horizontal to random transition compared with stimuli that had a horizontal to co-circular transition. In the adults, the responses peaked at 1 Hz in the former case (Figure 4A and B) but peaked at 2 Hz in the latter (Figure 5A and B). This pattern implies that responses to transitions between two global organizations are more similar than those between organized and random stimuli. Infant responses (to line patterns) by contrast were highest and most significant at odd harmonics (i.e., 1 or 3 Hz).
Experiment 3: Effect of Local Orientation Strength
The only distinction between our dot and line stimuli is the presence of two additional pixels in the line patterns that connect the dots. Given this, it is likely that impoverished local orientation cues limit infants in their ability to globally integrate local features in to textures. Infants seem to fail in an intermediate integration stage: a failure to locally integrate dots into appropriate local orientations despite a capacity to globally integrate line segments into globally coherent structures. The ability to interpolate an orientation signal may depend on separation. In the following experiment, we therefore determined how dot-pair separation or line segment length affected global integration of Glass patterns. We expected that global responses to conventional Glass patterns would decrease as a function of dot-pair length based on previous studies of psychophysical sensitivity (Kurki et al., 2003; Dakin, 1997; Jenkins, 1983), whereas global responses to connected line patterns might increase as a function of line segment length because of stronger orientation cues (Dakin, 1997).
We presented the infants with Glass patterns where dot-pair separations were smaller than in the first two experiments (24.8, 37.2, and 49.6 min end-to-end; Figure 2), reasoning that interpolation might be easier at shorter, rather than larger, dot separations. Line segments of the same length were also presented (Figure 2). For adults, we presented Glass and line patterns that had local element separations/lengths of 24.8, 49.6, and 124.0 min in an effort to find the maximal interpolation span for Glass patterns. Planned two-tailed t tests comparing mean responses to zero were used to detect significant responses. For either infant or adult data, four separate 3 (length/separation) × 2 (stimulus type) ANOVAs were carried out to test for separation/line length effects at the different response frequencies (1, 2, 3, and 20 Hz).
We found that infants were sensitive to transitions between two global flows for line patterns and for dot patterns at smaller separations. Infants and adults show a similar trend of decreasing global responses with dot-pair separation (Figure 6E and F) in the face of increasing global responses with line length (Figure 6K and L). Our data also show that element separation/length had no effect on local responses in infants and adults (Figure 6M–P).
Infants have significant global responses for Glass patterns at separations smaller than the standard of 49.2 min used in the first two experiments, at the 37.2-min separation at 1 Hz, t(20) = 3.008, p = .007, and at the 24.8-min separation at 2 Hz, t(20) = 3.792, p = .001. Infant responses to line patterns at corresponding lengths were only significant at 49.6 min at 1 Hz, t(20) = 3.558, p = .002, and 3 Hz, t(20) = 3.377, p = .003. In adults, we found that global responses were significantly different from zero for Glass patterns with separations smaller than 124 min and for line patterns at all line lengths (for details, see Figure 6).
In infants, the ANOVAs showed no significant main effects or interactions (ps > .10). In adults, the ANOVAs showed no significant main effects of element type, element length, or interactions between them at 1 or 3 Hz (ps > .05). At 2 Hz, there was a significant effect of element type, F(1, 9) = 32.825, p < .001, no significant effect of element length, F(2, 18) = 2.057, p = .157, and a significant interaction between them, F(2, 18) = 7.498, p = .004. The nonsignificant effects in infants may reflect the limitations of the short element lengths chosen. It is possible that we would find a reliable interaction of these factors in infants if we extended the line element lengths beyond 49.6 min as in adults. If we restrict analyses of our adult data to element lengths less than 49.6 min, results would also show nonsignificant main effects and interactions (ps > .05). Local responses (20 Hz) had no significant effect of element type, no significant effect of element length, and no significant interaction between them in either infants or adults (ps > .05; Figure 6M–P).
Experiment 4: Effect of Element Visibility in Adults
We have taken the presence of robust responses at the local update rate as indicating that the infants have successfully encoded the local pattern elements. However, visibility of local elements might still contribute to infant insensitivity to global patterns. Contrast sensitivity of 4-month-old infants is about three times lower than contrast sensitivity of adults (Norcia, Tyler, & Hamer, 1990) for 2-cycle/deg gratings, whose wavelength approximately matches the width of the elements in our Glass pattern stimuli. If limitations in contrast sensitivity simply determines coherence sensitivity to Glass patterns, then we would expect that matching the contrast sensitivity of infants by decreasing luminance contrast by a factor of three would eliminate coherence sensitivity in adults. Because we cannot make infant responses more adultlike by increasing our already maximal stimulus contrast, we sought to make adult responses more infantlike by decreasing stimulus contrast. We found that responses to the local update rate (20 Hz) depend strongly on the luminance contrast of the stimuli, but the responses to the harmonics of the global update rate (1–3 Hz) do not. Furthermore, local responses showed no difference between dots and lines, whereas global responses did.
We measured VEPs to dot and line patterns at 90%, 24%, 7%, and 1% contrast in 14 adults. We carried out a 4 (contrast) × 2 (stimulus type) ANOVA at four temporal frequencies (1, 2, 3, and 20 Hz). As expected, responses at the local update rate (20 Hz) decreased with contrast, F(3, 39) = 7.126, p = .001 (Figure 7D). Although the local responses to dots tended to be lower than responses to lines, they were not reliably different, F(1, 13) = 0.68, p = .424. The interaction of contrast and element type was also nonsignificant, F(3, 39) = 0.269, p = .847, suggesting that decreasing luminance contrast affected the local update of dots and lines similarly.
In contradistinction, we found that the responses at the global update rate and its harmonics (1–3 Hz) were principally resilient to the effects of luminance contrast. Similar to Experiments 1 and 2, global responses at 2 Hz were more reliable. Main effects and interactions were absent at 1 or 3 Hz (ps > .10). At 2 Hz, there was a main effect of element type, F(1, 13) = 11.873, p = .004, confirming that observers had better global sensitivity for lines than for dots. The interaction between these factors was not significant, F(3, 39) = 1.844, p = .155. There was an effect of contrast, F(3, 39) = 3.574, p = .022, but responses at this harmonic were constant between 7% and 90% (Figure 7B).
We also asked six of our observers to perform a two-alternative forced-choice discrimination between coherent and random patterns. In this task, a fraction of the dots or lines adhered to the global rule and the rest were randomized. The fraction (percent coherence) of organized elements was placed on a staircase that converged on 82% correct responses for each contrast level. Threshold visibility of coherent Glass patterns, expressed as a sensitivity measure (Figure 8), was largely invariant over contrast, similar to what we observed in the VEP. These data suggest that the global form of Glass patterns can be detected once the local elements are detected. A similar contrast insensitivity has been found in global motion integration (Burr & Santoro, 2001; Eagle & Rogers, 1997) and contour detection in noise tasks (Hess, Dakin, & Field, 1998). Because the detectability of the global structure of Glass patterns was mostly invariant to the contrast of local elements in adults, the inability of 4- to 5.5-month-old infants to detect the global structure of the dot Glass patterns does not likely stem solely from limitations in detecting local elements.
We investigated how infants extract global image structure in patterns that require at least three stages of processing: detection of the local elements, extraction of an orientation signal from the local elements, and global integration of the constituent elements into a texture flow. Our demonstration of a differential response to transitions between two different global patterns of organization of line elements constitutes positive evidence for high-level pattern discrimination in infants. Nevertheless, infant sensitivity to global structure is quite fragile, as evidenced by their weak responses to Glass patterns. Slight reductions in the quality of the local orientation cues [e.g., removal of two central pixels, larger interdot separations (the present study), or the introduction of orientation noise Pei et al., 2007)] causes global integration to fail in infants. In the broader developmental context, Glass pattern sensitivity is adultlike only by 9 years of age (Lewis et al., 2004) when studied behaviorally consistent with the notion that the processes underlying Glass pattern recognition have a protracted developmental sequence.
Limitations in the Detection of Local Elements
The detection of global structure in Glass patterns involves integrative mechanisms at multiple spatial scales and developmental immaturities at any level or combination of levels could limit performance. At the lowest level, infants are known to have poor spatio-temporal contrast sensitivity (Hartmann & Banks, 1992; Norcia et al., 1990; Banks & Bennett, 1988). Infant contrast sensitivity for gratings of comparable spatial scale as that of the local elements in our Glass pattern (2 cycles/deg) is about three times worse than adult contrast sensitivity (Norcia et al., 1990), and immaturities of contrast sensitivity early in the visual system could thus preclude extraction of higher level features.
Two of our results suggest that element visibility is not the critical limiting factor in Glass pattern processing in infants. First, the infants produced robust evoked responses at the element update rate (Figures 4B, 5B, and 6N and P), and the evoked responses for dots and lines with equivalent spatial spans were the same for all separations measured. Thus, the local element responses for dots are not systematically weaker than those from line element displays. Second, Glass pattern detection does not depend strongly on contrast and inter alia visibility: Evoked response amplitude and psychophysical thresholds for global structure in Glass patterns were each largely independent of stimulus contrast in the adults (Figures 7 and 8).
Limitations in Extracting Local Parallel Structure
Beyond simply detecting the presence of the dots in a Glass pattern, successful discrimination requires the extraction of an orientation signal from the dot pairs. This process will depend on the properties of receptive fields in early visual areas, and any immaturities at this level will propagate forward to higher level processes responsible for the discrimination of different patterns of global organization. We next consider whether the infants' relative insensitivity to Glass patterns by may be due to immaturities in the properties of classical and nonclassical receptive fields in early visual areas.
The classical receptive field is conventionally defined as that part of the visual field over which presentation of a small stimulus can elicit spiking (Barlow, Blakemore, & Pettigrew, 1967). Orientation tuning within classical receptive fields arises independently of visual experience (Wiesel & Hubel, 1974; Hubel & Wiesel, 1963), and orientation-tuning bandwidth in macaque V1 is constant from 1 week of age to adulthood (Kiorpes & Movshon, 2004). Assuming the usual 4:1 conversion factor for macaque to human developmental age, classical receptive field orientation tuning is not likely to be a critical limiting factor at 4–6 months of age in humans.
The spatial extent of notional classical fields is shown as the small yellow circles surrounding some of the dot pairs in Figure 1. Independent processing of orientation cues within such small integration areas would not elicit a differential population response in the VEP: Each location in the visual field is populated with classical receptive fields of all orientations, and thus equivalent responses would be generated by both random and organized patterns as exchanges of the patterns would activate equal numbers of cells.
More specialized receptive field structures could give rise to a differential response to organized versus random patterns that are detectable by the VEP. As already noted, strictly local processing of individual orientation elements, even if they are lines, would not result in a differential population response. In adults, we suggest that nonclassical receptive fields that preferentially integrate contrast along the orientation axis of explicit line stimuli or along the implicit orientation defined by sparse dot pairs may contribute to the differential population response we record for organized versus random displays. A schematic depiction of these more extensive receptive fields is shown as yellow ellipses in Figure 1. These more extensive receptive fields would be sensitive to the consistency of orientation information across multiple elements in the organized state of the pattern but would be poorly driven by random stimuli.
Nonclassical receptive fields encompass a more extensive region of visual space around classical receptive fields. Stimuli presented in nonclassical surrounds modify the response to stimuli presented within the classical receptive field but do not evoke a spiking response when presented in isolation (Angelucci & Bressloff, 2006; Angelucci, Levitt, & Lund, 2002). Stimulation of the nonclassical surround sharpens orientation tuning (Chen, Dan, & Li, 2005; Rose, 1977; Henry, Dreher, & Bishop, 1974), which would be useful in extracting locally parallel structure (for a quantitative analysis of how effective receptive field size controls sensitivity to implicit orientation in Glass patterns, see Smith et al., 2002).
Using small localized grating patches, we previously found that infants isotropically pool orientation information over extended regions of space (Hou, Pettet, Sampath, Candy, & Norcia, 2003). Infants pooled two collinear patches equally well as noncollinear patches. Adults, in comparison, preferentially pooled contrast of collinear elements. This result suggests that infants have a less spatially specific extended summation areas than adults.
Early research on Glass patterns suggested that the probability of incorrect pairings of dots limited the extraction of local orientation signal, which consequently constrained Glass pattern perception (Stevens, 1978). As Stevens observed, this probability increases as the dot density in a Glass pattern increases. If we define a critical integration area following Stevens as the area whose radius is the dot-pair separation, then on average, there would only be one dot pair in the critical integration area at our standard 49.6-min separation.2 Spurious dots that could elicit false pairings are very unlikely to fall within an integration area of this size, which is similar in size to our classical receptive field. Line patterns make the pairing explicit and negate the need to interpolate the orientation defined by a given dot pair. If, however, the infant nonclassical surround were isotropic rather than elongated, they would be more susceptible than adults to false matches in the dot stimuli (large yellow circles, Figure 1). For a dot-pair separation of 124 min, the maximum separation tested, there will be 6.29 dot pairs within the critical area of 13.42 deg2. This effect can be appreciated by comparing the large circular summation areas to the elliptical ones in Figure 1.
This mechanism may also explain why infants only show sensitivity to Glass patterns when the dots are very close together. As dot separation increases, the nearest neighbor dot within an extended isotropic pooling area becomes increasingly likely to signal a random orientation rather than a consistent one. In adults, this effect may be mitigated by preferential pooling of input that arise from appropriately aligned, albeit more distant, dots.
The structure and the function of nonclassical surround mechanisms are poorly understood in the adult, even more so during development. Surround mechanisms appear to be in place in infant macaque V1 by 2 weeks of age and in V2 by 4 weeks of age, but their modulatory effects on classical receptive fields become adultlike much later (Zhang et al., 2005). Anatomical tracer studies in human postmortem samples have shown only weak evidence for horizontal connections at 4 months of age (Burkhalter, Bernardo, & Charles, 1993). Similarly, feedback connections were also immature in humans at this age (Burkhalter, 1993). Thus, it is likely that the anatomical substrate for nonclassical receptive field refinement leading to enhanced orientation and spatial selectivity may be functionally immature in the infants we tested.
Global Form Processing Limitations
Although the ability to globally integrate elements into a pattern in infants exists, the detailed characteristics of the infant-evoked responses are qualitatively different from those of adults. Infants primarily have stronger odd harmonic responses to line patterns that transition from co-circular to horizontal structures (Figure 4B), whereas adults show stronger even harmonic responses (Figure 5B). Degrading local orientation signals by presenting dot pairs instead of lines (Experiments 1 and 2) presumably weakens the input to higher level mechanisms that process the specific form of different global organizations. The fact that adult global responses survive this degradation, but that infant responses do not, suggests that the global integration stage in infant can only operate on strong inputs from earlier in the pathway. It is also possible that infants may require more time to extract an orientation signal from dot pairs than from lines, and a slower global update rate may be have been necessary. Notably, however, infants can successfully extract motion (Gilmore, Hou, Pettet, & Norcia, 2007) and stereo (Birch & Petrig, 1996; Skarf, Eizenman, Katz, Bachynski, & Klein, 1993; Petrig, Julesz, Kropfl, Baumgartner, & Anliker, 1981) information from dot stimuli within the same period of 1 sec.
Global integration in a static glass pattern task has been found to occur in a network of extrastriate visual areas, including ventral stream areas V4, areas anterior to V4, and LOC (Ostwald et al., 2008). A similar network of areas is also activated in a contour-integration task that involves the linking of nearly collinear chains of Gabor patches that are embedded in a background of randomly oriented patterns (Altmann, Deubelius, & Kourtzi, 2004). Like Glass patterns, Gabor-defined contours elicit only weak VEPs in infants (Norcia et al., 2005), suggesting that ventral stream areas are late developing. Dynamic Glass patterns are processed in a range of early visual areas, including V1–V4 as well as in the LOC. However, dynamic Glass patterns also engage V3A and human middle temporal complex (Krekelberg, Vatakis, & Kourtzi, 2005). It is currently not known whether the dynamic Glass pattern activity in dorsal areas is dependent on input from ventral stream areas or if it arises independently. Development may not proceed uniformly over the extended network of areas that are activated by dynamic Glass patterns. Future developmental comparisons of static and dynamic Glass pattern sensitivity may in help to resolve this question.
Relationship to Other Developmental Studies of Global Integration
Our Glass and line pattern study resemble several other studies that involve hierarchical integration of a local cue into a global configuration, such as detection of orientation coherence from Gabor textures, texture segmentation of line-based elements, and detection of motion and stereo cues from random-dot kinematograms.
We have also used Gabor-defined textures to test for global integration. We found robust differential VEP responses between coherent and random textures in infants who were unresponsive to Glass patterns (Supplementary data; see also Pei et al., 2007; Norcia et al., 2005). Because it has frequently been argued that interaction between widely separated Gabor elements depends on mechanisms that extend the size of the classically defined V1 receptive fields (Cavanaugh, Bair, & Movshon, 2002; Kapadia, Westheimer, & Gilbert, 1999; Polat, Mizobe, Pettet, Kasamatsu, & Norcia, 1998; Polat & Norcia, 1998), activity in V1 nonclassical surrounds and/or extrastriate areas (Altmann et al., 2003) must contribute to texture processing in infants. Feedback processes from higher areas acting on lower areas may help to select matches that lead to a more consistent global organization.
The ability to segment a patch of coherent texture from line elements has also been found to be present in infants older than 3 months (Braddick & Atkinson, 2007) measured behaviorally and with VEPs. Our current study extends these findings in three ways. First, we show in Experiment 2 that infants are sensitive to the global organization of line textures even without local line crossings from random textures. In Braddick and Atkinson (2007), there were numerous line crossings in the random stimulus state that could be processed at a local level. Second, we demonstrate that infants are sensitive to global structure of texture in the absence of local texture segmentation cues, steep texture discontinuities between organized and random fields. Third, we show that infants can detect changes in global structure between two organized texture flows, not just detection of differences between organized and random textures. This would suggest that young infants truly integrate global structure across a large span of visual field rather than simply detecting locally coherent patches of line elements.
More is known about the cortical networks involved in two other global integration tasks that resemble the dynamic Glass pattern task in many ways: coherent motion and random-dot stereogram tasks. In the coherent motion task, a series of random-dot elements is systematically displaced according to a global constraint much like that used to generate Glass patterns. Here the pairing of dots occurs over time rather than over space. Coherent motion BOLD activations predominate in human middle temporal complex and V3A and are not prominent in ventral surface areas such as V4 (Smith et al., 2006; Koyama et al., 2005; Tootell et al., 1997). Infant VEPs are more robust to coherent motion displays at 4–6 months of age than are Glass pattern responses composed of dots of similar size and update rates (Gilmore et al., 2007). Behavioral sensitivity for coherent motion displays also develops earlier for coherent motion than for Glass patterns in infant macaques (Kiorpes & Movshon, 2003), suggesting that development is more advanced for the complement of dorsal stream visual areas.
In the dynamic random-dot stereogram task, successful performance requires extraction of dot displacements that occur across the two eyes (binocular disparity). Evoked responses to dynamic random-dot stereograms have been be demonstrated by 3–5 months of age in infants (Birch & Petrig, 1996; Skarf et al., 1993; Petrig et al., 1981). This task activates many cortical areas, including V1, V2, V4, and middle temporal cortex, and inferotemporal cortex in macaque (Parker, 2007). In human, activation is particularly strong in V3A and caudal intraparietal sulcus (Wall & Smith, 2008; Tsao et al., 2003; Backus, Fleet, Parker, & Heeger, 2001). The fact that robust evoked responses can be recorded in infants for coherent motion or stereogram displays that are based on the same spatio-temporal local elements used to generate Glass patterns further indicates that performance on the Glass pattern task is not primarily limited by immature spatio-temporal contrast sensitivity. Rather, significant immaturities must exist in the anatomically and functionally specialized networks leading to and including ventral stream areas such as V4 and LOC, where fMRI studies indicate the presence of strong activation.
Given the complex, hierarchical nature of the Glass pattern task, it is perhaps not surprising that performance may be limited by multiple developmental immaturities operating at the level of local orientation generation and global integration of these orientation signals over large areas of the visual image. Our analysis suggests that single, critical limitations do not exist at any one of these stages, but rather weaknesses at each of these levels may conspire to degrade infants' sensitivity.
This research was funded by the National Institutes of Health (grant nos. EY014536 and EY06579) and the Pacific Vision Foundation. The authors thank Margaret McGovern and Justin Ales for helping in recruiting and running participants. Preliminary data from this manuscript were presented at the 2008 Vision Sciences Society Conference in Naples, FL.
Reprint requests should be sent to Melanie Palomares, The Smith-Kettlewell Eye Research Institute, 2318 Fillmore Street, San Francisco, CA 94115, or via e-mail: firstname.lastname@example.org.
In Braddick et al. (1986), the phase of a grating refreshed every 40 msec (25 Hz), and the orientation of the grating periodically changed every 120 msec (8.33 Hz). A full cycle of orientation changes thus occurred at 4.16 Hz. They recorded an orientation-change response at 8.33 Hz, which was their second harmonic. Because the population response to a change in orientation from left oblique to right oblique is the same, they did not observe odd harmonic responses. The fourth harmonic in their experiment (in principle) also contained an orientation-specific response. In the present study, the frequency ratio between local presentation of the dots and change in global structure of our stimuli is 20:1. Thus, there are many more harmonics of the global update rate that could indicate a significant response to changes in the global pattern.
Critical area = πr2, where r is the dot-pair separation. For the standard separation of 49.6 min = 0.83°, the critical area is π(0.83°)2 or 2.14 deg2. For a density of 0.47 dot pairs/deg2, the number of dots in the critical area is 0.47 dot pairs × 2.2 deg2 or about 1 dot pair within the critical area.