Abstract
Human rhythmic movements spontaneously synchronize with auditory rhythms at various frequency ratios. The emergence of more complex relationships—for instance, frequency ratios of 1:2 and 1:3—is enhanced by adding a congruent accentuation pattern (binary for 1:2 and ternary for 1:3), resulting in a 1:1 movement–accentuation relationship. However, this benefit of accentuation on movement synchronization appears to be stronger for the ternary pattern than for the binary pattern. Here, we investigated whether this difference in accent-induced movement synchronization may be related to a difference in the neural tracking of these accentuation profiles. Accented and control unaccented auditory sequences were presented to participants who concurrently produced finger taps at their preferred frequency, and spontaneous movement synchronization was measured. EEG was recorded during passive listening to each auditory sequence. The results revealed that enhanced movement synchronization with ternary accentuation was accompanied by enhanced neural tracking of this pattern. Larger EEG responses at the accentuation frequency were found for the ternary pattern compared with the binary pattern. Moreover, the amplitude of accent-induced EEG responses was positively correlated with the magnitude of accent-induced movement synchronization across participants. Altogether, these findings show that the dynamics of spontaneous auditory–motor synchronization is strongly driven by the multi-time-scale sensory processing of auditory rhythms, highlighting the importance of considering neural responses to rhythmic sequences for understanding and enhancing synchronization performance.
INTRODUCTION
Human movements are highly sensitive to surrounding auditory events such as the presence of external rhythms (e.g., repetitive sounds or music). Without any intention to do so, an individual's periodic movements can become transiently synchronized with an auditory sequence, a phenomenon referred to as spontaneous or unintentional auditory–motor synchronization. Unintentional synchronization has been revealed for a large repertoire of human movements, namely, tapping, walking, running, clapping, and postural sway (Coste, Salesse, Gueugnon, Marin, & Bardy, 2018; Hattori, Tomonaga, & Matsuzawa, 2015; Van Dyck et al., 2015; Peckel, Pozzo, & Bigand, 2014; Repp & Su, 2013; Demos, Chaffin, Begosh, Daniels, & Marsh, 2012; Bernardi et al., 2009), and auditory stimuli, namely, simple metronome, music, and even subliminal rhythmic stimuli (Varlet, Williams, & Keller, 2020; Coste et al., 2018; Schurger, Faivre, Cammoun, Trovó, & Blanke, 2017; Van Dyck et al., 2015).
Although previous studies mostly focused on the occurrence of synchronization at a simple 1:1 frequency relationship between the movement and the auditory stimulus (i.e., one movement cycle for one stimulus cycle), human movements can also entrain to more complex frequency ratios such as 1:2 and 1:3 (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019; Bouvet, Varlet, Dalla Bella, Keller, Zelic, et al., 2019; Varlet, Williams, Bouvet, & Keller, 2018; Peckel et al., 2014). The occurrence and dynamic stability of these frequency ratios, however, are lower than that of the 1:1 frequency ratio (Bouvet, Varlet, Dalla Bella, Keller, Zelic, et al., 2019), as predicted by the mathematical concept of the Farey tree (Cvitanovic, Shraiman, & Söderberg, 1985; Hardy & Wright, 1979). The Farey tree orders different frequency ratios from more complex and least stable ratios to the simplest and more stable ones (e.g., 1:3 < 1:2 < 1:1). The most stable ratios tend to spontaneously emerge and be consistently maintained, as reported in previous studies on bimanual synchronization (Peper, Beek, & van Wieringen, 1995a, 1995b; Treffner & Turvey, 1993; Kelso & De Guzman, 1988) and locomotion–respiration coupling (e.g., Hoffmann & Bardy, 2015).
Interestingly, the occurrence of such various frequency ratios can be facilitated when adding a congruent accentuation pattern to the auditory sequences (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019). Accentuation corresponds to an acoustic event that is salient in comparison to its surrounding context (Bouwer, Burgoyne, Odijk, Honing, & Grahn, 2018; London, 2012; Ellis & Jones, 2009; Dawe, Platt, & Racine, 1993, 1995; Palmer & Krumhansl, 1990) and can arise from features of the auditory stimulus (Lerdahl & Jackendoff, 1983). For example, modulating the intensity of specific events in the signal (e.g., accents on vs. off the beat) can enhance beat perception (Bouwer et al., 2018; Fujioka, Ross, & Trainor, 2015; Schaefer, Vlek, & Desain, 2011; Grahn & Rowe, 2009; Drake, 1993) and intentional movement synchronization (Etani, Miura, Okano, Shinya, & Kudo, 2019; Repp, 2005). Moreover, in a previous study, we have recently reported (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019) that spontaneous movement synchronization at 1:2 and 1:3 frequency ratios is facilitated when auditory sequences are binary and ternary accented, respectively. Enhanced synchronization to 1:2 and 1:3 frequency ratios might result from accent-induced modulation of attention, as a foundation for auditory–motor interaction. This possibility is illustrated by a theory named Dynamic Attending Theory (Drake, Jones, & Baruch, 2000; Jones, 1976). According to the Dynamic Attending Theory, attention can be modeled as a self-sustained oscillator whose dynamics can be influenced by the presence of other oscillators, oscillators representing periodic stimuli or periodic movements, for instance. Consistent with such a process, EEG recordings have captured some forms of enhanced responses at frequencies specifically related to movement and components of the auditory stimulus' frequencies (Chemin, Mouraux, & Nozaradan, 2014; Nozaradan, Zerouali, Peretz, & Mouraux, 2013; Nozaradan, Peretz, & Mouraux, 2012; Nozaradan, Peretz, Missal, & Mouraux, 2011). Subcortical and cortical mechanisms, supporting lower- and higher-level processing of auditory rhythms, respectively, have been suggested to underpin the occurrence of these periodicities in neural activity (Nozaradan, Schönwiesner, Keller, Lenc, & Lehmann, 2018; Rajendran, Harper, Garcia-Lazaro, Lesica, & Schnupp, 2017). Here, we hypothesized that accentuation may result in neural periodicity that fosters the emergence of spontaneous movement synchronization. Accent-induced neural periodicity congruent with an individual's movement timing could facilitate synchronization by simplifying complex relations between the movement and an auditory sequence to a more stable 1:1 accentuation–movement relationship.
Importantly, we recently showed that the benefit of congruent accentuation patterns on spontaneous movement synchronization was stronger for 1:3 ternary accentuation than for 1:2 binary accentuation (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019). The origin of this difference remains unclear. A possible explanation is that ternary accentuation might drive neural activity to a greater degree than binary accentuation because of a perceptual contrast difference between the two accentuation patterns. Binary structure entails a symmetric alternation of accented and unaccented sounds, whereas ternary structure is composed of one accented sound followed by two unaccented sounds before repetition of the pattern, thus resulting in greater perceptual contrast. Repetitions induce stimulus-specific adaptation of the auditory perceptual system, interrupted by a second unaccented sound in the ternary accentuation pattern (Antunes & Malmierca, 2014). Such difference might result in larger neural responses to ternary accentuation compared to binary accentuation, despite identical frequencies and amplitudes, and might underpin enhanced accent-induced movement synchronization.
In the current study, we used EEG to measure neural responses to unaccented and accented auditory sequences and to determine if the magnitude of the neural tracking of binary and ternary patterns of accentuation differs. The term “neural tracking” here does not refer to any particular underlying mechanism, or form of entrainment, which would explain how the brain tracks periodicities in auditory sequences. Whether the tracking of periodicities in auditory rhythms is underpinned by dynamic modulations in evoked neural responses and/or endogenous neural oscillations is currently debated (Doelling, Assaneo, Bevilacqua, Pesaran, & Poeppel, 2019; Lenc, Keller, Varlet, & Nozaradan, 2018a, 2019; Rajendran & Schnupp, 2019; Novembre & Iannetti, 2018), but this level of neurophysiological detail is beyond the scope of the current study. Furthermore, we measured the occurrence of spontaneous movement synchronization toward 1:2 and 1:3 frequency ratios to assess whether individual differences in accent-induced movement synchronization are associated with differences in accent-induced EEG responses. We assessed participants' neural response to the accentuation patterns during passive listening trials of unaccented and accented auditory metronomes. During movement trials, we asked participants to produce cyclic finger taps at their preferred frequency while listening to the auditory sequences. It was predicted that the amplitude of accent-induced EEG responses would be larger for ternary accentuation than for binary accentuation and that the amplitude of accent-induced EEG responses would predict the magnitude of accent-induced movement synchronization.
METHODS
Participants
Nineteen right-handed participants (10 women) with a mean age of 27.48 years (SD = 4.2 years, range = 23–39 years) and various levels of musical training (mean = 7.84 years, SD = 9.42 years, range = 0–30 years) were tested in this experiment. All participants were selected based on a preferred movement tempo between 1.6 and 2 Hz, which corresponds to the average preferred tempo reported in previous studies (1.65–2 Hz; Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019; Bouvet, Varlet, Dalla Bella, Keller, Zelic, et al., 2019; Large, 2008; Moelants, 2002; Collyer, Broadbent, & Church, 1994; Fraisse, 1974, 1982). Participants were prescreened to make sure they fulfilled this criterion using an online tapping test (www.all8.com/tools/bpm.htm) where they were asked to “tap with your right index finger, wrist on a flat surface, on any key of your keyboard at your most comfortable tapping frequency that you can maintain for at least 60 taps.” All participants had no history of hearing impairment and provided written informed consent before the experiment. This study was approved by the human research ethics committee of Western Sydney University.
Apparatus and Stimuli
Participants were seated comfortably in a chair with their forearms resting on customized armrests configured to perform an air-tapping task, that is, vertical flexion–extension of the right index finger without tactile contact. A sensor was fixed on the participant's right index finger to record the vertical oscillations at a 240-Hz sampling rate with a Polhemus Liberty motion tracker (Polhemus Ltd.). EEG was recorded at a sampling rate of 1024 Hz using a Biosemi Active-Two system (Biosemi) with 64 Ag–AgCl electrodes placed over the participant's scalp according to the International 10–20 system. Four additional external electrodes were placed over the participant's face to control for blinks and horizontal eye movements, and two others were placed on the participant's mastoids to be used as reference.
The auditory metronomes were presented to the participant using MATLAB software (Version 2014B, The MathWorks, Inc.) via in-ear headphones (ER-1, Etymotic Research). To replicate the 1:2 and 1:3 accented congruent conditions of our previous experiment (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019), stimuli were presented at two different tempi, ensuring that the time interval between accents was the same across accent patterns. We used 3.6-Hz auditory sequences with binary accentuation and 5.4 Hz with ternary accentuation to examine spontaneous movement synchronization to 1:2 and 1:3 frequency ratios, considering an average preferred tempo of our participants around 1.8 Hz, in line with previous studies (Large, 2008), as illustrated in Figure 1. These combinations resulted in binary and ternary accentuations at 1.8 Hz corresponding to participants' preferred tempo. To test the effect of accentuation, 3.6- and 5.4-Hz sequences were also presented without accentuation. The four resulting sequences were composed of repetitions of a 50-msec drumbeat with 10-msec fade-in and fade-out and lasted 60 sec. The auditory sequences were presented at a comfortable intensity kept constant for all participants, and accentuation was produced by doubling the amplitude of the sound. Unaccented and accented sounds were presented at 60 and 66 dB, respectively. Accentuation patterns led to clear frequency peaks and corresponding harmonics specific to the binary and ternary accentuations in the frequency domain, as observed in Figure 1. A VIEWPixx monitor (VPixx Technologies) was positioned in front of the participant. A fixation cross was displayed at the center of the monitor throughout the trials to control for participant's eye movements. The monitor was also used to provide instructions for the different conditions.
Frequency-domain amplitude spectra with baseline subtraction for the different auditory sequences presented to participants and for the corresponding EEG responses to the binary (left) and ternary (right) 1.8-Hz accentuated sequences (orange) and unaccented sequences (black). EEG spectra correspond to the amplitude averaged across all participants in the seven selected fronto-central electrodes.
Frequency-domain amplitude spectra with baseline subtraction for the different auditory sequences presented to participants and for the corresponding EEG responses to the binary (left) and ternary (right) 1.8-Hz accentuated sequences (orange) and unaccented sequences (black). EEG spectra correspond to the amplitude averaged across all participants in the seven selected fronto-central electrodes.
Procedure
Before EEG preparation, participants were briefed regarding the EEG and motion capture technology but were not informed about the different accentuation patterns. The four different auditory sequences (i.e., unaccented and accented at 3.6 and 5.4 Hz) were presented in two types of trials—tapping and listening trials. In the tapping trials, participants tapped in the air with their right index finger at their most comfortable frequency following the instruction: “Try to adopt a tempo that you could maintain for a long period of time without fatigue.” They were instructed to do their best to maintain this frequency even when auditory stimuli were presented. Each tapping trial began with a period of silence that randomly lasted between 5 and 10 sec to ensure that participants found their preferred tempo before the beginning of the sequence. Participants' tapping was also measured in control trials in which auditory stimuli were not presented. During the listening trials, participants were asked to stay still. In all trials, participants were instructed to stay relaxed and to keep their eyes on the fixation cross.
Each participant performed 54 trials in total, including six trials for each of the nine different conditions (i.e., five tapping conditions: four auditory stimuli and one silence control, plus four listening conditions). Six blocks with nine trials, one for each condition, were presented to each participant in a randomized order (within and between blocks). After EEG preparation and instruction delivery, the experiment lasted about 1 hr. The participants were debriefed at the end of the experiment. Most of them reported interference from the auditory sequences on their capacity to maintain a steady movement tempo, but none of them reported that they intentionally synchronized with the sequences.
Data Analysis
Spontaneous Movement Synchronization
Vertical position data for movements of participants' right index fingers were extracted, centered on zero and band-pass filtered with 0.1- and 10-Hz cutoff frequencies. Movement peaks (flexions) were determined using the peakdet function in MATLAB that identifies lower and higher points in local areas (Billauer, 2012). The timing positions associated with maximal finger flexion of the right index finger were then used to compute the percentage of occurrence of synchrony relative to the expected 1:2 or 1:3 frequency ratios using Index of Stability analysis (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019; Bouvet, Varlet, Dalla Bella, Keller, Zelic, et al., 2019; Zelic, Varoqui, Kim, & Davis, 2017). This method allows the measure of the occurrence of stable frequency ratios between two oscillatory components by considering the local modes of relationship emerging between the two time series.
Before focusing more specifically on the effect of accentuation, we first examined the spontaneous movement synchronization occurring in unaccented and accented conditions separately. An ANOVA with the factors Accentuation presence (accented vs. unaccented) and Frequency ratio (1:2 vs. 1:3) was conducted on the percentage of occurrence at 1:2 and 1:3 ratios after subtraction of the incidental synchrony (percentage at these ratios in control trials without auditory stimuli).
The benefit of accentuation on spontaneous movement synchronization between binary accented and ternary accented conditions was then examined by subtracting the mean percentage occurrence to unaccented sequences from the mean percentage occurrence to accented sequences in the corresponding condition. Data for accent-induced synchrony at the expected ratios (i.e., 1:2 and 1:3) were submitted to a paired-sample t test between the two accentuation patterns (binary vs. ternary) and to a one-sample t test against 0. Statistical analyses were carried out using R (Version 3.4.1; www.R-project.org).
EEG Preprocessing
The EEG processing was carried out using the Fieldtrip toolbox (Oostenveld, Fries, Maris, & Schoffelen, 2011) using MATLAB software. EEG data were first high-pass filtered using a fourth-order Butterworth filter with a cutoff frequency of 0.1 Hz and notch filtered to remove 50-Hz (and corresponding harmonics) electrical power contamination. After removal of eye movement and blink artifacts via independent component analysis using the FastICA algorithm, as implemented in Fieldtrip, EEG data were segmented into 60-sec epochs for each passive listening trial. Each listening trial considered for the EEG analysis was controlled for uninstructed finger movement and discarded if necessary (<1%). The data were rereferenced to the mastoids and then averaged across trials in the time domain separately for each condition and participant to increase the signal-to-noise ratio (Lenc, Keller, Varlet, & Nozaradan, 2018b; Handy, 2005).
Frequency-Domain Analysis of the EEG Responses
EEG for the 60-sec trials of passive listening was transformed into the frequency domain using a fast Fourier transform, resulting in a frequency spectrum of signal amplitude (μV) ranging from 0 to 512 Hz, with a frequency resolution of ≈0.0167 Hz (i.e., 1/60 sec). To reduce background noise in the spectrum, the average amplitude of the surrounding frequency bins (from the second to fifth bins on each side) was subtracted from the amplitude at each frequency bin (Varlet, Nozaradan, Nijhuis, & Keller, 2020; Nozaradan et al., 2012; Mouraux et al., 2011). These noise-subtracted amplitudes were then used to measure EEG responses at 1.8 Hz corresponding to the frequency of the auditory accentuation in the two rhythmic sequences and at 3.6 and 5.4 Hz corresponding to the two first harmonics of 1.8 Hz that also showed responses to accentuation (see Figure 1). Including harmonics at which there was significant amplitude is critical to measure global amplitude changes at the accentuation frequency, as these harmonics capture deviations from a perfectly sinusoidal 1.8-Hz waveform. To compare the amplitude of EEG responses between binary and ternary accentuation when controlling for the influence of the difference of tempo between the two rhythmic sequences (i.e., 3.6 vs. 5.4 Hz), EEG responses to unaccented sequences at 1.8, 3.6, and 5.4 Hz were subtracted from EEG responses to accented sequences in the corresponding condition. Amplitudes at 1.8, 3.6, and 5.4 Hz were then averaged separately for binary and ternary accentuations.
In line with previous studies on auditory perception (Nozaradan, Mouraux, & Cousineau, 2017; Näätänen, Paavilainen, Rinne, & Alho, 2007), the average of a selection of seven fronto-central EEG electrodes, namely, Fz, FCz, Cz, F1, F2, FC1, and FC2, was considered for statistical analyses. The accent-induced EEG responses were submitted to a two-tailed paired-sample t test to evaluate the reliability of the difference between the two accentuation patterns (binary vs. ternary) and to one-sample t tests to evaluate differences from zero.
Time-Domain Analysis of the EEG Responses
To further examine the neural response to accentuation, EEG data were also analyzed in the time domain. EEG data were bandpass filtered using a fourth-order Butterworth filter with cutoff frequencies of 0.03 and 30 Hz in line with previous research (Edagawa & Kawasaki, 2017). The 60-sec passive listening trials were segmented into ≈0.56-sec epochs (i.e., two interonset intervals for 3.6 Hz and three interonset intervals for 5.4 Hz) that were then averaged across participants for each condition. To compare EEG time-domain responses to accentuation in 1:2 binary and 1:3 ternary conditions, we also examined EEG responses to accented sequences after subtraction of EEG responses to unaccented sequences in the corresponding frequency ratio condition.
We used cluster-based permutation testing to determine significant differences between accented and unaccented responses (Oostenveld et al., 2011). Point-by-point paired-sample t tests were used to compare accented and unaccented responses, and point-by-point one-sample t tests were used to compare the difference between accented and unaccented responses against 0. We then estimated clusters of adjacent time points above the critical t value (alpha level = .05) for a parametric two-sided test and the magnitude of each cluster by computing the sum of the absolute t values constituting each cluster. One thousand random permutations of each participant's waveforms were calculated to obtain a reference distribution of maximum cluster magnitude. The proportion of random partitions that resulted in a larger cluster-level statistic than the observed one (p < .05) was computed. Clusters were considered as significant in observed data if they had a magnitude exceeding the threshold of the 95th percentile of the permutation distribution.
Relationship between Accent-induced Synchrony and EEG Response
To determine whether neural activity at the frequency of the accentuation patterns was directly related to participants' accent-induced spontaneous movement synchronization, Spearman correlation analyses between accent-induced movement synchrony and accent-induced EEG responses were conducted separately for the binary and ternary conditions.
RESULTS
Accent-induced Movement Synchronization
The ANOVA with the factors Accentuation presence (accented vs. unaccented) and Frequency ratio (1:2 vs. 1:3) on the percentage of occurrence at 1:2 and 1:3 ratios after subtraction of the incidental synchrony (percentages in control trials) indicated no main effect of Accentuation presence, F(1, 18) = 2.86, p = .11, ηG2 = .013, and Frequency ratio, F(1, 18) = 3.82, p = .07, ηG2 = .021, but a significant interaction between the two factors, F(1, 18) = 5.41, p = .03, ηG2 = .018. Pairwise comparisons with Bonferroni correction (six in total) revealed a larger percentage of occurrence for 1:2 than 1:3 ratio in unaccented conditions, t(33.91) = 2.97, p = .03, d = .52. These results show that spontaneous synchronization with unaccented sequences was stronger toward the 1:2 than 1:3 frequency ratio, as displayed in Figure 2.
Spontaneous movement synchronization toward 1:2 and 1:3 frequency ratios for accented and unaccented auditory sequences. The data presented correspond to the percentages of occurrence after subtraction of the incidental synchrony (percentages in the control trials). Error bars represent Cousineau–Morey within-subject 95% confidence intervals. The asterisk represents p < .05.
Spontaneous movement synchronization toward 1:2 and 1:3 frequency ratios for accented and unaccented auditory sequences. The data presented correspond to the percentages of occurrence after subtraction of the incidental synchrony (percentages in the control trials). Error bars represent Cousineau–Morey within-subject 95% confidence intervals. The asterisk represents p < .05.
When focusing more specifically on the influence of the accentuation pattern, the results indicated greater accent-induced spontaneous movement synchrony (i.e., accented–unaccented difference in percentage of occurrence at the expected frequency ratio [1:2 or 1:3]) for the ternary accentuation than the binary accentuation, as illustrated in Figure 3A. The paired-sample t test on accent-induced synchrony data indicated a significant difference between the binary and ternary accentuation patterns, t(18) = −2.33, p = .03, d = .53. Moreover, one-sample t tests against 0 revealed no significant difference for the binary accentuation pattern, t(18) = −0.31, p = .76, d = .07, but a significant difference for the ternary accentuation pattern, t(18) = 2.23, p = .04, d = .51. These results show that only ternary accentuation strengthens participants' spontaneous movement synchronization.
(A) Accent-induced movement synchrony for the binary and ternary accentuation patterns, obtained by subtracting the percentage of occurrence of the expected ratio when listening to unaccented sequences from that when listening to accented sequences. (B) Accent-induced EEG responses to binary and ternary accentuation patterns. EEG responses correspond to the mean of the baseline-subtracted amplitudes at the frequency and corresponding harmonics (1.8, 3.6, and 5.4 Hz) exclusive to accentuation (after subtraction of EEG responses to unaccented sequences) averaged across seven fronto-central electrodes, in accordance with the corresponding grand-averaged topographical maps. (C) Correlations between accent-induced EEG response and accent-induced movement synchrony for binary accentuation (blue) and ternary accentuation (red). The colored diagonals indicate the lines of best fit. Error bars represent Cousineau–Morey within-subject 95% confidence intervals. Asterisks represent p < .05. t Tests and correlation analyses were conducted and deemed appropriate after checking that they give equivalent results when removing the percentage of occurrence outlier (> 3 × SD of the mean).
(A) Accent-induced movement synchrony for the binary and ternary accentuation patterns, obtained by subtracting the percentage of occurrence of the expected ratio when listening to unaccented sequences from that when listening to accented sequences. (B) Accent-induced EEG responses to binary and ternary accentuation patterns. EEG responses correspond to the mean of the baseline-subtracted amplitudes at the frequency and corresponding harmonics (1.8, 3.6, and 5.4 Hz) exclusive to accentuation (after subtraction of EEG responses to unaccented sequences) averaged across seven fronto-central electrodes, in accordance with the corresponding grand-averaged topographical maps. (C) Correlations between accent-induced EEG response and accent-induced movement synchrony for binary accentuation (blue) and ternary accentuation (red). The colored diagonals indicate the lines of best fit. Error bars represent Cousineau–Morey within-subject 95% confidence intervals. Asterisks represent p < .05. t Tests and correlation analyses were conducted and deemed appropriate after checking that they give equivalent results when removing the percentage of occurrence outlier (> 3 × SD of the mean).
Accent-induced EEG Responses
Frequency-Domain Response
As seen in Figure 3B, accent-induced EEG responses (1.8 Hz and its harmonics), obtained by subtracting EEG responses to unaccented sequences from EEG responses to accented sequences, differed between the binary accentuation and ternary accentuation conditions. The paired t test on these data indicated significantly larger responses to ternary accentuation compared to binary accentuation, t(18) = −2.45, p = .02, d = .56. Furthermore, one-sample t tests against 0 revealed a significant difference for the binary accent-induced EEG response, t(18) = 2.12, p = .047, d = .49, and for the ternary accent-induced EEG response, t(18) = 4.47, p < .001, d = 1.03. There were significant accent-induced EEG responses to both binary and ternary accentuations, but the amplitude of the response was larger for ternary accentuation. Topographic maps of these accent-induced EEG responses displayed at the top of Figure 3B are consistent with differences in amplitude that may originate from auditory regions.
Time-Domain Response
Figures 4 and 5 present EEG time-domain responses to the binary and ternary accentuation patterns with the corresponding control unaccented conditions. The difference between accented and unaccented conditions for the ternary accentuation pattern is numerically greater than the difference observed for the binary accentuation pattern. After subtraction of the unaccented responses from the accented responses (Figures 4 and 5, bottom), significant positive and negative deflections were found (i.e., significant clusters as indicated by gray-shaded sections), peaking between the unaccented (black vertical bar) and accented (orange vertical bar) sound, especially for ternary accentuation. Topographic maps of the amplitude difference between the two conditions averaged within interonset intervals are consistent with this enhancement of the response to accentuation occurring in auditory regions.
Time-domain EEG responses to 3.6-Hz binary accented sequence and the corresponding unaccented controls in the seven selected fronto-central electrodes. Bold vertical bars represent unaccented (gray) and accented (orange) auditory sounds in ≈556-msec epochs. The top section of the figure depicts the average amplitude in the unaccented (black) and accented (orange) conditions. The bottom section represents the contrast between the accented and unaccented conditions with the corresponding topographic maps averaged within interonset intervals. Shaded areas represent Cousineau–Morey within-participant 95% confidence intervals, and sections shaded in gray correspond to significant clusters (p < .05) after random permutations.
Time-domain EEG responses to 3.6-Hz binary accented sequence and the corresponding unaccented controls in the seven selected fronto-central electrodes. Bold vertical bars represent unaccented (gray) and accented (orange) auditory sounds in ≈556-msec epochs. The top section of the figure depicts the average amplitude in the unaccented (black) and accented (orange) conditions. The bottom section represents the contrast between the accented and unaccented conditions with the corresponding topographic maps averaged within interonset intervals. Shaded areas represent Cousineau–Morey within-participant 95% confidence intervals, and sections shaded in gray correspond to significant clusters (p < .05) after random permutations.
Time-domain EEG responses to 5.4-Hz ternary accented sequences and their corresponding unaccented controls in the seven selected fronto-central electrodes. Bold vertical bars represent unaccented (gray) and accented (orange) auditory sounds in ≈556-msec epochs. The top section of the figure depicts the average amplitude in the unaccented (black) and accented (orange) conditions. The bottom section represents the contrast between the accented and unaccented conditions with the corresponding topographic maps averaged within interonset intervals. Shaded areas represent Cousineau–Morey within-participant 95% confidence intervals, and sections shaded in gray correspond to significant clusters (p < .05) after random permutations.
Time-domain EEG responses to 5.4-Hz ternary accented sequences and their corresponding unaccented controls in the seven selected fronto-central electrodes. Bold vertical bars represent unaccented (gray) and accented (orange) auditory sounds in ≈556-msec epochs. The top section of the figure depicts the average amplitude in the unaccented (black) and accented (orange) conditions. The bottom section represents the contrast between the accented and unaccented conditions with the corresponding topographic maps averaged within interonset intervals. Shaded areas represent Cousineau–Morey within-participant 95% confidence intervals, and sections shaded in gray correspond to significant clusters (p < .05) after random permutations.
Relationship between Accent-induced EEG Responses and Movement Synchrony
As seen in Figure 3C, correlation analyses revealed a significant correlation between the magnitude of participants' accent-induced EEG (frequency-domain) responses and accent-induced movement synchrony for the ternary accentuation pattern, r2 = .26, p = .03, but not for the binary accentuation pattern, r2 = .015, p = .62. These results indicate that the larger the magnitude of participants' EEG responses to ternary accentuation, the greater the facilitation of the occurrence of spontaneous movement synchronization with ternary accentuation.
DISCUSSION
This study investigated the neural activity underlying the spontaneous synchronization of human movements to accented auditory sequences. The amplitude of accent-induced EEG responses and movement synchronization was examined for auditory sequences with congruent binary and ternary accentuation patterns (i.e., in a matched 1:1 relationship with movement frequency) to determine if differences in EEG responses could explain individual differences in spontaneous movement synchronization occurring across the two accentuation patterns.
The results corroborated recent evidence showing greater benefit of ternary accentuation than binary accentuation on an individual's movement synchronization (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019). Synchronization enhancement induced by binary accentuation did not even reach statistical significance in the current study. This negative finding may be because of higher variability in participants' preferred movement frequency as compared to Bouvet, Varlet, Dalla Bella, Keller, and Bardy (2019). It might also be because of a higher degree of synchronization without accentuation for the 1:2 than 1:3 ratio in line with the predictions of the Farey tree and previous studies (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019; Peper et al., 1995a; Cvitanovic et al., 1985), which might leave less room for accent-induced enhancement. Together, these results confirm the beneficial effects of accentuation on auditory–motor synchronization (Etani et al., 2019; Repp, 2005; Semjen & Vos, 2002) and the weaker effect of binary accentuation on spontaneous movement synchronization we previously found (Bouvet, Varlet, Dalla Bella, Keller, & Bardy, 2019). Although it is true that participants spontaneously synchronized more toward 1:2 than 1:3 without accentuation, these accentuation effects, at both neural and behavioral levels, contrast with previous works suggesting that humans have a general preference for binary patterns in perception and coordination (Collier & Wright, 1995; Povel, 1981; Fraisse, 1956), encouraging further exploration in future studies.
Our observation of the influence of accentuation pattern could be considered in line with the subdivision benefit. In intentional bimanual, locomotion, and auditory–motor synchronization (Roerdink et al., 2009; Kudo, Park, Kay, & Turvey, 2006; Repp, 2003; Fink, Foo, Jirsa, & Kelso, 2000), the addition of a cue between the intervals of the rhythm to be synchronized with (i.e., frequency × 2 for duple division) has been found to be associated with an improvement of the movement performance and an extension of the range of frequencies an individual can synchronize with. However, the subdivision benefit was not observed for triple subdivision (Repp, 2003) or for duple subdivision in spontaneous auditory–motor synchronization (Varlet, Williams, Bouvet, et al., 2018). Interestingly, Repp (2003) hypothesized that, if the target sound of the triple subdivision was accented, coordination might be enhanced. Therefore, by adding accentuation pattern to a monotone auditory isochronous sequence, we reproduced duple subdivision benefit and observed triple benefit for the first time in spontaneous auditory–motor coordination.
EEG recordings revealed significant responses to both accentuation patterns during passive listening. Notably, these responses were larger for ternary accentuation than binary accentuation, in line with participants' accent-induced movement synchronization. Frequency-domain analyses revealed larger responses at the accentuation frequency (1.8 Hz and its harmonics) for the ternary accentuation compared to the binary accentuation. This difference was also suggested by the time domain data, as indicated by an accent-induced periodic modulation of larger amplitude for the ternary pattern compared to the binary pattern. This modulation peaked for ternary accentuation after the second unaccented sound, which is assumed to be because of the contrast structure of the rhythmic sequence. The second unaccented sound breaks the accented-unaccented repetition, consequently releasing the auditory perceptual system from stimulus-specific adaptation (Antunes & Malmierca, 2014). Although the modulation induced by binary accentuation is of lower amplitude, similar dynamics can be observed with larger amplitude occurring before the accented sound. Interestingly, spontaneous movement synchronization benefits from accentuation even if accented sounds do not seem to drive the largest EEG responses in the current study. These results encourage further exploration as larger responses to accented sounds have been reported (Fujioka et al., 2015; Schaefer et al., 2011; Fujioka, Zendel, & Ross, 2010). Such differences could originate from variations in the characteristics of the auditory sequences presented in these studies, including their frequency as well as the form and magnitude of the accentuation. In other words, because of the relatively fast rates of the acoustic events used here, the various components of the neural response to the events may have been highly overlapping over time. This resulted in a complex waveform whose absolute latency of the components may not be meaningful because of various conduction delays, potentially leading to shifts of phases of these components captured by surface EEG. Overcoming this limitation of time domain analysis, the frequency analysis used here did not assume a particular shape or latency of the response and was thus helpful at demonstrating that enhanced accent-induced movement synchronization occurring with ternary accentuation originates from enhanced neural tracking of this accentuation pattern.
This statement is further supported by the observation of a positive correlation between ternary accent-induced EEG responses and movement synchrony. Participants who exhibited larger neural response to the ternary accentuation during passive listening also exhibited stronger spontaneous movement synchronization to ternary accentuation. These findings demonstrate the link between the magnitude of the neural tracking of auditory rhythms and the strength of movement synchronization occurring spontaneously with these rhythms. Thus, these results further demonstrate the relevance of EEG activity for understanding individual differences in movement synchronization with auditory rhythms, extending previous research on intentional synchronization that showed how the amplitude of an individual's EEG responses predicts capacity to move in synchrony at these specific frequencies (Nozaradan, Peretz, & Keller, 2016; Chemin et al., 2014; Nozaradan et al., 2012).
Together, our results suggest that the lower benefit of binary accentuation on spontaneous movement synchronization is because of weaker neural tracking of this pattern. Although significant EEG responses to binary accentuation were found in the current study, the amplitude of those responses might have been insufficient to support spontaneous movement synchronization. As noted above, it is also possible that the higher degree of synchronization without accentuation for the 1:2 than 1:3 ratio might have contributed to limit the benefit of binary accentuation. It can be assumed that a certain amplitude threshold of EEG responses to accentuation is necessary to observe accent-induced spontaneous movement synchronization. Future research is needed to further explore the causality between neural tracking and motor response, by testing if manipulating the intensity of the accentuation helps to enhance EEG responses to accentuation and thus accentuation-induced movement synchronization, including for binary patterns.
It would also be informative in future research to further examine the exact nature of the mechanisms underlying periodic EEG responses at the stimulus frequency and how they are modulated by accentuation. Modulations in evoked responses and/or endogenous neural oscillations have been discussed as possible underlying mechanisms (Doelling et al., 2019; Lenc et al., 2018a; Novembre & Iannetti, 2018). Distinguishing these two mechanisms from EEG recordings is challenging, especially under conditions as in this study where fast stimulus rates result in large overlap between successive evoked responses. Nevertheless, with slower auditory sequences (Fujioka et al., 2010, 2015; Schaefer et al., 2011), future studies could aim at addressing these questions more specifically and furthering the understanding of how accentuation modulates neural activity and spontaneous movement synchronization.
To conclude, the results of the current study demonstrate that differences in spontaneous auditory–motor synchronization across accentuation patterns and participants might be because of differences in the neural tracking of auditory rhythms while listening without overtly moving on the rhythms. The amplitude of EEG responses can explain the difference of movement synchronization between the binary and ternary accentuation patterns and individual differences between participants. Our results extend our understanding of the interaction between perception and action by showing that the magnitude of sensory auditory responses modulates the strength of spontaneous movement synchronization. These findings encourage future research to further consider interindividual and intraindividual differences in perceptual responses to understand spontaneous auditory–motor synchronization. Addressing these considerations could help to improve interventions that use auditory–motor synchronization and accentuation for enhancing motor performances in medical (Dalla Bella, 2020; Cochen de Cock et al., 2018; Dalla Bella, Dotov, Bardy, & de Cock, 2018; Benoit et al., 2014) and sport (Pfleiderer, Steidl-Müller, Schiltges, & Raschner, 2019; Bood, Nijssen, Van Der Kamp, & Roerdink, 2013) settings.
Acknowledgments
This work was supported by an Australian Research Council Discovery project grant (DP170104322) and by EnTimeMent, a project funded by the European Union (H2020-FETPROACT-2018-0, Contract #824160).
Reprint requests should be sent to Manuel Varlet, The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Locked Bag 1797, Penrith NSW 2751, Australia, or via e-mail: m.varlet@westernsydney.edu.au.