The leaky integrator, the basis for many neuronal models, possesses a negative group delay when a time-delayed recurrent inhibition is added to it. By means of this delay, the leaky integrator becomes a predictor for some frequency components of the input signal. The prediction properties are derived analytically, and an application to a local field potential is provided.
In “How Delays Affect Neural Dynamics and Learning” Baldi and Atiya (1994) state, “Integration and communication delays are ubiquitous, both in biological and man-made neural systems… . Indeed, delays should be considered as an additional media through which evolution, or skilled engineers, can achieve particular dynamical effects.” In fact, time delays have an impact on the dynamics of neuronal networks, for example, by causing oscillations and waves (Crook, Ermentrout, & Vanier, 1997). In this note, I point out how time delays added to leaky integrators are defining predictors for smooth input signals. The underlying mechanism is based on negative group delay (NGD) and to the best of my knowledge has not been used in the neurosciences so far.
For , the group delay is negative, a necessary condition for prediction.
The group delay is approximately independent of , a necessary condition for distortion-free signal transfer (Kandic & Bridges, 2013).
These ideas were applied to a local field potential (LFP) from the left hippocampus (CA1) of a rat. The data consisted of the first 80 s of the “hc-5” set from CRCNS.org (Pastalkova, Itskov, Amarasingham, & Buzsaki, 2008). The input x was defined as the average over all electrodes, normalized, and slightly low-pass-filtered (cutoff at 27 Hz). The parameters and were estimated from a fit to the first 5 s of the data set with a simplex search algorithm and then used to model 16 contiguous intervals of 5 s each (). Equation 1 was solved with a Runge-Kutta scheme with ms and for . All computations were performed with Matlab R2015a (MathWorks, Inc., Natick, MA).
In Figure 1A, 1.4 s of the input x and corresponding output y are shown. It is evident that the DLI output y at time t (red) predicts the LFP input x at a time (black) on average. The group delay is −16.2 ms (see Figure 1B, red dashed line shows ). Figure 1B also depicts a section of the estimated and analytic phase and gain of the frequency response function, including the first interval with NGD. Therefore, frequency components of x within this interval are predicted by y. More specifically, the cross-correlation function (CCF) between x and y (see Figure 1C) has a global maximum of 0.81 at ms. This result is reproducible. Out of the 16 data sections, 11 yielded a CCF with a global maximum between and −8.8 ms. The importance of signal frequency content is demonstrated in Figure 1D; spectral components near the resonance of the frequency response function are amplified and become detrimental to prediction if dominating the signal.
The real-time prediction of the LFP does not violate causality but follows from the delay-induced NGD (Voss, 2016) of the DLI, equation 1. Prediction performance depends on model parameters and spectral properties of the data. For improper conditions the DLI might not predict or cause oscillatory instabilities (Bernard, Belair, & Mackey, 2001). Very recently it has been emphasized in this journal that anticipatory systems can defy the inference of the direction of information flow from data (Schumacher, Wunderle, Fries, Jakel, & Pipa, 2015). It would be interesting if this holds true for NGD systems, too (Voss, 2000; Pethel, Corron, Underwood, & Myneni, 2003; Blakely, Pruitt, & Corron, 2008). DLIs might augment the related concept of neuronal anticipatory synchronization (Calvo, Chialvo, Eguiluz, Mirasso, & Toral, 2004; Ciszak, Marino, Toral, & Balle, 2004; Pyragiene & Pyragas, 2013; Sausedo-Solorio & Pisarchik, 2014), which recently has been used to explain observations in brain dynamics (Matias et al., 2014). Note that DLIs do not require a memory of past signal values, only of past predicted, already internalized states, as equation 1 does not contain delayed inputs. It would be worth investigating how NGD systems fit into general theories of prediction (Crutchfield, 2012) or how they perform as predictors in artificial neuronal networks. Since delay-induced NGD does not depend on a specific model for the signal, it is quite conceivable that biological neuronal networks might use this simple mechanism for real-time prediction, such that Baldi and Atiya’s insights could be corroborated once again.