In this letter, we propose a definition of the operational mode of a neuron, that is, whether a neuron integrates over its input or detects coincidences. We complete the range of possible operational modes by a new mode we call gap detection, which means that a neuron responds to gaps in its stimulus. We propose a measure consisting of two scalar values, both ranging from −1 to +1: the neural drive, which indicates whether its stimulus excites the neuron, serves as background noise, or inhibits it; the neural mode, which indicates whether the neuron’s response is the result of integration over its input, of coincidence detection, or of gap detection; with all three modes possible for all neural drive values. This is a pure spike-based measure and can be applied to measure the influence of either all or subset of a neuron’s stimulus. We derive the measure by decomposing the reverse correlation, test it in several artificial and biological settings, and compare it to other measures, finding little or no correlation between them. We relate the results of the measure to neural parameters and investigate the effect of time delay during spike generation. Our results suggest that a neuron can use several different modes simultaneously on different subsets of its stimulus to enable it to respond to its stimulus in a complex manner.

We consider the problem of designing local reinforcement learning rules for artificial neural network (ANN) controllers. Motivated by the universal approximation properties of ANNs, we adopt an ANN representation for the learning rules, which are optimized using evolutionary algorithms. We evaluate the ANN rules in partially observable versions of four tasks: the mountain car, the acrobot, the cart pole balancing, and the nonstationary mountain car. For testing whether such evolved ANN-based learning rules perform satisfactorily, we compare their performance with the performance of SARSA( ) with tile coding, when the latter is provided with either full or partial state information. The comparison shows that the evolved rules perform much better than SARSA( ) with partial state information and are comparable to the one with full state information, while in the case of the nonstationary environment, the evolved rule is much more adaptive. It is therefore clear that the proposed approach can be particularly effective in both partially observable and nonstationary environments. Moreover, it could potentially be utilized toward creating more general rules that can be applied in multiple domains and transfer learning scenarios.

In this letter, we aim to measure the relative contribution of coincidence detection and temporal integration to the firing of spikes of a simple neuron model. To this end, we develop a method to infer the degree of synchrony in an ensemble of neurons whose firing drives a single postsynaptic cell. This is accomplished by studying the effects of synchronous inputs on the membrane potential slope of the neuron and estimating the degree of response-relevant input synchrony, which determines the neuron's operational mode. The measure is calculated using the normalized slope of the membrane potential prior to the spikes fired by a neuron, and we demonstrate that it is able to distinguish between the two operational modes. By applying this measure to the membrane potential time course of a leaky integrate-and-fire neuron with the partial somatic reset mechanism, which has been shown to be the most likely candidate to reflect the mechanism used in the brain for reproducing the highly irregular firing at high rates, we show that the partial reset model operates as a temporal integrator of incoming excitatory postsynaptic potentials and that coincidence detection is not necessary for producing such high irregular firing.

In this note, we demonstrate that the high firing irregularity produced by the leaky integrate-and-fire neuron with the partial somatic reset mechanism, which has been shown to be the most likely candidate to reflect the mechanism used in the brain for reproducing the highly irregular cortical neuron firing at high rates (Bugmann, Christodoulou, & Taylor, 1997 ; Christodoulou & Bugmann, 2001 ), enhances learning. More specifically, it enhances reward-modulated spike-timing-dependent plasticity with eligibility trace when used in spiking neural networks, as shown by the results when tested in the simple benchmark problem of XOR, as well as in a complex multiagent setting task.

Partial reset is a simple and powerful tool for controlling the irregularity of spike trains fired by a leaky integrator neuron model with random inputs. In particular, a single neuron model with a realistic membrane time constant of 10 ms can reproduce the highly irregular firing of cortical neurons reported by Softky and Koch (1993). In this article, the mechanisms by which partial reset affects the firing pattern are investigated. Itisshown theoretically that partial reset is equivalent to the use of a time-dependent threshold, similar to a technique proposed by Wilbur and Rinzel (1983) to produce high irregularity. This equivalent model allows establishing that temporal integration and fluctuation detection can coexist and cooperate to cause highly irregular firing. This study also reveals that reverse correlation curves cannot be used reliably to assess the causes of firing. For instance, they do not reveal temporal integration when it takes place. Further, the peak near time zero does not always indicate coincidence detection. An alternative qualitative method is proposed here for that later purpose. Finally, it is noted that as the reset becomes weaker, the firing pattern shows a progressive transition from regular firing, to random, to temporally clustered, and eventually to bursting firing. Concurrently the slope of the transfer function increases. Thus, simulations suggest a correlation between high gain and highly irregular firing.