A Recurrent Network Implementation of Time Series Classification

An incremental credit assignment (ICRA) scheme is introduced and applied to time series classification. It has been inspired from Bayes' rule, but the Bayesian connection is not necessary either for its development or proof of its convergence properties. The ICRA scheme is implemented by a recurrent, hierarchical, modular neural network, which consists of a bank of predictive modules at the lower level, and a decision module at the higher level. For each predictive module, a credit function is computed; the module that best predicts the observed time series behavior receives highest credit. We prove that the credit functions converge (with probability one) to correct values. Simulation results are also presented.