A--D. Learned parameter distributions. The initial (yellow) and learned (green) distributions of parameters across neurons in single example networks are shown for the L-MNIST task. Results are shown for both homogeneous initialization (A) and heterogeneous initialization (B). Under both initialization schemes, heterogeneity in neuronal parameters is learned.