An emerging paradigm proposes that neural computations can be understood at the level of dynamic systems that govern low-dimensional trajectories of collective neural activity. How the connectivity structure of a network determines the emergent dynamical system, however, remains to be clarified. Here we consider a novel class of models, gaussian-mixture, low-rank recurrent networks in which the rank of the connectivity matrix and the number of statistically defined populations are independent hyperparameters. We show that the resulting collective dynamics form a dynamical system, where the rank sets the dimensionality and the population structure shapes the dynamics. In particular, the collective dynamics can be described in terms of a simplified effective circuit of interacting latent variables. While having a single global population strongly restricts the possible dynamics, we demonstrate that if the number of populations is large enough, a rank network can approximate any -dimensional dynamical system.
Skip Nav Destination
Article navigation
June 2021
May 13 2021
Shaping Dynamics With Multiple Populations in Low-Rank Recurrent Networks Unavailable
In Special Collection:
CogNet
Manuel Beiran,
Manuel Beiran
Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France [email protected]
Search for other works by this author on:
Alexis Dubreuil,
Alexis Dubreuil
Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France [email protected]
Search for other works by this author on:
Adrian Valente,
Adrian Valente
Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France [email protected]
Search for other works by this author on:
Francesca Mastrogiuseppe,
Francesca Mastrogiuseppe
Gatsby Computational Neuroscience Unit, UCL, London W1T 4JG, U.K. [email protected]
Search for other works by this author on:
Srdjan Ostojic
Srdjan Ostojic
Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France [email protected]
Search for other works by this author on:
Manuel Beiran
Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France [email protected]
Alexis Dubreuil
Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France [email protected]
Adrian Valente
Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France [email protected]
Francesca Mastrogiuseppe
Gatsby Computational Neuroscience Unit, UCL, London W1T 4JG, U.K. [email protected]
Srdjan Ostojic
Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Ecole Normale Superieure. PSL University, 75005 Paris, France [email protected]
Received:
July 21 2020
Accepted:
December 17 2020
Online ISSN: 1530-888X
Print ISSN: 0899-7667
© 2021 Massachusetts Institute of Technology
2021
Massachusetts Institute of Technology
Neural Computation (2021) 33 (6): 1572–1615.
Article history
Received:
July 21 2020
Accepted:
December 17 2020
Citation
Manuel Beiran, Alexis Dubreuil, Adrian Valente, Francesca Mastrogiuseppe, Srdjan Ostojic; Shaping Dynamics With Multiple Populations in Low-Rank Recurrent Networks. Neural Comput 2021; 33 (6): 1572–1615. doi: https://doi.org/10.1162/neco_a_01381
Download citation file:
Sign in
Don't already have an account? Register
Client Account
You could not be signed in. Please check your email address / username and password and try again.
Could not validate captcha. Please try again.
Sign in via your Institution
Sign in via your InstitutionEmail alerts
Advertisement
Related Articles
Probing the Relationship Between Latent Linear Dynamical Systems and Low-Rank Recurrent Neural Network Models
Neural Comput (August,2022)
Approximating Nonlinear Functions With Latent Boundaries in Low-Rank Excitatory-Inhibitory Spiking Networks
Neural Comput (April,2024)
Emergence of Universal Computations Through Neural Manifold Dynamics
Neural Comput (January,2024)
Related Book Chapters
Complexity Rankings
The Atlas of Economic Complexity: Mapping Paths to Prosperity
Representational Rank
Categorizing Cognition: Toward Conceptual Coherence in the Foundations of Psychology
Learning to Rank
Boosting: Foundations and Algorithms
Pranking with Ranking
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference