Skip Nav Destination
Close Modal
Update search
NARROW
Format
Journal
Date
Availability
1-3 of 3
Sina Khajehabdollahi
Close
Follow your search
Access your saved searches in your account
Would you like to receive an alert when new items match your search?
Sort by
Journal Articles
Publisher: Journals Gateway
Artificial Life 1–18.
Published: 31 October 2024
Abstract
View article
PDF
Developing reliable mechanisms for continuous local learning is a central challenge faced by biological and artificial systems. Yet, how the environmental factors and structural constraints on the learning network influence the optimal plasticity mechanisms remains obscure even for simple settings. To elucidate these dependencies, we study meta-learning via evolutionary optimization of simple reward-modulated plasticity rules in embodied agents solving a foraging task. We show that unconstrained meta-learning leads to the emergence of diverse plasticity rules. However, regularization and bottlenecks in the model help reduce this variability, resulting in interpretable rules. Our findings indicate that the meta-learning of plasticity rules is very sensitive to various parameters, with this sensitivity possibly reflected in the learning rules found in biological networks. When included in models, these dependencies can be used to discover potential objective functions and details of biological learning via comparisons with experimental observations.
Journal Articles
Publisher: Journals Gateway
Artificial Life (2022) 28 (4): 458–478.
Published: 01 November 2022
FIGURES
| View All (15)
Abstract
View article
PDF
It has long been hypothesized that operating close to the critical state is beneficial for natural and artificial evolutionary systems. We put this hypothesis to test in a system of evolving foraging agents controlled by neural networks that can adapt the agents’ dynamical regime throughout evolution. Surprisingly, we find that all populations that discover solutions evolve to be subcritical. By a resilience analysis, we find that there are still benefits of starting the evolution in the critical regime. Namely, initially critical agents maintain their fitness level under environmental changes (for example, in the lifespan) and degrade gracefully when their genome is perturbed. At the same time, initially subcritical agents, even when evolved to the same fitness, are often inadequate to withstand the changes in the lifespan and degrade catastrophically with genetic perturbations. Furthermore, we find the optimal distance to criticality depends on the task complexity. To test it we introduce a hard task and a simple task: For the hard task, agents evolve closer to criticality, whereas more subcritical solutions are found for the simple task. We verify that our results are independent of the selected evolutionary mechanisms by testing them on two principally different approaches: a genetic algorithm and an evolutionary strategy. In summary, our study suggests that although optimal behaviour in the simple task is obtained in a subcritical regime, initializing near criticality is important to be efficient at finding optimal solutions for new tasks of unknown complexity.
Journal Articles
Publisher: Journals Gateway
Artificial Life (2020) 26 (1): 112–129.
Published: 01 April 2020
FIGURES
| View All (10)
Abstract
View article
PDF
Criticality is thought to be crucial for complex systems to adapt at the boundary between regimes with different dynamics, where the system may transition from one phase to another. Numerous systems, from sandpiles to gene regulatory networks to swarms to human brains, seem to work towards preserving a precarious balance right at their critical point. Understanding criticality therefore seems strongly related to a broad, fundamental theory for the physics of life as it could be, which still lacks a clear description of how life can arise and maintain itself in complex systems. In order to investigate this crucial question, we model populations of Ising agents competing for resources in a simple 2D environment subject to an evolutionary algorithm. We then compare its evolutionary dynamics under different experimental conditions. We demonstrate the utility that arises at a critical state and contrast it with the behaviors and dynamics that arise far from criticality. The results show compelling evidence that not only is a critical state remarkable in its ability to adapt and find solutions to the environment, but the evolving parameters in the agents tend to flow towards criticality if starting from a supercritical regime. We present simulations showing that a system in a supercritical state will tend to self-organize towards criticality, in contrast to a subcritical state, which remains subcritical though it is still capable of adapting and increasing its fitness.