Natural evolution gives the impression of leading to an open-ended process of increasing diversity and complexity. If our goal is to produce such open-endedness artificially, this suggests an approach driven by evolutionary metaphor. On the other hand, techniques from machine learning and artificial intelligence are often considered too narrow to provide the sort of exploratory dynamics associated with evolution. In this article, we hope to bridge that gap by reviewing common barriers to open-endedness in the evolution-inspired approach and how they are dealt with in the evolutionary case—collapse of diversity, saturation of complexity, and failure to form new kinds of individuality. We then show how these problems map onto similar ones in the machine learning approach, and discuss how the same insights and solutions that alleviated those barriers in evolutionary approaches can be ported over. At the same time, the form these issues take in the machine learning formulation suggests new ways to analyze and resolve barriers to open-endedness. Ultimately, we hope to inspire researchers to be able to interchangeably use evolutionary and gradient-descent-based machine learning methods to approach the design and creation of open-ended systems.

This is a report on the Biological Foundations of Enactivism Workshop, which was held as part of Artificial Life XV. The workshop aimed to revisit enactivism's contributions to biology and to revitalize the discussion of autonomy with the goal of grounding it in quantitative definitions based in observable phenomena. This report summarizes some of the important issues addressed in the workshop's talks and discussions, which include how to identify emergent individuals out of an environmental background, what the roles of autonomy and normativity are in biological theory, how new autonomous agents can spontaneously emerge at the origins of life, and what science can say about subjective experience.

We describe the content and outcomes of the First Workshop on Open-Ended Evolution: Recent Progress and Future Milestones (OEE1), held during the ECAL 2015 conference at the University of York, UK, in July 2015. We briefly summarize the content of the workshop's talks, and identify the main themes that emerged from the open discussions. Two important conclusions from the discussions are: (1) the idea of pluralism about OEE—it seems clear that there is more than one interesting and important kind of OEE; and (2) the importance of distinguishing observable behavioral hallmarks of systems undergoing OEE from hypothesized underlying mechanisms that explain why a system exhibits those hallmarks. We summarize the different hallmarks and mechanisms discussed during the workshop, and list the specific systems that were highlighted with respect to particular hallmarks and mechanisms. We conclude by identifying some of the most important open research questions about OEE that are apparent in light of the discussions. The York workshop provides a foundation for a follow-up OEE2 workshop taking place at the ALIFE XV conference in Cancún, Mexico, in July 2016. Additional materials from the York workshop, including talk abstracts, presentation slides, and videos of each talk, are available at http://alife.org/ws/oee1 .

Life on Earth must originally have arisen from abiotic chemistry. Since the details of this chemistry are unknown, we wish to understand, in general, which types of chemistry can lead to complex, lifelike behavior. Here we show that even very simple chemistries in the thermodynamically reversible regime can self-organize to form complex autocatalytic cycles, with the catalytic effects emerging from the network structure. We demonstrate this with a very simple but thermodynamically reasonable artificial chemistry model. By suppressing the direct reaction from reactants to products, we obtain the simplest kind of autocatalytic cycle, resulting in exponential growth. When these simple first-order cycles are prevented from forming, the system achieves superexponential growth through more complex, higher-order autocatalytic cycles. This leads to nonlinear phenomena such as oscillations and bistability, the latter of which is of particular interest regarding the origins of life.

When niching or speciation is required to perform a task that has several different component parts, standard genetic algorithms (GAs) struggle. They tend to evaluate and select all individuals on the same part of the task, which leads to genetic convergence within the population. The goal of evolutionary niching methods is to enforce diversity in the population so that this genetic convergence is avoided. One drawback with some of these niching methods is that they require a priori knowledge or assumptions about the specific fitness landscape in order to work; another is that many such methods are not set up to work on cooperative tasks where fitness is only relevant at the group level. Here we address these problems by presenting the group GA , described earlier by the authors, which is a group-based evolutionary algorithm that can lead to emergent niching. After demonstrating the group GA on an immune system matching task, we extend the previous work and present two modified versions where the number of niches does not need to be specified ahead of time. In the random-group-size GA, the number of niches is varied randomly during evolution, and in the evolved-group-size GA the number of niches is optimized by evolution. This provides a framework in which we can evolve groups of individuals to collectively perform tasks with minimal a priori knowledge of how many subtasks there are or how they should be shared out.

Due to recent advances in synthetic biology and artificial life, the origin of life is currently a hot topic of research. We review the literature and argue that the two traditionally competing replicator-first and metabolism-first approaches are merging into one integrated theory of individuation and evolution. We contribute to the maturation of this more inclusive approach by highlighting some problematic assumptions that still lead to an ximpoverished conception of the phenomenon of life. In particular, we argue that the new consensus has so far failed to consider the relevance of intermediate time scales. We propose that an adequate theory of life must account for the fact that all living beings are situated in at least four distinct time scales, which are typically associated with metabolism, motility, development, and evolution. In this view, self-movement, adaptive behavior, and morphological changes could have already been present at the origin of life. In order to illustrate this possibility, we analyze a minimal model of lifelike phenomena, namely, of precarious, individuated, dissipative structures that can be found in simple reaction-diffusion systems. Based on our analysis, we suggest that processes on intermediate time scales could have already been operative in prebiotic systems. They may have facilitated and constrained changes occurring in the faster- and slower-paced time scales of chemical self-individuation and evolution by natural selection, respectively.

Building an evolvable physical self-replicating machine is a grand challenge. The main problem is that the device must be capable of hereditary variation, that is, replicating in many configurations—configurations into which it enters unpredictably by mutation. Template replication is the solution found by nature. A scalable device must also be capable of miniaturization, and so have few or no moving and electronic parts. Here a significant step toward this goal is presented in the form of a physical template replicator made from small plastic pieces containing embedded magnets that float on an air-hockey-type table and undergo stochastic motion. Our units replicate by a process analogous to the replication of DNA, except without the involvement of enzymes. Building a physical rather than a computational model forces us to confront several problems that have analogues on the nano scale. In particular, replication must be maintained by preventing side reactions such as spontaneous ligation, cyclization, product inhibition, and elongation at staggered ends. The last of these results in ever-lengthening sequences in a process known as the elongation catastrophe . The extreme specificity of structure required by the monomers is indirect evidence that some kind of natural selection took place prior to the existence of nucleotide analogues during the origin of life.