It is widely thought that sensorimotor synchronization, underpinning cultural domains such as music and dance, played a critical role in the evolution of human sociality. Here, we present virtual legged robots controlled by central pattern generators (CPGs) that evolve to synchronize motion to rhythmic sensory input in real time. Multi-stage, multi-objective evolutionary algorithms were used to maximize flexibility of the CPGs with respect to control parameters, and then to optimize a neural input layer for wide-ranging susceptibility to rhythmic inputs. The evolved CPGs self-organize to accommodate the input sequence over a range of frequencies and patterns while keeping the agents upright. We show how this behaviour can be scaled up to multiple interacting agents, including with differing morphologies, to produce novel behaviours. We then outline how spike timing dependent plasticity can be used for the acquisition of new motor patterns. Finally, taking inspiration from biocultural evolution and cognitive neuroscience, we suggest ways in which real-time social adaptation can play a key role in the evolution of complex social behaviours in robots.

There are many challenges pertaining to how one should jointly evolve the morphology and controllers of robots and virtual creatures. Innervation between decentralized control approaches can allow for coordinated rhythmic movement in organisms, and this can therefore be beneficial when evolving the bodies and brains of virtual creatures. To test how decentralized control could be beneficial when evolving the morphology and control of 2D virtual creatures, three open-loop decentralized control schemes were compared for their effectiveness: (1) a simple sinusoidal wave generator, (2) a phase-coupled oscillator and (3) a neural network. The latter two controllers could innervate to descending controllers enabling the expression of coordinated movement. In addition, the performance of the controllers were compared when the creatures were made through either a direct or indirect encoding. The results show that a phase-coupled oscillator gives significantly better performance than a simple wave when using either of the two encodings. The neural network approach performed somewhere in-between both controller approaches, although seeding an evolving population with manually designed neural networks improved the performance especially for the direct encoding. Controller modulation through descending innervation can lead to coordinated movements that can benefit decentralized control strategies when evolving the morphology and control of virtual creatures.

A striking difference between animals and traditional robots is that the latter usually have rigid and non-flexible bodies. Animals, on the other hand, exhibit highly adapted traits, such as elastic tendons. The tendons work as springs, storing and releasing kinetic energy during an animal’s gait cycle. Springs have been used in some hand designed robots for similar benefits. However, little research has been done on springs in robots with evolving morphology. We examine the use of compliant and structural modules in modular robots, using a standard evolutionary algorithm. We also look at connections between spring stiffness and robot size using the quality diversity algorithm MAP-Elites. We found that the modular robots evolved to use elastic actuators, and that structural modules enabled morphologies that use less actuators, but still achieve the same walking speed as the robots with actuators in every module. We also observe some indications that larger robots may require lower elasticity.

In Evolutionary Robotics, evolutionary algorithms are used to co-optimize morphology and control. However, co-optimizing leads to different challenges: How do you optimize a controller for a body that often changes its number of inputs and outputs? Researchers must then make some choice between centralized or decentralized control. In this article, we study the effects of centralized and decentralized controllers on modular robot performance and morphologies. This is done by implementing one centralized and two decentralized continuous time recurrent neural network controllers, as well as a sine wave controller for a baseline. We found that a decentralized approach that was more independent of morphology size performed significantly better than the other approaches. It also worked well in a larger variety of morphology sizes. In addition, we highlighted the difficulties of implementing centralized control for a changing morphology, and saw that our centralized controller struggled more with early convergence than the other approaches. Our findings indicate that duplicated decentralized networks are beneficial when evolving both the morphology and control of modular robots. Overall, if these findings translate to other robot systems, our results and issues encountered can help future researchers make a choice of control method when co-optimizing morphology and control.

A challenge in evolutionary robotics is the in parallel adaptation of morphologies and controllers. Here, we considered encoding methods for morphogenesis of 2D virtual creatures that can be created from directed trees. Using an evolutionary algorithm, we optimized locomotion in these virtual creatures and compared a direct encoding, an L-System, and two types of encodings that produce neural networks—a Compositional Pattern Producing Network (CPPN) and a Cellular Encoding (CE). We evaluated these encodings based on performance and diversification, and we introduced an OpenAI gym environment as a computationally inexpensive benchmark for exploring morphological evolution. The direct encoding and L-System generated more fit solutions compared to the network strategies. Considering morphological diversity, the direct encoding finds solutions more locally in the morphological search space, the L-System made larger jumps across this search space, and both network approaches also make larger jumps though find fewer solutions in this space. With these results we show how encodings exhibit different characteristics as developmental approaches. Since the genotype-phenotype mapping plays a major role in evolutionary robotics, further modifications using more complex tasks and environments can lead to a better understanding of morphogenesis and thereby improve how morphologies and controllers of robots are evolved.

The long term vision of the Autonomous Robot Evolution (ARE) project is to create an ecosystem of both virtual and physical robots with evolving brains and bodies. One of the major challenges for such a vision is the need to construct many unique individuals without prior knowledge of what designs evolution will produce. To this end, an autonomous robot fabrication system for evolutionary robotics, the Robot Fabricator , is introduced in this paper. Evolutionary algorithms can create robot designs without direct human interaction; the Robot Fabricator will extend this to create physical copies of these designs (phenotypes) without direct human interaction. The Robot Fabricator will receive genomes and produce populations of physical individuals that can then be evaluated, allowing this to form part of the evolutionary loop, so robotic evolution is not confined to simulation and the reality gap is minimised. In order to allow the production of robot bodies with the widest variety of shapes and functional parts, individuals will be produced through 3D printing, with prefabricated actuators and sensors autonomously attached in the positions determined by evolution. This paper presents details of the proposed physical system, including a proof-of-concept demonstrator, and discusses the importance of considering the physical manufacture for evolutionary robotics.

An ongoing discussion in biology concerns whether intrinsic mortality, or senescence, is programmed or not. The death (i.e. removal) of an individual solution is an inherent feature in evolutionary algorithms that can potentially explain how intrinsic mortality can be beneficial in natural systems. This paper investigates the relationship between mutation rate and mortality rate with a steady state genetic algorithm that has a specific intrinsic mortality rate. Experiments were performed on a predefined deceptive fitness landscape, the hierarchical if-and-only-if function (H-IFF). To test whether the relationship between mutation and mortality rate holds for more complex systems, an agent-based spatial grid model based on the H-IFF function was also investigated. This paper shows that there is a direct correlation between the evolvability of a population and an indiscriminate intrinsic mortality rate to mutation rate ratio. Increased intrinsic mortality or increased mutation rate can cause a random drift that can allow a population to find a global optimum. Thus, mortality in evolutionary algorithms does not only explain evolvability, but might also improve existing algorithms for deceptive/rugged landscapes. Since an intrinsic mortality rate increases the evolvability of our spatial model, we bolster the claim that intrinsic mortality can be beneficial for the evolvability of a population.

Due to the replacement of natural flora and fauna with urban environments, a significant part of the earths organisms that function as primary consumers have been dispelled. To compensate for the reduction in the amount of primary consumers, robotic systems that mimic plant-like organisms are interesting to mimic for their potential functional and aesthetic value in urban environments. To investigate how to utilize plant developmental strategies in order to engender urban artificial plants, we built a simple evolutionary model that applies an L-System based grammar as an abstraction of plant development. In the presented experiments, phytomorphologies (plant morphologies) are iteratively constructed using a context sensitive L-System. The genomic representation of the L-System is subject to mutation by an evolutionary algorithm. These mutations thus alter the developmental rules of these phytomorphologies. We compare the differences between the light absorption of evolving virtual plants that remain static during their life and virtual plants that possess the possibility to move joints that link the separate parts of the virtual plants. Our results show that our evolutionary algorithm did not exploit potential beneficial joint actuation, instead, mostly static structures evolved. The results of our evolving L-System show that it is able to create various phytomorphologies, albeit that the results are preliminary and will be more thoroughly investigated in the future.