Skip Nav Destination
Close Modal
Update search
NARROW
Format
TocHeadingTitle
Date
Availability
1-5 of 5
Hervé Luga
Close
Follow your search
Access your saved searches in your account
Would you like to receive an alert when new items match your search?
Sort by
Proceedings Papers
Learning aquatic locomotion with animats
Open Access
. ecal2017, ECAL 2017, the Fourteenth European Conference on Artificial Life585-592, (September 4–8, 2017) 10.1162/isal_a_092
Abstract
View Papertitled, Learning aquatic locomotion with animats
View
PDF
for content titled, Learning aquatic locomotion with animats
One of the challenges of researching spiking neural networks (SNN) is translation from temporal spiking behavior to classic controller output. While many encoding schemes exist to facilitate this translation, there are few benchmarks for neural networks that inherently utilize a temporal controller. In this work, we consider the common reinforcement problem of animat locomotion in an environment suited for evaluating SNNs. Using this problem, we explore novel methods of reward distribution as they impacts learning. Hebbian learning, in the form of spike time dependent plasticity (STDP), is modulated by a dopamine signal and affected by reward-induced neural activity. Different reward strategies are parameterized and the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is used to find the best strategies for fixed animat morphologies. The contribution of this work is two-fold: to cast the problem of animat locomotion in a form directly applicable to simple temporal controllers, and to demonstrate novel methods for reward modulated Hebbian learning.
Proceedings Papers
A Predator-Prey Scenario in a Virtual Ecosystem
Open Access
. ecal2015, ECAL 2015: the 13th European Conference on Artificial Life463, (July 20–24, 2015) 10.1162/978-0-262-33027-5-ch082
Proceedings Papers
Checkpoint Orientated Cell Cycle Modeling Issues in Simulation of Synchronized Situation
Open Access
. alife2012, ALIFE 2012: The Thirteenth International Conference on the Synthesis and Simulation of Living Systems465-472, (July 19–22, 2012) 10.1162/978-0-262-31050-5-ch061
Proceedings Papers
A checkpoint-orientated model to simulate unconstrained proliferation of cells (full article)
Open Access
. ecal2011, ECAL 2011: The 11th European Conference on Artificial Life96, (August 8–12, 2011) 10.7551/978-0-262-29714-1-ch096
Proceedings Papers
Artificial gene regulatory networks and spatial computation: A case study (full article)
Open Access
. ecal2011, ECAL 2011: The 11th European Conference on Artificial Life32, (August 8–12, 2011) 10.7551/978-0-262-29714-1-ch032