The main objective of this paper is to analyze the (1, λ) evolution strategy by use of stochastic approximation methods. Both constant and decreasing step size algorithms are studied. Convergence and estimation error bounds for the (1, λ) evolution strategy are developed. First the algorithm is converted to a recursively defined scheme of stochastic approximation type. Then the analysis is carried out by using the analytic tools from stochastic approximation. In lieu of examining the discrete iterates, suitably scaled sequences are defined. These interpolated sequences are then studied in detail. It is shown that the limits of the sequences have natural connections to certain continuous time dynamical systems.
The rcsearch of this author was supported in part by the National Science Foundation under grant DMS-9224372, and in part by the Deutscher Akademischer Austauschdienst (DAAD).
The research of this author was supported by BMBF under grant 01 IB 403A, project EVOALG