This chapter deals with algorithms for the optimization of simulated systems.In particular we study stochastic variants of the gradient algorithm

xn+1=xn−an∇F(xn)]

which was introduced in (1.27) to solve the optimization problem

[F(x)=∥∥∥MinimizeF(x)x∈Rd]

where F is bounded from below.