Strong Convergence of Stochastic Approximation Without Lyapunov Functions

Kaniovski, Y.M. (1995). Strong Convergence of Stochastic Approximation Without Lyapunov Functions. IIASA Working Paper. IIASA, Laxenburg, Austria: WP-95-019

[thumbnail of WP-95-019.pdf]

Download (274kB) | Preview


We prove convergence with probability one of a multivariate Markov stochastic approximation procedure of the Robbins-Monro type with several roots. The argument exploits convergence of the corresponding system of ordinary differential equations to its stationary points. If the points are either linearly stable or linearly unstable, we prove convergence with probability 1 of the procedure to a random vector whose distribution concentrates on the set of stable stationary points. This generalizes for procedures with several roots the approach suggested by L. Ljung for processes with a single root.

Along with stochastic approximation processes as such, the result can be applied to generalized urn schemes and stochastic models of technological and economic dynamics based on them, in particular, evolutionary games with incomplete information.

Item Type: Monograph (IIASA Working Paper)
Research Programs: Technological and Economic Dynamics (TED)
Depositing User: IIASA Import
Date Deposited: 15 Jan 2016 02:06
Last Modified: 27 Aug 2021 17:15

Actions (login required)

View Item View Item