No label defined (Q4454225)

From MaRDI portal

!

This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:

scientific article; zbMATH DE number 2052583
Language Label Description Also known as
default for all languages
No label defined
    English
    No label defined
    scientific article; zbMATH DE number 2052583

      Statements

      8 March 2004
      0 references
      stochastic approximation
      0 references
      dynamical processes
      0 references
      stochastic differential equations
      0 references
      iterative procedure
      0 references
      differential inequalities
      0 references
      Robbins-Monro procedure
      0 references
      0 references
      Dynamical processes of stochastic approximation are investigated. That is, the optimization methods which are described by stochastic differential equations are considered. These processes are the continuous analogues of the Robbins-Monro and Kiefer-Wolfowitz stochastic iterative procedures. The following problem is studied: \(f(x) \to \min\), \(x \in R^l\), where \(f(x)\) is a differential function in \(R^l.\) The author proposes the continuous analog of the Robbins-Monro iterative method, which is described by the following stochastic differential equation: \[ dx(t) = - \alpha (t) \biggl(f'(X(t))\,dt + \sum_{i=1}^n \sigma_i (t, X(t))\,d\xi_i (t)\biggr), \quad X(t_0) = X^0, \tag{1} \] where \(\xi(t) = ( \xi_1(t), \xi_2(t), \ldots, \xi_n(t))\), \(t\geq t_0\), be a standard Wiener process. A continuous analog of the Kiefer-Wolfowitz iterative method is considered as well. The author investigates a behaviour of solutions of the differential equation (1) and similar differential equations on the semi-infinite interval \([ t_0, \infty).\) Let \(x^*\) be the unique minimal point of the function \(f(x).\) The author finds assumptions under which \(E\| X(t) - x^*\|^2 \to 0\) as \(t \to \infty.\) The rate of convergence of \(X(t)\) to \(x^*\) is found as well. For example, the conditions under which \(E\| X(t) - x^*\|^2 \leq C t^{-1}\) are found.
      0 references

      Identifiers