Weighted Means in Stochastic Approximation of Minima (Q4377400)
From MaRDI portal
!
This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:
scientific article; zbMATH DE number 1116139
| Language | Label | Description | Also known as |
|---|---|---|---|
| default for all languages | No label defined |
||
| English | Weighted Means in Stochastic Approximation of Minima |
scientific article; zbMATH DE number 1116139 |
Statements
Weighted Means in Stochastic Approximation of Minima (English)
0 references
9 February 1998
0 references
Kiefer-Wolfowitz procedure
0 references
averaging
0 references
invariance principle
0 references
optimization
0 references
0.9307516
0 references
0.9144031
0 references
0.91036564
0 references
0.89427435
0 references
0.8868604
0 references
Continuing their own work [Math. Methods Stat. 5, No. 1, 32-60 (1996; Zbl 0858.62070)] the authors derive optimal rates of convergence for various multi-dimensional stochastic approximation procedures of the Kiefer-Wolfowitz type which aim at finding the extremum of a multivariate response function. The procedures considered here are based on the averaging method introduced by Ruppert and Polyak for the Robbins-Monro situation which was one of the major developments in stochastic approximation during the last years. In contrast to the standard Kiefer-Wolfowitz process no prior knowledge is required for the curvature at the extremum. The method allows for a wide flexibility in choosing the estimator of the gradient which covers averaged versions of the \textsl{random direction} and the \textsl{simultaneous perturbation stochastic approximation}. A computation of the resulting asymptotic mean squared errors exhibits a stable behaviour for the present procedures based on the averaging method compared to standard competitors.
0 references