Stochastic optimization with averaging of trajectories

DOI10.1080/17442509208833769MaRDI QIDQ4018640zbMATH OpenOpenAlexFDO

Authors Bernard Delyon, Anatoli Juditsky

Publication date 16 January 1993

Published in Stochastics and Stochastic Reports (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1080/17442509208833769

zbMATH Keywords

Polyak-Ruppert algorithmrecursive stochastic optimization procedurestochastic approximation algorithms

Mathematics Subject Classification ID

Optimal stochastic control (93E20)

Recommendations

• Stochastic averaging and stochastic extremum seeking
• Stochastic Averaging in Continuous Time and Its Applications to Extremum Seeking
• Optimization by stochastic continuation
• scientific article; zbMATH DE number 5281595
• scientific article; zbMATH DE number 4055383
• Passive stochastic approximation with averaging along trajectories
• Trajectory averaging for stochastic approximation MCMC algorithms

Cited in

(16)

• How does a stochastic optimization/approximation algorithm adapt to a randomly evolving optimum/root with jump Markov sample paths
• Convergence of a stochastic approximation version of the EM algorithm
• Some results about averaging in stochastic approximation
• Passive stochastic approximation with averaging along trajectories
• Semimartingale stochastic approximation procedure and recursive estimation
• Online estimation of the asymptotic variance for averaged stochastic gradient algorithms
• The multivariate Révész's online estimator of a regression function and its averaging
• A companion for the Kiefer-Wolfowitz-Blum stochastic approximation algorithm
• Optimal non-asymptotic analysis of the Ruppert-Polyak averaging stochastic algorithm
• Asymptotic behavior of a modified stochastic optimization procedure in an averaging scheme
• Asymptotic behaviour of stochastic optimization jumping procedure in averaging scheme
• The Robbins-Monro type stochastic differential equations. III: Polyak's averaging
• Acceleration of Stochastic Approximation by Averaging
• Asymptotically optimal rate of convergence of smoothed stochastic recursive algorithms
• Multivariate compact law of the iterated logarithm for averaged stochastic approximation algorithms
• Convergence rate and averaging of nonlinear two-time-scale stochastic approximation algo\-rithms

This page was built for publication: Stochastic optimization with averaging of trajectories

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4018640)