Revisiting stochastic approximation and stochastic gradient descent

MaRDI QIDQ7301671zbMATH OpenFDO

Authors Rajeeva L. Karandikar, Bhamidi V. Rao, M. Vidyasagar

Publication date 21 July 2026

Published in Pure and Applied Functional Analysis (Search for Journal in Brave)

Full work available at URL http://yokohamapublishers.jp/online2/oppafa/vol11/p315.html

Mathematics Subject Classification ID

Strong limit theorems (60F15) Sample path properties (60G17) Stochastic approximation (62L20) Lyapunov and other classical stabilities (Lagrange, Poisson, (L^p, l^p), etc.) in control theory (93D05)

Cites work

• A Stochastic Approximation Method
• An analysis of temporal-difference learning with function approximation
• Applications of a Kushner and Clark lemma to general classes of stochastic algorithms
• Approximation Methods which Converge with Probability one
• Asynchronous Stochastic Approximations
• Convergence rates for stochastic approximation: biased noise with unbounded variance, and applications
• General convergence results for stochastic approximations via weak convergence theory
• scientific article; zbMATH DE number 3121164 (Why is no real title available?)
• scientific article; zbMATH DE number 3169854 (Why is no real title available?)
• scientific article; zbMATH DE number 5348356 (Why is no real title available?)
• scientific article; zbMATH DE number 48727 (Why is no real title available?)
• scientific article; zbMATH DE number 53676 (Why is no real title available?)
• scientific article; zbMATH DE number 1043533 (Why is no real title available?)
• scientific article; zbMATH DE number 1972910 (Why is no real title available?)
• scientific article; zbMATH DE number 3449561 (Why is no real title available?)
• scientific article; zbMATH DE number 3068087 (Why is no real title available?)
• Multidimensional Stochastic Approximation Methods
• Multivariate stochastic approximation using a simultaneous perturbation gradient approximation
• On positive real transfer functions and the convergence of some recursive schemes
• On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
• Optimal random perturbations for stochastic approximation using a simultaneous perturbation gradient approximation
• Sample average approximations of strongly convex stochastic programs in Hilbert spaces
• Stochastic approximation
• Stochastic Approximation in Hilbert Space: Identification and Optimization of Linear Continuous Parameter Systems
• Stochastic approximation in infinite dimensions
• Stochastic approximation methods for constrained and unconstrained systems
• Stochastic approximation. A dynamical systems viewpoint
• Stochastic Estimation of the Maximum of a Regression Function
• Strong convergence of a stochastic approximation algorithm
• The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning

This page was built for publication: Revisiting stochastic approximation and stochastic gradient descent

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q7301671)