Lp and almost sure rates of convergence of averaged stochastic gradient algorithms: locally strongly convex objective

DOI10.1051/PS/2019011OpenAlexW2963190787MaRDI QIDQ5881051

Antoine Godichon-Baggioni

Publication date: 9 March 2023

Published in: ESAIM: Probability and Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1609.05479

zbMATH Keywords

stochastic optimizationrobust statisticsaveragingstochastic gradient algorithm

Mathematics Subject Classification ID

Nonparametric robustness (62G35) Stochastic approximation (62L20) Sequential estimation (62L12)

Related Items (6)

Optimal non-asymptotic analysis of the Ruppert-Polyak averaging stochastic algorithm ⋮ On the rates of convergence of parallelized averaged stochastic gradient algorithms ⋮ Convergence in quadratic mean of averaged stochastic gradient algorithms without strong convexity nor bounded gradient ⋮ On the asymptotic rate of convergence of stochastic Newton algorithms and their weighted averaged versions ⋮ Asymptotic distribution and convergence rates of stochastic algorithms for entropic optimal transportation between probability measures ⋮ An Efficient Stochastic Newton Algorithm for Parameter Estimation in Logistic Regressions

Uses Software

• robustbase

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Efficient and fast estimation of the geometric median in Hilbert spaces with an averaged stochastic gradient algorithm
• Fast estimation of the median covariation matrix with application to online robust principal components analysis
• Estimating the geometric median in Hilbert spaces with stochastic gradient algorithms: \(L^p\) and almost sure rates of convergence
• Multivariate location estimation using extension of \(R\)-estimates through \(U\)-statistics type approach
• On the almost sure asymptotic behaviour of stochastic algorithm
• Stochastic algorithms
• Online estimation of the geometric median in Hilbert spaces: nonasymptotic confidence balls
• Semiparametrically efficient rank-based inference for shape. I: optimal rank-based tests for sphericity
• Adaptivity of averaged stochastic gradient descent to local strong convexity for logistic regression
• On a Geometric Notion of Quantiles for Multivariate Data
• Acceleration of Stochastic Approximation by Averaging
• Asymptotic Almost Sure Efficiency of Averaged Stochastic Algorithms
• Optimal Stochastic Approximation Algorithms for Strongly Convex Stochastic Composite Optimization I: A Generic Algorithmic Framework
• Recent developments in non-asymptotic theory of random matrices
• Robust Statistics
• Note on the median of a multivariate distribution
• A Stochastic Approximation Method
• Robust Statistics

This page was built for publication: L^p and almost sure rates of convergence of averaged stochastic gradient algorithms: locally strongly convex objective