Efficient and fast estimation of the geometric median in Hilbert spaces with an averaged stochastic gradient algorithm
From MaRDI portal
(Redirected from Publication:89452)
Abstract: With the progress of measurement apparatus and the development of automatic sensors it is not unusual anymore to get thousands of samples of observations taking values in high dimension spaces such as functional spaces. In such large samples of high dimensional data, outlying curves may not be uncommon and even a few individuals may corrupt simple statistical indicators such as the mean trajectory. We focus here on the estimation of the geometric median which is a direct generalization of the real median and has nice robustness properties. The geometric median being defined as the minimizer of a simple convex functional that is differentiable everywhere when the distribution has no atoms, it is possible to estimate it with online gradient algorithms. Such algorithms are very fast and can deal with large samples. Furthermore they also can be simply updated when the data arrive sequentially. We state the almost sure consistency and the L2 rates of convergence of the stochastic gradient estimator as well as the asymptotic normality of its averaged version. We get that the asymptotic distribution of the averaged version of the algorithm is the same as the classic estimators which are based on the minimization of the empirical loss function. The performances of our averaged sequential estimator, both in terms of computation speed and accuracy of the estimations, are evaluated with a small simulation study. Our approach is also illustrated on a sample of more 5000 individual television audiences measured every second over a period of 24 hours.
Recommendations
- Estimating the geometric median in Hilbert spaces with stochastic gradient algorithms: L^p and almost sure rates of convergence
- Recursive estimation of the conditional geometric median in Hilbert spaces
- Online estimation of the geometric median in Hilbert spaces: nonasymptotic confidence balls
- Stochastic approximation for multivariate and functional median
- Fast estimation of the median covariation matrix with application to online robust principal components analysis
Cites work
- scientific article; zbMATH DE number 4096466 (Why is no real title available?)
- scientific article; zbMATH DE number 48727 (Why is no real title available?)
- scientific article; zbMATH DE number 53271 (Why is no real title available?)
- scientific article; zbMATH DE number 976356 (Why is no real title available?)
- scientific article; zbMATH DE number 1972910 (Why is no real title available?)
- scientific article; zbMATH DE number 3340881 (Why is no real title available?)
- A Newton-Raphson version of the multivariate Robbins-Monro procedure
- A fast and recursive algorithm for clustering large datasets with \(k\)-medians
- Acceleration of Stochastic Approximation by Averaging
- An invariance principle for the Robbins-Monro process in a Hilbert space
- Asymptotic Almost Sure Efficiency of Averaged Stochastic Algorithms
- Concavity and estimation
- Convergent estimators for the l1-median of banach valued random variable
- Design-based estimation for geometric quantiles with application to outlier detection
- Exact \(L_{2}\)-small ball asymptotics of Gaussian processes and the spectrum of boundary-value problems
- Gaussian processes: Inequalities, small ball probabilities and applications
- Multivariate location estimation using extension of \(R\)-estimates through \(U\)-statistics type approach
- Note on the median of a multivariate distribution
- On a Geometric Notion of Quantiles for Multivariate Data
- Online learning algorithms
- Robust Statistics
- Robust estimation and classification for functional data via projection-based depth notions
- Robust functional estimation using the median and spherical principal components
- Stochastic algorithms for computing means of probability measures
- Stochastic approximation methods for constrained and unconstrained systems
- The averaged Robbins-Monro method for linear problems in a Banach space
- The multivariate L 1 -median and associated data depth
- Trimmed means for functional data
- \(M\)-estimation, convexity and quantiles
Cited in
(48)- Robust Bregman clustering
- Affine-equivariant inference for multivariate location under \({L_p}\) loss functions
- Optimal non-asymptotic analysis of the Ruppert-Polyak averaging stochastic algorithm
- Stochastic approximation for multivariate and functional median
- Choices and intervals
- Online estimation of the geometric median in Hilbert spaces: nonasymptotic confidence balls
- On the rates of convergence of parallelized averaged stochastic gradient algorithms
- The spatial sign covariance operator: asymptotic results and applications
- Depth-based nonparametric description of functional data, with emphasis on use of spatial depth
- Non asymptotic controls on a recursive superquantile approximation
- The geometric median and applications to robust mean estimation
- Robust simultaneous inference for the mean function of functional data
- Lp and almost sure rates of convergence of averaged stochastic gradient algorithms: locally strongly convex objective
- Convergence in quadratic mean of averaged stochastic gradient algorithms without strong convexity nor bounded gradient
- A \(k\)-points-based distance for robust geometric inference
- Simultaneous predictive bands for functional time series using minimum entropy sets
- The spatial distribution in infinite dimensional spaces and related quantiles and depths
- Functional spherical autocorrelation: a robust estimate of the autocorrelation of a functional time series
- Spatial depth-based classification for functional data
- Online robust estimation and bootstrap inference for function-on-scalar regression
- High-dimensional multivariate analysis of variance via geometric median and bootstrapping
- Recursive estimation of the conditional geometric median in Hilbert spaces
- Kmedians
- Improved similarity-based modeling for the classification of rotating-machine failures
- Stochastic approximation algorithms for superquantiles estimation
- Online bootstrap inference for the geometric median
- Extreme geometric quantiles in a multivariate regular variation framework
- Nearly minimax robust estimator of the mean vector by iterative spectral dimension reduction
- Robust functional principal components for sparse longitudinal data
- Online estimation of the asymptotic variance for averaged stochastic gradient algorithms
- Online and offline robust multivariate linear regression
- On the Behavior of Extreme d-dimensional Spatial Quantiles Under Minimal Assumptions
- Convergence of Markovian stochastic approximation with discontinuous dynamics
- Fast recursive and efficient algorithms for estimating the functional median and robust clustering in large dimension
- An introduction to recent advances in high/infinite dimensional statistics
- Spatial quantiles on the hypersphere
- A penalized criterion for selecting the number of clusters for K-medians
- The deepest point for distributions in infinite dimensional spaces
- Fast estimation of the median covariation matrix with application to online robust principal components analysis
- Functional data analysis: an introduction and recent developments
- Estimating the geometric median in Hilbert spaces with stochastic gradient algorithms: L^p and almost sure rates of convergence
- Multivariate \(\rho \)-quantiles: a spatial approach
- Geometric median and robust estimation in Banach spaces
- Multi-sample comparison using spatial signs for infinite dimensional data
- Online stochastic Newton methods for estimating the geometric median and applications
- Robust functional sliced inverse regression
- Robust and scalable Bayes via a median of subset posterior measures
- Robust optimal estimation of location from discretely sampled functional data
This page was built for publication: Efficient and fast estimation of the geometric median in Hilbert spaces with an averaged stochastic gradient algorithm
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q89452)
