Dimension-free bounds for sums of dependent matrices and operators with heavy-tailed distributions
From MaRDI portal
Abstract: We study the deviation inequality for a sum of high-dimensional random matrices and operators with dependence and arbitrary heavy tails. There is an increase in the importance of the problem of estimating high-dimensional matrices, and dependence and heavy-tail properties of data are among the most critical topics currently. In this paper, we derive a dimension-free upper bound on the deviation, that is, the bound does not depend explicitly on the dimension of matrices, but depends on their effective rank. Our result is a generalization of several existing studies on the deviation of the sum of matrices. Our proof is based on two techniques: (i) a variational approximation of the dual of moment generating functions, and (ii) robustification through truncation of eigenvalues of matrices. We show that our results are applicable to several problems such as covariance matrix estimation, hidden Markov models, and overparameterized linear regression models.
Cites work
- \(L_{p}\)-moments of random vectors via majorizing measures
- A simple tool for bounding the deviation of random matrices on geometric sets
- Adaptive estimation of a quadratic functional by model selection.
- Benign overfitting in linear regression
- Bootstrapping the operator norm in high dimensions: error estimation for covariance matrices and sketching
- Challenging the empirical mean and empirical variance: a deviation study
- Compressed sensing
- Concentration inequalities and moment bounds for sample covariance operators
- Covariance estimation for distributions with \({2+\varepsilon}\) moments
- High-dimensional probability. An introduction with applications in data science
- scientific article; zbMATH DE number 5544465 (Why is no real title available?)
- Inégalités de Hoeffding pour les fonctions lipschitziennes de suites dépendantes
- Model selection for weakly dependent time series forecasting
- Moment bounds for large autocovariance matrices under dependence
- New dependence coefficients. Examples and applications to statistics
- Non-strong mixing autoregressive processes
- On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA
- On the singular values of random matrices
- Optimal rates of convergence for covariance matrix estimation
- Quantitative estimates of the convergence of the empirical covariance matrix in log-concave ensembles
- Random vectors in the isotropic position
- Robust dimension-free Gram operator estimates
- Structured random matrices
- Sub-Gaussian matrices on sets: optimal tail dependence and applications
- Weak dependence. With examples and applications.
- Weakly dependent chains with infinite memory
Cited in
(2)
This page was built for publication: Dimension-free bounds for sums of dependent matrices and operators with heavy-tailed distributions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6200904)
