A note on the Hanson-Wright inequality for random vectors with dependencies

DOI10.1214/ECP.V20-3829MaRDI QIDQ894498zbMATH OpenFDO

Authors Radosław Adamczak

Publication date 1 December 2015

Published in Electronic Communications in Probability (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1409.8457

zbMATH Keywords

quadratic formsconcentration of measureHanson-Wright inequalityempirical covariance operator

Mathematics Subject Classification ID

Probability theory on linear topological spaces (60B11) Inequalities; stochastic orderings (60E15)

Abstract: We prove that quadratic forms in isotropic random vectors $X$ in $mathbb{R}^n$, possessing the convex concentration property with constant $K$, satisfy the Hanson-Wright inequality with constant $CK$, where $C$ is an absolute constant, thus eliminating the logarithmic (in the dimension) factors in a recent estimate by Vu and Wang. We also show that the concentration inequality for all Lipschitz functions implies a uniform version of the Hanson-Wright inequality for suprema of quadratic forms (in the spirit of the inequalities by Borell, Arcones-Gin'e and Ledoux-Talagrand). Previous results of this type relied on stronger isoperimetric properties of $X$ and in some cases provided an upper bound on the deviations rather than a concentration inequality. In the last part of the paper we show that the uniform version of the Hanson-Wright inequality for Gaussian vectors can be used to recover a recent concentration inequality for empirical estimators of the covariance operator of $B$-valued Gaussian variables due to Koltchinskii and Lounici.

Recommendations

• Hanson-Wright inequality and sub-Gaussian concentration
• Hanson-Wright inequality in Banach spaces
• Uniform Hanson-Wright type concentration inequalities for unbounded entries via the entropy method
• Sparse Hanson-Wright inequalities for subgaussian quadratic forms
• The Hanson-Wright inequality for random tensors

Cited in

(48)

• Outlier robust and sparse estimation of linear regression coefficients
• Concentration inequalities on the multislice and for sampling without replacement
• New challenges in covariance estimation: multiple structures and coarse quantization
• Five ways to recover the symbol of a non-binary localization operator
• Estimation of binary time-frequency masks from ambient noise
• Norms of sub-exponential random vectors
• Modified log-Sobolev inequalities and two-level concentration
• Estimation of smooth functionals of covariance operators: jackknife bias reduction and bounds in terms of effective rank
• Policy Gradient Methods for the Noisy Linear Quadratic Regulator over a Finite Horizon
• Concentration of kernel matrices with application to kernel spectral clustering
• Moments of Gaussian chaoses in Banach spaces
• Uniform Hanson-Wright type concentration inequalities for unbounded entries via the entropy method
• Relative perturbation bounds with applications to empirical covariance operators
• Sharper dimension-free bounds on the Frobenius distance between sample covariance and its expectation
• Some notes on concentration for -subexponential random variables
• Controlling the least eigenvalue of a random Gram matrix
• Fitting an ellipsoid to a quadratic number of random points
• The Hanson-Wright inequality for random tensors
• A note on concentration for polynomials in the Ising model
• Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks
• High-dimensional limit of one-pass SGD on least squares
• Extreme eigenvalues of log-concave ensemble
• Variance reduction for Markov chains with application to MCMC
• Hanson-Wright inequality in Banach spaces
• Probability and moment inequalities for quadratic forms in independent random variables with fat tails
• Deterministic equivalent and error universality of deep random features learning
• Variations and extensions of the Gaussian concentration inequality, Part I
• Dimension free ridge regression
• Tyler's and Maronna's M-estimators: non-asymptotic concentration results
• Dimension-free bounds for sums of independent matrices and simple tensors via the variational principle
• A note on moment inequality for quadratic forms
• Concentration inequalities for bounded functionals via log-Sobolev-type inequalities
• Concentration inequalities for polynomials in \(\alpha\)-sub-exponential random variables
• Covariance Model with General Linear Structure and Divergent Parameters
• Bounds on tail probabilities for quadratic forms in dependent sub-Gaussian random variables
• Sparse Hanson-Wright inequalities with applications
• Dimension-free uniform concentration bound for logistic regression
• Hanson-Wright inequality in Hilbert spaces with application to \(K\)-means clustering for non-Euclidean data
• Generic error bounds for the generalized Lasso with sub-exponential data
• Random Euclidean embeddings in finite-dimensional Lorentz spaces
• Perturbation bounds for eigenspaces under a relative gap condition
• Homogenization of SGD in high-dimensions: exact dynamics and generalization properties
• Provable training set debugging for linear regression
• Hanson-Wright inequality and sub-Gaussian concentration
• Sparse Hanson-Wright inequalities for subgaussian quadratic forms
• Random weighted projections, random quadratic forms and random eigenvectors
• Spectral-norm risk rates for multi-taper estimation of Gaussian processes
• Flexible results for quadratic forms with applications to variance components estimation

This page was built for publication: A note on the Hanson-Wright inequality for random vectors with dependencies

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q894498)