Central limit theorems and bootstrap in high dimensions

From MaRDI portal
Publication:2406563



Abstract: This paper derives central limit and bootstrap theorems for probabilities that sums of centered high-dimensional random vectors hit hyperrectangles and sparsely convex sets. Specifically, we derive Gaussian and bootstrap approximations for probabilities Pr(n−1/2sumi=1nXiinA) where X1,dots,Xn are independent random vectors in mathbbRp and A is a hyperrectangle, or, more generally, a sparsely convex set, and show that the approximation error converges to zero even if p=pnoinfty as noinfty and pggn; in particular, p can be as large as O(eCnc) for some constants c,C>0. The result holds uniformly over all hyperrectangles, or more generally, sparsely convex sets, and does not require any restriction on the correlation structure among coordinates of Xi. Sparsely convex sets are sets that can be represented as intersections of many convex sets whose indicator functions depend only on a small subset of their arguments, with hyperrectangles being a special case.


Let \(X_1,\ldots,X_n\) be independent, centred random vectors in \(\mathbb{R}^p\), and let \(S_n^X=\frac{1}{\sqrt{n}}\sum_{i=1}^nX_i\). The authors consider Gaussian approximation of \(S_n^X\). That is, letting \(Y_1,\ldots,Y_n\) be independent, centred Gaussian random variables such that \(Y_i\) has the same covariance structure as \(X_i\) for each \(i\), and defining \(S_n^Y=\frac{1}{\sqrt{n}}\sum_{i=1}^nY_i\), the authors provide bounds on \[ \rho_n(\mathcal{A})=\sup_{A\in\mathcal{A}}\left|P(S_n^X\in A)-P(S_n^Y\in A)\right|\,, \] for classes \(\mathcal{A}\) of Borel sets in \(\mathbb{R}^p\). Motivated by modern high-dimensional statistical applications (for example, for statistics of the Kolmogorov-Smirnov or Pearson type), the authors' primary interest is those cases where \(\rho_n(\mathcal{A})\rightarrow0\) even when the dimension \(p=p_n\) is allowed to grow much faster than \(n\). Through explicit bounds (which do not place any restriction on the correlation structure in the underlying random variables), this is shown to be the case if \(\mathcal{A}\) is the class of hyperrectangles in \(\mathbb{R}^p\) or, more generally, the class of simple or sparsely convex sets. In the case of hyperrectangles, the authors show that we have \(\rho_n\rightarrow0\) even when \(p=O(\exp\{an^b\})\), for some constants \(a\) and \(b\). Finally, the authors also derive high-dimensional empirical and multiplier bootstrap theorems, which can be used to provide explicit approximations for the probabilities \(P(S_n^X\in A)\) by data-dependent techniques in cases where the covariance structure of \(S_n^Y\) is unknown and direct computation of \(P(S_n^Y\in A)\) is not feasible.




Cited in
(only showing first 100 items - show all)








This page was built for publication: Central limit theorems and bootstrap in high dimensions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2406563)