Contiguity under high-dimensional Gaussianity with applications to covariance testing

DOI10.1214/22-AAP1917MaRDI QIDQ6138900zbMATH OpenOpenAlexFDO

Authors Qiyang Han, Tiefeng Jiang, Yandi Shen

Publication date 16 January 2024

Published in The Annals of Applied Probability (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2101.11086

zbMATH Keywords

contiguitypower analysisPoincaré inequalitiescovariance test

Mathematics Subject Classification ID

Approximations to statistical distributions (nonasymptotic) (62E17) Functional limit theorems; invariance principles (60F17)

Abstract: Le Cam's third/contiguity lemma is a fundamental probabilistic tool to compute the limiting distribution of a given statistic $T_n$ under a non-null sequence of probability measures $Q_n$, provided its limiting distribution under a null sequence $P_n$ is available, and the log likelihood ratio $log(d{Q}_n/d{P}_n)$ has a distributional limit. Despite its wide-spread applications to low-dimensional statistical problems, the stringent requirement of Le Cam's third/contiguity lemma on the distributional limit of the log likelihood ratio makes it challenging, or even impossible to use in many modern high-dimensional statistical problems. This paper provides a non-asymptotic analogue of Le Cam's third/contiguity lemma under high dimensional normal populations. Our contiguity method is particularly compatible with sufficiently regular statistics $T_n$: the regularity of $T_n$ effectively reduces both the problems of (i) obtaining a null (Gaussian) limit distribution and of (ii) verifying our new quantitative contiguity condition, to those of derivative calculations and moment bounding exercises. More important, our method bypasses the need to understand the precise behavior of the log likelihood ratio, and therefore possibly works even when it necessarily fails to stabilize -- a regime beyond the reach of classical contiguity methods. As a demonstration of the scope of our new contiguity method, we obtain asymptotically exact power formulae for a number of widely used high-dimensional covariance tests, including the likelihood ratio tests and trace tests, that hold uniformly over all possible alternative covariance under mild growth conditions on the dimension-to-sample ratio. These new results go much beyond the scope of previous available case-specific techniques, and exhibit new phenomenon regarding the behavior of these important class of covariance tests.

Cites work

• scientific article; zbMATH DE number 3886886 (Why is no real title available?)
• scientific article; zbMATH DE number 3169867 (Why is no real title available?)
• scientific article; zbMATH DE number 2107836 (Why is no real title available?)
• scientific article; zbMATH DE number 3347500 (Why is no real title available?)
• A note on testing the covariance matrix for large dimension
• A study of two high-dimensional likelihood ratio tests under alternative hypotheses
• Asymptotic Statistics
• Asymptotic power of sphericity tests for high-dimensional data
• CLT for linear spectral statistics of large-dimensional sample covariance matrices.
• Central limit theorems for classical likelihood ratio tests for high-dimensional normal distributions
• Concentration inequalities and moment bounds for sample covariance operators
• Concentration inequalities. A nonasymptotic theory of independence
• Corrections to LRT on large-dimensional covariance matrix by RMT
• Determinant of sample correlation matrix with application
• Fluctuations of eigenvalues and second order Poincaré inequalities
• High-dimensional asymptotics of likelihood ratio tests in the Gaussian sequence model under convex constraints
• Likelihood ratio tests for covariance matrices of high-dimensional normal distributions
• Likelihood ratio tests for high-dimensional normal distributions
• On some test criteria for covariance matrix
• On the distribution of the largest eigenvalue in principal components analysis
• On the sphericity test with large-dimensional observations
• Optimal hypothesis testing for high dimensional covariance matrices
• Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices
• Signal detection in high dimension: the multispiked case
• Smallest singular value of a random rectangular matrix
• Some hypothesis tests for the covariance matrix when the dimension is large compared to the sample size
• Substitution principle for CLT of linear spectral statistics of high-dimensional sample covariance matrices with applications to hypothesis testing
• Superconcentration and related topics
• Tests for high-dimensional covariance matrices
• Universality of covariance matrices

Cited in

(1)

• Spectral statistics of sample block correlation matrices

This page was built for publication: Contiguity under high-dimensional Gaussianity with applications to covariance testing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6138900)