Likelihood ratio test in multivariate linear regression: from low to high dimension

DOI10.5705/SS.202019.0056MaRDI QIDQ5155185zbMATH OpenOpenAlexFDO

Authors Yinqiu He, Tiefeng Jiang, Jiyang Wen, Gongjun Xu

Publication date 6 October 2021

Published in STATISTICA SINICA (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1812.06894

zbMATH Keywords

dimensionalitylikelihood ratio testmultivariate linear regression

Mathematics Subject Classification ID

Hypothesis testing in multivariate analysis (62H15) Linear regression; mixed models (62J05) Applications of statistics to biology and medical sciences; meta analysis (62P10)

Abstract: Multivariate linear regressions are widely used statistical tools in many applications to model the associations between multiple related responses and a set of predictors. To infer such associations, it is often of interest to test the structure of the regression coefficients matrix, and the likelihood ratio test (LRT) is one of the most popular approaches in practice. Despite its popularity, it is known that the classical $ch{i}^2$ approximations for LRTs often fail in high-dimensional settings, where the dimensions of responses and predictors $(m,p)$ are allowed to grow with the sample size $n$. Though various corrected LRTs and other test statistics have been proposed in the literature, the fundamental question of when the classic LRT starts to fail is less studied, an answer to which would provide insights for practitioners, especially when analyzing data with $m/n$ and $p/n$ small but not negligible. Moreover, the power performance of the LRT in high-dimensional data analysis remains underexplored. To address these issues, the first part of this work gives the asymptotic boundary where the classical LRT fails and develops the corrected limiting distribution of the LRT for a general asymptotic regime. The second part of this work further studies the test power of the LRT in the high-dimensional setting. The result not only advances the current understanding of asymptotic behavior of the LRT under alternative hypothesis, but also motivates the development of a power-enhanced LRT. The third part of this work considers the setting with $p>n$, where the LRT is not well-defined. We propose a two-step testing procedure by first performing dimension reduction and then applying the proposed LRT. Theoretical properties are developed to ensure the validity of the proposed method. Numerical studies are also presented to demonstrate its good performance.

Recommendations

• Testing linear hypotheses in high-dimensional regressions
• The likelihood ratio test for high-dimensional linear regression model
• Asymptotic power of likelihood ratio tests for high dimensional data
• Moderate deviation principle for likelihood ratio test in multivariate linear regression model
• On the likelihood ratio test for envelope models in multivariate linear regression

Cites work

• \(p\)-values for high-dimensional regression
• Approximate null distribution of the largest root in multivariate analysis
• Central limit theorems for classical likelihood ratio tests for high-dimensional normal distributions
• Central limit theorems for linear spectral statistics of large dimensional \(F\)-matrices
• Corrections to LRT on large-dimensional covariance matrix by RMT
• Deterministic parallel analysis: an improved method for selecting factors and principal components
• Dimension Reduction and Coefficient Estimation in Multivariate Linear Regression
• Generalized additive models
• High dimensional ordinary least squares projection for screening variables
• High-dimensional general linear hypothesis testing under heteroscedasticity
• High-dimensional general linear hypothesis tests via non-linear spectral shrinkage
• High-dimensional sparse MANOVA
• scientific article; zbMATH DE number 1964693 (Why is no real title available?)
• scientific article; zbMATH DE number 889593 (Why is no real title available?)
• Indirect multivariate response linear regression
• Likelihood ratio tests for covariance matrices of high-dimensional normal distributions
• Likelihood ratio tests for high-dimensional normal distributions
• Multivariate analysis and Jacobi ensembles: largest eigenvalue, Tracy-Widom limits and rates of convergence
• Multivariate analysis of variance with fewer observations than the dimension
• On a Heuristic Method of Test Construction and its use in Multivariate Analysis
• On testing the equality of high dimensional mean vectors with unequal covariance matrices
• Reduced rank regression via adaptive nuclear norm penalization
• Regularized multivariate regression for identifying master predictors with application to integrative genomics study of breast cancer
• Sparse principal component analysis and iterative thresholding
• Stability selection. With discussion and authors' reply
• Statistical learning and selective inference
• Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
• Sure independence screening in generalized linear models with NP-dimensionality
• Testing linear hypotheses in high-dimensional regressions
• Valid post-selection inference

Cited in

(18)

• A note on the likelihood ratio test in high-dimensional exploratory factor analysis
• Moderate deviation principle for likelihood ratio test in multivariate linear regression model
• A fast and consistent variable selection method for high-dimensional multivariate linear regression with a large number of explanatory variables
• The likelihood ratio test in high-dimensional logistic regression is asymptotically a rescaled Chi-square
• Testing linear hypotheses in high-dimensional regressions
• The relative effects of dimensionality and multiplicity of hypotheses on the F-test in linear regression
• Empirical Likelihood Ratio Tests for Coefficients in High Dimensional Heteroscedastic Linear Models
• The likelihood ratio test for high-dimensional linear regression model
• scientific article; zbMATH DE number 7376764 (Why is no real title available?)
• On the likelihood ratio test for envelope models in multivariate linear regression
• Simultaneous model change detection in multivariate linear regression with application to Indonesian economic growth data
• Association testing for high-dimensional multiple response regression
• Hotelling \(T^2\) test in high dimensions with application to Wilks outlier method
• Testing General Linear Hypotheses Under a High-Dimensional Multivariate Regression Model with Spiked Noise Covariance
• An integrated test on the linear structure of high-dimensional covariance matrices
• A robust nonparametric test for conditional symmetry in high dimension
• Testing covariates effects on bivariate reference regions
• On the phase transition of Wilks' phenomenon under block compound symmetry covariance structure

This page was built for publication: Likelihood ratio test in multivariate linear regression: from low to high dimension

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5155185)