Model selection for high-dimensional linear regression with dependent observations

From MaRDI portal
Publication:2215720



Abstract: We investigate the prediction capability of the orthogonal greedy algorithm (OGA) in high-dimensional regression models with dependent observations. The rates of convergence of the prediction error of OGA are obtained under a variety of sparsity conditions. To prevent OGA from overfitting, we introduce a high-dimensional Akaike's information criterion (HDAIC) to determine the number of OGA iterations. A key contribution of this work is to show that OGA, used in conjunction with HDAIC, can achieve the optimal convergence rate without knowledge of how sparse the underlying high-dimensional model is.


The article concentrates on high-dimensional regression models of the form \(y_t=\sum_{j=1}^{p} {\beta_j}x_{tj}+\epsilon _t\), \(t=1,\dots,n\), where \(n\) is the sample size, \(x_{t1},\dots,x_{tp}\) are predictor variables and \(\epsilon_t\) are disturbance terms. The aim is to develop an efficient model selection procedure. The author assumes that (\({x_t},{\epsilon _t}\)) is a zero-mean stationary time series, \(E(x_t, \epsilon _t)=0\) and as model selection procedure one considers the couple consisting of the orthogonal greedy algorithm (OGA) and the high-dimensional Akaike information criterion (HDAIC). Under a set of quite special assumptions on coefficients and parameters and some sparsity conditions, rates of convergence of the OGA and rates of convergence of OGA+HDAIC are obtained. Results are compared to the existing ones in the literature. Additional technical results are shown in Appendices A and B. There it is reported that simulation results to illustrate the performance of OGA+HDAIC together with some more technical details are to be found in a supplementary material: Supplement to ``Model selection for high-dimensional linear regression with dependent observations, \url{doi:10.1214/19-AOS1872SUPP}.



Cites work









This page was built for publication: Model selection for high-dimensional linear regression with dependent observations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2215720)