On the within-family Kullback-Leibler risk in Gaussian Predictive models
From MaRDI portal
Publication:6237688
Abstract: We consider estimating the predictive density under Kullback-Leibler loss in a high-dimensional Gaussian model. Decision theoretic properties of the within-family prediction error -- the minimal risk among estimates in the class of all Gaussian densities are discussed. We show that in sparse models, the class is minimax sub-optimal. We produce asymptotically sharp upper and lower bounds on the within-family prediction errors for various subfamilies of . Under mild regularity conditions, in the sub-family where the covariance structure is represented by a single data dependent parameter , the Kullback-Leiber risk has a tractable decomposition which can be subsequently minimized to yield optimally flattened predictive density estimates. The optimal predictive risk can be explicitly expressed in terms of the corresponding mean square error of the location estimate, and so, the role of shrinkage in the predictive regime can be determined based on point estimation theory results. Our results demonstrate that some of the decision theoretic parallels between predictive density estimation and point estimation regimes can be explained by second moment based concentration properties of the quadratic loss.
This page was built for publication: On the within-family Kullback-Leibler risk in Gaussian Predictive models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6237688)
