Bayesian model choice and information criteria in sparse generalized linear models

arXiv1112.5635MaRDI QIDQ6229891FDOQ6229891

Authors: Rina Foygel Barber, Mathias Drton 

Publication date: 23 December 2011

Abstract: We consider Bayesian model selection in generalized linear models that are high-dimensional, with the number of covariates p being large relative to the sample size n, but sparse in that the number of active covariates is small compared to p. Treating the covariates as random and adopting an asymptotic scenario in which p increases with n, we show that Bayesian model selection using certain priors on the set of models is asymptotically equivalent to selecting a model using an extended Bayesian information criterion. Moreover, we prove that the smallest true model is selected by either of these methods with probability tending to one. Having addressed random covariates, we are also able to give a consistency result for pseudo-likelihood approaches to high-dimensional sparse graphical modeling. Experiments on real data demonstrate good performance of the extended Bayesian information criterion for regression and for graphical models.

This page was built for publication: Bayesian model choice and information criteria in sparse generalized linear models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6229891)