Empirical Bayes posterior concentration in sparse high-dimensional linear models

DOI10.3150/15-BEJ797zbMATH Open1450.62085arXiv1406.7718OpenAlexW3103712593MaRDI QIDQ125752FDOQ125752

Authors: Ryan Martin, Raymond Mess, Stephen G. Walker, Raymond Mess, Ryan Martin, Stephen G. Walker 

Publication date: 1 August 2017

Published in: Bernoulli (Search for Journal in Brave)

Abstract: We propose a new empirical Bayes approach for inference in the $pggn$ normal linear model. The novelty is the use of data in the prior in two ways, for centering and regularization. Under suitable sparsity assumptions, we establish a variety of concentration rate results for the empirical Bayes posterior distribution, relevant for both estimation and model selection. Computation is straightforward and fast, and simulation results demonstrate the strong finite-sample performance of the empirical Bayes model selection procedure.

Full work available at URL: https://arxiv.org/abs/1406.7718

Recommendations

• Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
• Bayesian linear regression with sparse priors
• Empirical priors for prediction in sparse high-dimensional linear regression
• Local posterior concentration rate for multilevel sparse sequences
• Empirical Bayes analysis of spike and slab posterior distributions

zbMATH Keywords

variable selectionregressionminimaxdata-dependent priorfractional likelihood

Mathematics Subject Classification ID

Linear regression; mixed models (62J05) Empirical decision procedures; empirical Bayes procedures (62C12)

Cited In (55)

• Optimal convergence rates of Bayesian wavelet estimation with a novel empirical prior in nonparametric regression model
• Generalized Bayes approach to inverse problems with model misspecification
• Bayesian fractional posteriors
• Complexity analysis of Bayesian learning of high-dimensional DAG models and their equivalence classes
• Empirical Bayes oracle uncertainty quantification for regression
• Variational Bayes for High-Dimensional Linear Regression With Sparse Priors
• Learning from a lot: empirical Bayes for high-dimensional model-based prediction
• Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
• Nearly optimal Bayesian shrinkage for high-dimensional regression
• Posterior contraction in group sparse logit models for categorical responses
• Maximum pairwise Bayes factors for covariance structure testing
• Bayesian linear regression with sparse priors
• Contraction properties of shrinkage priors in logistic regression
• Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
• Empirical E-Bayesian estimation for the parameter of Poisson distribution
• Bayesian linear regression for multivariate responses under group sparsity
• Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior
• Asymptotic behaviour of the empirical Bayes posteriors associated to maximum marginal likelihood estimator
• Bayesian joint inference for multiple directed acyclic graphs
• A general framework for Bayes structured linear models
• Bayesian inference for high-dimensional decomposable graphs
• Unified Bayesian theory of sparse linear regression with nuisance parameters
• The empirical Bayes estimators of the variance parameter of the normal distribution with a conjugate inverse gamma prior under Stein’s loss function
• Minimax posterior convergence rates and model selection consistency in high-dimensional DAG models based on sparse Cholesky factors
• ebreg
• On the beta prime prior for scale parameters in high-dimensional Bayesian regression models
• Concentration of posterior model probabilities and normalized \({L_0}\) criteria
• Posterior consistency of factor dimensionality in high-dimensional sparse factor models
• High-dimensional Bayesian network classification with network global-local shrinkage priors
• A comparison of learning rate selection methods in generalized Bayesian inference
• Empirical priors and posterior concentration rates for a monotone density
• Finite sample posterior concentration in high-dimensional regression
• Fast rates for general unbounded loss functions: from ERM to generalized Bayes
• Empirical priors and coverage of posterior credible sets in a sparse normal mean model
• Posterior consistency in linear models under shrinkage priors
• Gibbs posterior concentration rates under sub-exponential type losses
• Optimal Bayesian estimation of Gaussian mixtures with growing number of components
• The empirical Bayes estimators of the parameter of the Poisson distribution with a conjugate gamma prior under Stein's loss function
• The empirical Bayes estimators of the rate parameter of the inverse gamma distribution with a conjugate inverse gamma prior under Stein's loss function
• The beta-mixture shrinkage prior for sparse covariances with near-minimax posterior convergence rate
• Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors
• Bayesian tensor response regression with an application to brain activation studies
• Bayesian bandwidth test and selection for high-dimensional banded precision matrices
• Empirical Bayes analysis of spike and slab posterior distributions
• Scalable Bayesian high-dimensional local dependence learning
• Bayesian group selection in logistic regression with application to MRI data analysis
• Empirical priors for prediction in sparse high-dimensional linear regression
• Data-driven priors and their posterior concentration rates
• Local posterior concentration rate for multilevel sparse sequences
• Empirical Bayes inference in sparse high-dimensional generalized linear models
• Bayesian Generalized Sparse Symmetric Tensor-on-Vector Regression
• Uncertainty Quantification for High-Dimensional Sparse Nonparametric Additive Models
• Empirical priors and posterior concentration in a piecewise polynomial sequence model
• Spike and slab Bayesian sparse principal component analysis
• Consistent group selection using nonlocal priors in regression

This page was built for publication: Empirical Bayes posterior concentration in sparse high-dimensional linear models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q125752)