High-dimensional multivariate posterior consistency under global-local shrinkage priors

DOI10.1016/J.JMVA.2018.04.010zbMATH Open1403.62134OpenAlexW2768228643WikidataQ129915462 ScholiaQ129915462MaRDI QIDQ1661340FDOQ1661340

Authors: Ray Bai, Malay Ghosh 

Publication date: 16 August 2018

Published in: Journal of Multivariate Analysis (Search for Journal in Brave)

Abstract: We consider sparse Bayesian estimation in the classical multivariate linear regression model with $p$ regressors and $q$ response variables. In univariate Bayesian linear regression with a single response $y$, shrinkage priors which can be expressed as scale mixtures of normal densities are popular for obtaining sparse estimates of the coefficients. In this paper, we extend the use of these priors to the multivariate case to estimate a $pimesq$ coefficients matrix $mathbfB$. We derive sufficient conditions for posterior consistency under the Bayesian multivariate linear regression framework and prove that our method achieves posterior consistency even when $p>n$ and even when $p$ grows at nearly exponential rate with the sample size. We derive an efficient Gibbs sampling algorithm and provide the implementation in a comprehensive R package called MBSP. Finally, we demonstrate through simulations and data analysis that our model has excellent finite sample performance.

Full work available at URL: https://arxiv.org/abs/1711.07635

Recommendations

• Ultra high-dimensional multivariate posterior contraction rate under shrinkage priors
• Posterior consistency in linear models under shrinkage priors
• Finite sample posterior concentration in high-dimensional regression
• Bayesian linear regression for multivariate responses under group sparsity
• High-dimensional posterior consistency of the Bayesian Lasso

zbMATH Keywords

variable selectionhigh-dimensional datasparsityheavy tailposterior consistencyshrinkage estimation

Mathematics Subject Classification ID

Asymptotic properties of parametric estimators (62F12) Bayesian inference (62F15) Estimation in multivariate analysis (62H12) Ridge regression; shrinkage estimators (Lasso) (62J07)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• A robust generalized Bayes estimator and confidence region for a multivariate normal mean
• Adaptive posterior contraction rates for the horseshoe
• An algorithm for the multivariate group Lasso with covariance estimation
• Asymptotic optimality of one-group shrinkage priors in sparse high-dimensional problems
• Asymptotic properties of Bayes risk for the horseshoe prior
• Asymptotic properties of Bayes risk of a general class of shrinkage priors in multiple hypothesis testing under sparsity
• Bayesian Variable Selection in Linear Regression
• Bayesian generalized low rank regression models for neuroimaging phenotypes and genetic markers
• Bayesian linear regression with sparse priors
• Bayesian sparse reduced rank multivariate regression
• Bayesian variable selection and estimation for group Lasso
• Bayesian variable selection regression of multivariate responses for group data
• Bayesian variable selection with shrinking and diffusing priors
• Conditions for posterior contraction in the sparse normal means problem
• Generalized double Pareto shrinkage
• Joint high-dimensional Bayesian variable and covariance selection with an application to eQTL analysis
• Joint variable and rank selection for parsimonious estimation of high-dimensional matrices
• Model Selection and Estimation in Regression with Grouped Variables
• Multivariate Bayesian Variable Selection and Prediction
• Multivariate sparse group Lasso for the multivariate multiple linear regression with an arbitrary group structure
• On the half-Cauchy prior for a global scale parameter
• Posterior consistency in linear models under shrinkage priors
• Proper Bayes Minimax Estimators of the Multivariate Normal Mean
• Regularization and Variable Selection Via the Elastic Net
• Scaled sparse linear regression
• Some priors for sparse regression modelling
• Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable Selection
• Sparse reduced-rank regression for simultaneous dimension reduction and variable selection
• Spike and slab variable selection: frequentist and Bayesian strategies
• Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
• Sure independence screening in generalized linear models with NP-dimensionality
• The Adaptive Lasso and Its Oracle Properties
• The Bayesian Lasso
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• The horseshoe estimator for sparse signals
• The horseshoe estimator: posterior concentration around nearly black vectors
• The horseshoe+ estimator of ultra-sparse signals
• Uncertainty quantification for the horseshoe (with discussion)

Cited In (14)

• The EAS approach to variable selection for multivariate response data in high-dimensional settings
• A Comparison of Bayesian Multivariate Versus Univariate Normal Regression Models for Prediction
• Necessary and sufficient conditions for high-dimensional posterior consistency under \(g\)-priors
• Posterior contraction in sparse Bayesian factor models for massive covariance matrices
• Summaries of three keynote lectures at the SAE – 2018
• Bayesian linear regression for multivariate responses under group sparsity
• MBSP
• High-dimensional Bayesian network classification with network global-local shrinkage priors
• Finite sample posterior concentration in high-dimensional regression
• Ultra high-dimensional multivariate posterior contraction rate under shrinkage priors
• Posterior consistency in linear models under shrinkage priors
• Statistical inference via conditional Bayesian posteriors in high-dimensional linear regression
• High-dimensional posterior consistency of the Bayesian Lasso
• Bayesian sparse spiked covariance model with a continuous matrix shrinkage prior

Uses Software

• R
• glmnet
• R2GUESS

This page was built for publication: High-dimensional multivariate posterior consistency under global-local shrinkage priors

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1661340)