Bayesian linear regression for multivariate responses under group sparsity
From MaRDI portal
Abstract: We study frequentist properties of a Bayesian high-dimensional multivariate linear regression model with correlated responses. The predictors are separated into many groups and the group structure is pre-determined. Two features of the model are unique: (i) group sparsity is imposed on the predictors. (ii) the covariance matrix is unknown and its dimensions can also be high. We choose a product of independent spike-and-slab priors on the regression coefficients and a new prior on the covariance matrix based on its eigendecomposition. Each spike-and-slab prior is a mixture of a point mass at zero and a multivariate density involving a -norm. We first obtain the posterior contraction rate, the bounds on the effective dimension of the model with high posterior probabilities. We then show that the multivariate regression coefficients can be recovered under certain compatibility conditions. Finally, we quantify the uncertainty for the regression coefficients with frequentist validity through a Bernstein-von Mises type theorem. The result leads to selection consistency for the Bayesian method. We derive the posterior contraction rate using the general theory by constructing a suitable test from the first principle using moment bounds for certain likelihood ratios. This leads to posterior concentration around the truth with respect to the average R'enyi divergence of order 1/2. This technique of obtaining the required tests for posterior contraction rate could be useful in many other problems.
Recommendations
- Bayesian linear regression with sparse priors
- High-dimensional multivariate posterior consistency under global-local shrinkage priors
- Consistent group selection with Bayesian high dimensional modeling
- Bayesian variable selection regression of multivariate responses for group data
- Ultra high-dimensional multivariate posterior contraction rate under shrinkage priors
Cites work
- scientific article; zbMATH DE number 6114094 (Why is no real title available?)
- A general framework for Bayes structured linear models
- A tail inequality for quadratic forms of subgaussian random vectors
- Asymptotic normality of posterior distributions for exponential families when the number of parameters tends to infinity.
- Asymptotic normality of posterior distributions in high-dimensional linear models
- Bayesian estimation of principal components for functional data
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- Bayesian linear regression for multivariate responses under group sparsity
- Bayesian linear regression with sparse priors
- Bayesian method for causal inference in spatially-correlated multivariate time series
- Bayesian sparse linear regression with unknown symmetric error
- Bayesian structure learning in graphical models
- Bayesian variable selection and estimation for group Lasso
- Bayesian variable selection in structured high-dimensional covariate spaces with applications in genomics
- Bayesian variable selection regression of multivariate responses for group data
- Bernstein-von Mises theorems for Gaussian regression with increasing number of regressors
- Bernstein-von Mises theorems for functionals of the covariance matrix
- Concentration inequalities. A nonasymptotic theory of independence
- Empirical Bayes analysis of spike and slab posterior distributions
- Empirical Bayes oracle uncertainty quantification for regression
- Empirical Bayes posterior concentration in sparse high-dimensional linear models
- Estimation of a covariance matrix using the reference prior
- Fast Bayesian model assessment for nonparametric additive regression
- Fundamentals of nonparametric Bayesian inference
- Incorporating grouping information in Bayesian variable selection with applications in genomics
- Model Selection and Estimation in Regression with Grouped Variables
- Nearly optimal Bayesian shrinkage for high-dimensional regression
- On the asymptotic properties of the group lasso estimator for linear models
- Oracle inequalities and optimal inference under group sparsity
- Posterior contraction in sparse Bayesian factor models for massive covariance matrices
- Posterior convergence rates for estimating large precision matrices using graphical models
- Semiparametric Bernstein-von Mises for the error standard deviation
- Statistics for high-dimensional data. Methods, theory and applications.
- The benefit of group sparsity
- Weak convergence and empirical processes. With applications to statistics
Cited in
(18)- Posterior contraction in group sparse logit models for categorical responses
- Time-varying auto-regressive models for count time-series
- Unified Bayesian theory of sparse linear regression with nuisance parameters
- An approach of Bayesian variable selection for ultrahigh-dimensional multivariate regression
- Bayesian modelling of time-varying conditional heteroscedasticity
- Empirical priors and coverage of posterior credible sets in a sparse normal mean model
- Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
- Spike and slab Bayesian sparse principal component analysis
- A generalized likelihood-based Bayesian approach for scalable joint regression and covariance selection in high dimensions
- Bayesian variable selection regression of multivariate responses for group data
- Bayesian MIDAS penalized regressions: estimation, selection, and prediction
- Bayesian Group-Sparse Modeling and Variational Inference
- Bayesian linear regression for multivariate responses under group sparsity
- Bayesian sparse seemingly unrelated regressions model with variable selection and covariance estimation via the horseshoe+
- Bayesian Sparse Regression for Mixed Multi-Responses with Application to Runtime Metrics Prediction in Fog Manufacturing
- High-dimensional multivariate posterior consistency under global-local shrinkage priors
- Bayesian estimation of sparse precision matrices in the presence of Gaussian measurement error
- Bayesian sparse spiked covariance model with a continuous matrix shrinkage prior
This page was built for publication: Bayesian linear regression for multivariate responses under group sparsity
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2175004)
