Bayesian linear regression with sparse priors
From MaRDI portal
Abstract: We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the posterior distribution is shown to contract at the optimal rate for recovery of the unknown sparse vector, and to give optimal prediction of the response vector. It is also shown to select the correct sparse model, or at least the coefficients that are significantly different from zero. The asymptotic shape of the posterior distribution is characterized and employed to the construction and study of credible sets for uncertainty quantification.
Recommendations
- Bayesian sparse linear regression with unknown symmetric error
- Finite sample posterior concentration in high-dimensional regression
- Empirical Bayes posterior concentration in sparse high-dimensional linear models
- Posterior consistency in linear models under shrinkage priors
- Unified Bayesian theory of sparse linear regression with nuisance parameters
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Adapting to unknown sparsity by controlling the false discovery rate
- Aggregation by Exponential Weighting and Sharp Oracle Inequalities
- Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
- Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
- Bayesian Variable Selection in Linear Regression
- Bayesian lasso regression
- Bayesian linear regression with sparse priors
- Bayesian variable selection in structured high-dimensional covariate spaces with applications in genomics
- Bayesian variable selection via particle stochastic search
- Calibration and empirical Bayes variable selection
- Convergence rates of posterior distributions.
- Correlated variables in regression: clustering and sparse estimation
- EMVS: the EM approach to Bayesian variable selection
- Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
- Estimation and variable selection with exponential weights
- Evolutionary stochastic search for Bayesian model exploration
- Exponential screening and optimal rates of sparse estimation
- Inference with normal-gamma prior distributions in regression problems
- Information Theory and Mixing Least-Squares Regressions
- Limiting laws of coherence of random matrices with applications to testing covariance structure and construction of compressed sensing matrices
- MAP model selection in Gaussian regression
- Nearly unbiased variable selection under minimax concave penalty
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
- Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion
- On Bayesian model and variable selection using MCMC
- On higher order isotropy conditions and lower bounds for sparse quadratic forms
- On the conditions used to prove oracle results for the Lasso
- On variational Bayes estimation and variational information criteria for linear regression models
- Oracle convergence rate of posterior under projection prior and Bayesian model selection
- Sequential Monte Carlo on large binary sampling spaces
- Shotgun Stochastic Search for “Largep” Regression
- Simultaneous analysis of Lasso and Dantzig selector
- Sparse estimation by exponential weighting
- Sparsity oracle inequalities for the Lasso
- Spike and slab variable selection: frequentist and Bayesian strategies
- Stable recovery of sparse overcomplete representations in the presence of noise
- Statistics for high-dimensional data. Methods, theory and applications.
- Sup-norm convergence rate and sign concentration property of Lasso and Dantzig estimators
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The Variable Selection Problem
- The horseshoe estimator for sparse signals
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
Cited in
(only showing first 100 items - show all)- Variational Bayes for High-Dimensional Linear Regression With Sparse Priors
- On the exponentially weighted aggregate with the Laplace prior
- Maximum pairwise Bayes factors for covariance structure testing
- Ultra high-dimensional multivariate posterior contraction rate under shrinkage priors
- Bayesian Estimation of Gaussian Conditional Random Fields
- Conditions for posterior contraction in the sparse normal means problem
- Bayesian inference for high-dimensional decomposable graphs
- Unified Bayesian theory of sparse linear regression with nuisance parameters
- A Bayesian nonparametric multiple testing procedure for comparing several treatments against a control
- Spike-and-slab Lasso biclustering
- On Bayesian oracle properties
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- Minimax posterior convergence rates and model selection consistency in high-dimensional DAG models based on sparse Cholesky factors
- Needles and straw in a haystack: robust confidence for possibly sparse sequences
- Bayesian bridge regression
- Neuronized Priors for Bayesian Sparse Linear Regression
- Lasso meets horseshoe: a survey
- Bayesian factor-adjusted sparse regression
- Some priors for sparse regression modelling
- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
- Sparse Bayesian inference with regularized Gaussian distributions *
- The horseshoe estimator: posterior concentration around nearly black vectors
- Empirical priors and coverage of posterior credible sets in a sparse normal mean model
- Variable selection consistency of Gaussian process regression
- Posterior consistency in linear models under shrinkage priors
- Bayesian effect selection in structured additive distributional regression models
- A model selection approach for variable selection with censored data
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Prior distributions for objective Bayesian analysis
- Posterior concentration for Bayesian regression trees and forests
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- Sharp oracle inequalities for low-complexity priors
- DOLDA: a regularized supervised topic model for high-dimensional multi-class regression
- On the beta prime prior for scale parameters in high-dimensional Bayesian regression models
- Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors
- Bayesian MIDAS penalized regressions: estimation, selection, and prediction
- Empirical Bayes posterior concentration in sparse high-dimensional linear models
- Nonparametric Bayesian analysis of the compound Poisson prior for support boundary recovery
- Prediction risk for the horseshoe regression
- Bayesian sparse linear regression with unknown symmetric error
- The spike-and-slab LASSO
- Rates of contraction of posterior distributions based on \(p\)-exponential priors
- Convergence rates of variational posterior distributions
- Bayesian linear regression with sparse priors
- Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors
- Sub-optimality of some continuous shrinkage priors
- Bernstein-von Mises theorems for functionals of the covariance matrix
- Oracle posterior contraction rates under hierarchical priors
- Probabilistic Community Detection With Unknown Number of Communities
- Bayesian linear regression for multivariate responses under group sparsity
- On frequentist coverage errors of Bayesian credible sets in moderately high dimensions
- High-dimensional posterior consistency for hierarchical non-local priors in regression
- Well-posed Bayesian inverse problems with infinitely divisible and heavy-tailed prior measures
- A general framework for Bayes structured linear models
- Bayesian effect fusion for categorical predictors
- Bayesian Approaches to Shrinkage and Sparse Estimation
- Criteria for posterior consistency and convergence at a rate
- Variational nonparametric discriminant analysis
- Bayesian inference and optimal design for the sparse linear model
- Hierarchical species sampling models
- High-dimensional multivariate posterior consistency under global-local shrinkage priors
- Quasi-Bayesian estimation of large Gaussian graphical models
- Penalising model component complexity: a principled, practical approach to constructing priors
- Variable Selection in the Presence of Factors: A Model Selection Perspective
- A Critical Review of LASSO and Its Derivatives for Variable Selection Under Dependence Among Covariates
- Empirical Bayes oracle uncertainty quantification for regression
- Model averaging prediction by \(K\)-fold cross-validation
- Graph signal denoising using \(t\)-shrinkage priors
- Posterior contraction in group sparse logit models for categorical responses
- Consistent skinny Gibbs in probit regression
- Joint analysis of mixed types of outcomes with latent variables
- A Mass-Shifting Phenomenon of Truncated Multivariate Normal Priors
- Improved inference for doubly robust estimators of heterogeneous treatment effects
- Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
- Objective Bayesian edge screening and structure selection for Ising networks
- Nonparametric Statistical Inference via Metric Distribution Function in Metric Spaces
- Sparse Online Variational Bayesian Regression
- Horseshoe shrinkage methods for Bayesian fusion estimation
- A new flexible Bayesian hypothesis test for multivariate data
- Comment: ``Bayes, oracle Bayes and empirical Bayes
- Posterior asymptotic normality for an individual coordinate in high-dimensional linear regression
- Bayesian Stein-type shrinkage estimators in high-dimensional linear regression models
- Empirical priors and posterior concentration in a piecewise polynomial sequence model
- Additive Bayesian variable selection under censoring and misspecification
- Estimating promotion effects in email marketing using a large-scale cross-classified Bayesian joint model for nested imbalanced data
- Fast Markov Chain Monte Carlo for High-Dimensional Bayesian Regression Models With Shrinkage Priors
- Statistical inference via conditional Bayesian posteriors in high-dimensional linear regression
- A new Bayesian Lasso and ridge regression with a practically meaningful parameterization and a simple weakly informative prior
- Development of network-guided transcriptomic risk score for disease prediction
- Consistent group selection using nonlocal priors in regression
- Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates
- Bayesian fused lasso modeling via horseshoe prior
- Nearly optimal Bayesian shrinkage for high-dimensional regression
- Subjective Bayesian testing using calibrated prior probabilities
- Precision matrix estimation under the horseshoe-like prior-penalty dual
- Hierarchical shrinkage Gaussian processes: applications to computer code emulation and dynamical system recovery
- Concentration of posterior model probabilities and normalized \({L_0}\) criteria
- Posterior consistency of factor dimensionality in high-dimensional sparse factor models
- Sparse Bayesian linear regression using generalized normal priors
- Two-Stage Bayesian Approach for GWAS With Known Genealogy
This page was built for publication: Bayesian linear regression with sparse priors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q888501)