Bayesian linear regression with sparse priors
From MaRDI portal
(Redirected from Publication:888501)
Abstract: We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the posterior distribution is shown to contract at the optimal rate for recovery of the unknown sparse vector, and to give optimal prediction of the response vector. It is also shown to select the correct sparse model, or at least the coefficients that are significantly different from zero. The asymptotic shape of the posterior distribution is characterized and employed to the construction and study of credible sets for uncertainty quantification.
Recommendations
- Bayesian sparse linear regression with unknown symmetric error
- Finite sample posterior concentration in high-dimensional regression
- Empirical Bayes posterior concentration in sparse high-dimensional linear models
- Posterior consistency in linear models under shrinkage priors
- Unified Bayesian theory of sparse linear regression with nuisance parameters
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Adapting to unknown sparsity by controlling the false discovery rate
- Aggregation by Exponential Weighting and Sharp Oracle Inequalities
- Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
- Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
- Bayesian Variable Selection in Linear Regression
- Bayesian lasso regression
- Bayesian linear regression with sparse priors
- Bayesian variable selection in structured high-dimensional covariate spaces with applications in genomics
- Bayesian variable selection via particle stochastic search
- Calibration and empirical Bayes variable selection
- Convergence rates of posterior distributions.
- Correlated variables in regression: clustering and sparse estimation
- EMVS: the EM approach to Bayesian variable selection
- Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
- Estimation and variable selection with exponential weights
- Evolutionary stochastic search for Bayesian model exploration
- Exponential screening and optimal rates of sparse estimation
- Inference with normal-gamma prior distributions in regression problems
- Information Theory and Mixing Least-Squares Regressions
- Limiting laws of coherence of random matrices with applications to testing covariance structure and construction of compressed sensing matrices
- MAP model selection in Gaussian regression
- Nearly unbiased variable selection under minimax concave penalty
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
- Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion
- On Bayesian model and variable selection using MCMC
- On higher order isotropy conditions and lower bounds for sparse quadratic forms
- On the conditions used to prove oracle results for the Lasso
- On variational Bayes estimation and variational information criteria for linear regression models
- Oracle convergence rate of posterior under projection prior and Bayesian model selection
- Sequential Monte Carlo on large binary sampling spaces
- Shotgun Stochastic Search for “Largep” Regression
- Simultaneous analysis of Lasso and Dantzig selector
- Sparse estimation by exponential weighting
- Sparsity oracle inequalities for the Lasso
- Spike and slab variable selection: frequentist and Bayesian strategies
- Stable recovery of sparse overcomplete representations in the presence of noise
- Statistics for high-dimensional data. Methods, theory and applications.
- Sup-norm convergence rate and sign concentration property of Lasso and Dantzig estimators
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The Variable Selection Problem
- The horseshoe estimator for sparse signals
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
Cited in
(only showing first 100 items - show all)- Nonparametric Statistical Inference via Metric Distribution Function in Metric Spaces
- Hierarchical species sampling models
- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
- Bayesian inference and optimal design for the sparse linear model
- Distributed Bayesian Inference in Linear Mixed-Effects Models
- Prediction risk for the horseshoe regression
- Neuronized Priors for Bayesian Sparse Linear Regression
- Fast Markov Chain Monte Carlo for High-Dimensional Bayesian Regression Models With Shrinkage Priors
- Penalising model component complexity: a principled, practical approach to constructing priors
- A new flexible Bayesian hypothesis test for multivariate data
- The horseshoe estimator: posterior concentration around nearly black vectors
- Comment: ``Bayes, oracle Bayes and empirical Bayes
- Posterior asymptotic normality for an individual coordinate in high-dimensional linear regression
- Needles and straw in a haystack: robust confidence for possibly sparse sequences
- Convergence rates of variational posterior distributions
- Variable Selection in the Presence of Factors: A Model Selection Perspective
- New approach to Bayesian high-dimensional linear regression
- Bayesian sparse linear regression with unknown symmetric error
- Spike-and-slab Lasso biclustering
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Bayesian approaches to variable selection: a comparative study from practical perspectives
- A Hierarchical Expected Improvement Method for Bayesian Optimization
- Conditions for posterior contraction in the sparse normal means problem
- Empirical Bayes oracle uncertainty quantification for regression
- On Bayesian oracle properties
- Sub-optimality of some continuous shrinkage priors
- Variational Bayes for High-Dimensional Linear Regression With Sparse Priors
- Bayesian effect fusion for categorical predictors
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- A Mass-Shifting Phenomenon of Truncated Multivariate Normal Priors
- A Bayesian nonparametric multiple testing procedure for comparing several treatments against a control
- Prior distributions for objective Bayesian analysis
- Subjective Bayesian testing using calibrated prior probabilities
- Nearly optimal Bayesian shrinkage for high-dimensional regression
- Criteria for posterior consistency and convergence at a rate
- Variational nonparametric discriminant analysis
- Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates
- The spike-and-slab LASSO
- Graph signal denoising using \(t\)-shrinkage priors
- Posterior contraction in group sparse logit models for categorical responses
- Bayesian fused lasso modeling via horseshoe prior
- Posterior contraction rates for stochastic block models
- Improved inference for doubly robust estimators of heterogeneous treatment effects
- Bayesian neural networks for selection of drug sensitive genes
- Maximum pairwise Bayes factors for covariance structure testing
- Well-posed Bayesian inverse problems with infinitely divisible and heavy-tailed prior measures
- Bayesian linear regression with sparse priors
- Nonparametric Bayesian analysis of the compound Poisson prior for support boundary recovery
- Contraction properties of shrinkage priors in logistic regression
- Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
- On frequentist coverage errors of Bayesian credible sets in moderately high dimensions
- On the sparse Bayesian learning of linear models
- Posterior concentration for Bayesian regression trees and forests
- Sharp oracle inequalities for low-complexity priors
- Empirical Bayes inference in sparse high-dimensional generalized linear models
- Model averaging prediction by \(K\)-fold cross-validation
- Quasi-Bayesian estimation of large Gaussian graphical models
- Bayesian factor-adjusted sparse regression
- Two-way sparsity for time-varying networks with applications in genomics
- Bayesian MIDAS penalized regressions: estimation, selection, and prediction
- Discussion to: Bayesian graphical models for modern biological applications by Y. Ni, V. Baladandayuthapani, M. Vannucci and F.C. Stingo
- Sparse Bayesian linear regression using generalized normal priors
- Bernstein-von Mises theorems for functionals of the covariance matrix
- Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors
- Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
- Bayesian linear regression for multivariate responses under group sparsity
- Objective Bayesian edge screening and structure selection for Ising networks
- Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior
- A Critical Review of LASSO and Its Derivatives for Variable Selection Under Dependence Among Covariates
- Oracle posterior contraction rates under hierarchical priors
- Model Uncertainty Quantification in Cox Regression
- Bayesian Estimation of Gaussian Conditional Random Fields
- Bayesian bridge regression
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- Random weighting in LASSO regression
- Contraction of a quasi-Bayesian model with shrinkage priors in precision matrix estimation
- Posterior impropriety of some sparse Bayesian learning models
- A general framework for Bayes structured linear models
- Bayesian inference for high-dimensional decomposable graphs
- Unified Bayesian theory of sparse linear regression with nuisance parameters
- Sparse Online Variational Bayesian Regression
- Adaptive variational Bayes: optimality, computation and applications
- Consistent skinny Gibbs in probit regression
- Joint analysis of mixed types of outcomes with latent variables
- Sparse Bayesian inference with regularized Gaussian distributions *
- Horseshoe shrinkage methods for Bayesian fusion estimation
- Bayesian fusion estimation via \(t\) shrinkage
- Empirical Bayes posterior concentration in sparse high-dimensional linear models
- Minimax posterior convergence rates and model selection consistency in high-dimensional DAG models based on sparse Cholesky factors
- Lasso meets horseshoe: a survey
- Bayesian sparse seemingly unrelated regressions model with variable selection and covariance estimation via the horseshoe+
- Bayesian Dynamic Feature Partitioning in High-Dimensional Regression With Big Data
- On the beta prime prior for scale parameters in high-dimensional Bayesian regression models
- Modeling association between multivariate correlated outcomes and high-dimensional sparse covariates: the adaptive SVS method
- Variable selection consistency of Gaussian process regression
- Bayesian effect selection in structured additive distributional regression models
- A model selection approach for variable selection with censored data
- Precision matrix estimation under the horseshoe-like prior-penalty dual
- Concentration of posterior model probabilities and normalized \({L_0}\) criteria
- Posterior consistency of factor dimensionality in high-dimensional sparse factor models
This page was built for publication: Bayesian linear regression with sparse priors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q888501)
