Dirichlet-Laplace priors for optimal shrinkage
From MaRDI portal
(Redirected from Publication:5367461)
Abstract: Penalized regression methods, such as regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is routinely induced through two-component mixture priors having a probability mass at zero, but such priors encounter daunting computational problems in high dimensions. This has motivated an amazing variety of continuous shrinkage priors, which can be expressed as global-local scale mixtures of Gaussians, facilitating computation. In sharp contrast to the frequentist literature, little is known about the properties of such priors and the convergence and concentration of the corresponding posterior distribution. In this article, we propose a new class of Dirichlet--Laplace (DL) priors, which possess optimal posterior concentration and lead to efficient posterior computation exploiting results from normalized random measure theory. Finite sample performance of Dirichlet--Laplace priors relative to alternatives is assessed in simulated and real data examples.
Recommendations
- Sub-optimality of some continuous shrinkage priors
- Contraction properties of shrinkage priors in logistic regression
- Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
- Generalized double Pareto shrinkage
- Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors
Cited in
(only showing first 100 items - show all)- Predictive performance of Dirichlet process shrinkage methods in linear regression
- Bayesian Bootstrap Spike-and-Slab LASSO
- Prior distributions for objective Bayesian analysis
- Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors
- Variable selection using shrinkage priors
- Model selection using mass-nonlocal prior
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- Optimal Gaussian approximations to the posterior for log-linear models with Diaconis-Ylvisaker priors
- Locally adaptive smoothing with Markov random fields and shrinkage priors
- Fast Monte Carlo Markov chains for Bayesian shrinkage models with random effects
- Penalising model component complexity: a principled, practical approach to constructing priors
- Hierarchical Bayes, maximum a posteriori estimators, and minimax concave penalized likelihood estimation
- Bayesian wavelet shrinkage with beta priors
- The horseshoe-like regularization for feature subset selection
- Bayesian deconvolution and quantification of metabolites from J-resolved NMR spectroscopy
- Intuitive joint priors for variance parameters
- Dynamic variable selection with spike-and-slab process priors
- Ultra high-dimensional multivariate posterior contraction rate under shrinkage priors
- A hybrid scan Gibbs sampler for Bayesian models with latent variables
- The illusion of the illusion of sparsity: an exercise in prior sensitivity
- Shared Bayesian variable shrinkage in multinomial logistic regression
- Sparse linear mixed model selection via streamlined variational Bayes
- Robust sparse Bayesian infinite factor models
- Frequentist conditional variance for nonlinear mixed-effects models
- Fast and accurate variational inference for large Bayesian VARs with stochastic volatility
- On minimax optimality of sparse Bayes predictive density estimates
- Graph signal denoising using \(t\)-shrinkage priors
- Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
- Empirical estimates for heteroscedastic hierarchical dynamic normal models
- Bayesian hierarchical modeling: application towards production results in the Eagle Ford Shale of South Texas
- Bayesian sparse convex clustering via global-local shrinkage priors
- Geometric ergodicity of Gibbs samplers for the horseshoe and its regularized variants
- Bayesian factor-adjusted sparse regression
- Contraction of a quasi-Bayesian model with shrinkage priors in precision matrix estimation
- Horseshoe shrinkage methods for Bayesian fusion estimation
- An extreme value Bayesian Lasso for the conditional left and right tails
- Projective inference in high-dimensional problems: prediction and feature selection
- Relevant parameter changes in structural break models
- Bayesian shrinkage towards sharp minimaxity
- Function-on-scalar quantile regression with application to mass spectrometry proteomics data
- Bayesian fusion estimation via \(t\) shrinkage
- Bayesian inference in nonparanormal graphical models
- Shrinkage priors for single-spiked covariance models
- Spike and slab empirical Bayes sparse credible sets
- Radio-iBAG: radiomics-based integrative Bayesian analysis of multiplatform genomic data
- A novel Bayesian approach for variable selection in linear regression models
- Lasso meets horseshoe: a survey
- Bayesian network marker selection via the thresholded graph Laplacian Gaussian prior
- Adaptive Bayesian nonparametric regression using a kernel mixture of polynomials with application to partial linear models
- Contraction properties of shrinkage priors in logistic regression
- Bayesian shrinkage in mixture-of-experts models: identifying robust determinants of class membership
- Bayesian discriminant analysis using a high dimensional predictor
- High-dimensional confounding adjustment using continuous Spike and Slab priors
- Data-driven priors and their posterior concentration rates
- Shrinkage priors for Bayesian penalized regression
- The Bayesian group Lasso for confounded spatial data
- Inference with normal-gamma prior distributions in regression problems
- Group-wise shrinkage estimation in penalized model-based clustering
- Nearly optimal Bayesian shrinkage for high-dimensional regression
- Distributed Bayesian posterior voting strategy for massive data
- Modeling time-varying parameters using artificial neural networks: a GARCH illustration
- Compound Poisson processes, latent shrinkage priors and Bayesian nonconvex penalization
- Conditions for posterior contraction in the sparse normal means problem
- Sub-optimality of some continuous shrinkage priors
- Efficient Sampling for Gaussian Linear Regression With Arbitrary Priors
- Uncertainty Quantification for Modern High-Dimensional Regression via Scalable Bayesian Methods
- Testing Sparsity-Inducing Penalties
- Singular value shrinkage priors for Bayesian prediction
- Bayesian neural networks for selection of drug sensitive genes
- Bayesian tensor regression
- Bayesian semiparametric multivariate density deconvolution
- The spike-and-slab LASSO
- Generalized double Pareto shrinkage
- Bayesian MAP estimation using Gaussian and diffused-gamma prior
- Bayesian regression trees for high-dimensional prediction and variable selection
- Scalable approximate MCMC algorithms for the horseshoe prior
- Empirical priors for prediction in sparse high-dimensional linear regression
- On the beta prime prior for scale parameters in high-dimensional Bayesian regression models
- The adaptive normal-hypergeometric-inverted-beta priors for sparse signals
- Bayesian bridge regression
- Fast Markov Chain Monte Carlo for High-Dimensional Bayesian Regression Models With Shrinkage Priors
- Spatial Shrinkage Via the Product Independent Gaussian Process Prior
- Bayesian Approaches to Shrinkage and Sparse Estimation
- MIMIX: a Bayesian mixed-effects model for microbiome data from designed experiments
- Dealing with Measurement Uncertainties as Nuisance Parameters in Bayesian Model Calibration
- Comparison and contrast of two general functional regression modelling frameworks
- Functional Horseshoe Priors for Subspace Shrinkage
- Targeted random projection for prediction from high-dimensional features
- Large-scale multiple hypothesis testing with the normal-beta prime prior
- Bayesian semiparametric functional mixed models for serially correlated functional data, with application to glaucoma data
- Two Metropolis--Hastings Algorithms for Posterior Measures with Non-Gaussian Priors in Infinite Dimensions
- Skinny Gibbs: a consistent and scalable Gibbs sampler for model selection
- Prediction risk for the horseshoe regression
- Default Bayesian analysis with global-local shrinkage priors
- EP-GIG priors and applications in Bayesian sparse learning
- Trace class Markov chains for Bayesian inference with generalized double Pareto shrinkage priors
- Local shrinkage rules, Lévy processes and regularized regression
- Bayesian wavelet shrinkage with logistic prior
- Revisiting Jeffreys’ Example: Bayes Test of the Normal Mean
- Asymmetric Prior in Wavelet Shrinkage
This page was built for publication: Dirichlet-Laplace priors for optimal shrinkage
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5367461)
