Dirichlet-Laplace priors for optimal shrinkage

DOI10.1080/01621459.2014.960967MaRDI QIDQ5367461zbMATH OpenOpenAlexWikidataFDO

Authors Anirban Bhattacharya, Debdeep Pati, Natesh S. Pillai, David Dunson

Publication date 13 October 2017

Published in Journal of the American Statistical Association (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1401.5398

zbMATH Keywords

LassoBayesianregularizationhigh-dimensionalpenalized regressionconvergence rateshrinkage priorDirichlet-Laplace\(L_1\)

Mathematics Subject Classification ID

Bayesian inference (62F15) Ridge regression; shrinkage estimators (Lasso) (62J07)

Abstract: Penalized regression methods, such as $L_1$ regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is routinely induced through two-component mixture priors having a probability mass at zero, but such priors encounter daunting computational problems in high dimensions. This has motivated an amazing variety of continuous shrinkage priors, which can be expressed as global-local scale mixtures of Gaussians, facilitating computation. In sharp contrast to the frequentist literature, little is known about the properties of such priors and the convergence and concentration of the corresponding posterior distribution. In this article, we propose a new class of Dirichlet--Laplace (DL) priors, which possess optimal posterior concentration and lead to efficient posterior computation exploiting results from normalized random measure theory. Finite sample performance of Dirichlet--Laplace priors relative to alternatives is assessed in simulated and real data examples.

Recommendations

• Sub-optimality of some continuous shrinkage priors
• Contraction properties of shrinkage priors in logistic regression
• Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
• Generalized double Pareto shrinkage
• Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors

Cited in

(only showing first 100 items - show all)

• A divide and conquer algorithm of Bayesian density estimation
• Prediction risk for the horseshoe regression
• The Bayesian group Lasso for confounded spatial data
• Minimaxity under the half-Cauchy prior
• A robust Bayesian analysis of variable selection under prior ignorance
• Adaptive Bayesian nonparametric regression using a kernel mixture of polynomials with application to partial linear models
• Structured Shrinkage Priors
• Neuronized Priors for Bayesian Sparse Linear Regression
• The R2D2 Prior for Generalized Linear Mixed Models
• Proximal MCMC for Bayesian Inference of Constrained and Regularized Estimation
• Optimal false discovery control of minimax estimators
• Model selection using mass-nonlocal prior
• Pseudo-R2D2 prior for high-dimensional ordinal regression
• Fast Markov Chain Monte Carlo for High-Dimensional Bayesian Regression Models With Shrinkage Priors
• Penalising model component complexity: a principled, practical approach to constructing priors
• Radio-iBAG: radiomics-based integrative Bayesian analysis of multiplatform genomic data
• Bayesian variable selection on structured logistic-normal mixture models for subgroup analysis
• Uncertainty quantification in Bayesian reduced-rank sparse regressions
• Spike and slab empirical Bayes sparse credible sets
• Shrinkage priors for Bayesian penalized regression
• Bayesian modeling of interaction between features in sparse multivariate count data with application to microbiome study
• A horseshoe mixture model for Bayesian screening with an application to light sheet fluorescence microscopy in brain imaging
• Generalized double Pareto shrinkage
• Addressing topic modelling via reduced latent space clustering
• A Projection Approach to Local Regression with Variable-Dimension Covariates
• Bayesian regression trees for high-dimensional prediction and variable selection
• Bayesian approaches to variable selection: a comparative study from practical perspectives
• Sparse Bayesian Group Factor Model for Feature Interactions in Multiple Count Tables Data
• Bayesian wavelet shrinkage with logistic prior
• Asymmetric Prior in Wavelet Shrinkage
• Compound Poisson processes, latent shrinkage priors and Bayesian nonconvex penalization
• Conditions for posterior contraction in the sparse normal means problem
• Predictive performance of Dirichlet process shrinkage methods in linear regression
• Wavelet shrinkage in nonparametric regression models with positive noise
• Projective inference in high-dimensional problems: prediction and feature selection
• Sub-optimality of some continuous shrinkage priors
• Efficient Sampling for Gaussian Linear Regression With Arbitrary Priors
• A conditional Bayesian approach with valid inference for high dimensional logistic regression
• A latent shrinkage position model for binary and count network data
• Modeling sparsity with super heavy-tailed priors
• Variable selection using Bayesian additive regression trees
• Bayesian estimation of sparse signals with a continuous spike-and-slab prior
• Bayesian approaches to variable selection in mixture models with application to disease clustering
• Prior distributions for objective Bayesian analysis
• Transport Monte Carlo: High-Accuracy Posterior Approximation via Random Transport
• Nearly optimal Bayesian shrinkage for high-dimensional regression
• Bayesian tensor regression
• The spike-and-slab LASSO
• Discussions
• Graph signal denoising using \(t\)-shrinkage priors
• Inference with normal-gamma prior distributions in regression problems
• A Bayesian approach to multi-task learning with network Lasso
• Skinny Gibbs: a consistent and scalable Gibbs sampler for model selection
• Bayesian deconvolution and quantification of metabolites from J-resolved NMR spectroscopy
• Scalable approximate MCMC algorithms for the horseshoe prior
• Frequentist conditional variance for nonlinear mixed-effects models
• Robust sparse Bayesian infinite factor models
• Spatial Shrinkage Via the Product Independent Gaussian Process Prior
• Bayesian neural networks for selection of drug sensitive genes
• Revisiting Jeffreys’ Example: Bayes Test of the Normal Mean
• Gradient-Based Markov Chain Monte Carlo for Bayesian Inference With Non-differentiable Priors
• Fast and accurate variational inference for large Bayesian VARs with stochastic volatility
• Bayesian semiparametric multivariate density deconvolution
• Contraction properties of shrinkage priors in logistic regression
• Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
• Empirical estimates for heteroscedastic hierarchical dynamic normal models
• A hybrid scan Gibbs sampler for Bayesian models with latent variables
• Locally adaptive smoothing with Markov random fields and shrinkage priors
• Optimal Gaussian approximations to the posterior for log-linear models with Diaconis-Ylvisaker priors
• Bayesian Factor Analysis for Inference on Interactions
• Local shrinkage rules, Lévy processes and regularized regression
• Bayesian factor-adjusted sparse regression
• Bayesian hierarchical modeling: application towards production results in the Eagle Ford Shale of South Texas
• Bayesian sparse convex clustering via global-local shrinkage priors
• Geometric ergodicity of Gibbs samplers for the horseshoe and its regularized variants
• Properties of the generalized inverse Gaussian with applications to Monte Carlo simulation and distribution function evaluation
• Using prior-data conflict to tune Bayesian regularized regression models
• Default Bayesian analysis with global-local shrinkage priors
• Intuitive joint priors for Bayesian linear multilevel models: the R2D2M2 prior
• Group inverse-gamma gamma shrinkage for sparse linear models with block-correlated regressors
• Sparse Bayesian inference on gamma-distributed observations using shape-scale inverse-gamma mixtures
• Non-parametric comparison and classification of two large-scale populations
• Bayesian Edge Regression in Undirected Graphical Models to Characterize Interpatient Heterogeneity in Cancer
• Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
• Prior knowledge elicitation: the past, present, and future
• Bayesian spatial and spatiotemporal models based on multiscale factorizations
• The how and why of Bayesian nonparametric causal inference
• Bayesian wavelet shrinkage with beta priors
• Shrinkage priors for single-spiked covariance models
• Correction
• Two-step mixed-type multivariate Bayesian sparse variable selection with shrinkage priors
• Tail-adaptive Bayesian shrinkage
• Comparison and contrast of two general functional regression modelling frameworks
• Large-scale multiple hypothesis testing with the normal-beta prime prior
• Bayesian bridge regression
• Bayesian MAP estimation using Gaussian and diffused-gamma prior
• EP-GIG priors and applications in Bayesian sparse learning
• Inducing Sparsity and Shrinkage in Time-Varying Parameter Models
• A sparse factor model for clustering high-dimensional longitudinal data
• Contraction of a quasi-Bayesian model with shrinkage priors in precision matrix estimation

This page was built for publication: Dirichlet-Laplace priors for optimal shrinkage

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5367461)