Sparsity information and regularization in the horseshoe and other shrinkage priors
From MaRDI portal
(Redirected from Publication:86320)
Abstract: The horseshoe prior has proven to be a noteworthy alternative for sparse Bayesian estimation, but has previously suffered from two problems. First, there has been no systematic way of specifying a prior for the global shrinkage hyperparameter based on the prior information about the degree of sparsity in the parameter vector. Second, the horseshoe prior has the undesired property that there is no possibility of specifying separately information about sparsity and the amount of regularization for the largest coefficients, which can be problematic with weakly identified parameters, such as the logistic regression coefficients in the case of data separation. This paper proposes solutions to both of these problems. We introduce a concept of effective number of nonzero parameters, show an intuitive way of formulating the prior for the global hyperparameter based on the sparsity assumptions, and argue that the previous default choices are dubious based on their tendency to favor solutions with more unshrunk parameters than we typically expect a priori. Moreover, we introduce a generalization to the horseshoe prior, called the regularized horseshoe, that allows us to specify a minimum level of regularization to the largest values. We show that the new prior can be considered as the continuous counterpart of the spike-and-slab prior with a finite slab width, whereas the original horseshoe resembles the spike-and-slab with an infinitely wide slab. Numerical experiments on synthetic and real world data illustrate the benefit of both of these theoretical advances.
Recommendations
- Inducing sparsity via the horseshoe prior in imaging problems
- Theoretical Guarantees for the Horseshoe and Other Global-Local Shrinkage Priors
- Bayesian Approaches to Shrinkage and Sparse Estimation
- The horseshoe estimator for sparse signals
- Some priors for sparse regression modelling
- Functional Horseshoe Priors for Subspace Shrinkage
- Dirichlet-Laplace priors for optimal shrinkage
- The horseshoe+ estimator of ultra-sparse signals
- Nonparametric sparsity and regularization
- Sparsity and the possibility of inference
Cited in
(only showing first 100 items - show all)- BHAFT: Bayesian heredity-constrained accelerated failure time models for detecting gene-environment interactions in survival analysis
- Global–local shrinkage multivariate logit-beta priors for multiple response-type data
- Model selection in Bayesian neural networks via horseshoe priors
- Estimating the stillbirth rate for 195 countries using a Bayesian sparse regression model with temporal smoothing
- Marginally calibrated response distributions for end-to-end learning in autonomous driving
- Using reference models in variable selection
- Variable selection for prediction in clinical research
- A seamless hybrid phase II/III design with Bayesian interim subgroup selection
- Extended beta models for poverty mapping. An application integrating survey and remote sensing data in Bangladesh
- Some priors for sparse regression modelling
- A global-local approach for detecting hotspots in multiple-response regression
- Inconsistency identification in network meta-analysis via stochastic search variable selection
- Modeling obesity rate with spatial auto-correlation: a case study
- Tree ensembles with rule structured horseshoe regularization
- Informative Bayesian neural network priors for weak signals
- Shrinkage with shrunken shoulders: Gibbs sampling shrinkage model posteriors with guaranteed convergence rates
- Locally Adaptive Shrinkage Priors for Trends and Breaks in Count Time Series
- Sparse Bayesian predictive modelling of tumour response using radiomic features
- Prediction risk for the horseshoe regression
- A Review of Data‐Driven Discovery for Dynamic Systems
- Neuronized Priors for Bayesian Sparse Linear Regression
- Bayesian joint modeling of multiple brain functional networks
- The horseshoe+ estimator of ultra-sparse signals
- Proximal MCMC for Bayesian Inference of Constrained and Regularized Estimation
- Joint mean-covariance estimation via the horseshoe
- Fast Bayesian inference on spectral analysis of multivariate stationary time series
- The horseshoe estimator: posterior concentration around nearly black vectors
- Variance prior forms for high-dimensional Bayesian variable selection
- Robust Bayesian nonparametric variable selection for linear regression
- Shrinkage priors for Bayesian penalized regression
- A horseshoe mixture model for Bayesian screening with an application to light sheet fluorescence microscopy in brain imaging
- Generalized double Pareto shrinkage
- Bayesian compositional generalized linear models for analyzing microbiome data
- The short-term dynamics of conflict-driven displacement: Bayesian modeling of disaggregated data from Somalia
- Mean field variational Bayes for continuous sparse signal shrinkage: pitfalls and remedies
- Bayesian approaches to variable selection: a comparative study from practical perspectives
- Projective inference in high-dimensional problems: prediction and feature selection
- Storvik, Palomares, Engebretsen, Rø, Engø-Monsen, Kristoffersen, De Blasio and Frigessi's reply to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Bhatt, Ferguson, Flaxman, Gandy, Mishra, and Scott's reply to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Jorge Mateu and Álvaro Briz-Redón's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Andrew B. Lawson's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Hans R. Künsch and Fabio Sigrist's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Sawitree Boonpatcharanon, Jane Heffernan and Hanna Jankowski's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Heejong Bong, Valerie Ventura and Larry Wasserman's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Alice Corbella, Anne M. Presanis, Paul J. Birrell and Daniela de Angelis's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Sanmitra Ghosh's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Paul J. Birrell, Angelos Alexopoulos and Daniela de Angelis's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Arun Chind's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Seconder of the vote of thanks and contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Proposer of the vote of thanks and contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
- Semi-mechanistic Bayesian modelling of COVID-19 with renewal processes
- Variable selection for high-dimensional incomplete data using horseshoe estimation with data augmentation
- A Dynamic Binary Probit Model with Time-Varying Parameters and Shrinkage Prior
- Bayesian Lesion Estimation with a Structured Spike-and-Slab Prior
- Screening Methods for Linear Errors-in-Variables Models in High Dimensions
- Locally time-varying parameter regression
- Bayesian approaches to variable selection in mixture models with application to disease clustering
- Prior distributions for objective Bayesian analysis
- Reversible Jump PDMP Samplers for Variable Selection
- Efficient estimation and correction of selection-induced bias with order statistics
- Bayesian deconvolution and quantification of metabolites from J-resolved NMR spectroscopy
- Scalable approximate MCMC algorithms for the horseshoe prior
- Projection predictive variable selection for discrete response families with finite support
- Efficient Posterior Sampling for Bayesian Poisson Regression
- Empirical Bayes inference in sparse high-dimensional generalized linear models
- Bayesian sparse convex clustering via global-local shrinkage priors
- Geometric ergodicity of Gibbs samplers for the horseshoe and its regularized variants
- The role of passing network indicators in modeling football outcomes: an application using Bayesian hierarchical models
- Default Bayesian analysis with global-local shrinkage priors
- Intuitive joint priors for Bayesian linear multilevel models: the R2D2M2 prior
- Advances in projection predictive inference
- Prior knowledge elicitation: the past, present, and future
- Bayesian semiparametric hidden Markov tensor models for time varying random partitions with local variable selection
- Dynamic graphical models with variable selection for effective connectivity
- Bayesian regularization: from Tikhonov to horseshoe
- Cauchy and other shrinkage priors for logistic regression in the presence of separation
- Mapping non-monetary poverty at multiple geographical scales
- The horseshoe estimator for sparse signals
- Tail-adaptive Bayesian shrinkage
- Ultimate Pólya Gamma Samplers–Efficient MCMC for Possibly Imbalanced Binary and Categorical Data
- On high-dimensional classification by sparse generalized Bayesian logistic regression
- A sparse Bayesian hierarchical vector autoregressive model for microbial dynamics in a wastewater treatment plant
- A fully Bayesian sparse polynomial chaos expansion approach with joint priors on the coefficients and global selection of terms
- Implicitly adaptive importance sampling
- Flexible Bayesian MIDAS: Time-Variation, Group-Shrinkage and Sparsity
- Default priors for the intercept parameter in logistic regressions
- Bayesian sparse estimation using double Lomax priors
- Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
- Bayesian hierarchical models with calibrated mixtures of g-priors for assessing treatment effect moderation in meta-analysis
- Scalable multiple network inference with the joint graphical horseshoe
- hsstan
- nestedcv
- Benchmarking sparse variable selection methods for genomic data analyses
- The horseshoe-like regularization for feature subset selection
- Empirical Bayesian inference using a support informed prior
- The Bayesian simulation study (BASIS) framework for simulation studies in statistical and methodological research
- The reciprocal Bayesian Lasso
- Horseshoe shrinkage methods for Bayesian fusion estimation
- Gibbs Sampling Using Anti-Correlation Gaussian Data Augmentation, with Applications to L1-Ball-Type Models
- Lasso meets horseshoe: a survey
This page was built for publication: Sparsity information and regularization in the horseshoe and other shrinkage priors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q86320)
