Geometric ergodicity of Gibbs samplers for the horseshoe and its regularized variants
From MaRDI portal
Publication:2136599
Abstract: The Horseshoe is a widely used and popular continuous shrinkage prior for high-dimensional Bayesian linear regression. Recently, regularized versions of the Horseshoe prior have also been introduced in the literature. Various Gibbs sampling Markov chains have been developed in the literature to generate approximate samples from the corresponding intractable posterior densities. Establishing geometric ergodicity of these Markov chains provides crucial technical justification for the accuracy of asymptotic standard errors for Markov chain based estimates of posterior quantities. In this paper, we establish geometric ergodicity for various Gibbs samplers corresponding to the Horseshoe prior and its regularized variants in the context of linear regression. First, we establish geometric ergodicity of a Gibbs sampler for the original Horseshoe posterior under strictly weaker conditions than existing analyses in the literature. Second, we consider the regularized Horseshoe prior introduced in Piironen and Vehtari (2017), and prove geometric ergodicity for a Gibbs sampling Markov chain to sample from the corresponding posterior without any truncation constraint on the global and local shrinkage parameters. Finally, we consider a variant of this regularized Horseshoe prior introduced in Nishimura and Suchard (2020), and again establish geometric ergodicity for a Gibbs sampling Markov chain to sample from the corresponding posterior.
Recommendations
- Geometric ergodicity for Bayesian shrinkage models
- Geometric ergodicity of Gibbs samplers in Bayesian penalized regression models
- Trace class Markov chains for Bayesian inference with generalized double Pareto shrinkage priors
- Sparsity information and regularization in the horseshoe and other shrinkage priors
- Geometric ergodicity of Gibbs samplers for Bayesian general linear mixed models with proper priors
Cites work
- Batch means and spectral variance estimators in Markov chain Monte Carlo
- Convergence of conditional Metropolis-Hastings samplers
- Dirichlet-Laplace priors for optimal shrinkage
- Fixed-Width Output Analysis for Markov Chain Monte Carlo
- Geometric ergodicity for Bayesian shrinkage models
- Geometric ergodicity of the Bayesian Lasso
- Gibbs sampling, exponential families and orthogonal polynomials
- Inverses of 2 2 block matrices
- Markov chains and de-initializing processes
- Markov chains and stochastic stability
- Minorization Conditions and Convergence Rates for Markov Chain Monte Carlo
- On the geometric ergodicity of Hamiltonian Monte Carlo
- On the half-Cauchy prior for a global scale parameter
- Scalable approximate MCMC algorithms for the horseshoe prior
- Sparsity information and regularization in the horseshoe and other shrinkage priors
- The horseshoe estimator for sparse signals
- Trace class Markov chains for Bayesian inference with generalized double Pareto shrinkage priors
Cited in
(7)- Geometric ergodicity for Bayesian shrinkage models
- On the Geometric Ergodicity of Metropolis-Hastings Algorithms for Lattice Gaussian Sampling
- Trace class Markov chains for Bayesian inference with generalized double Pareto shrinkage priors
- Horseshoe Priors for Edge-Preserving Linear Bayesian Inversion
- Exact Gibbs sampling for Bayesian GLMs using link functions of a novel form
- Two-step mixed-type multivariate Bayesian sparse variable selection with shrinkage priors
- Geometric ergodicity of Gibbs sampler for Bayesian linear regression with tail adaptive shrinkage
This page was built for publication: Geometric ergodicity of Gibbs samplers for the horseshoe and its regularized variants
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2136599)
