Bayesian Trend Filtering via Proximal Markov Chain Monte Carlo
From MaRDI portal
Publication:6180725
Abstract: Proximal Markov Chain Monte Carlo is a novel construct that lies at the intersection of Bayesian computation and convex optimization, which helped popularize the use of nondifferentiable priors in Bayesian statistics. Existing formulations of proximal MCMC, however, require hyperparameters and regularization parameters to be prespecified. In this work, we extend the paradigm of proximal MCMC through introducing a novel new class of nondifferentiable priors called epigraph priors. As a proof of concept, we place trend filtering, which was originally a nonparametric regression problem, in a parametric setting to provide a posterior median fit along with credible intervals as measures of uncertainty. The key idea is to replace the nonsmooth term in the posterior density with its Moreau-Yosida envelope, which enables the application of the gradient-based MCMC sampler Hamiltonian Monte Carlo. The proposed method identifies the appropriate amount of smoothing in a data-driven way, thereby automating regularization parameter selection. Compared with conventional proximal MCMC methods, our method is mostly tuning free, achieving simultaneous calibration of the mean, scale and regularization parameters in a fully Bayesian framework. Supplementary materials for this article are available online.
Cites work
- scientific article; zbMATH DE number 3390139 (Why is no real title available?)
- $\ell_1$ Trend Filtering
- A first-order primal-dual algorithm for convex problems with applications to imaging
- A proximal Markov chain Monte Carlo method for Bayesian inference in imaging inverse problems: when Langevin meets Moreau
- A variable selection approach to monotonic regression with Bernstein polynomials
- Accelerating Proximal Markov Chain Monte Carlo by Using an Explicit Stabilized Method
- Adaptive piecewise polynomial estimation via trend filtering
- An algorithm for total variation minimization and applications
- Bayesian Isotonic Regression and Trend Analysis
- Bayesian analysis of shape-restricted functions using Gaussian process priors
- Bayesian estimation and inference for generalised partial linear models using shape-restricted splines
- Dynamic shrinkage processes
- Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau
- Exponential convergence of Langevin distributions and their discrete approximations
- First-order methods in optimization
- Fixed-point algorithms for inverse problems in science and engineering. Based on the presentations at the interdisciplinary workshop, BIRS, Banff, Canada, November 1--6, 2009.
- Gaussian Markov Random Fields
- Locally adaptive smoothing with Markov random fields and shrinkage priors
- MCMC using Hamiltonian dynamics
- Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. I: Methodology and experiments
- Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. II: Theoretical analysis
- Multivariate output analysis for Markov chain Monte Carlo
- Nearly unbiased variable selection under minimax concave penalty
- Nonlinear total variation based noise removal algorithms
- Proximal Markov chain Monte Carlo algorithms
- Sparsity and Smoothness Via the Fused Lasso
- Splines in higher order TV regularization
- The Bayesian Lasso
- The Split Bregman Method for L1-Regularized Problems
- The Support Reduction Algorithm for Computing Non‐Parametric Function Estimates in Mixture Models
- The horseshoe estimator for sparse signals
- The no-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
This page was built for publication: Bayesian Trend Filtering via Proximal Markov Chain Monte Carlo
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6180725)
