Bayesian Trend Filtering via Proximal Markov Chain Monte Carlo

DOI10.1080/10618600.2023.2170089arXiv2201.00092OpenAlexW4319836241MaRDI QIDQ6180725FDOQ6180725

Authors: Hua Zhou, Eric C. Chi 

Publication date: 22 January 2024

Published in: Journal of Computational and Graphical Statistics (Search for Journal in Brave)

Abstract: Proximal Markov Chain Monte Carlo is a novel construct that lies at the intersection of Bayesian computation and convex optimization, which helped popularize the use of nondifferentiable priors in Bayesian statistics. Existing formulations of proximal MCMC, however, require hyperparameters and regularization parameters to be prespecified. In this work, we extend the paradigm of proximal MCMC through introducing a novel new class of nondifferentiable priors called epigraph priors. As a proof of concept, we place trend filtering, which was originally a nonparametric regression problem, in a parametric setting to provide a posterior median fit along with credible intervals as measures of uncertainty. The key idea is to replace the nonsmooth term in the posterior density with its Moreau-Yosida envelope, which enables the application of the gradient-based MCMC sampler Hamiltonian Monte Carlo. The proposed method identifies the appropriate amount of smoothing in a data-driven way, thereby automating regularization parameter selection. Compared with conventional proximal MCMC methods, our method is mostly tuning free, achieving simultaneous calibration of the mean, scale and regularization parameters in a fully Bayesian framework. Supplementary materials for this article are available online.

Full work available at URL: https://arxiv.org/abs/2201.00092

zbMATH Keywords

convex optimizationHamiltonian Monte Carlotrend filteringepigraphsMoreau-Yosida envelope

Mathematics Subject Classification ID

Statistics (62-XX)

Cites Work

• MCMC using Hamiltonian dynamics
• Gaussian Markov Random Fields
• Nearly unbiased variable selection under minimax concave penalty
• Nonlinear total variation based noise removal algorithms
• The no-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Exponential convergence of Langevin distributions and their discrete approximations
• Adaptive piecewise polynomial estimation via trend filtering
• The horseshoe estimator for sparse signals
• The Bayesian Lasso
• Sparsity and Smoothness Via the Fused Lasso
• Multivariate output analysis for Markov chain Monte Carlo
• First-order methods in optimization
• Bayesian Isotonic Regression and Trend Analysis
• The Split Bregman Method for L1-Regularized Problems
• $\ell_1$ Trend Filtering
• A variable selection approach to monotonic regression with Bernstein polynomials
• The Support Reduction Algorithm for Computing Non‐Parametric Function Estimates in Mixture Models
• Title not available (Why is that?)
• An algorithm for total variation minimization and applications
• A first-order primal-dual algorithm for convex problems with applications to imaging
• Bayesian analysis of shape-restricted functions using Gaussian process priors
• Bayesian estimation and inference for generalised partial linear models using shape-restricted splines
• Fixed-point algorithms for inverse problems in science and engineering. Based on the presentations at the interdisciplinary workshop, BIRS, Banff, Canada, November 1--6, 2009.
• Splines in higher order TV regularization
• Accelerating Proximal Markov Chain Monte Carlo by Using an Explicit Stabilized Method
• Locally adaptive smoothing with Markov random fields and shrinkage priors
• Proximal Markov chain Monte Carlo algorithms
• Dynamic shrinkage processes
• Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau
• Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. I: Methodology and experiments
• Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. II: Theoretical analysis
• A proximal Markov chain Monte Carlo method for Bayesian inference in imaging inverse problems: when Langevin meets Moreau

Cited In (1)

• Bayesian boundary trend filtering

This page was built for publication: Bayesian Trend Filtering via Proximal Markov Chain Monte Carlo

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6180725)