A Diffusion Process Perspective on Posterior Contraction Rates for Parameters

arXiv1909.00966MaRDI QIDQ6324573FDOQ6324573

Authors: Wenlong Mou, Nhat Ho, Martin J. Wainwright, Peter L. Bartlett, Michael Jordan 

Publication date: 3 September 2019

Abstract: We analyze the posterior contraction rates of parameters in Bayesian models via the Langevin diffusion process, in particular by controlling moments of the stochastic process and taking limits. Analogous to the non-asymptotic analysis of statistical M-estimators and stochastic optimization algorithms, our contraction rates depend on the structure of the population log-likelihood function, and stochastic perturbation bounds between the population and sample log-likelihood functions. Convergence rates are determined by a non-linear equation that relates the population-level structure to stochastic perturbation terms, along with a term characterizing the diffusive behavior. Based on this technique, we also prove non-asymptotic versions of a Bernstein-von-Mises guarantee for the posterior. We illustrate this general theory by deriving posterior convergence rates for various concrete examples, as well as approximate posterior distributions computed using Langevin sampling procedures.

This page was built for publication: A Diffusion Process Perspective on Posterior Contraction Rates for Parameters

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6324573)