A New Framework for Variance-Reduced Hamiltonian Monte Carlo

MaRDI QIDQ6360176zbMATH OpenFDO

Authors Zhengmian Hu, Feihu Huang, Heng Huang

Publication date 8 February 2021

Abstract: We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an $L$-smooth and $m$-strongly log-concave distribution, based on a unified formulation of biased and unbiased variance reduction methods. We study the convergence properties for HMC with gradient estimators which satisfy the Mean-Squared-Error-Bias (MSEB) property. We show that the unbiased gradient estimators, including SAGA and SVRG, based HMC methods achieve highest gradient efficiency with small batch size under high precision regime, and require $ildeO(N+kapp{a}^2{d}^{frac12}varepsilo{n}^{-1}+N^{frac23}kapp{a}^{frac43}{d}^{frac13}varepsilo{n}^{-frac23})$ gradient complexity to achieve $epsilon$-accuracy in 2-Wasserstein distance. Moreover, our HMC methods with biased gradient estimators, such as SARAH and SARGE, require $ildeO(N+sqrtNkapp{a}^2{d}^{frac12}varepsilo{n}^{-1})$ gradient complexity, which has the same dependency on condition number $kappa$ and dimension $d$ as full gradient method, but improves the dependency of sample size $N$ for a factor of $N^{f}rac12$. Experimental results on both synthetic and real-world benchmark data show that our new framework significantly outperforms the full gradient and stochastic gradient HMC approaches. The earliest version of this paper was submitted to ICML 2020 with three weak accept but was not finally accepted.

This page was built for publication: A New Framework for Variance-Reduced Hamiltonian Monte Carlo

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6360176)