Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation
From MaRDI portal
Publication:2058738
Abstract: Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric empirical Bayesian estimation. Combined with Markov chain Monte Carlo algorithms, these stochastic optimisation methods have been successfully applied to a wide range of problems in science and industry. However, this strategy scales poorly to large problems because of methodological and theoretical difficulties related to using high-dimensional Markov chain Monte Carlo algorithms within a stochastic approximation scheme. This paper proposes to address these difficulties by using unadjusted Langevin algorithms to construct the stochastic approximation. This leads to a highly efficient stochastic optimisation methodology with favourable convergence properties that can be quantified explicitly and easily checked. The proposed methodology is demonstrated with three experiments, including a challenging application to high-dimensional statistical audio analysis and a sparse Bayesian logistic regression with random effects problem.
Recommendations
- Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. II: Theoretical analysis
- Proximal Markov chain Monte Carlo algorithms
- High-dimensional Bayesian inference via the unadjusted Langevin algorithm
- Trajectory averaging for stochastic approximation MCMC algorithms
- Analysis of Langevin Monte Carlo via convex optimization
Cites work
- scientific article; zbMATH DE number 1713116 (Why is no real title available?)
- scientific article; zbMATH DE number 46578 (Why is no real title available?)
- scientific article; zbMATH DE number 48727 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 1972910 (Why is no real title available?)
- scientific article; zbMATH DE number 2107836 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- A Stochastic Approximation Method
- Adaptive subgradient methods for online learning and stochastic optimization
- An introduction to continuous optimization for imaging
- Bayesian Inference for Logistic Models Using Pólya–Gamma Latent Variables
- Bayesian and frequentist regression methods
- Compressive sampling
- Consistency and fluctuations for stochastic gradient Langevin dynamics
- Convergence of Langevin MCMC in KL-divergence
- Convergence of a stochastic approximation version of the EM algorithm
- Convergence of adaptive and interacting Markov chain Monte Carlo algorithms
- Convergence of the Monte Carlo expectation maximization for curved exponential families.
- Couplings and quantitative contraction rates for Langevin dynamics
- Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau
- Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation
- Empirical Bayes: Past, Present and Future
- Exploration of the (non-)asymptotic bias and variance of stochastic gradient Langevin dynamics
- Exponential convergence of Langevin distributions and their discrete approximations
- Geometric ergodicity of Metropolis algorithms
- Handbook of computational statistics. Concepts and methods.
- Handbook of convex optimization methods in imaging science
- Irreducibility and geometric ergodicity of Hamiltonian Monte Carlo
- Is there an analog of Nesterov acceleration for gradient-based MCMC?
- Markov Chains
- Markov chains for exploring posterior distributions. (With discussion)
- Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. I: Methodology and experiments
- Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. II: Theoretical analysis
- Nonasymptotic convergence analysis for the unadjusted Langevin algorithm
- On perturbed proximal gradient algorithms
- On sampling from a log-concave density using kinetic Langevin diffusions
- On the ergodicity properties of some adaptive MCMC algorithms
- Problems and theorems in analysis. I. Series, integral calculus, theory of functions. Transl. from the German by Dorothee Aeppli
- Quantitative contraction rates for Markov chains on general state spaces
- Reflection couplings and contraction rates for diffusions
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Robust Stochastic Approximation Approach to Stochastic Programming
- Stability of Markovian processes I: criteria for discrete-time Chains
- Theoretical Guarantees for Approximate Sampling from Smooth and Log-Concave Densities
- Yet Another Look at Harris’ Ergodic Theorem for Markov Chains
Cited in
(7)- Hybrid unadjusted Langevin methods for high-dimensional latent variable models
- Marginal likelihood estimation in semiblind image deconvolution: a stochastic approximation approach
- Cost free hyper-parameter selection/averaging for Bayesian inverse problems with vanilla and Rao-blackwellized SMC samplers
- The Split Gibbs Sampler Revisited: Improvements to Its Algorithmic Structure and Augmented Target Distribution
- Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. II: Theoretical analysis
- Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation
- Maximum entropy methods for texture synthesis: theory and practice
This page was built for publication: Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2058738)
