Fixed-form variational posterior approximation through stochastic linear regression

DOI10.1214/13-BA858zbMATH Open1329.62142arXiv1206.6679OpenAlexW3104819538MaRDI QIDQ908038FDOQ908038

Authors: Tim Salimans, David A. Knowles 

Publication date: 2 February 2016

Published in: Bayesian Analysis (Search for Journal in Brave)

Abstract: We propose a general algorithm for approximating nonstandard Bayesian posterior distributions. The algorithm minimizes the Kullback-Leibler divergence of an approximating distribution to the intractable posterior distribution. Our method can be used to approximate any posterior distribution, provided that it is given in closed form up to the proportionality constant. The approximation can be any distribution in the exponential family or any mixture of such distributions, which means that it can be made arbitrarily precise. Several examples illustrate the speed and accuracy of our approximation method in practice.

Full work available at URL: https://arxiv.org/abs/1206.6679

Recommendations

• Variational inference of linear regression with nonzero prior means
• On variational Bayes estimation and variational information criteria for linear regression models
• Variational Bayes for High-Dimensional Linear Regression With Sparse Priors
• Variational Bayesian approximation. A rigorous approach
• Variational Bayesian Inference for a Nonlinear Forward Model
• scientific article
• Variational Bayesian approximation for linear inverse problems with a hierarchical prior models
• Variational approximation for heteroscedastic linear models and matching pursuit algorithms
• Stochastic variational inference for scalable non-stationary Gaussian process regression

zbMATH Keywords

variational Bayesstochastic approximationapproximate inference

Mathematics Subject Classification ID

Bayesian inference (62F15) Linear regression; mixed models (62J05) Stochastic approximation (62L20)

Cited In (33)

• Conditionally structured variational Gaussian approximation with importance weights
• Monte Carlo gradient estimation in machine learning
• Variational Bayes with synthetic likelihood
• Likelihood-free inference in high dimensions with synthetic likelihood
• Fast Bayesian estimation of spatial count data models
• Tightening bounds for variational inference by revisiting perturbation theory
• Bayesian Deep Net GLM and GLMM
• Variational inferences for partially linear additive models with variable selection
• A stochastic variational framework for fitting and diagnosing generalized linear mixed models
• Correlated random measures
• Variational Hamiltonian Monte Carlo via score matching
• Fast and accurate variational inference for models with many latent variables
• Bayesian computation: a summary of the current state, and samples backwards and forwards
• Grid based variational approximations
• Very accurate posterior approximations based on finite mixtures of the hyperparameters condi\-tionals
• Variational inference for cutting feedback in misspecified models
• Title not available (Why is that?)
• Bayesian adaptive lasso with variational Bayes for variable selection in high-dimensional generalized linear mixed models
• Variational approximation for heteroscedastic linear models and matching pursuit algorithms
• Dynamical variational autoencoders: a comprehensive review
• Divergence measures and a general framework for local variational approximation
• Non-parametric sampling approximation via Voronoi tessellations
• Gaussian Variational Approximation With a Factor Covariance Structure
• Gaussian variational approximation with sparse precision matrices
• Nonasymptotic estimates for stochastic gradient Langevin dynamics under local conditions in nonconvex optimization
• A probabilistic approach to tomography and adjoint state methods, with an application to full waveform inversion in medical ultrasound
• High-Dimensional Copula Variational Approximation Through Transformation
• Gaussian variational approximations for high-dimensional state space models
• Checking for prior-data conflict using prior-to-posterior divergences
• Title not available (Why is that?)
• Stochastic variational inference for large-scale discrete choice models using adaptive batch sizes
• Variational Bayes Estimation of Discrete-Margined Copula Models With Application to Time Series
• Variational inference with NoFAS: normalizing flow with adaptive surrogate for computationally expensive models

This page was built for publication: Fixed-form variational posterior approximation through stochastic linear regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q908038)