Gaussian variational approximation with sparse precision matrices
From MaRDI portal
(Redirected from Publication:1702005)
Abstract: We consider the problem of learning a Gaussian variational approximation to the posterior distribution for a high-dimensional parameter, where we impose sparsity in the precision matrix to reflect appropriate conditional independence structure in the model. Incorporating sparsity in the precision matrix allows the Gaussian variational distribution to be both flexible and parsimonious, and the sparsity is achieved through parameterization in terms of the Cholesky factor. Efficient stochastic gradient methods which make appropriate use of gradient information for the target distribution are developed for the optimization. We consider alternative estimators of the stochastic gradients which have lower variation and are more stable. Our approach is illustrated using generalized linear mixed models and state space models for time series.
Recommendations
- Conditionally structured variational Gaussian approximation with importance weights
- The Variational Gaussian Approximation Revisited
- The limited-memory recursive variational Gaussian approximation (L-RVGA)
- Bayesian structure learning in graphical models
- Asymptotic normality and valid inference for Gaussian variational approximation
Cites work
- scientific article; zbMATH DE number 6377992 (Why is no real title available?)
- A Stochastic Approximation Method
- A new approach to Cholesky-based covariance regularization in high dimensions
- A stochastic variational framework for fitting and diagnosing generalized linear mixed models
- Adaptive subgradient methods for online learning and stochastic optimization
- An introduction to variational methods for graphical models
- Applied logistic regression
- Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations (with discussion)
- Approximate Inference in Generalized Linear Mixed Models
- Approximate dynamic programming. Solving the curses of dimensionality
- Automatic differentiation variational inference
- Explaining variational approximations
- Fixed-form variational posterior approximation through stochastic linear regression
- Gaussian Kullback-Leibler approximate inference
- Introduction to Stochastic Search and Optimization
- Maximizing Generalized Linear Mixed Model Likelihoods With an Automated Monte Carlo EM Algorithm
- Multivariate Stochastic Variance Models
- Pattern recognition and machine learning.
- Semiparametric mean field variational Bayes: general principles and numerical issues
- Some Covariance Models for Longitudinal Count Data with Overdispersion
- Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models
- Streamlined mean field variational Bayes for longitudinal and multilevel data analysis
- The Variational Gaussian Approximation Revisited
- Time series analysis by state space methods.
- Variational inference for generalized linear mixed models using partially noncentered parametrizations
- Variational message passing
Cited in
(54)- Conditionally structured variational Gaussian approximation with importance weights
- Variational Bayes with synthetic likelihood
- Bayesian computational methods for state-space models with application to SIR model
- Variational inference for high dimensional structured factor copulas
- The Variational Gaussian Approximation Revisited
- Flexible Variational Bayes Based on a Copula of a Mixture
- Variational Inference based on a Subclass of Closed Skew Normals
- Structured Variational Approximations with Skew Normal Decomposable Graphical Models and Implicit Copulas
- Variational Bayes for Fast and Accurate Empirical Likelihood Inference
- R-VGAL: a sequential variational Bayes algorithm for generalised linear mixed models
- Generalized Sparse Precision Matrix Selection for Fitting Multivariate Gaussian Random Fields to Large Data Sets
- Bayesian Deep Net GLM and GLMM
- Variational Bayes inference for simultaneous autoregressive models with missing data
- An integrated FIR adaptive filter design by hybridizing canonical signed digit (CSD) and approximate booth recode (ABR) algorithm in DA architecture for the reduction of noise in the sensor nodes
- Efficient Importance Variational Approximations for State Space Models
- Variational approximation for heteroscedastic linear models and matching pursuit algorithms
- Stochastic variational inference for GARCH models
- On coregionalized multivariate Gaussian Markov random fields: construction, parameterization, and Bayesian estimation and inference
- Accelerated Bayesian kernel machine regression: a Gaussian variational approximation with the horseshoe prior
- Recursive variational Gaussian approximation with the Whittle likelihood for linear non-Gaussian state space models
- Authors' reply to the discussion of: ``Extreme-value modelling of migratory bird arrival dates: insights from citizen-science data
- Authors' reply to the discussion of ``Frequentist prediction sets for species abundance using indirect information at the `Discussion meeting on the analysis of citizen science data'
- Authors' reply to the discussion of: ``Efficient statistical inference methods for assessing changes in species' populations using citizen science data at the `Discussion meeting on the analysis of citizen science data'
- Maozai Tian's contribution to the discussion of the `Discussion meeting on the analysis of citizen science data'
- Stefano Rizzelli's contribution to the discussion of the `Discussion meeting on the analysis of citizen science data'
- Allan Reese's contribution to the discussion of the `Discussion meeting on the analysis of citizen science data'
- Subhash Lele's contribution to the discussion of `The discussion meeting on the analysis of citizen science data'
- Kuldeep Kumar's contribution to the discussion of `The discussion meeting on the analysis of citizen science data'
- Raphaël Huser and Andrew Zammit-Mangion's contribution to the discussion of the `Discussion meeting on the analysis of citizen science data'
- Dani Gamerman's contribution to the discussion of `The discussion meeting on the analysis of citizen science data'
- Abdelaati daouia and gilles Stupfler's contribution to the discussion of the `Discussion meeting on the analysis of citizen science data'
- Léo R. Belzile and Rishikesh Yadav's contribution to the discussion of `The discussion meeting on the analysis of citizen science data'
- Jafet Belmont, Sara Martino, Janine Illian, and Håvard Rue's contribution to the discussion of the `Discussion meeting on the analysis of citizen science data'
- Benjamin R. Baer's contribution to the discussion of `The discussion meeting on analysis of citizen science data'
- Andrej Srakar's contribution to the discussion of `The discussion meeting on the analysis of citizen science data'
- Seconder of the vote of thanks and contribution to the discussion of `the discussion meeting on the analysis of citizen science data'
- Proposer of the vote of thanks and contribution to the discussion of the `Discussion meeting on the analysis of citizen science data'
- Extreme-value modelling of migratory bird arrival dates: insights from citizen science data
- Frequentist prediction sets for species abundance using indirect information
- Efficient statistical inference methods for assessing changes in species' populations using citizen science data
- Gaussian Variational Approximation With a Factor Covariance Structure
- Cutting Feedback in Misspecified Copula Models
- The limited-memory recursive variational Gaussian approximation (L-RVGA)
- Updating variational Bayes: fast sequential posterior inference
- Implementation and analysis of GPU algorithms for Vecchia approximation
- Analytic natural gradient updates for Cholesky factor in Gaussian variational approximation
- Partially factorized variational inference for high-dimensional mixed models
- Deep Compositional Spatial Models
- Bayesian Variational Inference for Exponential Random Graph Models
- High-Dimensional Copula Variational Approximation Through Transformation
- Gaussian variational approximations for high-dimensional state space models
- Variational Bayesian approximation of inverse problems using sparse precision matrices
- Variational Bayes Estimation of Discrete-Margined Copula Models With Application to Time Series
- A variational inference for the Lévy adaptive regression with multiple kernels
This page was built for publication: Gaussian variational approximation with sparse precision matrices
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1702005)
