Improved Laplace approximation for marginal likelihoods

DOI10.1214/16-EJS1218MaRDI QIDQ502848zbMATH OpenOpenAlexFDO

Authors Erlis Ruli, N. Sartori, Laura Ventura

Publication date 11 January 2017

Published in Electronic Journal of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1502.06440, https://projecteuclid.org/euclid.ejs/1483002043

zbMATH Keywords

Bayes factornumerical integrationintegrated likelihoodasymptotic expansions for integralsconditional minimisationnormalising constant

Mathematics Subject Classification ID

Bayesian inference (62F15) Density estimation (62G07) Software, source code, etc. for problems pertaining to statistics (62-04) Generalized linear models (logistic models) (62J12)

Abstract: Statistical applications often involve the calculation of intractable multidimensional integrals. The Laplace formula is widely used to approximate such integrals. However, in high-dimensional or small sample size problems, the shape of the integrand function may be far from that of the Gaussian density, and thus the standard Laplace approximation can be inaccurate. We propose an improved Laplace approximation that reduces the asymptotic error of the standard Laplace formula by one order of magnitude, thus leading to third-order accuracy. We also show, by means of practical examples of various complexity, that the proposed method is extremely accurate, even in high dimensions, improving over the standard Laplace formula. Such examples also demonstrate that the accuracy of the proposed method is comparable with that of other existing methods, which are computationally more demanding. An R implementation of the improved Laplace approximation is also provided through the R package iLaplace available on CRAN.

Recommendations

• On a generalization of the Laplace approximation
• Publication:3359720
• Applications of Laplace’s method in Bayesian analysis and related topics
• scientific article; zbMATH DE number 774847
• scientific article; zbMATH DE number 795286

Cited in

(12)

• The reciprocal Bayesian Lasso
• Improving the INLA approach for approximate Bayesian inference for latent Gaussian models
• Ultra-Fast Approximate Inference Using Variational Functional Mixed Models
• A novel method of marginalisation using low discrepancy sequences for integrated nested Laplace approximations
• A new mixed‐effects regression model for the analysis of zero‐modified hierarchical count data
• On a generalization of the Laplace approximation
• ASYMPTOTIC LIKELIHOOD APPROXIMATIONS USING A PARTIAL LAPLACE APPROXIMATION
• Improved informative prior for the mixture of Laplace distribution under different loss functions
• Penalty parameter selection and asymmetry corrections to Laplace approximations in Bayesian P-splines models
• Laplace approximation in measurement error models
• Approximate Bayesian model inversion for PDEs with heterogeneous and state-dependent coefficients
• Some improvements to the Shenoy-Shafer and Hugin architectures for computing marginals

Describes a project that uses

Uses Software

• R
• CRAN
• JAGS
• iLaplace

This page was built for publication: Improved Laplace approximation for marginal likelihoods

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q502848)