Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC

DOI10.1007/S11222-016-9696-4zbMath1505.62408DBLPjournals/sac/VehtariGG17arXiv1507.04544OpenAlexW2203714058WikidataQ61703736 ScholiaQ61703736MaRDI QIDQ59366

Jonah Gabry, Andrew Gelman, Jonah Gabry, Aki Vehtari

Publication date: 30 August 2016

Published in: Statistics and Computing (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1507.04544

zbMATH Keywords

Bayesian computation \(K\)-fold cross-validation widely applicable information criterion (WAIC)leave-one-out cross-validation (LOO)Pareto smoothed importance sampling (PSIS)Stan

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Bayesian inference (62F15) Statistical aspects of information-theoretic topics (62B10)

Related Items (only showing first 100 items - show all)

Bayesian estimation of a flexible bifactor generalized partial credit model to survey data ⋮ Marginal Likelihood Computation for Model Selection and Hypothesis Testing: An Extensive Review ⋮ On the quantification of model uncertainty: a Bayesian perspective ⋮ Approximate leave-future-out cross-validation for Bayesian time series models ⋮ Quantifying conditional probability tables in Bayesian networks: Bayesian regression for scenario-based encoding of elicited expert assessments on feral pig habitat ⋮ Hierarchical Bayesian models of reinforcement learning: introduction and comparison to alternative methods ⋮ Monotonicity of rank order probabilities in signal detection models of simultaneous detection and identification ⋮ Information criteria and cross validation for Bayesian inference in regular and singular cases ⋮ Support provided by elderly in Italy: a hierarchical analysis of ego networks controlling for alter-overlapping ⋮ A Bayesian Approach to Envelope Quantile Regression ⋮ Semiparametric Regression for Dual Population Mortality ⋮ Bayesian structured antedependence model proposals for longitudinal data ⋮ Detecting and modeling changes in a time series of proportions ⋮ Bayesian mitigation of spatial coarsening for a Hawkes model applied to gunfire, wildfire and viral contagion ⋮ Using stacking to average Bayesian predictive distributions (with discussion) ⋮ Unnamed Item ⋮ Bayesian forecasting with a regime-switching zero-inflated multilevel Poisson regression model: an application to adolescent alcohol use with spatial covariates ⋮ Massive Parallelization Boosts Big Bayesian Multidimensional Scaling ⋮ Bayesian Variable Selection for Gaussian Copula Regression Models ⋮ Software defect prediction model based on distance metric learning ⋮ Bayesian inference for conditional copulas using Gaussian process single index models ⋮ Bayesian functional registration of fMRI activation maps ⋮ A flexible procedure for formulating probability distributions on the unit interval with applications ⋮ Bayesian mixed effects models for zero-inflated compositions in microbiome data analysis ⋮ Optimal group decision: a matter of confidence calibration ⋮ Bayesian inference and model comparison for metallic fatigue data ⋮ Bayesian Approaches to Shrinkage and Sparse Estimation ⋮ Model-based clustering of trends and cycles of nitrate concentrations in rivers across France ⋮ Generalized Bayes approach to inverse problems with model misspecification ⋮ A Bayesian spatial model for imaging genetics ⋮ The Dirichlet dual response model: an item response model for continuous bounded interval responses ⋮ Projective inference in high-dimensional problems: prediction and feature selection ⋮ Regression modelling with the tilted beta distribution: A Bayesian approach ⋮ Neuro-cognitive models of single-trial EEG measures describe latent effects of spatial attention during perceptual decision making ⋮ Disease mapping method comparing the spatial distribution of a disease with a control disease ⋮ History and nature of the Jeffreys-Lindley paradox ⋮ A Richards growth model to predict fruit weight ⋮ Multivariate Conway-Maxwell-Poisson Distribution: Sarmanov Method and Doubly Intractable Bayesian Inference ⋮ Bayesian analysis of first-order Markov models for autocorrelated binary responses ⋮ Performance of asymmetric links and correction methods for imbalanced data in binary regression ⋮ How close and how much? Linking health outcomes to built environment spatial distributions ⋮ Using reference models in variable selection ⋮ The role of passing network indicators in modeling football outcomes: an application using Bayesian hierarchical models ⋮ Hierarchical Bayes modelling of penalty conversion rates of bundesliga players ⋮ R-squared for Bayesian Regression Models ⋮ Parameter continuity in time-varying Gauss-Markov models for learning from small training data sets ⋮ An explanatory mixture <scp>IRT</scp> model for careless and insufficient effort responding in self‐report measures ⋮ Exploring examinees' responses to constructed response items with a supervised topic model ⋮ Bayesian clustering of spatial functional data with application to a human mobility study during COVID-19 ⋮ Extending RT-MPTs to enable equal process times ⋮ The leave-worst-\(k\)-out criterion for cross validation ⋮ Modeling COVID-19 pandemic using Bayesian analysis with application to Slovene data ⋮ Bayesian nonparametric quantile process regression and estimation of marginal quantile effects ⋮ The quantile probability model ⋮ Bayesian dynamic modelling to assess differential treatment effects on panic attack frequencies ⋮ Bayesian model selection in the \(\mathcal{M}\)-open setting -- approximate posterior inference and subsampling for efficient large-scale leave-one-out cross-validation via the difference estimator ⋮ Development of a novel computational model for the balloon analogue risk task: the exponential-weight mean-variance model ⋮ Inflection points in community-level homeless rates ⋮ Bayesian Non-Parametric Factor Analysis for Longitudinal Spatial Surfaces ⋮ Modelling publication bias and p-hacking ⋮ PARSIMONIOUS PARAMETERIZATION OF AGE-PERIOD-COHORT MODELS BY BAYESIAN SHRINKAGE ⋮ Practical Hilbert space approximate Bayesian Gaussian processes for probabilistic programming ⋮ Robustness against outliers: A new variance inflated regression model for proportions ⋮ Stochastic optimization with adaptive restart: a framework for integrated local and global learning ⋮ An extended two-stage sequential optimization approach: properties and performance ⋮ Probabilistic approach to limited-data computed tomography reconstruction ⋮ TriDimRegression ⋮ Efficient leave-one-out cross-validation for Bayesian non-factorized normal and Student-\(t\) models ⋮ A Bayesian model of microbiome data for simultaneous identification of covariate associations and prediction of phenotypic outcomes ⋮ Bayesian residual analysis for spatially correlated data ⋮ Bayesian cylindrical data modeling using Abe-Ley mixtures ⋮ Implicitly adaptive importance sampling ⋮ Bayesian Multivariate Distributional Regression With Skewed Responses and Skewed Random Effects ⋮ loo ⋮ A spatial mixed-effects regression model for electoral data ⋮ Bayesian spatial modeling for housing data in South Africa ⋮ Transfer of macroeconomic shocks in stress tests modeling ⋮ Detecting multiple random changepoints in Bayesian piecewise growth mixture models ⋮ Bayesian model-based clustering for longitudinal ordinal data ⋮ A Bayesian generalized explanatory item response model to account for learning during the test ⋮ A Bayesian time-varying effect model for behavioral mHealth data ⋮ Region-referenced spectral power dynamics of EEG signals: a hierarchical modeling approach ⋮ Estimating the stillbirth rate for 195 countries using a Bayesian sparse regression model with temporal smoothing ⋮ Bayesian multivariate sparse functional principal components analysis with application to longitudinal microbiome multiomics data ⋮ On outliers detection and prior distribution sensitivity in standard skew-probit regression models ⋮ Item response and response time model for personality assessment via linear ballistic accumulation ⋮ Joint modeling of distances and times in point-count surveys ⋮ A simple method for comparing complex models: Bayesian model comparison for hierarchical multinomial processing tree models using Warp-III bridge sampling ⋮ Bayesian comparison of latent variable models: conditional versus marginal likelihoods ⋮ A hierarchical Bayesian state trace analysis for assessing monotonicity while factoring out subject, item, and trial level dependencies ⋮ Modeling obesity rate with spatial auto-correlation: a case study ⋮ Bayesian mixture model of extended redundancy analysis ⋮ Bayesian hierarchical models for the prediction of volleyball results ⋮ The reliability factor: modeling individual reliability with multiple items from a single assessment ⋮ Prediction scoring of data-driven discoveries for reproducible research ⋮ A Bayesian approach to model individual differences and to partition individuals: case studies in growth and learning curves ⋮ Fundamental tools for developing likelihood functions within ACT-R ⋮ Extending exploratory diagnostic classification models: Inferring the effect of covariates ⋮ Longitudinal binary response models using alternative links for medical data ⋮ Bayesian inference and dynamic prediction for multivariate longitudinal and survival data

Uses Software

Cites Work

This page was built for publication: Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC