Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy

DOI10.1214/23-ss145arXiv2209.02439OpenAlexW4389062785MaRDI QIDQ6185714

Paul-Christian Bürkner, Maximilian Scholz, Stefan T. Radev

Publication date: 8 January 2024

Published in: Statistics Surveys (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2209.02439

zbMATH Keywords

Bayesian statisticsmachine learningmodel comparisonstatistical learningprobabilistic modeling

Mathematics Subject Classification ID

Bayesian problems; characterization of Bayes procedures (62C10) General considerations in statistical decision theory (62C05)

Cites Work

• Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
• Sparsity information and regularization in the horseshoe and other shrinkage priors
• The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
• Sensitivity analysis for Bayesian hierarchical models
• Weak informativity and the information in one prior relative to another
• Markov chain Monte Carlo estimation of quantiles
• Asymptotic behavior of global positive solution to a stochastic SIR model
• Bayesian inference with optimal maps
• Bayesianly justifiable and relevant frequency calculations for the applied statistician
• Markov chain Monte Carlo: can we trust the third significant figure?
• To explain or to predict?
• Causal inference in statistics: an overview
• MCMC-based local parametric sensitivity estimations
• Occam's razor
• Modeling by shortest data description
• Lyapunov characteristic exponents for smooth dynamical systems and for Hamiltonian systems; a method for computing all of them. I: Theory
• Multivariate adaptive regression splines
• Statistical modeling: The two cultures. (With comments and a rejoinder).
• Using stacking to average Bayesian predictive distributions (with discussion)
• Identifiability of structural characteristics: how relevant is it for the Bayesian approach?
• Bayesian estimation of agent-based models
• Chaotic dynamics in the seasonally forced SIR epidemic model
• A tutorial on bridge sampling
• J. B. S. Haldane's contribution to the Bayes factor hypothesis test
• Inference from iterative simulation using multiple sequences
• The Bernstein-von Mises theorem under misspecification
• A survey of Bayesian predictive methods for model assessment, selection and comparison
• Efficient leave-one-out cross-validation for Bayesian non-factorized normal and Student-\(t\) models
• Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods
• Implicitly adaptive importance sampling
• Rank-normalization, folding, and localization: an improved \(\widehat{R}\) for assessing convergence of MCMC (with Discussion)
• Graphical test for discrete uniformity and its applications in goodness-of-fit evaluation and multiple sample comparison
• Convergence rates of variational posterior distributions
• Theoretical and computational guarantees of mean field variational inference for community detection
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Explanation in artificial intelligence: insights from the social sciences
• Shrinkage priors for Bayesian penalized regression
• Comparison of Bayesian predictive methods for model selection
• Misspecification in infinite-dimensional Bayesian statistics
• Counting degrees of freedom in hierarchical and other richly-parameterised models
• Approximate Bayesian Inference for Latent Gaussian models by using Integrated Nested Laplace Approximations
• The Intrinsic Bayes Factor for Model Selection and Prediction
• Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review
• A Multiscale Strategy for Bayesian Inference Using Transport Maps
• Some Covariance Models for Longitudinal Count Data with Overdispersion
• On a Measure of the Information Provided by an Experiment
• The Analysis of Rates Using Poisson Regression Models
• Algebraic Geometry and Statistical Learning Theory
• Sequential Monte Carlo Samplers
• The horseshoe estimator for sparse signals
• Information About Hyperparamters in Hierarchical Models
• Likelihood and Bayesian Prediction of Chaotic Systems
• Cross-validation:a review²
• Numerical Optimization
• Sequential Imputations and Bayesian Missing Data Problems
• Integral Probability Metrics and Their Generating Classes of Functions
• Model Selection and the Principle of Minimum Description Length
• Gibbs Sampling
• Variance estimation in the particle filter
• Learning Summary Statistic for Approximate Bayesian Computation via Deep Neural Network
• Deterministic Nonperiodic Flow
• Approximated adjusted fractional Bayes factors: A general method for testing informative hypotheses
• Testing for a Finite Mixture Model with Two Components
• Thin Plate Regression Splines
• Gaussian Markov Random Fields
• Bayes Factors
• Approximate leave-future-out cross-validation for Bayesian time series models
• Robust Approximate Bayesian Inference With Synthetic Likelihood
• The frontier of simulation-based inference
• Theoretical Guarantees for the Horseshoe and Other Global-Local Shrinkage Priors
• Model Misspecification in Approximate Bayesian Computation: Consequences and Diagnostics
• A Survey on the Explainability of Supervised Machine Learning
• Constructing Priors that Penalize the Complexity of Gaussian Random Fields
• Effective degrees of freedom: a flawed metaphor
• Causal Inference for Statistics, Social, and Biomedical Sciences
• Statistical Models and Causal Inference
• Simple mathematical models with very complicated dynamics
• A General Framework for Updating Belief Distributions
• Default Bayesian analysis with global-local shrinkage priors
• Sequential Monte Carlo without likelihoods
• Probabilistic Forecasts, Calibration and Sharpness
• Advanced Lectures on Machine Learning
• Monte Carlo sampling methods using Markov chains and their applications
• Proper multivariate conditional autoregressive models for spatial data analysis
• Parameterization and Bayesian Modeling
• Wide neural networks of any depth evolve as linear models under gradient descent ^*
• R-squared for Bayesian Regression Models
• Expert Knowledge Elicitation: Subjective but Scientific
• An Invitation to Sequential Monte Carlo Samplers
• Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
• Superstatistics
• Checking for prior-data conflict
• Horseshoe Regularisation for Machine Learning in Complex and Deep Models¹
• Using reference models in variable selection
• A fully Bayesian sparse polynomial chaos expansion approach with joint priors on the coefficients and global selection of terms
• Intuitive joint priors for Bayesian linear multilevel models: the R2D2M2 prior
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item