Compatibility of prior specifications across linear models

DOI10.1214/08-STS258MaRDI QIDQ908147zbMATH OpenFDO

Authors Guido Consonni, Piero Veronese

Publication date 3 February 2016

Published in Statistical Science (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1102.2981, https://projecteuclid.org/euclid.ss/1233153062

zbMATH Keywords

variable selectionhypothesis testingBayes factorconjugate prior\(g\)-priornested modelcompatible priorKullback-Leibler projection

Mathematics Subject Classification ID

Bayesian inference (62F15) Analysis of variance and covariance (ANOVA) (62J10) Bayesian problems; characterization of Bayes procedures (62C10)

Abstract: Bayesian model comparison requires the specification of a prior distribution on the parameter space of each candidate model. In this connection two concerns arise: on the one hand the elicitation task rapidly becomes prohibitive as the number of models increases; on the other hand numerous prior specifications can only exacerbate the well-known sensitivity to prior assignments, thus producing less dependable conclusions. Within the subjective framework, both difficulties can be counteracted by linking priors across models in order to achieve simplification and compatibility; we discuss links with related objective approaches. Given an encompassing, or full, model together with a prior on its parameter space, we review and summarize a few procedures for deriving priors under a submodel, namely marginalization, conditioning, and Kullback--Leibler projection. These techniques are illustrated and discussed with reference to variable selection in linear models adopting a conventional $g$-prior; comparisons with existing standard approaches are provided. Finally, the relative merits of each procedure are evaluated through simulated and real data sets.

Recommendations

• Joint specification of model space and parameter space prior distributions
• Compatible priors for Bayesian model comparison with an application to the Hardy-Weinberg equilibrium model
• Bayesian model selection using encompassing priors
• Benchmark priors for Bayesian model averaging.
• Expected-posterior prior distributions for model selection

Cites work

• scientific article; zbMATH DE number 3885090 (Why is no real title available?)
• scientific article; zbMATH DE number 3886886 (Why is no real title available?)
• scientific article; zbMATH DE number 3874435 (Why is no real title available?)
• scientific article; zbMATH DE number 4211299 (Why is no real title available?)
• scientific article; zbMATH DE number 4070082 (Why is no real title available?)
• scientific article; zbMATH DE number 4098509 (Why is no real title available?)
• scientific article; zbMATH DE number 3716572 (Why is no real title available?)
• scientific article; zbMATH DE number 720686 (Why is no real title available?)
• scientific article; zbMATH DE number 1034042 (Why is no real title available?)
• scientific article; zbMATH DE number 1865509 (Why is no real title available?)
• A Bayesian approach to selecting covariates for prediction
• Assessing robustness of intrinsic tests of independence in two-way contingency tables
• Bayes factors for nonlinear hypotheses and likelihood distributions
• Bayesian Hypothesis Testing: A Reference Approach
• Bayesian Model Averaging for Linear Regression Models
• Bayesian thinking, modeling and computation.
• Benchmark priors for Bayesian model averaging.
• Calibration and empirical Bayes variable selection
• Comparison of Bayesian objective procedures for variable selection in linear regression
• Compatible Prior Distributions for Directed Acyclic Graph Models
• Compatible priors for Bayesian model comparison with an application to the Hardy-Weinberg equilibrium model
• Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
• Expected-posterior prior distributions for model selection
• Extending conventional priors for testing general hypotheses in linear models
• Mixtures of g Priors for Bayesian Variable Selection
• Model choice in generalised linear models: a Bayesian approach via Kullback-Leibler projections
• Model choice: a minimum posterior predictive loss approach
• Model uncertainty
• Nonparametric regression using Bayesian variable selection
• Objective Bayesian Variable Selection
• Optimal predictive model selection.
• Parsimonious estimation of multiplicative interaction in analysis of variance using Kullback-Leibler information
• Prediction Via Orthogonalized Model Mixing
• Predictive specification of prior model probabilities in variable selection
• Statistical Models
• Tests based on intrinsic priors for the equality of two correlated proportions
• The Intrinsic Bayes Factor for Model Selection and Prediction
• The Variable Selection Problem
• The Weighted Likelihood Ratio, Linear Hypotheses on Normal Location Parameters
• Training samples in objective Bayesian model selection.
• Variable selection in qualitative models via an entropic explanatory power

Cited in

(33)

• Power-Expected-Posterior Methodology with Baseline Shrinkage Priors
• Objective methods for graphical structural learning
• Penalising model component complexity: a principled, practical approach to constructing priors
• Compatible priors for model selection of high-dimensional Gaussian DAGs
• Joint specification of model space and parameter space prior distributions
• On consistency and optimality of Bayesian variable selection based on \(g\)-prior in normal linear regression models
• Power-expected-posterior priors for variable selection in Gaussian linear models
• Nonparametric Bayes classification and hypothesis testing on manifolds
• Bayesian sample size determination for causal discovery
• Prior distributions for objective Bayesian analysis
• Bayesian effect estimation accounting for adjustment uncertainty
• An encompassing prior generalization of the Savage-Dickey density ratio
• Learning Markov equivalence classes of directed acyclic graphs: an objective Bayes approach
• Power-expected-posterior priors for generalized linear models
• Priors via imaginary training samples of sufficient statistics for objective Bayesian hypothesis testing
• Objective Bayesian comparison of constrained analysis of variance models
• An evaluation of alternative methods for testing hypotheses, from the perspective of Harold Jeffreys
• On the correspondence from Bayesian log-linear modelling to logistic regression modelling with g-priors
• Bayesian model comparison based on expected posterior priors for discrete decomposable graphical models
• On resolving the Savage-Dickey paradox
• On the invariance of conditioning procedures for the specification of prior distributions for nested DAG models
• Information consistency of the Jeffreys power-expected-posterior prior in Gaussian linear models
• Compatible priors for Bayesian model comparison with an application to the Hardy-Weinberg equilibrium model
• A Generalization of the Savage–Dickey Density Ratio for Testing Equality and Order Constrained Hypotheses
• Shrinkage priors via random imaginary data
• Conjugate and conditional conjugate Bayesian analysis of discrete graphical models of marginal independence
• Objective Bayesian comparison of order-constrained models in contingency tables
• A comparison of power-expected-posterior priors in shrinkage regression
• Objective Bayesian transformation and variable selection using default Bayes factors
• Bayesian estimation and hypothesis tests for a circular generalized linear model
• A general approach to prior transformation
• Power-expected-posterior priors as mixtures of \(g\)-priors in normal linear models
• A general approximation to nested Bayes factors with informed priors

This page was built for publication: Compatibility of prior specifications across linear models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q908147)