Posterior model consistency in variable selection as the model dimension grows
From MaRDI portal
Abstract: Most of the consistency analyses of Bayesian procedures for variable selection in regression refer to pairwise consistency, that is, consistency of Bayes factors. However, variable selection in regression is carried out in a given class of regression models where a natural variable selector is the posterior probability of the models. In this paper we analyze the consistency of the posterior model probabilities when the number of potential regressors grows as the sample size grows. The novelty in the posterior model consistency is that it depends not only on the priors for the model parameters through the Bayes factor, but also on the model priors, so that it is a useful tool for choosing priors for both models and model parameters. We have found that some classes of priors typically used in variable selection yield posterior model inconsistency, while mixtures of these priors improve this undesirable behavior. For moderate sample sizes, we evaluate Bayesian pairwise variable selection procedures by comparing their frequentist Type I and II error probabilities. This provides valuable information to discriminate between the priors for the model parameters commonly used for variable selection.
Recommendations
- Posterior consistency of \(g\)-prior for variable selection with a growing number of parameters
- Consistency of Bayesian procedures for variable selection
- Bayesian variable selection with shrinking and diffusing priors
- Consistency of objective Bayes factors as the model dimension grows
- On consistency and optimality of Bayesian variable selection based on \(g\)-prior in normal linear regression models
Cites work
- scientific article; zbMATH DE number 4070082 (Why is no real title available?)
- scientific article; zbMATH DE number 3716572 (Why is no real title available?)
- scientific article; zbMATH DE number 1034037 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 1124630 (Why is no real title available?)
- A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
- A comment on D. V. Lindley's statistical paradox
- An Intrinsic Limiting Procedure for Model Selection and Hypotheses Testing
- Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
- Bayesian model selection in high-dimensional settings
- Benchmark priors for Bayesian model averaging.
- Calibration and empirical Bayes variable selection
- Comparison of Bayesian objective procedures for variable selection in linear regression
- Consistency of Bayes factors for intrinsic priors in normal linear models
- Consistency of Bayesian procedures for variable selection
- Consistency of objective Bayes factors as the model dimension grows
- Consistency of objective Bayes factors for nonnested linear models and increasing model dimension
- Estimating the dimension of a model
- Flexible Empirical Bayes Estimation for Wavelets
- Is Bayes posterior just quick and dirty confidence?
- Mixtures of g Priors for Bayesian Variable Selection
- Model Selection and the Principle of Minimum Description Length
- Model uncertainty
- Multiple shrinkage and subset selection in wavelets
- Objective Bayesian Variable Selection
- Objective Testing Procedures in Linear Models: Calibration of the p‐values
- The Intrinsic Bayes Factor for Model Selection and Prediction
- The whetstone and the alum block: balanced objective Bayesian comparison of nested models for discrete data
Cited in
(22)- Statistical Issues in Bayesian Meta-Analysis
- An exact approach to ridge regression for big data
- Consistency of objective Bayes factors as the model dimension grows
- Variable selection consistency of Gaussian process regression
- On the Consistency of Bayesian Variable Selection for High Dimensional Binary Regression and Classification
- Bayes factor asymptotics for variable selection in the Gaussian process framework
- On consistency and optimality of Bayesian variable selection based on \(g\)-prior in normal linear regression models
- Bayesian Model Selection in Additive Partial Linear Models Via Locally Adaptive Splines
- The spike-and-slab LASSO
- Consistency of Bayes factors under hyper \(g\)-priors with growing model size
- AN IN-DEPTH LOOK AT HIGHEST POSTERIOR MODEL SELECTION
- Information consistency of the Jeffreys power-expected-posterior prior in Gaussian linear models
- Consistency of Bayes factor for nonnested model selection when the model dimension grows
- On posterior consistency in selection models
- Consistency of Bayesian linear model selection with a growing number of parameters
- Bayesian and frequentist evidence in one-sided hypothesis testing
- Posterior model probabilities via path‐based pairwise priors
- Cost-effectiveness analysis for heterogeneous samples
- A hybrid deterministic-deterministic approach for high-dimensional Bayesian variable selection with a default prior
- Consistency of Bayesian procedures for variable selection
- Objective Bayesian model choice for non-nested families: the case of the Poisson and the negative binomial
- Posterior consistency of \(g\)-prior for variable selection with a growing number of parameters
This page was built for publication: Posterior model consistency in variable selection as the model dimension grows
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q254450)
