Posterior model consistency in variable selection as the model dimension grows
From MaRDI portal
(Redirected from Publication:254450)
Abstract: Most of the consistency analyses of Bayesian procedures for variable selection in regression refer to pairwise consistency, that is, consistency of Bayes factors. However, variable selection in regression is carried out in a given class of regression models where a natural variable selector is the posterior probability of the models. In this paper we analyze the consistency of the posterior model probabilities when the number of potential regressors grows as the sample size grows. The novelty in the posterior model consistency is that it depends not only on the priors for the model parameters through the Bayes factor, but also on the model priors, so that it is a useful tool for choosing priors for both models and model parameters. We have found that some classes of priors typically used in variable selection yield posterior model inconsistency, while mixtures of these priors improve this undesirable behavior. For moderate sample sizes, we evaluate Bayesian pairwise variable selection procedures by comparing their frequentist Type I and II error probabilities. This provides valuable information to discriminate between the priors for the model parameters commonly used for variable selection.
Recommendations
- Posterior consistency of \(g\)-prior for variable selection with a growing number of parameters
- Consistency of Bayesian procedures for variable selection
- Bayesian variable selection with shrinking and diffusing priors
- Consistency of objective Bayes factors as the model dimension grows
- On consistency and optimality of Bayesian variable selection based on \(g\)-prior in normal linear regression models
Cites work
- scientific article; zbMATH DE number 4070082 (Why is no real title available?)
- scientific article; zbMATH DE number 3716572 (Why is no real title available?)
- scientific article; zbMATH DE number 1034037 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 1124630 (Why is no real title available?)
- A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
- A comment on D. V. Lindley's statistical paradox
- An Intrinsic Limiting Procedure for Model Selection and Hypotheses Testing
- Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
- Bayesian model selection in high-dimensional settings
- Benchmark priors for Bayesian model averaging.
- Calibration and empirical Bayes variable selection
- Comparison of Bayesian objective procedures for variable selection in linear regression
- Consistency of Bayes factors for intrinsic priors in normal linear models
- Consistency of Bayesian procedures for variable selection
- Consistency of objective Bayes factors as the model dimension grows
- Consistency of objective Bayes factors for nonnested linear models and increasing model dimension
- Estimating the dimension of a model
- Flexible Empirical Bayes Estimation for Wavelets
- Is Bayes posterior just quick and dirty confidence?
- Mixtures of g Priors for Bayesian Variable Selection
- Model Selection and the Principle of Minimum Description Length
- Model uncertainty
- Multiple shrinkage and subset selection in wavelets
- Objective Bayesian Variable Selection
- Objective Testing Procedures in Linear Models: Calibration of the p‐values
- The Intrinsic Bayes Factor for Model Selection and Prediction
- The whetstone and the alum block: balanced objective Bayesian comparison of nested models for discrete data
Cited in
(22)- Consistency of Bayes factors under hyper g-priors with growing model size
- On consistency and optimality of Bayesian variable selection based on \(g\)-prior in normal linear regression models
- Bayesian and frequentist evidence in one-sided hypothesis testing
- Statistical Issues in Bayesian Meta-Analysis
- A hybrid deterministic-deterministic approach for high-dimensional Bayesian variable selection with a default prior
- Consistency of Bayesian procedures for variable selection
- The spike-and-slab LASSO
- Consistency of Bayes factor for nonnested model selection when the model dimension grows
- Bayes factor asymptotics for variable selection in the Gaussian process framework
- Posterior consistency of \(g\)-prior for variable selection with a growing number of parameters
- Posterior model probabilities via path‐based pairwise priors
- Consistency of Bayesian linear model selection with a growing number of parameters
- Cost-effectiveness analysis for heterogeneous samples
- Information consistency of the Jeffreys power-expected-posterior prior in Gaussian linear models
- On the Consistency of Bayesian Variable Selection for High Dimensional Binary Regression and Classification
- AN IN-DEPTH LOOK AT HIGHEST POSTERIOR MODEL SELECTION
- Objective Bayesian model choice for non-nested families: the case of the Poisson and the negative binomial
- Variable selection consistency of Gaussian process regression
- An exact approach to ridge regression for big data
- On posterior consistency in selection models
- Bayesian Model Selection in Additive Partial Linear Models Via Locally Adaptive Splines
- Consistency of objective Bayes factors as the model dimension grows
This page was built for publication: Posterior model consistency in variable selection as the model dimension grows
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q254450)
