Consistency of Bayesian procedures for variable selection
From MaRDI portal
Abstract: It has long been known that for the comparison of pairwise nested models, a decision based on the Bayes factor produces a consistent model selector (in the frequentist sense). Here we go beyond the usual consistency for nested pairwise models, and show that for a wide class of prior distributions, including intrinsic priors, the corresponding Bayesian procedure for variable selection in normal regression is consistent in the entire class of normal linear models. We find that the asymptotics of the Bayes factors for intrinsic priors are equivalent to those of the Schwarz (BIC) criterion. Also, recall that the Jeffreys--Lindley paradox refers to the well-known fact that a point null hypothesis on the normal mean parameter is always accepted when the variance of the conjugate prior goes to infinity. This implies that some limiting forms of proper prior distributions are not necessarily suitable for testing problems. Intrinsic priors are limits of proper prior distributions, and for finite sample sizes they have been proved to behave extremely well for variable selection in regression; a consequence of our results is that for intrinsic priors Lindley's paradox does not arise.
Recommendations
- Consistency of Bayes factors for intrinsic priors in normal linear models
- Posterior model consistency in variable selection as the model dimension grows
- Consistency of objective Bayes factors as the model dimension grows
- On Model Selection Consistency of Bayesian Method for Normal Linear Models
- Objective Bayesian Variable Selection
Cites work
- scientific article; zbMATH DE number 6114083 (Why is no real title available?)
- scientific article; zbMATH DE number 3863589 (Why is no real title available?)
- scientific article; zbMATH DE number 1034037 (Why is no real title available?)
- scientific article; zbMATH DE number 1865509 (Why is no real title available?)
- scientific article; zbMATH DE number 777884 (Why is no real title available?)
- scientific article; zbMATH DE number 5196684 (Why is no real title available?)
- scientific article; zbMATH DE number 3273020 (Why is no real title available?)
- A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
- An Intrinsic Limiting Procedure for Model Selection and Hypotheses Testing
- BINOMIAL SAMPLING SCHEMES AND THE CONCEPT OF INFORMATION
- Consistency of Bayes factors for intrinsic priors in normal linear models
- Erratum: Comparison of Bayesian objective procedures for variable selection in linear regression
- Estimating the dimension of a model
- Objective Bayesian Variable Selection
- Objective Testing Procedures in Linear Models: Calibration of the p‐values
- On the consistency of Bayes estimates
- The Intrinsic Bayes Factor for Model Selection and Prediction
- Training samples in objective Bayesian model selection.
Cited in
(53)- Bayesian hypothesis testing for Gaussian graphical models: conditional independence and order constraints
- Bayes variable selection in semiparametric linear models
- Bayesian high-dimensional screening via MCMC
- Using random subspace method for prediction and variable importance assessment in linear regression
- Power-expected-posterior priors for variable selection in Gaussian linear models
- A consistent on‐line Bayesian procedure for detecting change points
- Laplace approximations and Bayesian information criteria in possibly misspecified models
- Cluster analysis, model selection, and prior distributions on models
- Limiting behavior of the Jeffreys power-expected-posterior Bayes factor in Gaussian linear models
- Statistical Issues in Bayesian Meta-Analysis
- Objective Bayesian testing for the correlation coefficient under divergence-based priors
- Areal prediction of survey data using Bayesian spatial generalised linear models
- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
- An alternative to the standard Bayesian procedure for discrimination between normal linear models
- Consistency of objective Bayes factors as the model dimension grows
- Adaptive change-point mixed models applied to data on outpatient tetracycline use in Europe
- Subjective Bayesian testing using calibrated prior probabilities
- Objective Bayesian group variable selection for linear model
- Objective Bayesian variable selection in linear regression model
- Prior distributions for objective Bayesian analysis
- Bayes factor asymptotics for variable selection in the Gaussian process framework
- Power-expected-posterior prior Bayes factor consistency for nested linear models with increasing dimensions
- Massively parallel feature selection: an approach based on variance preservation
- Increasing the replicability for linear models via adaptive significance levels
- Consistency of Bayes factors for intrinsic priors in normal linear models
- A note on Bayes factor consistency in partial linear models
- Bayes factor consistency for nested linear models with a growing number of parameters
- Computation for intrinsic variable selection in normal regression models via expected-posterior prior
- Bayesian model selection in high-dimensional settings
- Posterior model consistency in variable selection as the model dimension grows
- Consistency of Bayes factors under hyper \(g\)-priors with growing model size
- The whetstone and the alum block: balanced objective Bayesian comparison of nested models for discrete data
- Bayes factor consistency for one-way random effects model
- Objective Bayesian comparison of constrained analysis of variance models
- Information consistency of the Jeffreys power-expected-posterior prior in Gaussian linear models
- Consistency of Bayes factor for nonnested model selection when the model dimension grows
- Consistency of Bayesian linear model selection with a growing number of parameters
- Bayesian and frequentist evidence in one-sided hypothesis testing
- Informed reversible jump algorithms
- Criteria for Bayesian model choice with application to variable selection
- Intrinsic priors for model comparison in multivariate normal regression
- Introducing and analyzing the Bayesian power function as an alternative to the power function for a test
- Consistency of objective Bayes factors for nonnested linear models and increasing model dimension
- High-dimensional Bayesian inference in nonparametric additive models
- Consistency of hyper-\(g\)-prior-based Bayesian variable selection for generalized linear models
- Objective Bayesian model choice for non-nested families: the case of the Poisson and the negative binomial
- Posterior consistency of \(g\)-prior for variable selection with a growing number of parameters
- Simultaneous SNP identification in association studies with missing data
- Inference from intrinsic Bayes' procedures under model selection and uncertainty
- Bayes factor consistency for unbalanced ANOVA models
- Stochastic model specification search for Gaussian and partial non-Gaussian state space models
- Joint Diagnosis of High-Dimensional Process Mean and Covariance Matrix based on Bayesian Model Selection
- Bayesian model selection via composite likelihood for high-dimensional data integration
This page was built for publication: Consistency of Bayesian procedures for variable selection
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1018639)
