Consistency of Bayesian procedures for variable selection
From MaRDI portal
Abstract: It has long been known that for the comparison of pairwise nested models, a decision based on the Bayes factor produces a consistent model selector (in the frequentist sense). Here we go beyond the usual consistency for nested pairwise models, and show that for a wide class of prior distributions, including intrinsic priors, the corresponding Bayesian procedure for variable selection in normal regression is consistent in the entire class of normal linear models. We find that the asymptotics of the Bayes factors for intrinsic priors are equivalent to those of the Schwarz (BIC) criterion. Also, recall that the Jeffreys--Lindley paradox refers to the well-known fact that a point null hypothesis on the normal mean parameter is always accepted when the variance of the conjugate prior goes to infinity. This implies that some limiting forms of proper prior distributions are not necessarily suitable for testing problems. Intrinsic priors are limits of proper prior distributions, and for finite sample sizes they have been proved to behave extremely well for variable selection in regression; a consequence of our results is that for intrinsic priors Lindley's paradox does not arise.
Recommendations
- Consistency of Bayes factors for intrinsic priors in normal linear models
- Posterior model consistency in variable selection as the model dimension grows
- Consistency of objective Bayes factors as the model dimension grows
- On Model Selection Consistency of Bayesian Method for Normal Linear Models
- Objective Bayesian Variable Selection
Cites work
- A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
- An Intrinsic Limiting Procedure for Model Selection and Hypotheses Testing
- BINOMIAL SAMPLING SCHEMES AND THE CONCEPT OF INFORMATION
- Consistency of Bayes factors for intrinsic priors in normal linear models
- Erratum: Comparison of Bayesian objective procedures for variable selection in linear regression
- Estimating the dimension of a model
- scientific article; zbMATH DE number 6114083 (Why is no real title available?)
- scientific article; zbMATH DE number 3863589 (Why is no real title available?)
- scientific article; zbMATH DE number 1034037 (Why is no real title available?)
- scientific article; zbMATH DE number 1865509 (Why is no real title available?)
- scientific article; zbMATH DE number 777884 (Why is no real title available?)
- scientific article; zbMATH DE number 5196684 (Why is no real title available?)
- scientific article; zbMATH DE number 3273020 (Why is no real title available?)
- Objective Bayesian Variable Selection
- Objective Testing Procedures in Linear Models: Calibration of the p‐values
- On the consistency of Bayes estimates
- The Intrinsic Bayes Factor for Model Selection and Prediction
- Training samples in objective Bayesian model selection.
Cited in
(54)- Using random subspace method for prediction and variable importance assessment in linear regression
- Prior distributions for objective Bayesian analysis
- Posterior consistency of \(g\)-prior for variable selection with a growing number of parameters
- Objective Bayesian comparison of constrained analysis of variance models
- Information consistency of the Jeffreys power-expected-posterior prior in Gaussian linear models
- Increasing the replicability for linear models via adaptive significance levels
- Bayesian and frequentist evidence in one-sided hypothesis testing
- Bayes factor asymptotics for variable selection in the Gaussian process framework
- Objective Bayesian group variable selection for linear model
- Informed reversible jump algorithms
- Consistency of Bayesian linear model selection with a growing number of parameters
- Subjective Bayesian testing using calibrated prior probabilities
- Consistency of Bayes factors for intrinsic priors in normal linear models
- Posterior model consistency in variable selection as the model dimension grows
- Consistency of Bayes factors under hyper g-priors with growing model size
- Stochastic model specification search for Gaussian and partial non-Gaussian state space models
- Objective Bayesian model choice for non-nested families: the case of the Poisson and the negative binomial
- Power-expected-posterior priors for variable selection in Gaussian linear models
- Bayes factor consistency for unbalanced ANOVA models
- Limiting behavior of the Jeffreys power-expected-posterior Bayes factor in Gaussian linear models
- Statistical Issues in Bayesian Meta-Analysis
- Introducing and analyzing the Bayesian power function as an alternative to the power function for a test
- Objective Bayesian variable selection in linear regression model
- An alternative to the standard Bayesian procedure for discrimination between normal linear models
- Massively parallel feature selection: an approach based on variance preservation
- Bayes factor consistency for nested linear models with a growing number of parameters
- Simultaneous SNP identification in association studies with missing data
- Laplace approximations and Bayesian information criteria in possibly misspecified models
- Bayesian high-dimensional screening via MCMC
- High-dimensional Bayesian inference in nonparametric additive models
- Bayesian model selection in high-dimensional settings
- Adaptive change-point mixed models applied to data on outpatient tetracycline use in Europe
- Bayes variable selection in semiparametric linear models
- Inference from intrinsic Bayes' procedures under model selection and uncertainty
- Objective Bayesian testing for the correlation coefficient under divergence-based priors
- Areal prediction of survey data using Bayesian spatial generalised linear models
- Consistency of hyper-\(g\)-prior-based Bayesian variable selection for generalized linear models
- Bayes factor consistency for one-way random effects model
- Power-expected-posterior prior Bayes factor consistency for nested linear models with increasing dimensions
- The whetstone and the alum block: balanced objective Bayesian comparison of nested models for discrete data
- A consistent on‐line Bayesian procedure for detecting change points
- Joint Diagnosis of High-Dimensional Process Mean and Covariance Matrix based on Bayesian Model Selection
- Bayesian model selection via composite likelihood for high-dimensional data integration
- Objective Bayesian trend filtering via adaptive piecewise polynomial regression
- Intrinsic priors for model comparison in multivariate normal regression
- Criteria for Bayesian model choice with application to variable selection
- Consistency of Bayes factor for nonnested model selection when the model dimension grows
- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
- Bayesian hypothesis testing for Gaussian graphical models: conditional independence and order constraints
- Computation for intrinsic variable selection in normal regression models via expected-posterior prior
- Cluster analysis, model selection, and prior distributions on models
- A note on Bayes factor consistency in partial linear models
- Consistency of objective Bayes factors for nonnested linear models and increasing model dimension
- Consistency of objective Bayes factors as the model dimension grows
This page was built for publication: Consistency of Bayesian procedures for variable selection
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1018639)
