Tractable Bayesian variable selection: beyond normality
From MaRDI portal
Abstract: Bayesian variable selection often assumes normality, but the effects of model misspecification are not sufficiently understood. There are sound reasons behind this assumption, particularly for large : ease of interpretation, analytical and computational convenience. More flexible frameworks exist, including semi- or non-parametric models, often at the cost of some tractability. We propose a simple extension of the Normal model that allows for skewness and thicker-than-normal tails but preserves tractability. It leads to easy interpretation and a log-concave likelihood that facilitates optimization and integration. We characterize asymptotically parameter estimation and Bayes factor rates, in particular studying the effects of model misspecification. Under suitable conditions misspecified Bayes factors are consistent and induce sparsity at the same asymptotic rates than under the correct model. However, the rates to detect signal are altered by an exponential factor, often resulting in a loss of sensitivity. These deficiencies can be ameliorated by inferring the error distribution from the data, a simple strategy that can improve inference substantially. Our work focuses on the likelihood and can thus be combined with any likelihood penalty or prior, but here we focus on non-local priors to induce extra sparsity and ameliorate finite-sample effects caused by misspecification. Our results highlight the practical importance of focusing on the likelihood rather than solely on the prior, when it comes to Bayesian variable selection. The methodology is available in R package `mombf'.
Recommendations
- Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
- Bayes variable selection in semiparametric linear models
- On Model Selection Consistency of Bayesian Method for Normal Linear Models
- Bayesian variable selection in linear regression models with non-normal errors
- Bayesian variable selection with shrinking and diffusing priors
Cites work
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A method for the solution of certain non-linear problems in least squares
- Adaptive robust variable selection
- An Algorithm for Least-Squares Estimation of Nonlinear Parameters
- Asymptotic Normality and Consistency of the Least Squares Estimators for Families of Linear Regressions
- Asymptotics for L1‐estimators of regression parameters under heteroscedasticityY
- Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
- Bayes variable selection in semiparametric linear models
- Bayesian model selection in high-dimensional settings
- Bayesian robust transformation and variable selection: A unified approach
- Bayesian variable selection in quantile regression
- Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection
- Criteria for Bayesian model choice with application to variable selection
- Flexible objective Bayesian linear regression with applications in survival analysis
- High-dimensional heteroscedastic regression with an application to eQTL data analysis
- Inconsistency of Bayesian inference for misspecified linear models, and a proposal for repairing it
- Inference in two-piece location-scale models with Jeffreys priors
- Learning without concentration for general loss functions
- Methods for the two-piece normal distribution
- Natural (non-)informative priors for skew-symmetric distributions
- Newton’s Method with a Model Trust Region Modification
- Nonparametric Bayes conditional distribution modeling with variable selection
- On Bayesian Modeling of Fat Tails and Skewness
- On Fixed-Width Confidence Bounds for Regression Parameters
- On numerical aspects of Bayesian model selection in high and ultrahigh-dimensional settings
- On the use of non-local prior densities in Bayesian hypothesis tests
- Optimal predictive model selection.
- Quantile regression.
- Robust nonnegative garrote variable selection in linear regression
- Robust regression through the Huber's criterion and adaptive lasso penalty
- Robust regression: Asymptotics, conjectures and Monte Carlo
- Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
- Sparse least trimmed squares regression for analyzing high-dimensional large data sets
- Statistical consistency and asymptotic normality for high-dimensional robust \(M\)-estimators
- Statistical inference for a general class of asymmetric distributions
- Tests of Linear Hypotheses and l"1 Estimation
- The epsilon-skew-normal distribution for analyzing near-normal data
- The two-piece normal, binormal, or double Gaussian distribution: its origin and rediscoveries
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Variable selection in quantile regression
- Weighted LAD-LASSO method for robust parameter estimation and variable selection in regression
- Weighted Wilcoxon‐Type Smoothly Clipped Absolute Deviation Method
Cited in
(16)- Scalable Importance Tempering and Bayesian Variable Selection
- A loss-based prior for variable selection in linear regression methods
- Variations of power-expected-posterior priors in normal regression models
- Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
- Bayesian variable selection and estimation in quantile regression using a quantile-specific prior
- Bayesian variable selection for non‐Gaussian responses: a marginally calibrated copula approach
- Letter to the Editor: ‘On Quantile‐based Asymmetric Family of Distributions: Properties and Inference’
- mombf
- Variable selection via thresholding
- An objective non-local prior for skew-symmetric models
- A novel variational Bayesian method for variable selection in logistic regression models
- Bayesian effect selection in structured additive distributional regression models
- Selecting the normal population with the best regression value -- a Bayesian approach
- Additive Bayesian variable selection under censoring and misspecification
- Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection
- Bayesian bandwidth test and selection for high-dimensional banded precision matrices
This page was built for publication: Tractable Bayesian variable selection: beyond normality
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3121566)
