Model selection confidence sets by likelihood ratio testing
From MaRDI portal
Abstract: The traditional activity of model selection aims at discovering a single model superior to other candidate models. In the presence of pronounced noise, however, multiple models are often found to explain the same data equally well. To resolve this model selection ambiguity, we introduce the general approach of model selection confidence sets (MSCSs) based on likelihood ratio testing. A MSCS is defined as a list of models statistically indistinguishable from the true model at a user-specified level of confidence, which extends the familiar notion of confidence intervals to the model-selection framework. Our approach guarantees asymptotically correct coverage probability of the true model when both sample size and model dimension increase. We derive conditions under which the MSCS contains all the relevant information about the true model structure. In addition, we propose natural statistics based on the MSCS to measure importance of variables in a principled way that accounts for the overall model uncertainty. When the space of feasible models is large, MSCS is implemented by an adaptive stochastic search algorithm which samples MSCS models with high probability. The MSCS methodology is illustrated through numerical experiments on synthetic data and real data examples.
Recommendations
Cited in
(22)- Sparsified simultaneous confidence intervals for high-dimensional linear models
- Subdata selection algorithm for linear model discrimination
- Visualization and assessment of model selection uncertainty
- Variable importance based interaction modelling with an application on initial spread of COVID-19 in China
- Model confidence bounds for variable selection
- Discussion on Prior-based Bayesian Information Criterion (PBIC) by M. J. Bayarri, James O. Berger, Woncheol Jang, Surajit Ray, Luis R. Pericchi, and Ingmar Visser
- Penalized estimating equations for generalized linear models with multiple imputation
- Confidence Sets for Causal Orderings
- Measures of Uncertainty for Shrinkage Model Selection
- Confidence sets for model selection by F -testing
- Order selection with confidence for finite mixture models
- Measuring the uncertainty for shrinkage model selection in quantile regression models
- MoST: model specification test by variable selection stability
- Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
- Confidence graphs for graphical model selection
- Confidence set for mixture order selection
- Parameter-based hypothesis tests for model selection
- Simple measures of uncertainty for model selection
- A weighted model confidence set: applications to local and mixture model confidence sets
- How hard is it to pick the right model? MCS and backtest overfitting
- A Subsampling Strategy for AIC-based Model Averaging with Generalized Linear Models
- Forward stability and model path selection
This page was built for publication: Model selection confidence sets by likelihood ratio testing
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5226611)
