A general framework for frequentist model averaging
From MaRDI portal
Abstract: Model selection strategies have been routinely employed to determine a model for data analysis in statistics, and further study and inference then often proceed as though the selected model were the true model that were known a priori. This practice does not account for the uncertainty introduced by the selection process and the fact that the selected model can possibly be a wrong one. Model averaging approaches try to remedy this issue by combining estimators for a set of candidate models. Specifically, instead of deciding which model is the 'right' one, a model averaging approach suggests to fit a set of candidate models and average over the estimators using certain data adaptive weights. In this paper we establish a general frequentist model averaging framework that does not set any restrictions on the set of candidate models. It greatly broadens the scope of the existing methodologies under the frequentist model averaging development. Assuming the data is from an unknown model, we derive the model averaging estimator and study its limiting distributions and related predictions while taking possible modeling biases into account. We propose a set of optimal weights to combine the individual estimators so that the expected mean squared error of the average estimator is minimized. Simulation studies are conducted to compare the performance of the estimator with that of the existing methods. The results show the benefits of the proposed approach over traditional model selection approaches as well as existing model averaging methods.
Recommendations
Cites work
- scientific article; zbMATH DE number 1220667 (Why is no real title available?)
- scientific article; zbMATH DE number 1249686 (Why is no real title available?)
- scientific article; zbMATH DE number 720675 (Why is no real title available?)
- scientific article; zbMATH DE number 765034 (Why is no real title available?)
- scientific article; zbMATH DE number 802829 (Why is no real title available?)
- A model selection criterion based on the BHHJ measure of divergence
- Asymptotic Statistics
- Bayesian Model Averaging for Linear Regression Models
- Bayesian model averaging: A tutorial. (with comments and a rejoinder).
- Bias of the corrected AIC criterion for underfitted regression and time series models
- Focused Information Criteria and Model Averaging for the Cox Hazard Regression Model
- Frequentist Model Average Estimators
- Least Squares Model Averaging
- Least squares model averaging by Mallows criterion
- Mixture model averaging for clustering
- Model Selection and Model Averaging
- Model Selection: An Integral Part of Inference
- Model averaging and weight choice in linear mixed-effects models
- Model averaging based on Kullback-Leibler distance
- Model averaging based on leave-subject-out cross-validation
- On the harm that ignoring pretesting can cause
- Optimal weight choice for frequentist model average estimators
- Regression and time series model selection in small samples
- Robust regression using iteratively reweighted least-squares
- Some Properties of Tests for Specification Error in a Linear Regression Model
- Weighted average least squares estimation with nonspherical disturbances and an application to the Hong Kong housing market
Cited in
(16)- Optimal weight choice for frequentist model average estimators
- Multimodel inference based on smoothed information criteria
- scientific article; zbMATH DE number 7448633 (Why is no real title available?)
- Prediction Using Many Samples with Models Possibly Containing Partially Shared Parameters
- Frequentist model averaging with missing observations
- Frequentist Model Averaging for Undirected Gaussian Graphical Models
- Frequentist model averaging for threshold models
- Minimum mean squared error model averaging in likelihood models
- Frequentist model averaging for high dimensional Poisson models
- When and when not to use optimal model averaging
- Frequentist Model Average Estimators
- Choice of weights in FMA estimators under general parametric models
- Frequentist model averaging estimation: a review
- A general framework for model-based statistics
- Frequentist model averaging in structure equation model with ordinal data
- Frequentist model averaging in structural equation modelling
This page was built for publication: A general framework for frequentist model averaging
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1729944)
