On predictive least squares principles (Q1192957)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | On predictive least squares principles |
scientific article |
Statements
On predictive least squares principles (English)
0 references
27 September 1992
0 references
The paper considers various principles of regression model selection. The recently proposed PLS (predictive least squares) criterion is shown to be decomposable into the residual sum of squares and a penalty term (staying for the complexity of the model). Then an asymptotic statistical interpretation of the penalty term is offered. Conditions for the strong consistency of PSL for stochastic regression models are presented and illustrated by the example of a fixed design model and of an unstable autoregressive process. Also the strong consistency for BIC (an information-based criterion which similarly as the Akaike criterion minimizes a loss function which is the sum of residual sum of squares and a penalty term) is proposed, and then the equivalence (up to \(o(1)\) a.s.) between PLS and BIC is derived. Further the numerical performance of PLS is studied and advantages and disadvantages indicated. This results in a proposition of a new criterion FIC (based on Fisher information) and its features and relationship with PLS are explained. The paper is accompanied by a simulation study showing the advantages of FIC.
0 references
decomposibility
0 references
predictive least squares
0 references
regression model selection
0 references
residual sum of squares
0 references
penalty term
0 references
strong consistency of PSL
0 references
stochastic regression models
0 references
fixed design model
0 references
unstable autoregressive process
0 references
BIC
0 references
information-based criterion
0 references
FIC
0 references
Fisher information
0 references
simulation study
0 references