A Generalized View on Continuum Regression

DOI10.1111/1467-9469.00134MaRDI QIDQ4255153zbMATH OpenOpenAlexFDO

Authors Anders Björkström, Rolf Sundberg

Publication date 10 August 1999

Published in Scandinavian Journal of Statistics (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1111/1467-9469.00134

zbMATH Keywords

continuum regressionlinear predictionnear collinearitypartial least squares regressionprincipal components regressionridge regressionshrinkage

Mathematics Subject Classification ID

Factor analysis and principal components; correspondence analysis (62H25) General nonlinear regression (62J02) Ridge regression; shrinkage estimators (Lasso) (62J07)

Review text

This article focuses on investigation of interrelationships between such important regularized regression methods as continuum regression (CR) and ridge regression (RR) used for analysis of data with near collinearity in explanatory variables. The CR approach by \textit{M. Stone} and \textit{R. J. Brooks} [J. R. Stat. Soc., Ser. B 52, No.2, 237-269 (1990; Zbl 0708.62054)] is wide enough to include ordinary and partial least squares regression as well as principal component regression as special cases. The authors demonstrated that RR is in a certain sense an even more fundamental method than CR by showing that any reasonable maximization criterion which depends only on regression sample correlation and sample variation will yield a regressor that is proportional to a ridge regressor. Based on this result, a generalized formulation of CR is proposed. It is proved that for this formulation the coefficient of determination and length of estimators are decreasing functions of the continuum parameter. Applications to real data sets are presented.

Recommendations

• scientific article; zbMATH DE number 946664
• scientific article; zbMATH DE number 472964
• scientific article; zbMATH DE number 4163945
• Kernel continuum regression

Cited in

(12)

• Continuum redundancy-\textit{PLS} regression: a simple continuum approach
• Kernel continuum regression
• Continuum directions for supervised dimension reduction
• Connecting continuum regression with sufficient dimension reduction
• Functional continuum regression
• Fixed-size least squares support vector machines: A large scale application in electrical load forecasting
• Some insights into continuum regression and its asymptotic properties
• Improved Empirical Bayes Ridge Regression Estimators Under Multicollinearity
• scientific article; zbMATH DE number 4163945 (Why is no real title available?)
• Constructive Cross-Validation in Linear Prediction
• scientific article; zbMATH DE number 472964 (Why is no real title available?)
• scientific article; zbMATH DE number 946664 (Why is no real title available?)

This page was built for publication: A Generalized View on Continuum Regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4255153)