Influence Functions of Iteratively Reweighted Least Squares Estimators
bounded influenceboundedness of the limiting influence functionfully iterated \(M\) estimatorgeneralized \(M\) estimatorHuber's \(M\) estimatorsinfluence functions of iteratively reweighted least squares estimatorsiteration derivativeMallows class of estimatorsNewton- Raphson one-step estimatorsone-step estimatorrate of convergenceresidualrobust regressionstatistical functionalunknown scaleweighted least squares estimator
The authors study the influence functions of iteratively reweighted least squares estimators. The influence function of the weighted least squares estimator is shown to depend both on the weights and on the influence function of the initial estimator, where the weights are determined by both position in the design space and the residual relative to an initial regression estimator. When the weights are iteratively reestimated, convergence of the corresponding estimates and their influence functions relies on the magnitude of the iteration derivative, which is the derivative of the \(k+1\)st iterate with respect to the \(k\) th iterate. Conditions are given on the weights for such convergence and for boundedness of the limiting influence function, and shown to be easily checked for the Mallows class of estimators, including Huber's \(M\) estimators. Also, the relationship between iteratively reweighted least squares, Newton-Raphson one-step estimators, and the fully iterated \(M\) estimator they approximate is clarified. Besides, a numerical study for Huber's \(M\) estimators has been carried out to show that the iteration derivative determines not only the rate of convergence of the sequence of influence functions corresponding to iterated reweighted least squares but the rate of convergence of the iterated estimates themselves. Further, the case with unknown scale is discussed.
- Robustness of reweighted least squares kernel based regression
- Iteratively reweighted least squares: A comparison of several single step algorithms for linear models
- Influence functions and resampling techniques
- Reweighting approximate GM estimators: Asymptotics and residual-based graphics
- Convergence behavior of an iterative reweighting algorithm to compute multivariate M-estimates for location and scatter
- A journey in single steps: robust one-step M-estimation in linear regression
- Robustness by reweighting for kernel estimators: an overview
- Information geometry of modal linear regression
- Analysis of the forward search using some new results for martingales and empirical processes
- On the iteratively reweighted rank regression estimator
- Influence Functions for Iteratively Defined Statistics
- Iteratively Reweighted Least Squares: Algorithms, Convergence Analysis, and Numerical Comparisons
- Applied regression analysis bibliography update 1990-91
- On the robustness of two-stage estimators
- Asymptotic analysis of iterated 1-step Huber-skip M-estimators with varying cut-offs
- Robust regression credibility: The influence function approach
- Influence function analysis applied to partial least squares
This page was built for publication: Influence Functions of Iteratively Reweighted Least Squares Estimators
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3984604)