Estimation of the density of regression errors
From MaRDI portal
Abstract: Estimation of the density of regression errors is a fundamental issue in regression analysis and it is typically explored via a parametric approach. This article uses a nonparametric approach with the mean integrated squared error (MISE) criterion. It solves a long-standing problem, formulated two decades ago by Mark Pinsker, about estimation of a nonparametric error density in a nonparametric regression setting with the accuracy of an oracle that knows the underlying regression errors. The solution implies that, under a mild assumption on the differentiability of the design density and regression function, the MISE of a data-driven error density estimator attains minimax rates and sharp constants known for the case of directly observed regression errors. The result holds for error densities with finite and infinite supports. Some extensions of this result for more general heteroscedastic models with possibly dependent errors and predictors are also obtained; in the latter case the marginal error density is estimated. In all considered cases a blockwise-shrinking Efromovich--Pinsker density estimate, based on plugged-in residuals, is used. The obtained results imply a theoretical justification of a customary practice in applied regression analysis to consider residuals as proxies for underlying regression errors. Numerical and real examples are presented and discussed, and the S-PLUS software is available.
Recommendations
- Nonparametric estimation of the density of regression errors
- Optimal nonparametric estimation of the density of regression errors with finite support
- scientific article; zbMATH DE number 5054705
- Nonparametric estimation of the density of the regression noise
- Estimation of the density of regression errors by pointwise model selection
Cites work
- scientific article; zbMATH DE number 991833 (Why is no real title available?)
- scientific article; zbMATH DE number 3120956 (Why is no real title available?)
- scientific article; zbMATH DE number 42417 (Why is no real title available?)
- scientific article; zbMATH DE number 3481257 (Why is no real title available?)
- scientific article; zbMATH DE number 3541805 (Why is no real title available?)
- scientific article; zbMATH DE number 1306459 (Why is no real title available?)
- scientific article; zbMATH DE number 1380579 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- scientific article; zbMATH DE number 918103 (Why is no real title available?)
- scientific article; zbMATH DE number 3074512 (Why is no real title available?)
- Adapting to Unknown Smoothness via Wavelet Shrinkage
- Asymptotic equivalence of density estimation and Gaussian white noise
- Asymptotic equivalence of nonparametric regression and white noise
- Asymptotically efficient estimation for analytic distributions
- Density Estimation Under Random Censorship and Order Restrictions
- Density Estimation for the Case of Supersmooth Measurement Error
- Density and hazard estimation in censored regression models
- Density estimation for biased data.
- Estimating linear functionals of the error distribution in nonparametric regression
- Exact mean integrated squared error
- General empirical Bayes wavelet methods and exactly adaptive minimax estimation
- Modeling Regression Error With a Mixture of Polya Trees
- Non-parametric estimation of the residual distribution
- Nonparametric Estimation of a Density of Unknown Smoothness
- Nonparametric curve estimation. Methods, theory, and applications
- Nonparametric estimation of smooth probability densities in \(L_ 2\)
- Nonparametric estimators which can be ``plugged-in.
- Nonparametric regression with long-range dependence
- Nonparametric smoothing and lack-of-fit tests
- On nonparametric regression for iid observations in a general setting
- On the limit in the equivalence between heteroscedastic regression and filtering model.
- Optimal filtering of square-integrable signals in Gaussian noise
- Optimal plug-in estimators for nonparametric functional estimation
- Optimal rates and constants in \(L_ 2\)-minimax estimation of probability density functions
- Oracle inequalities for Efromovich--Pinsker blockwise estimates
- Superefficiency in nonparametric function estimation
- Weak and strong uniform consistency of a kernel error density estimator in nonparametric regression
Cited in
(33)- Bayesian bandwidth estimation for local linear fitting in nonparametric regression models
- A Bayesian approach for determining the optimal semi-metric and bandwidth in scalar-on-function quantile regression with unknown error density and dependent functional data
- A note on residual-based empirical likelihood kernel density estimation
- The Lp consistency of error density estimator in censored linear regression
- Nonparametric conditional variance and error density estimation in regression models with dependent errors and predictors
- Estimation of a distribution from data with small measurement errors
- Estimating the conditional error distribution in non-parametric regression
- Estimation of the error density in a semiparametric transformation model
- Strong uniform consistency and asymptotic normality of a kernel based error density estimator in functional autoregressive models
- Oracle inequality for conditional density estimation and an actuarial example
- Bayesian bandwidth estimation and semi-metric selection for a functional partial linear model with unknown error density
- Asymptotic normality of Powell's kernel estimator
- Adaptive estimation of error density in nonparametric regression with small sample size
- Conditional density estimation in a regression setting
- Estimation of the density of regression errors by pointwise model selection
- \(L_1\)-consistent estimation of the density of residuals in random design regression models
- Optimal nonparametric estimation of the density of regression errors with finite support
- Adaptive estimation of and oracle inequalities for probability densities and characteristic functions
- Asymptotic Properties of Error Density Estimator in Regression Model Under α-Mixing Assumptions
- Nonparametric estimation of the density of the regression noise
- Revisiting the estimation of the error density in functional autoregressive models
- Rate of convergence of the density estimation of regression residual
- Discussion on “Optimal Sequential Surveillance for Finance, Public Health, and Other Areas” by Marianne Frisén
- Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density
- Bayesian bandwidth estimation for a functional nonparametric regression model with mixed types of regressors and unknown error density
- Estimation of a functional single index model with dependent errors and unknown error density
- Nonparametric estimation of the density of regression errors
- Strongly consistent density estimation of the regression residual
- Uniform consistency in nonparametric mixture models
- Goodness-of-fit tests for parametric regression with selection biased data
- A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density
- Adaptive density estimation using the blockwise Stein method
- Robust error density estimation in ultrahigh dimensional sparse linear model
This page was built for publication: Estimation of the density of regression errors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2368851)
