Large Sample Properties of Partitioning-Based Series Estimators
From MaRDI portal
Abstract: We present large sample results for partitioning-based least squares nonparametric regression, a popular method for approximating conditional expectation functions in statistics, econometrics, and machine learning. First, we obtain a general characterization of their leading asymptotic bias. Second, we establish integrated mean squared error approximations for the point estimator and propose feasible tuning parameter selection. Third, we develop pointwise inference methods based on undersmoothing and robust bias correction. Fourth, employing different coupling approaches, we develop uniform distributional approximations for the undersmoothed and robust bias-corrected t-statistic processes and construct valid confidence bands. In the univariate case, our uniform distributional approximations require seemingly minimal rate restrictions and improve on approximation rates known in the literature. Finally, we apply our general results to three partitioning-based estimators: splines, wavelets, and piecewise polynomials. The supplemental appendix includes several other general and example-specific technical and methodological results. A companion R package is provided.
Recommendations
- Sample partitioning estimation for ergodic diffusions
- Asymptotic distribution of partitioning estimation and modified partitioning estimation for regression functions
- scientific article; zbMATH DE number 3903804
- Some results of partitioning estimation for regression functions
- Partitioned Approach for High-dimensional Confidence Intervals with Large Split Sizes
- Pseudo-likelihood methodology for partitioned large and complex samples
- The large sample properties of the solutions of general estimating equations
- Large Sample Properties of Separable Nonlinear Least Squares Estimators
- On Large-Sample Estimation and Testing in Parametric Models
- Large deviations of \(\chi^2\) divergence errors on partitions
Cites work
- scientific article; zbMATH DE number 3171491 (Why is no real title available?)
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 3949392 (Why is no real title available?)
- scientific article; zbMATH DE number 1423401 (Why is no real title available?)
- scientific article; zbMATH DE number 967931 (Why is no real title available?)
- A distribution-free theory of nonparametric regression
- A high-dimensional CLT in \(\mathcal {W}_2\) distance with near optimal convergence rate
- Adaptive piecewise polynomial estimation via trend filtering
- An approximation of partial sums of independent RV'-s, and the sample DF. I
- An approximation of partial sums of independent RV's, and the sample DF. II
- Anti-concentration and honest, adaptive confidence bands
- Asymptotic integrated mean square error using least squares and bias minimizing splines
- Comparison and anti-concentration bounds for maxima of Gaussian random vectors
- Conditional quantile processes based on series or many regressors
- Convergence rates and asymptotic normality for series estimators
- Efficient estimation of the dose-response function under ignorability using subclassification on the covariates
- Empirical and multiplier bootstraps for suprema of empirical processes of increasing complexity, and related Gaussian couplings
- Gaussian approximation of suprema of empirical processes
- Histogram regression estimation using data-dependent partitions
- Intersection bounds: estimation and inference
- Local asymptotics for polynomial spline regression
- Local asymptotics for regression splines and confidence regions
- Maximum penalized likelihood estimation. Volume II: Regression
- On the Effect of Bias Estimation on Coverage Accuracy in Nonparametric Inference
- On the Error of the Gaussian Approximation for Convolutions
- On the accuracy of normal approximation in the invariance principle
- Optimal convergence rates, Bahadur representation, and asymptotic normality of partitioning estimators
- Optimal data-driven regression discontinuity plots
- Optimal global rates of convergence for nonparametric regression
- Optimal sup-norm rates and uniform inference on nonlinear functionals of nonparametric IV regression
- Optimal uniform convergence rates and asymptotic normality for series estimators under weak dependence and weak conditions
- Projection estimation in multiple regression with application to functional ANOVA models
- Recursive partitioning and applications
- Robust nonparametric confidence intervals for regression-discontinuity designs
- Semiparametric regression during 2003--2007
- Some new asymptotic theory for least squares series: pointwise and uniform results
- Stable local bases for multivariate spline spaces
- The accuracy of strong Gaussian approximation for sums of independent random vectors
- (SOFTWARE) binsreg
Cited in
(12)- A nonparametric predictive regression model using partitioning estimators based on Taylor expansions
- Debiased machine learning of set-identified linear models
- Coverage error optimal confidence intervals for local polynomial regression
- Optimal convergence rates, Bahadur representation, and asymptotic normality of partitioning estimators
- lspartition
- Local Partitioned Regression
- Local regression distribution estimators
- A nonparametric test of significant variables in gradients
- Inference in nonparametric series estimation with specification searches for the number of series terms
- Partitioned Approach for High-dimensional Confidence Intervals with Large Split Sizes
- Heterogeneous treatment effect bounds under sample selection with an application to the effects of social media on political polarization
- Some new asymptotic theory for least squares series: pointwise and uniform results
This page was built for publication: Large Sample Properties of Partitioning-Based Series Estimators
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q143957)
