Distribution-free consistency results in nonparametric discrimination and regression function estimation

DOI10.1214/AOS/1176344949zbMath0431.62025OpenAlexW2034106324MaRDI QIDQ1138316

T. J. Wagner, Luc P. Devroye

Publication date: 1980

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aos/1176344949

zbMATH Keywords

robustnessconsistencykernel estimateBayes risk consistencynonparametric discriminationnonparametric regression function estimation

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Nonparametric estimation (62G05) General nonlinear regression (62J02)

Related Items (77)

Recursive estimation of nonparametric regression with functional covariate ⋮ Nonparametric function recovering from noisy observations ⋮ How well can a regression function be estimated if the distribution of the (random) design is concentrated on a finite set? ⋮ Estimation of the optimal design of a nonlinear parametric regression problem via Monte Carlo experiments ⋮ Consistent nonparametric hypothesis tests with an application to Slutsky symmetry ⋮ Estimation of a density in a simulation model ⋮ Consistent nonparametric multiple regression: the fixed design case ⋮ Modified nonparametric kernel estimates of a regression function and their consistencies with rates ⋮ Cascade non-linear system identification by a non-parametric method ⋮ Nonparametric curve estimation with Bernstein estimates ⋮ Consistency of \(L_ p\)-best monotone approximations ⋮ Strong uniform consistency of nonparametric regression function estimates ⋮ Nonlinear black-box models in system identification: Mathematical foundations ⋮ Exponential bounds of mean error for the kernel estimate of regression functions ⋮ Nonparametric estimation of a function from noiseless observations at random points ⋮ Estimation of a distribution from data with small measurement errors ⋮ Optimal global rates of convergence for interpolation problems with random design ⋮ Unnamed Item ⋮ Asymptotic properties of integrated square error and cross-validation for kernel estimation of a regression function ⋮ Estimation of a regression function on a manifold by fully connected deep neural networks ⋮ Asymptotic normality of Nadaraya–Waton kernel regression estimation for mixing high-frequency data ⋮ Consistent nonparametric regression from recursive partitioning schemes ⋮ On Learning and Convergence of RBF Networks in Regression Estimation and Classification ⋮ Analysis of the rate of convergence of two regression estimates defined by neural features which are easy to implement ⋮ Consistency of a recursive nearest neighbor regression function estimate ⋮ Nonparametric estimation of non-stationary velocity fields from 3D particle tracking velocimetry data ⋮ The asymptotic normality of linear functions of conditional order statistics ⋮ Optimal global rates of convergence for noiseless regression estimation problems with adaptively chosen design ⋮ Analysis of the rate of convergence of fully connected deep neural network regression estimates with smooth activation function ⋮ Testing conditional moment restrictions ⋮ Lower bounds on the rate of convergence of nonparametric regression estimates ⋮ On estimation of surrogate models for multivariate computer experiments ⋮ Nonparametric estimation of a maximum of quantiles ⋮ Over-parametrized deep neural networks minimizing the empirical risk do not generalize well ⋮ Nonparametric quantile estimation using importance sampling ⋮ Curves discrimination: a nonparametric functional approach ⋮ Semiparametric Double Balancing Score Estimation for Incomplete Data With Ignorable Missingness ⋮ Rate of convergence of the density estimation of regression residual ⋮ Generalized signed-rank estimation for regression models with non-ignorable missing responses ⋮ Error inference for nonparametric regression ⋮ On the almost everywhere properties of the kernel regression estimate ⋮ Improved learning of Riemannian metrics for exploratory analysis ⋮ Estimation of extreme quantiles in a simulation model ⋮ Kernel classification with missing data and the choice of smoothing parameters ⋮ [https://portal.mardi4nfdi.de/wiki/Publication:3038407 Propri�t�s de convergence presque compl�te du pr�dicteur � noyau] ⋮ Strong universal consistency of smooth kernel regression estimates ⋮ Nonparametric estimation of a latent variable model ⋮ Kernel regression estimation in a Banach space ⋮ Smoothing spline regression estimation based on real and artificial data ⋮ On the L 1 convergence of kernel estimators of regression functions with applications in discrimination ⋮ Model checks for regression: an innovation process approach ⋮ Limits to classification and regression estimation from ergodic processes ⋮ Unnamed Item ⋮ Theoretical analysis of cross-validation for estimating the risk of the k-Nearest Neighbor classifier ⋮ Strongly consistent nonparametric forecasting and regression for stationary ergodic sequences. ⋮ Strong universal pointwise consistency of some regression function estimates ⋮ An equivalence theorem for \(L_ 1\) convergence of the kernel regression estimate ⋮ Robust nonparametric regression estimation ⋮ The Hilbert kernel regression estimate. ⋮ Nonparametric quantile estimation using surrogate models and importance sampling ⋮ On the rate of convergence of fully connected deep neural network regression estimates ⋮ Leader-independent nonparametric consistent algorithms for incremental learning ⋮ Minimum distance regression-type estimates with rates under weak dependence ⋮ Nonparametric estimation of piecewise smooth regression functions ⋮ Efficient estimators for expectations in nonlinear parametric regression models with responses missing at random ⋮ On the strong universal consistency of local averaging regression estimates ⋮ Inequalities for uniform deviations of averages from expectations with applications to nonparametric regression ⋮ Combining different procedures for adaptive regression ⋮ Models under which random forests perform badly; consequences for applications ⋮ Adaptive density estimation based on real and artificial data ⋮ Universal consistency of delta estimators ⋮ Universally consistent conditional \(U\)-statistic for absolutely regular processes and its applications for hidden Markov models ⋮ Prediction from randomly right censored data ⋮ Estimation of a regression function corresponding to latent~variables ⋮ Probability estimation with machine learning methods for dichotomous and multicategory outcome: Theory ⋮ Nonparametric regression: An up–to–date bibliography ⋮ A comparison of Kriging with nonparametric regression methods

This page was built for publication: Distribution-free consistency results in nonparametric discrimination and regression function estimation