Lectures on the nearest neighbor method
\(k\)-nearest neighbor densityentropylocal behaviornearest neighborsorder statisticsrates of convergenceregression estimationsupervised classification, nearest neighbor rulesuniform consistencyweighted \(k\)-nearest neighbor density
Applications of statistics in engineering and industry; control charts (62P30) Introductory exposition (textbooks, tutorial papers, etc.) pertaining to computer science (68-01) Research exposition (monographs, survey articles) pertaining to computer science (68-02) Learning and adaptive systems in artificial intelligence (68T05) Pattern recognition, speech recognition (68T10)
The nearest neighbor paradigm is one of the most used machine learning methods in the classification domain. This book deals with different aspects regarding this approach, starting with the standard \(k\)-nearest neighbor model, and passing through the weighted \(k\)-nearest neighbor model, estimations for entropy, regression functions etc. Problems like point-wise and uniform consistency, rates of convergence, noiseless case etc. are also approached. The last part of the book deals with the supervised classification via \(k\)-nearest neighbors for fixed or variable parameter \(k\). The book ends with an appendix. It is intended for a large audience, including students, teachers, and researchers.
- A nearest neighbor estimate of the residual variance
- Efficient multivariate entropy estimation via \(k\)-nearest neighbour distances
- Shape-preserving wavelet-based multivariate density estimation
- A nearest neighbor characterization of Lebesgue points in metric measure spaces
- Adaptive transfer learning
- The functional \(k\mathrm{NN}\) estimator of the conditional expectile: uniform consistency in number of neighbors
- Asymptotic connectedness of random interval graphs in a one dimensional data delivery problem
- Distributionally robust stochastic programs with side information based on trimmings
- Conditional independence testing via weighted partial copulas
- Uniform consistency and uniform in number of neighbors consistency for nonparametric regression estimates and conditional U-statistics involving functional data
- Rates of convergence for random forests via generalized U-statistics
- Entropy-based test for generalised Gaussian distributions
- Reweighting samples under covariate shift using a Wasserstein distance criterion
- Dynamic optimization with side information
- Optimal functional supervised classification with separation condition
- Local nearest neighbour classification with applications to semi-supervised learning
- Testing multivariate uniformity based on random geometric graphs
- Statistical estimation of mutual information for mixed model
- Global and local two-sample tests via regression
- Pointwise density estimation for biased sample
- On the strong universal consistency of local averaging regression estimates
- Rate of convergence of k-nearest-neighbor classification rule
- Evaluating the complexity of some families of functional data
- Theoretical analysis of cross-validation for estimating the risk of the \(k\)-nearest neighbor classifier
- Explaining the success of nearest neighbor methods in prediction
- On the measure of Voronoi cells
- Statistical estimation of conditional Shannon entropy
- Aggregated hold-out
- Asymptotic properties of random Voronoi cells with arbitrary underlying density
- Nearest Neighbor Classification and Search
- scientific article; zbMATH DE number 7625194 (Why is no real title available?)
- Stock market prediction based on adaptive training algorithm in machine learning
- On the Kozachenko-Leonenko entropy estimator
- Universal consistency and rates of convergence of multiclass prototype algorithms in metric spaces
- The limit distribution of the maximum probability nearest-neighbour ball
- Limit laws for large kth-nearest neighbor balls
- Learning and Convergence of the Normalized Radial Basis Functions Networks
- Open problems in geometric methods for instance-based learning
- Estimation of extreme quantiles from heavy-tailed distributions with neural networks
- Variance function estimation in regression model via aggregation procedures
- Nonparametric Prediction for Spatial Dependent Functional Data Under Fixed Sampling Design
- Finding our way in the dark: approximate MCMC for approximate Bayesian methods
- Entropy estimation via uniformization
- Self-supervised Metric Learning in Multi-View Data: A Downstream Task Perspective
- Optimal Nonparametric Inference with Two-Scale Distributional Nearest Neighbors
- Distribution-free algorithms for predictive stochastic programming in the presence of streaming data
- The \(k\)-nearest neighbors method in single index regression model for functional quasi-associated time series data
- A study on relationship between prediction uncertainty and robustness to noisy data
- Consistency of the k-nearest neighbor classifier for spatially dependent data
- Efficient functional estimation and the super-oracle phenomenon
- On Learning and Convergence of RBF Networks in Regression Estimation and Classification
- On Azadkia-Chatterjee's conditional dependence coefficient
- Exact detection thresholds and minimax optimality of Chatterjee's correlation coefficient
- A comparison among a fuzzy algorithm for image rescaling with other methods of digital image processing
- Nearest neighbor empirical processes
- Detection of small holes by the scale-invariant robust density-aware distance (RDAD) filtration
- Background modeling for double Higgs boson production: density ratios and optimal transport
- The local approach to causal inference under network interference
- Rates of strong uniform consistency for the k-nearest neighbors kernel estimators of density and regression function
- Bagged regularized k-distances for anomaly detection
- Learning conditional distributions on continuous spaces
- Augmentation invariant manifold learning
- On regression-adjusted imputation estimators of average treatment effects
- On deviation probabilities in non-parametric regression with heavy-tailed noise
- Stone's theorem for distributional regression in Wasserstein distance
- Minimum discrepancy principle strategy for choosing k in k-NN regression
- Nearest neighbor sampling for covariate shift adaptation
- Using low-discrepancy points for data compression in machine learning: an experimental comparison
- Speeding up Monte Carlo integration: control neighbors for optimal convergence
- Utility-Maximizing Binary Prediction via the Nearest Neighbor Method and Its Application to Credit Scoring
- Image resizing by neural network operators and their convergence rate with respect to the L^p-norm and the dissimilarity index defined through the continuous SSIM
- Infinite random forests for imbalanced classification tasks
- Implementation of neural network operators with applications to remote sensing data
- A hybrid weighted nearest neighbour classifier for semi-supervised learning
- A note on k-NN gating in RAG
- Statistical estimates of information characteristics
- Double cross-fit doubly robust estimators: beyond series regression
- Improved convergence rate of \(k\mathrm{NN}\) graph Laplacians: differentiable self-tuned affinity
- Adaptive kNN estimation of distribution functions: theory, simulation, and applications
- Adaptive sampling-based quadrature rules for efficient Bayesian prediction
- The Delaunay triangulation learner and its ensembles
This page was built for publication: Lectures on the nearest neighbor method
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q892829)