Improved nearest neighbor classifiers by weighting and selection of predictors

DOI10.1007/s11222-015-9588-zzbMath1505.62404OpenAlexW760607554MaRDI QIDQ340856

Dominik Koch, Gerhard Tutz

Publication date: 15 November 2016

Published in: Statistics and Computing (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s11222-015-9588-z

zbMATH Keywords

classificationrandom forestsboostingLassosupport vector machinelogit modelnearest neighborhood methods

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05)

Uses Software

• R
• UCI-ml
• MASS (R)
• kknn
• penalized
• mboost
• e1071
• mlbench
• glmnet
• randomForest
• samr
• TH.data
• MRSP

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Bagging predictors
• On hybrid classification using model assisted posterior estimates
• Boosting algorithms: regularization, prediction and model fitting
• Choice of neighbor order in nearest-neighbor classification
• Consistent nonparametric regression. Discussion
• Heuristics of instability and stabilization in model selection
• Variable selection in general multinomial logit models
• Additive logistic regression: a statistical view of boosting. (With discussion and a rejoinder by the authors)
• Support-vector networks
• Stacked regressions
• Smoothing methods in statistics
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• Statistical Analysis of Financial Data in S-Plus
• E. Fix and J.L. Hodges (1951): An Important Contribution to Nonparametric Discriminant Analysis and Density Estimation: Commentary on Fix and Hodges (1951)
• Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties
• Likelihood inference in nearest-neighbour classification models
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Boosting With theL₂Loss
• A Probabilistic Nearest Neighbour Method for Statistical Pattern Recognition
• L 1-Regularization Path Algorithm for Generalized Linear Models
• Generalized Additive Modeling with Implicit Variable Selection by Likelihood‐Based Boosting
• Regularization and Variable Selection Via the Elastic Net
• Combining Nearest Neighbor Classifiers Versus Cross-Validation Selection
• Random Forests and Adaptive Nearest Neighbors
• Random forests

This page was built for publication: Improved nearest neighbor classifiers by weighting and selection of predictors