Random-projection ensemble classification. (With discussion).
From MaRDI portal
Publication:5364897
Abstract: We introduce a very general method for high-dimensional classification, based on careful combination of the results of applying an arbitrary base classifier to random projections of the feature vectors into a lower-dimensional space. In one special case that we study in detail, the random projections are divided into disjoint groups, and within each group we select the projection yielding the smallest estimate of the test error. Our random projection ensemble classifier then aggregates the results of applying the base classifier on the selected projections, with a data-driven voting threshold to determine the final assignment. Our theoretical results elucidate the effect on performance of increasing the number of projections. Moreover, under a boundary condition implied by the sufficient dimension reduction assumption, we show that the test excess risk of the random projection ensemble classifier can be controlled by terms that do not depend on the original data dimension and a term that becomes negligible as the number of projections increases. The classifier is also compared empirically with several other popular high-dimensional classifiers via an extensive simulation study, which reveals its excellent finite-sample performance.
Recommendations
- Random projections as regularizers: learning a linear discriminant from fewer observations than dimensions
- A weighted multiple classifier framework based on random projection
- Randomized nonlinear projections uncover high-dimensional structure
- Stability of random-projection based classifiers. The Bayes error perspective
- Random Projection Ensemble Classification with High-Dimensional Time Series
Cited in
(48)- Metric Learning via Cross-Validation
- Pattern recognition via projection-based \(k\)NN rules
- A weighted multiple classifier framework based on random projection
- Classification by ensembles from random partitions of high-dimensional data
- Random projections as regularizers: learning a linear discriminant from fewer observations than dimensions
- Asymptotics, finite-sample comparisons and applications for two-sample tests with functional data
- Ensemble of a subset of kNN classifiers
- On principal components regression, random projections, and column subsampling
- A multivariate adaptive stochastic search method for dimensionality reduction in classification
- Reduced rank regression with matrix projections for high-dimensional multivariate linear regression model
- Fuzzy \(c\)-means and cluster ensemble with random projection for big data clustering
- Estimating a sharp convergence bound for randomized ensembles
- Random embedding machines for pattern recognition
- Advance of the sufficient dimension reduction
- scientific article; zbMATH DE number 7370612 (Why is no real title available?)
- Regularizing axis-aligned ensembles via data rotations that favor simpler learners
- High dimensional classification for spatially dependent data with application to neuroimaging
- An Outer-Product-of-Gradient Approach to Dimension Reduction and its Application to Classification in High Dimensional Space
- Robust ranking by ensembling of diverse models and assessment metrics
- Covariance matrix testing in high dimension using random projections
- Comments on: ``A random forest guided tour
- Statistical embedding: beyond principal components
- Comprehensive study of variational Bayes classification for dense deep neural networks
- On the fusion of threshold classifiers for categorization and dimensionality reduction
- Ensemble quantile classifier
- Multiclass sparse discriminant analysis incorporating graphical structure among predictors
- Ensembles of least squares classifiers with randomized kernels
- Ensemble of optimal trees, random forest and random projection ensemble classification
- Ensemble Subset Regression (ENSURE): Efficient High-dimensional Prediction
- scientific article; zbMATH DE number 7370562 (Why is no real title available?)
- Random Projection Ensemble Classification with High-Dimensional Time Series
- Random forest kernel for high-dimension low sample size classification
- Quadratic discriminant analysis by projection
- Stability of random-projection based classifiers. The Bayes error perspective
- A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
- Ensemble LDA via the modified Cholesky decomposition
- Stabilizing variable selection and regression
- Targeted random projection for prediction from high-dimensional features
- Bioinspired Random Projections for Robust, Sparse Classification
- Predictive performances of implicitly and explicitly robust classifiers on high dimensional data
- Measuring the algorithmic convergence of randomized ensembles: the regression setting
- RaSE: A Variable Screening Framework via Random Subspace Ensembles
- Estimating the algorithmic variance of randomized ensembles via the bootstrap
- Learning from high dimensional data based on weighted feature importance in decision tree ensembles
- High-dimensional clustering via random projections
- Randomized nonlinear projections uncover high-dimensional structure
- Variable selection using axis-aligned random projections for partial least-squares regression
- scientific article; zbMATH DE number 7295881 (Why is no real title available?)
This page was built for publication: Random-projection ensemble classification. (With discussion).
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5364897)
