Random-projection ensemble classification. (With discussion).
From MaRDI portal
Abstract: We introduce a very general method for high-dimensional classification, based on careful combination of the results of applying an arbitrary base classifier to random projections of the feature vectors into a lower-dimensional space. In one special case that we study in detail, the random projections are divided into disjoint groups, and within each group we select the projection yielding the smallest estimate of the test error. Our random projection ensemble classifier then aggregates the results of applying the base classifier on the selected projections, with a data-driven voting threshold to determine the final assignment. Our theoretical results elucidate the effect on performance of increasing the number of projections. Moreover, under a boundary condition implied by the sufficient dimension reduction assumption, we show that the test excess risk of the random projection ensemble classifier can be controlled by terms that do not depend on the original data dimension and a term that becomes negligible as the number of projections increases. The classifier is also compared empirically with several other popular high-dimensional classifiers via an extensive simulation study, which reveals its excellent finite-sample performance.
Recommendations
- Random projections as regularizers: learning a linear discriminant from fewer observations than dimensions
- A weighted multiple classifier framework based on random projection
- Randomized nonlinear projections uncover high-dimensional structure
- Stability of random-projection based classifiers. The Bayes error perspective
- Random Projection Ensemble Classification with High-Dimensional Time Series
Cited in
(59)- Classification by ensembles from random partitions of high-dimensional data
- Stabilizing variable selection and regression
- Randomized nonlinear projections uncover high-dimensional structure
- Ensemble of optimal trees, random forest and random projection ensemble classification
- On principal components regression, random projections, and column subsampling
- Ensemble of a subset of kNN classifiers
- Asymptotics, finite-sample comparisons and applications for two-sample tests with functional data
- Fuzzy \(c\)-means and cluster ensemble with random projection for big data clustering
- Regularizing axis-aligned ensembles via data rotations that favor simpler learners
- High-dimensional clustering via random projections
- Quadratic discriminant analysis by projection
- Covariance matrix testing in high dimension using random projections
- Stability of random-projection based classifiers. The Bayes error perspective
- High dimensional classification for spatially dependent data with application to neuroimaging
- A weighted multiple classifier framework based on random projection
- Reduced rank regression with matrix projections for high-dimensional multivariate linear regression model
- Ensemble quantile classifier
- Estimating a sharp convergence bound for randomized ensembles
- Random projections as regularizers: learning a linear discriminant from fewer observations than dimensions
- On the fusion of threshold classifiers for categorization and dimensionality reduction
- A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
- Random embedding machines for pattern recognition
- Ensembles of least squares classifiers with randomized kernels
- Predictive performances of implicitly and explicitly robust classifiers on high dimensional data
- RaSE: random subspace ensemble classification
- Histogram transform ensembles for large-scale regression
- Measuring the algorithmic convergence of randomized ensembles: the regression setting
- Bioinspired Random Projections for Robust, Sparse Classification
- Metric Learning via Cross-Validation
- scientific article; zbMATH DE number 7295881 (Why is no real title available?)
- Targeted random projection for prediction from high-dimensional features
- Robust ranking by ensembling of diverse models and assessment metrics
- Comments on: ``A random forest guided tour
- Comprehensive study of variational Bayes classification for dense deep neural networks
- Ensemble Subset Regression (ENSURE): Efficient High-dimensional Prediction
- An Outer-Product-of-Gradient Approach to Dimension Reduction and its Application to Classification in High Dimensional Space
- Random Projection Ensemble Classification with High-Dimensional Time Series
- Random forest kernel for high-dimension low sample size classification
- Ensemble LDA via the modified Cholesky decomposition
- RaSE: A Variable Screening Framework via Random Subspace Ensembles
- Statistical embedding: beyond principal components
- Multiclass sparse discriminant analysis incorporating graphical structure among predictors
- Learning from high dimensional data based on weighted feature importance in decision tree ensembles
- Variable selection using axis-aligned random projections for partial least-squares regression
- Advance of the sufficient dimension reduction
- Estimating the algorithmic variance of randomized ensembles via the bootstrap
- Multi-label Random Subspace Ensemble Classification
- Projection-based estimators for matrix/tensor-valued data
- Random projection-based response best-subset selector for ultra-high dimensional multivariate data
- Spherical random projection
- Conjunction subspaces test for conformal and selective classification
- Sharp-SSL: Selective High-Dimensional Axis-Aligned Random Projections for Semi-Supervised Learning
- Ultrahigh-dimensional quadratic discriminant analysis using random projections
- Gaussian random projections of convex cones: approximate kinematic formulae and applications
- Are ensembles getting better all the time?
- Model-based clustering of functional data via random projection ensembles
- Data-driven random projection and screening for high-dimensional generalized linear models
- Pattern recognition via projection-based \(k\)NN rules
- A multivariate adaptive stochastic search method for dimensionality reduction in classification
This page was built for publication: Random-projection ensemble classification. (With discussion).
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5364897)
