A multivariate adaptive stochastic search method for dimensionality reduction in classification
From MaRDI portal
Abstract: High-dimensional classification has become an increasingly important problem. In this paper we propose a "Multivariate Adaptive Stochastic Search" (MASS) approach which first reduces the dimension of the data space and then applies a standard classification method to the reduced space. One key advantage of MASS is that it automatically adjusts to mimic variable selection type methods, such as the Lasso, variable combination methods, such as PCA, or methods that combine these two approaches. The adaptivity of MASS allows it to perform well in situations where pure variable selection or variable combination methods fail. Another major advantage of our approach is that MASS can accurately project the data into very low-dimensional non-linear, as well as linear, spaces. MASS uses a stochastic search algorithm to select a handful of optimal projection directions from a large number of random directions in each iteration. We provide some theoretical justification for MASS and demonstrate its strengths on an extensive range of simulation studies and real world data sets by comparing it to many classical and modern classification methods.
Recommendations
- High-dimensional classification when useful information comes from many, perhaps all features
- Linear dimension reduction in classification: adaptive procedure for optimum results
- A new reduced-rank linear discriminant analysis method and its applications
- An Adaptive Estimation of Dimension Reduction Space
- Random-projection ensemble classification. (With discussion).
Cites work
- Asymptotics for Lasso-type estimators.
- Bayesian Variable Selection in Linear Regression
- Comparison of deterministic and stochastic approaches to global optimization
- High-dimensional classification using features annealed independence rules
- scientific article; zbMATH DE number 1687015 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Least angle regression. (With discussion)
- Regularization and Variable Selection Via the Elastic Net
- Simulation-based optimization: Parametric optimization techniques and reinforcement learning
- Smoothing by spline functions.
- Square root penalty: Adaption to the margin in classification and in edge estimation
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Variable inclusion and shrinkage algorithms
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(5)- Linear dimension reduction in classification: adaptive procedure for optimum results
- A modified minimum classification error (MCE) training algorithm for dimensionality reduction
- Solving dimension reduction problems for classification using promoted crow search algorithm (PCSA)
- High-dimensional classification when useful information comes from many, perhaps all features
- On maximum depth classifiers: depth distribution approach
This page was built for publication: A multivariate adaptive stochastic search method for dimensionality reduction in classification
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q977639)
