On the dimension effect of regularized linear discriminant analysis
From MaRDI portal
Publication:1786573
Abstract: This paper studies the dimension effect of the linear discriminant analysis (LDA) and the regularized linear discriminant analysis (RLDA) classifiers for large dimensional data where the observation dimension is of the same order as the sample size . More specifically, built on properties of the Wishart distribution and recent results in random matrix theory, we derive explicit expressions for the asymptotic misclassification errors of LDA and RLDA respectively, from which we gain insights of how dimension affects the performance of classification and in what sense. Motivated by these results, we propose adjusted classifiers by correcting the bias brought by the unequal sample sizes. The bias-corrected LDA and RLDA classifiers are shown to have smaller misclassification rates than LDA and RLDA respectively. Several interesting examples are discussed in detail and the theoretical results on dimension effect are illustrated via extensive simulation studies.
Recommendations
- A modified linear discriminant analysis for high-dimensional data
- Asymptotic properties of the EPMC for modified linear discriminant analysis when sample size and dimension are both large
- Computation of regularized linear discriminant analysis
- Discriminant analysis in small and large dimensions
- The Dantzig discriminant analysis with high dimensional data
Cites work
- scientific article; zbMATH DE number 4084766 (Why is no real title available?)
- scientific article; zbMATH DE number 1964693 (Why is no real title available?)
- scientific article; zbMATH DE number 889593 (Why is no real title available?)
- A Closer Look at Two Alternative Methods of Statistical Discrimination
- A constrained \(\ell _{1}\) minimization approach to sparse precision matrix estimation
- A direct approach to sparse discriminant analysis in ultra-high dimensions
- A direct estimation approach to sparse linear discriminant analysis
- A distance-based, misclassification rate adjusted classifier for multiclass, high-dimensional data
- A regularized Hotelling's \(T^{2}\) test for pathway analysis in proteomic studies
- A road to classification in high dimensional space: the regularized optimal affine discriminant
- Asymptotic expansion of the misclassification probabilities of D- and A- criteria for discrimination from two high dimensional populations using the theory of large dimensional random matrices
- Asymptotic probabilities of misclassification of two discriminant functions in cases of high dimensional data
- Asymptotic properties of eigenmatrices of a large sample covariance matrix
- Bias-corrected diagonal discriminant rules for high-dimensional classification
- Central limit theorem for Hotelling's \(T^{2}\) statistic under large dimension
- Central limit theorems for classical likelihood ratio tests for high-dimensional normal distributions
- Classifier technology and the illusion of progress
- Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
- DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
- Eigenvectors of some large sample covariance matrix ensembles
- Enhancement of the applicability of Markowitz's portfolio optimization by utilizing random matrix theory
- Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data
- General moments of the inverse real Wishart distribution and orthogonal Weingarten functions
- Generalized Consistent Error Estimator of Linear Discriminant Analysis
- High dimensional ordinary least squares projection for screening variables
- High-dimensional asymptotics of prediction: ridge regression and classification
- High-dimensionality effects in the Markowitz problem and other quadratic programs with linear constraints: risk underestimation
- Integration with respect to the Haar measure on unitary, orthogonal and symplectic group
- On asymptotics of eigenvectors of large sample covariance matrix
- On the mean and variance of the generalized inverse of a singular Wishart matrix
- On two simple and effective procedures for high dimensional classification of general populations
- Regularized linear discriminant analysis and its application in microarrays
- Scale adjustments for classifiers in high-dimensional, low sample size settings
- Shrinkage estimation of large dimensional precision matrix using random matrix theory
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observations
- Sparse linear discriminant analysis by thresholding for high dimensional data
- Spectral analysis of large dimensional random matrices
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- Statistical significance in high-dimensional linear models
- Two-Sample Test of High Dimensional Means Under Dependence
Cited in
(11)- Do unbalanced data have a negative effect on LDA?
- Computation of regularized linear discriminant analysis
- High-dimensional linear discriminant analysis classifier for spiked covariance model
- High dimensional discriminant rules with shrinkage estimators of the covariance matrix and mean vector
- Dimension Reduction with Linear Discriminant Functions Based on an Odds Ratio Parameterization
- Asymptotic properties of the EPMC for modified linear discriminant analysis when sample size and dimension are both large
- Analytical study of performance of linear discriminant analysis in stochastic settings
- High dimensional binary classification under label shift: phase transition and regularization
- Bias-corrected diagonal discriminant rules for high-dimensional classification
- Generalized two-dimensional linear discriminant analysis with regularization
- The effect of intrinsic dimension on the Bayes-error of projected quadratic discriminant classification
This page was built for publication: On the dimension effect of regularized linear discriminant analysis
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1786573)
