Generalized two-dimensional linear discriminant analysis with regularization

DOI10.1016/J.NEUNET.2021.04.030MaRDI QIDQ6079054zbMATH OpenOpenAlexFDO

Authors Chunna Li, Yuan-Hai Shao, Weijie Chen, Zhen Wang, Nai-Yang Deng

Publication date 28 September 2023

Published in Neural Networks (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1801.07426

zbMATH Keywords

regularizationlinear discriminant analysistwo-dimensional linear discriminant analysisrobust dimensionality reduction

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05)

Abstract: Recent advances show that two-dimensional linear discriminant analysis (2DLDA) is a successful matrix based dimensionality reduction method. However, 2DLDA may encounter the singularity issue theoretically and the sensitivity to outliers. In this paper, a generalized Lp-norm 2DLDA framework with regularization for an arbitrary $p>0$ is proposed, named G2DLDA. There are mainly two contributions of G2DLDA: one is G2DLDA model uses an arbitrary Lp-norm to measure the between-class and within-class scatter, and hence a proper $p$ can be selected to achieve the robustness. The other one is that by introducing an extra regularization term, G2DLDA achieves better generalization performance, and solves the singularity problem. In addition, G2DLDA can be solved through a series of convex problems with equality constraint, and it has closed solution for each single problem. Its convergence can be guaranteed theoretically when $1leqpleq2$. Preliminary experimental results on three contaminated human face databases show the effectiveness of the proposed G2DLDA.

Recommendations

• Robust bilateral \(L_p\)-norm two-dimensional linear discriminant analysis
• Robust L1-norm two-dimensional linear discriminant analysis
• Separable two-dimensional linear discriminant analysis
• Separable linear discriminant analysis
• Lp- and Ls-norm distance based robust linear discriminant analysis

Cites work

• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• scientific article; zbMATH DE number 6253899 (Why is no real title available?)
• 10.1162/153244303321897726
• 2D Feature Selection by Sparse Matrix Regression
• 2D Quaternion Sparse Discriminant Analysis
• A Non-Greedy Algorithm for L1-Norm LDA
• A statistical perspective on ill-posed inverse problems (with discussion)
• A survey of multilinear subspace learning for tensor data
• Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis
• Face recognition based on 2D Fisherface approach
• Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization
• Iterative refinement for \(\ell_p\)-norm regression
• Linear Discriminant Analysis Based on L1-Norm Maximization
• Lp- and Ls-norm distance based robust linear discriminant analysis
• Multi-class discriminant kernel learning via convex programming
• Multiview Hessian Regularization for Image Annotation
• On the dimension effect of regularized linear discriminant analysis
• Penalized classification using Fisher's linear discriminant
• RELATIONS BETWEEN TWO SETS OF VARIATES
• Recursive ``concave-convex Fisher linear discriminant with applications to face, handwritten digit and terrain recognition
• Regularization and Variable Selection Via the Elastic Net
• Regularized linear discriminant analysis and its application in microarrays
• Robust L1-norm two-dimensional linear discriminant analysis
• Robust bilateral \(L_p\)-norm two-dimensional linear discriminant analysis
• Robust recursive absolute value inequalities discriminant analysis with sparseness
• Tikhonov Regularization and Total Least Squares
• Two-dimensional discriminant transform for face recognition
• Weighted Schatten <inline-formula> <tex-math notation="LaTeX">$p$ </tex-math> </inline-formula>-Norm Minimization for Image Denoising and Background Subtraction

Cited in

(8)

• Robust bilateral \(L_p\)-norm two-dimensional linear discriminant analysis
• Matrix-based vs. vector-based linear discriminant analysis: a comparison of regularized variants on multivariate time series data
• Regularized linear discriminant analysis based on generalized capped \(l_{2, q}\)-norm
• Separable two-dimensional linear discriminant analysis
• Improving two-dimensional linear discriminant analysis with L1 norm for optimizing EEG signal
• Lp- and Ls-norm distance based robust linear discriminant analysis
• Robust L1-norm two-dimensional linear discriminant analysis
• Regularized coplanar discriminant analysis for dimensionality reduction

This page was built for publication: Generalized two-dimensional linear discriminant analysis with regularization

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6079054)