A theoretical contribution to the fast implementation of null linear discriminant analysis with random matrix multiplication

DOI10.1002/NLA.1990MaRDI QIDQ5739749zbMATH OpenOpenAlexFDO

Authors Gang Wu, Tingting Feng

Publication date 19 July 2016

Published in Numerical Linear Algebra with Applications (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1409.2579

zbMATH Keywords

dimensionality reductionlinear discriminant analysisrandom matrixnumerical experimentssmall sample size problemfacial recognitionfast implementation of null linear discriminant analysisnull linear discriminant analysis

Mathematics Subject Classification ID

Numerical computation of matrix exponential and similar matrix functions (65F60)

Abstract: The null linear discriminant analysis method is a competitive approach for dimensionality reduction. The implementation of this method, however, is computationally expensive. Recently, a fast implementation of null linear discriminant analysis method using random matrix multiplication with scatter matrices was proposed. However, if the random matrix is chosen arbitrarily, the orientation matrix may be rank deficient, and some useful discriminant information will be lost. In this paper, we investigate how to choose the random matrix properly, such that the two criteria of the null LDA method are satisfied theoretically. We give a necessary and sufficient condition to guarantee full column rank of the orientation matrix. Moreover, the geometric characterization of the condition is also described.

Recommendations

• A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices
• A new and fast implementation for null space based linear discriminant analysis
• Complexity-reduced implementations of complete and null-space-based linear discriminant analysis
• Computational and theoretical analysis of null space and orthogonal linear discriminant analysis
• Fast rate of convergence in high-dimensional linear discriminant analysis
• A new reduced-rank linear discriminant analysis method and its applications
• A new and fast orthogonal linear discriminant analysis on undersampled problems
• Fast and robust discriminant analysis
• High-dimensional linear discriminant analysis using nonparametric methods

Cites work

• scientific article; zbMATH DE number 3052156 (Why is no real title available?)
• A comparison of generalized linear discriminant analysis algorithms
• A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices
• Complexity-reduced implementations of complete and null-space-based linear discriminant analysis

Cited in

(2)

• A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices
• A new and fast implementation for null space based linear discriminant analysis

Describes a project that uses

Uses Software

• ORL face
• Matlab

This page was built for publication: A theoretical contribution to the fast implementation of null linear discriminant analysis with random matrix multiplication

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5739749)