A theoretical contribution to the fast implementation of null linear discriminant analysis with random matrix multiplication

DOI10.1002/NLA.1990zbMATH Open1374.65084arXiv1409.2579OpenAlexW2135650845MaRDI QIDQ5739749FDOQ5739749

Authors: Gang Wu, Tingting Feng 

Publication date: 19 July 2016

Published in: Numerical Linear Algebra with Applications (Search for Journal in Brave)

Abstract: The null linear discriminant analysis method is a competitive approach for dimensionality reduction. The implementation of this method, however, is computationally expensive. Recently, a fast implementation of null linear discriminant analysis method using random matrix multiplication with scatter matrices was proposed. However, if the random matrix is chosen arbitrarily, the orientation matrix may be rank deficient, and some useful discriminant information will be lost. In this paper, we investigate how to choose the random matrix properly, such that the two criteria of the null LDA method are satisfied theoretically. We give a necessary and sufficient condition to guarantee full column rank of the orientation matrix. Moreover, the geometric characterization of the condition is also described.

Full work available at URL: https://arxiv.org/abs/1409.2579

Recommendations

• A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices
• A new and fast implementation for null space based linear discriminant analysis
• Complexity-reduced implementations of complete and null-space-based linear discriminant analysis
• Computational and theoretical analysis of null space and orthogonal linear discriminant analysis
• Fast rate of convergence in high-dimensional linear discriminant analysis
• A new reduced-rank linear discriminant analysis method and its applications
• A new and fast orthogonal linear discriminant analysis on undersampled problems
• Fast and robust discriminant analysis
• High-dimensional linear discriminant analysis using nonparametric methods

zbMATH Keywords

dimensionality reductionlinear discriminant analysisrandom matrixnumerical experimentssmall sample size problemfacial recognitionfast implementation of null linear discriminant analysisnull linear discriminant analysis

Mathematics Subject Classification ID

Numerical computation of matrix exponential and similar matrix functions (65F60)

Cites Work

• A comparison of generalized linear discriminant analysis algorithms
• A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices
• Complexity-reduced implementations of complete and null-space-based linear discriminant analysis
• Title not available (Why is that?)

Cited In (2)

• A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices
• A new and fast implementation for null space based linear discriminant analysis

Uses Software

• Matlab
• ORL face

This page was built for publication: A theoretical contribution to the fast implementation of null linear discriminant analysis with random matrix multiplication

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5739749)