Bioinspired Random Projections for Robust, Sparse Classification

DOI10.1137/22M1503579MaRDI QIDQ5056926zbMATH OpenOpenAlexFDO

Authors Nina Dekoninck Bruhin, Bryn Davies

Publication date 8 December 2022

Published in SIAM Journal on Imaging Sciences (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2206.09222

zbMATH Keywords

machine learningrandom matrixsupport vector machinedata compressionmusical genre classificationneural processing

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Random matrices (algebraic aspects) (15B52) Neural networks for/in biological studies, artificial life and related topics (92B20)

Abstract: Inspired by the use of random projections in biological sensing systems, we present a new algorithm for processing data in classification problems. This is based on observations of the human brain and the fruit fly's olfactory system and involves randomly projecting data into a space of greatly increased dimension before applying a cap operation to truncate the smaller entries. This leads to a simple algorithm that is very computationally efficient and can be used to either give a sparse representation with minimal loss in classification accuracy or give improved robustness, in the sense that classification accuracy is improved when noise is added to the data. This is demonstrated with numerical experiments, which supplement theoretical results demonstrating that the resulting signal transform is continuous and invertible, in an appropriate sense.

Recommendations

• Binary random projections with controllable sparsity patterns
• Randomized projective methods for the construction of binary sparse vector representations
• Random-projection ensemble classification. (With discussion).
• Two-dimensional random projection
• An algorithmic theory of learning: Robust concepts and random projection

Cites work

• scientific article; zbMATH DE number 7559100 (Why is no real title available?)
• scientific article; zbMATH DE number 6026126 (Why is no real title available?)
• A neural algorithm for a fundamental computing problem
• An algorithmic theory of learning: Robust concepts and random projection
• Compressed sensing
• Database-friendly random projections: Johnson-Lindenstrauss with binary coins.
• Deep Scattering Spectrum
• Group invariant scattering
• Mimicking the active cochlea with a fluid-coupled array of subwavelength Hopf resonators
• Multi-scale classification for electrosensing
• On random ±1 matrices: Singularity and determinant
• Visual categorization with random projection

Describes a project that uses

Uses Software

• ScatNet

This page was built for publication: Bioinspired Random Projections for Robust, Sparse Classification

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5056926)