PCANet: A Simple Deep Learning Baseline for Image Classification?
From MaRDI portal
Abstract: In this work, we propose a very simple deep learning network for image classification which comprises only the very basic data processing components: cascaded principal component analysis (PCA), binary hashing, and block-wise histograms. In the proposed architecture, PCA is employed to learn multistage filter banks. It is followed by simple binary hashing and block histograms for indexing and pooling. This architecture is thus named as a PCA network (PCANet) and can be designed and learned extremely easily and efficiently. For comparison and better understanding, we also introduce and study two simple variations to the PCANet, namely the RandNet and LDANet. They share the same topology of PCANet but their cascaded filters are either selected randomly or learned from LDA. We have tested these basic networks extensively on many benchmark visual datasets for different tasks, such as LFW for face verification, MultiPIE, Extended Yale B, AR, FERET datasets for face recognition, as well as MNIST for hand-written digits recognition. Surprisingly, for all tasks, such a seemingly naive PCANet model is on par with the state of the art features, either prefixed, highly hand-crafted or carefully learned (by DNNs). Even more surprisingly, it sets new records for many classification tasks in Extended Yale B, AR, FERET datasets, and MNIST variations. Additional experiments on other public datasets also demonstrate the potential of the PCANet serving as a simple but highly competitive baseline for texture classification and object recognition.
Cited in
(9)- Bayesian variable selection for globally sparse probabilistic PCA
- Median arc center corrected binary pattern (MACCBP) for noise robust feature extraction
- Do ideas have shape? Idea registration as the continuous limit of artificial neural networks
- A novel neural network based image descriptor for texture classification
- A generalized information criterion for high-dimensional PCA rank selection
- Latent local feature extraction for low-resolution virus image classification
- Multilayer bootstrap networks
- Provably scale-covariant continuous hierarchical networks based on scale-normalized differential expressions coupled in cascade
- Neural operators can play dynamic Stackelberg games
This page was built for publication: PCANet: A Simple Deep Learning Baseline for Image Classification?
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4613252)
