Diffusion nets
From MaRDI portal
Publication:2325536
Abstract: Non-linear manifold learning enables high-dimensional data analysis, but requires out-of-sample-extension methods to process new data points. In this paper, we propose a manifold learning algorithm based on deep learning to create an encoder, which maps a high-dimensional dataset and its low-dimensional embedding, and a decoder, which takes the embedded data back to the high-dimensional space. Stacking the encoder and decoder together constructs an autoencoder, which we term a diffusion net, that performs out-of-sample-extension as well as outlier detection. We introduce new neural net constraints for the encoder, which preserves the local geometry of the points, and we prove rates of convergence for the encoder. Also, our approach is efficient in both computational complexity and memory requirements, as opposed to previous methods that require storage of all training points in both the high-dimensional and the low-dimensional spaces to calculate the out-of-sample-extension and the pre-image.
Recommendations
Cites work
- A Fast Learning Algorithm for Deep Belief Nets
- Diffusion Interpretation of Nonlocal Neighborhood Filters for Signal Denoising
- Diffusion maps
- Diffusion maps for changing data
- Geometric harmonics: a novel tool for multiscale out-of-sample extension of empirical functions
- Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data
- Hierarchical data organization, clustering and denoising via localized diffusion folders
- scientific article; zbMATH DE number 867339 (Why is no real title available?)
- Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
- Learning deep architectures for AI
- Multidimensional binary search trees used for associative searching
- Non-linear independent component analysis with diffusion maps
- Numerical Optimization
- Reducing the Dimensionality of Data with Neural Networks
- Texture separation via a reference set
- Universal approximation bounds for superpositions of a sigmoidal function
Cited in
(17)- Almost involutory recursive MDS diffusion layers
- Bigeometric organization of deep nets
- Networks for nonlinear diffusion problems in imaging
- Image anomalies: a review and synthesis of detection methods
- Diffusion maps-aided neural networks for the solution of parametrized PDEs
- Deep autoencoders for physics-constrained data-driven nonlinear materials modeling
- Landmark diffusion maps (L-dMaps): accelerated manifold learning out-of-sample extension
- Diffusion learning algorithms for feedforward neural networks
- Parametric UMAP Embeddings for Representation and Semisupervised Learning
- scientific article; zbMATH DE number 7626797 (Why is no real title available?)
- Local conformal autoencoder for standardized data coordinates
- Spectral embedding norm: looking deep into the spectrum of the graph Laplacian
- Convergent autoencoder approximation of low bending and low distortion manifold embeddings
- Supervised learning of explicit maps with ability to correct distortions in the target output for manifold learning
- Adaptive unsupervised anomaly detection in variable environment by online expectation maximization
- A comparison of latent space modeling techniques in a plain-vanilla autoencoder setting
- Learning collective variables that reproduce transition rates
This page was built for publication: Diffusion nets
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2325536)
