A Fast Learning Algorithm for Deep Belief Nets
From MaRDI portal
Publication:5476682
DOI10.1162/neco.2006.18.7.1527zbMath1106.68094OpenAlexW2136922672WikidataQ33996665 ScholiaQ33996665MaRDI QIDQ5476682
Simon Osindero, Geoffrey E. Hinton, Yee Whye Teh
Publication date: 17 July 2006
Published in: Neural Computation (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1162/neco.2006.18.7.1527
Related Items
Applicability of \(n\)-vicinity method for calculation of free energy of Ising model, A survey on deep learning and its applications, The elementary excitation of spin lattice models: the quasiparticles of Gentile statistics, On an artificial neural network for inverse scattering problems, Deep sparse autoencoder for feature extraction and diagnosis of locomotive adhesion status, Unsupervised 3D shape segmentation and co-segmentation via deep learning, Background information of deep learning for structural engineering, Online multi-label dependency topic models for text classification, Parameter inference in a probabilistic model from data: regulation of transition rate in the Monte Carlo method, A topological approach for protein classification, Statistical testing of segment homogeneity in classification of piecewise-regular objects, Centered kernel alignment enhancing neural network pretraining for MRI-based dementia diagnosis, Hybrid deep learning model-based prediction of images related to cyberbullying, Bayesian models of brain and behaviour, SIMD parallel MCMC sampling with applications for big-data Bayesian analytics, Learning invariant features using inertial priors, Topologically ordered feature extraction based on sparse group restricted Boltzmann machines, Realization problem of multi-layer cellular neural networks, Designing phononic crystal with anticipated band gap through a deep learning based data-driven method, Neural networks retrieving Boolean patterns in a sea of Gaussian ones, Deep neural networks for texture classification -- a theoretical analysis, Towards understanding sparse filtering: a theoretical perspective, Necessary and sufficient conditions of proper estimators based on self density ratio for unnormalized statistical models, Probabilistic lower bounds for approximation by shallow perceptron networks, A deep belief network with PLSR for nonlinear system modeling, Synchronization of hybrid coupled reaction-diffusion neural networks with time delays via generalized intermittent control with spacial sampled-data, An adaptive deep Q-learning strategy for handwritten digit recognition, Accelerating deep learning with memcomputing, Theory of deep convolutional neural networks: downsampling, Preserving differential privacy in deep neural networks with relevance-based adaptive noise imposition, Relative entropy minimizing noisy non-linear neural network to approximate stochastic processes, Synaptic dynamics: linear model and adaptation algorithm, Neural network learning of optimal Kalman prediction and control, Recursive compositional models for vision: description and review of recent work, Editorial introduction to the neural networks special issue on deep learning of representations, Deep learning of support vector machines with class probability output networks, Expected energy-based restricted Boltzmann machine for classification, Data science applications to string theory, An unsupervised parameter learning model for RVFL neural network, Predicate logic based image grammars for complex pattern recognition, Latent structure preserving hashing, Deep multimodal fusion: a hybrid approach, Training restricted Boltzmann machines: an introduction, Complex-valued autoencoders, An unsupervised fault diagnosis method for rolling bearing using STFT and generative neural networks, Preserving differential privacy in convolutional deep belief networks, Generating feature spaces for linear algorithms with regularized sparse kernel slow feature analysis, Impact of random weights on nonlinear system identification using convolutional neural networks, Sim2vec: node similarity preserving network embedding, The learning problem of multi-layer neural networks, Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification, Using isotope composition and other node attributes to predict edges in fish trophic networks, Algorithms for drug sensitivity prediction, Nonequilibrium thermodynamics of self-supervised learning, Infinite ensemble clustering, Multi-feature gait recognition with DNN based on sEMG signals, Non-convex multi-species Hopfield models, Convergence of contrastive divergence algorithm in exponential family, TONR: an exploration for a novel way combining neural network with topology optimization, A cycle deep belief network model for multivariate time series classification, Scalability of using restricted Boltzmann machines for combinatorial optimization, Boolean autoencoders and hypercube clustering complexity, Improved neural networks based on mutual information via information geometry, Non-iterative and fast deep learning: multilayer extreme learning machines, Face recognition via deep stacked denoising sparse autoencoders (DSDSA), A simultaneous perturbation weak derivative estimator for stochastic neural networks, Rejoinder of: Treelets -- an adaptive multi-scale basis for spare unordered data, Deep learned finite elements, SO(8) supergravity and the magic of machine learning, Discriminative deep belief networks for visual data classification, Multidisciplinary pattern recognition applications: a review, Deep network based on stacked orthogonal convex incremental ELM autoencoders, Simplified information maximization for improving generalization performance in multilayered neural networks, Deep autoencoder based energy method for the bending, vibration, and buckling analysis of Kirchhoff plates with transfer learning, Class sparsity signature based restricted Boltzmann machine, Discovering the impact of hidden layer parameters on non-iterative training of feed-forward neural networks, Simulating a perceptron on a quantum computer, Learning sparse FRAME models for natural image patterns, Nonredundant sparse feature extraction using autoencoders with receptive fields clustering, Deep neural mapping support vector machines, Limitations of shallow nets approximation, Structured machine learning: the next ten years, Universality of deep convolutional neural networks, Bottom-up learning of hierarchical models in a class of deterministic pomdp environments, On the relative expressiveness of Bayesian and neural networks, A DBN-based deep neural network model with multitask learning for online air quality prediction, Sum-product graphical models, A survey on semi-supervised learning, A theory of incremental compression, Theory of deep convolutional neural networks. II: Spherical analysis, Deep learning on image denoising: an overview, A surface-to-surface contact search method enhanced by deep learning, Computational mechanics enhanced by deep learning, A comprehensive survey and analysis of generative models in machine learning, Deep learning of chroma representation for cover song identification in compression domain, Stochastic modeling of inhomogeneities in the aortic wall and uncertainty quantification using a Bayesian encoder-decoder surrogate, A capsule-unified framework of deep neural networks for graphical programming, An iterative stacked weighted auto-encoder, Mathematical analysis of finite parameter deep neural network models with skip connections from the viewpoint of representation sets, Approximation of functions from korobov spaces by deep convolutional neural networks, Research on three-step accelerated gradient algorithm in deep learning, What are the Most Important Statistical Ideas of the Past 50 Years?, Tractable Multivariate Binary Density Estimation and the Restricted Boltzmann Forest, Unified field theoretical approach to deep and recurrent neuronal networks, Low Rank Tensor Manifold Learning, Features Selection as a Nash-Bargaining Solution: Applications in Online Advertising and Information Systems, Minimal model of permutation symmetry in unsupervised learning, Mean-field inference methods for neural networks, Legendre equivalences of spherical Boltzmann machines, Toward Efficient Ensemble Learning with Structure Constraints: Convergent Algorithms and Applications, Features Reweighting and Selection in ligand-based Virtual Screening for Molecular Similarity Searching Based on Deep Belief Networks, An Efficient Learning Procedure for Deep Boltzmann Machines, RANDOM NEURAL NETWORK METHODS AND DEEP LEARNING, Deep distributed convolutional neural networks: Universality, Biological modelling of a computational spiking neural network with neuronal avalanches, Overparameterized neural networks implement associative memory, The unreasonable effectiveness of deep learning in artificial intelligence, Brain-Inspired Constructive Learning Algorithms with Evolutionally Additive Nonlinear Neurons, Justifying and Generalizing Contrastive Divergence, Automatic operational modal analysis of structures based on image recognition of stabilization diagrams with uncertainty quantification, A survey of deep network techniques all classifiers can adopt, Machine learning based data retrieval for inverse scattering problems with incomplete data, Probabilistic Segmentation of Musical Sequences Using Restricted Boltzmann Machines, An algorithm selection approach for the flexible job shop scheduling problem: choosing constraint programming solvers through machine learning, Complexity of training ReLU neural network, DECISION TREES DO NOT GENERALIZE TO NEW VARIATIONS, Realizing number recognition with simulated quantum semi-restricted Boltzmann machine, Calculations of fractional derivative option pricing models based on neural network, Analysis of time-frequency scattering transforms, Eigen solution of neural networks and its application in prediction and analysis of controller parameters of grinding robot in complex environments, Large data sets and machine learning: applications to statistical arbitrage, Data-driven forward-inverse problems for Yajima-Oikawa system using deep learning with parameter regularization, MultiComposite Nonconvex Optimization for Training Deep Neural Networks, Recent Deep Learning Methods for Melanoma Detection: A Review, A Deep Learning Based Artificial Neural Network Approach for Intrusion Detection, Generative model of autoencoders self-learning on images represented by count samples, Deep Haar scattering networks, GSNs: generative stochastic networks, Unnamed Item, Sensitivity Derivatives for Flexible Sensorimotor Learning, Application of grey relational analysis and artificial neural networks on currency exchange-traded notes (ETNs), Spike-Timing-Dependent Construction, Dissociable Forms of Repetition Priming: A Computational Model, Large Margin Low Rank Tensor Analysis, A Survey on Deep Learning for Multimodal Data Fusion, On Kernel Method–Based Connectionist Models and Supervised Deep Learning Without Backpropagation, Efficient Training of Convolutional Deep Belief Networks in the Frequency Domain for Application to High-Resolution 2D and 3D Images, Deep Learning with Dynamic Spiking Neurons and Fixed Feedback Weights, An Approximation of the Error Backpropagation Algorithm in a Predictive Coding Network with Local Hebbian Synaptic Plasticity, Deep Restricted Kernel Machines Using Conjugate Feature Duality, Deep, Narrow Sigmoid Belief Networks Are Universal Approximators, Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review, Convergence of Markovian stochastic approximation for Markov random fields with hidden variables, Universal Approximation Depth and Errors of Narrow Belief Networks with Discrete Units, The Architectures of Geoffrey Hinton, Emergence of giant strongly connected components in continuum disk-spin percolation, Statistical mechanics of unsupervised feature learning in a restricted Boltzmann machine with binary synapses, Constrained low-rank matrix estimation: phase transitions, approximate message passing and applications, Machine learning algorithms based on generalized Gibbs ensembles, Resolution and relevance trade-offs in deep learning, A Model of Indispensability of a Large Glial Layer in Cerebrovascular Circulation, Decreasing the Size of the Restricted Boltzmann Machine, Dynamics of Learning in MLP: Natural Gradient and Singularity Revisited, Neural Simpletrons: Learning in the Limit of Few Labels with Directed Generative Networks, Adaptive Learning Algorithm Convergence in Passive and Reactive Environments, Unnamed Item, Refinements of Universal Approximation Results for Deep Belief Networks and Restricted Boltzmann Machines, Better Approximations of High Dimensional Smooth Functions by Deep Neural Networks with Rectified Power Units, Deep Belief Networks Are Compact Universal Approximators, Unnamed Item, Unnamed Item, Visual Recognition and Inference Using Dynamic Overcomplete Sparse Learning, Large-Margin Classification in Infinite Neural Networks, Comparing Classification Methods for Longitudinal fMRI Studies, A Connection Between Score Matching and Denoising Autoencoders, Neural Decoding with Hierarchical Generative Models, A Principle for Learning Egocentric-Allocentric Transformation, Deep Learning at the Interface of Agricultural Insurance Risk and Spatio-Temporal Uncertainty in Weather Extremes, Learning Compositional Representations of Interacting Systems with Restricted Boltzmann Machines: Comparative Study of Lattice Proteins, Complexity of Shallow Networks Representing Finite Mappings, Learning a Generative Model of Images by Factoring Appearance and Shape, Bounding the Bias of Contrastive Divergence Learning, DNN-PPI: A LARGE-SCALE PREDICTION OF PROTEIN–PROTEIN INTERACTIONS BASED ON DEEP NEURAL NETWORKS, Model criticism in latent space, A Simple and Efficient Tensor Calculus for Machine Learning, Deep neural networks for rotation-invariance approximation and learning, Cooperative hierarchical Dirichlet processes: superposition vs. maximization, Diffusion nets, Learning algorithm of Boltzmann machine based on spatial Monte Carlo integration method, A tale of three probabilistic families: Discriminative, descriptive, and generative models, Enhancing performance of the back-propagation algorithm based on a novel regularization method of preserving inter-object-distance of data, Unnamed Item, Condition Monitoring of Equipment in Oil Wells using Deep Learning, Graph interpolating activation improves both natural and robust accuracies in data-efficient deep learning, Discussion of: Treelets -- an adaptive multi-scale basis for sparse unordered data, Influence of long-range interaction on degeneracy of eigenvalues of connection matrix of d-dimensional Ising system, Replica analysis of the lattice-gas restricted Boltzmann machine partition function, Approximating functions with multi-features by deep convolutional neural networks, Quantum state tomography of multi-qubit systems — a comparative study, A brain-inspired computational model for spatio-temporal information processing, A distributed optimisation framework combining natural gradient with Hessian-free for discriminative sequence training, Theory of deep convolutional neural networks. III: Approximating radial functions, Approximating smooth and sparse functions by deep neural networks: optimal approximation rates and saturation, Rates of approximation by ReLU shallow neural networks, Supervised Machine Learning Techniques: An Overview with Applications to Banking, Successfully and efficiently training deep multi-layer perceptrons with logistic activation function simply requires initializing the weights with an appropriate negative mean, Unsupervised learning of disentangled representations in deep restricted kernel machines with orthogonality constraints, On the effective initialisation for restricted Boltzmann machines via duality with Hopfield model, Data assimilation predictive GAN (DA-PredGAN) applied to a spatio-temporal compartmental model in epidemiology, Scaling Up Bayesian Uncertainty Quantification for Inverse Problems Using Deep Neural Networks, Learning sparse and smooth functions by deep sigmoid nets, Dunkl analouge of Szász Schurer Beta bivariate operators, Space-dependent turbulence model aggregation using machine learning, Energy-Based Models with Applications to Speech and Language Processing, Deep learning for natural language processing: a survey, The role of mutual information in variational classifiers, A new taxonomy of global optimization algorithms, An industrial process fault diagnosis method based on independent slow feature analysis and stacked sparse autoencoder network, Multimodal deep learning for cetacean distribution modeling of fin whales (\textit{Balaenoptera physalus}) in the western Mediterranean sea, Asset pricing with neural networks: significance tests, Hilbert C∗-Module for Analyzing Structured Data, Helmholtz machine with differential privacy
Uses Software
Cites Work
