Learning Deep Architectures for AI

From MaRDI portal
Publication:3404182

DOI10.1561/2200000006zbMath1192.68503OpenAlexW4231109964WikidataQ29306504 ScholiaQ29306504MaRDI QIDQ3404182

Yoshua Bengio

Publication date: 8 February 2010

Published in: Foundations and Trends® in Machine Learning (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1561/2200000006



Related Items

Probabilistic Learning Vector Quantization with Cross-Entropy for Probabilistic Class Assignments in Classification Learning, A Comparative Study on Machine Learning Techniques for Intense Convective Rainfall Events Forecasting, Modeling and Learning of Hierarchical Decision Models: The Case of the Choquet Integral, A random forest guided tour, Structured Sparsity: Discrete and Convex Approaches, Unnamed Item, IDC Breast Cancer Detection Using Deep Learning Schemes, Features Reweighting and Selection in ligand-based Virtual Screening for Molecular Similarity Searching Based on Deep Belief Networks, An Efficient Learning Procedure for Deep Boltzmann Machines, Unnamed Item, Unnamed Item, A survey of deep network techniques all classifiers can adopt, A neighborhood rough set model with nominal metric embedding, Enhanced Gradient for Training Restricted Boltzmann Machines, Robustness and Tractability for Non-convex M-estimators, An information-theoretic instance-based classifier, Dimension of Marginals of Kronecker Product Models, DECISION TREES DO NOT GENERALIZE TO NEW VARIATIONS, When are two multi-layer cellular neural networks the same?, A converged deep graph semi-NMF algorithm for learning data representation, Multistart global optimization with tunnelling and an evolutionary strategy supervised by a martingale, A class-specific mean vector-based weighted competitive and collaborative representation method for classification, On smoothing and scaling language model for sentiment based information retrieval, Three ways to solve partial differential equations with neural networks — A review, Dimension of tensor network varieties, Unsupervised learning of disentangled representations in deep restricted kernel machines with orthogonality constraints, A comprehensive survey on deep learning based malware detection techniques, Accuracy and architecture studies of residual neural network method for ordinary differential equations, Scaling Up Bayesian Uncertainty Quantification for Inverse Problems Using Deep Neural Networks, Learning sparse and smooth functions by deep sigmoid nets, GRIDS-Net: inverse shape design and identification of scatterers via geometric regularization and physics-embedded deep learning, Large data sets and machine learning: applications to statistical arbitrage, Deep learning for natural language processing: a survey, Model-Based Deep Learning, Deep nonparametric estimation of intrinsic data structures by chart autoencoders: generalization error and robustness, On the number of regions of piecewise linear neural networks, Stochastic perturbation of subgradient algorithm for nonconvex deep neural networks, Optimal deep neural networks by maximization of the approximation power, A Deep Learning Based Artificial Neural Network Approach for Intrusion Detection, Back-propagating errors through artificial neural networks for variable selection, Helmholtz machine with differential privacy, On invariance and selectivity in representation learning, GSNs: generative stochastic networks, Stable architectures for deep neural networks, A Survey on Deep Learning for Multimodal Data Fusion, Deep Learning with Dynamic Spiking Neurons and Fixed Feedback Weights, Deep Restricted Kernel Machines Using Conjugate Feature Duality, Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review, Implementing a Bayes Filter in a Neural Circuit: The Case of Unknown Stimulus Dynamics, Universal Approximation Depth and Errors of Narrow Belief Networks with Discrete Units, Rejoinder to ‘Estimating rates of rare events through a multidimensional dynamic hierarchical Bayesian framework’, Resolution and relevance trade-offs in deep learning, Blessing of dimensionality: mathematical foundations of the statistical physics of data, Dynamics of Learning in MLP: Natural Gradient and Singularity Revisited, Hierarchical model of natural images and the origin of scale invariance, Deep Belief Networks Are Compact Universal Approximators, Unnamed Item, Unnamed Item, Unnamed Item, Large-Margin Classification in Infinite Neural Networks, Prognosis of EPEX SPOT Electricity Prices Using Artificial Neural Networks, A Regularized Correntropy Framework for Robust Pattern Recognition, A Note on the Size of Denoising Neural Networks, Learning in compressed space, Neural Decoding with Hierarchical Generative Models, Scalable estimation strategies based on stochastic approximations: classical results and new insights, Deep Learning at the Interface of Agricultural Insurance Risk and Spatio-Temporal Uncertainty in Weather Extremes, Deep Splitting Method for Parabolic PDEs, A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures, Complexity of Shallow Networks Representing Finite Mappings, Mathematical Characterization of Sophisticated Variants for Relevance Learning in Learning Matrix Quantization Based on Schatten-p-norms, Entropy Bifurcation of Neural Networks on Cayley Trees, Unnamed Item, Supervised Deep Learning in High Energy Phenomenology: a Mini Review*, Predicting critical transitions in multiscale dynamical systems using reservoir computing, Bayesian Model and Dimension Reduction for Uncertainty Propagation: Applications in Random Media, Construction of reduced-order models for fluid flows using deep feedforward neural networks, Unnamed Item, When Does a Mixture of Products Contain a Product of Mixtures?, Condition Monitoring of Equipment in Oil Wells using Deep Learning, Learning and Memory Processes in Autonomous Agents Using an Intelligent System of Decision-Making, Layer-Parallel Training of Deep Residual Neural Networks, A survey on deep learning and its applications, Anti-synchronization control for delayed memristor-based distributed parameter NNs with mixed boundary conditions, Feasibility-based fixed point networks, Bio-inspired feedback-circuit implementation of discrete, free energy optimizing, winner-take-all computations, Parameter inference in a probabilistic model from data: regulation of transition rate in the Monte Carlo method, Jointly learning shape descriptors and their correspondence via deep triplet CNNs, A topological insight into restricted Boltzmann machines, Centered kernel alignment enhancing neural network pretraining for MRI-based dementia diagnosis, Bidirectional nonnegative deep model and its optimization in learning, Prediction model of permeability index for blast furnace based on the improved multi-layer extreme learning machine and wavelet transform, A novel, gradient boosting framework for sentiment analysis in languages where NLP resources are not plentiful: a case study for modern Greek, Deep extreme learning machine and its application in EEG classification, Topologically ordered feature extraction based on sparse group restricted Boltzmann machines, \(p\)-adic mathematical physics: the first 30 years, Many regression algorithms, one unified model: a review, Realization problem of multi-layer cellular neural networks, Learning with infinitely many features, Manifold regularization based on Nyström type subsampling, Hierarchical semi-Markov conditional random fields for deep recursive sequential data, Designing phononic crystal with anticipated band gap through a deep learning based data-driven method, Cost-sensitive sequential three-way decision modeling using a deep neural network, Why does deep and cheap learning work so well?, Probabilistic lower bounds for approximation by shallow perceptron networks, Accelerating deep learning with memcomputing, Compositionally-warped Gaussian processes, Trends in extreme learning machines: a review, Editorial introduction to the neural networks special issue on deep learning of representations, Two-layer contractive encodings for learning stable nonlinear features, Deep learning of support vector machines with class probability output networks, Dimensionality reduction by mixed kernel canonical correlation analysis, Deep multimodal fusion: a hybrid approach, Training restricted Boltzmann machines: an introduction, The C-loss function for pattern classification, On the equivalence of Hopfield networks and Boltzmann machines, Aspects in classification learning -- review of recent developments in learning vector quantization, Preserving differential privacy in convolutional deep belief networks, Model of protein fragments and statistical potentials, Approximate greatest descent in neural network optimization, The learning problem of multi-layer neural networks, Improved multi-layer online sequential extreme learning machine and its application for hot metal silicon content, Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification, Wasserstein discriminant analysis, A tabu-search heuristic for deterministic two-mode blockmodeling of binary network matrices, Optimal learning with anisotropic Gaussian SVMs, A CNN-based shock detection method in flow visualization, Data-driven inverse modelling through neural network (deep learning) and computational heat transfer, Infinite ensemble clustering, Spatiotemporal adaptive neural network for long-term forecasting of financial time series, Vulnerability of classifiers to evolutionary generated adversarial examples, Deep autoencoders for physics-constrained data-driven nonlinear materials modeling, Bigeometric organization of deep nets, Forward stability of ResNet and its variants, Deep neural networks motivated by partial differential equations, Discovery without a `logic' would be a miracle, Wavelet-based option pricing: an empirical study, Graph-induced restricted Boltzmann machines for document modeling, Near universal consistency of the maximum pseudolikelihood estimator for discrete models, A distributed algorithm for the cluster-based outlier detection using unsupervised extreme learning machines, Lie group impression for deep learning, Achieving a compromise between performance and complexity of structure: an incremental approach, Selection dynamics for deep neural networks, Sufficient forecasting using factor models, Face recognition via deep stacked denoising sparse autoencoders (DSDSA), Privacy-preserving restricted Boltzmann machine, Deep learning for model order reduction of multibody systems to minimal coordinates, Learning vector quantization classifiers for ROC-optimization, A thermodynamic perspective of immune capabilities, Mittag-Leffler stability of fractional-order neural networks in the presence of generalized piecewise constant arguments, Modeling the cost of energy in public sector buildings by linear regression and deep learning, Continuous-time system identification with neural networks: model structures and fitting criteria, Deep network based on stacked orthogonal convex incremental ELM autoencoders, Simplified information maximization for improving generalization performance in multilayered neural networks, Nonredundant sparse feature extraction using autoencoders with receptive fields clustering, Deep neural mapping support vector machines, Limitations of shallow nets approximation, A linear relation between input and first layer in neural networks, A minimal model of the interaction of social and individual learning, Neural random forests, The voice of optimization, An analytic layer-wise deep learning framework with applications to robotics, Recurrent neural networks for stochastic control problems with delay, Network embedding: taxonomies, frameworks and applications, Prediction of aerodynamic flow fields using convolutional neural networks, A mean-field optimal control formulation of deep learning, Interpretable machine learning: fundamental principles and 10 grand challenges, A deep learning framework for hybrid heterogeneous transfer learning, Syntax-aware entity representations for neural relation extraction, Improved handwritten digit recognition using quantum \(K\)-nearest neighbor algorithm, Complete set of translation invariant measurements with Lipschitz bounds, Diffusion nets, Fully hyperbolic convolutional neural networks, Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations, Data driven approximation of parametrized PDEs by reduced basis and neural networks, Detecting anomalous packets in network transfers: investigations using PCA, autoencoder and isolation forest in TCP, Sharing hash codes for multiple purposes, Deep learning of chroma representation for cover song identification in compression domain, A novel parallel auto-encoder framework for multi-scale data in civil structural health monitoring, Key time steps selection for CFD data based on deep metric learning, Recurrence plot and convolutional neural networks for terrain classification using energy consumption of multi-legged robots, Provable ICA with unknown Gaussian noise, and implications for Gaussian mixtures and autoencoders