Nonlinear approximation via compositions

DOI10.1016/j.neunet.2019.07.011zbMath1475.41013arXiv1902.10170OpenAlexW2965192329WikidataQ92547051 ScholiaQ92547051MaRDI QIDQ2185653

Zuowei Shen, Haizhao Yang, Shijun Zhang

Publication date: 5 June 2020

Published in: Neural Networks (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1902.10170

zbMATH Keywords

parallel computingHölder continuitynonlinear approximationfunction compositiondeep neural networksReLU activation function

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Functional equations in the complex plane, iteration and composition of analytic functions of one complex variable (30D05) Multidimensional problems (41A63) Rate of convergence, degree of approximation (41A25) Special approximation methods (nonlinear Galerkin, etc.) for infinite-dimensional dissipative dynamical systems (37L65)

Related Items (23)

Int-Deep: a deep learning initialized iterative method for nonlinear problems ⋮ Neural network approximation ⋮ SelectNet: self-paced learning for high-dimensional partial differential equations ⋮ Finite-Sample Two-Group Composite Hypothesis Testing via Machine Learning ⋮ Approximation properties of deep ReLU CNNs ⋮ Convergence Rate Analysis for Deep Ritz Method ⋮ Deep ReLU Networks Overcome the Curse of Dimensionality for Generalized Bandlimited Functions ⋮ Full error analysis for the training of deep neural networks ⋮ Simultaneous neural network approximation for smooth functions ⋮ Deep Neural Networks for Solving Large Linear Systems Arising from High-Dimensional Problems ⋮ Neural network approximation: three hidden layers are enough ⋮ A deep network construction that adapts to intrinsic dimensionality beyond the domain ⋮ Overall error analysis for the training of deep neural networks via stochastic gradient descent with random initialisation ⋮ Just least squares: binary compressive sampling with low generative intrinsic dimension ⋮ Deep nonparametric regression on approximate manifolds: nonasymptotic error bounds with polynomial prefactors ⋮ Deep learning via dynamical systems: an approximation perspective ⋮ A review on deep learning in medical image reconstruction ⋮ Approximation in shift-invariant spaces with deep ReLU neural networks ⋮ Deep Network Approximation for Smooth Functions ⋮ Deep Network Approximation Characterized by Number of Neurons ⋮ Chebyshev approximation of multivariable functions by the exponential expression ⋮ Optimal approximation rate of ReLU networks in terms of width and depth ⋮ Deep Network With Approximation Error Being Reciprocal of Width to Power of Square Root of Depth

Uses Software

• AdaGrad

Cites Work

• Unnamed Item
• Unnamed Item
• Constructive approximate interpolation by neural networks
• Nonlinear approximation using Gaussian kernels
• Neocognition: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position
• Efficient distribution-free learning of probabilistic concepts
• Saturation classes for MAX-product neural network operators activated by sigmoidal functions
• Multilayer feedforward networks are universal approximators
• Approximation results in Orlicz spaces for sequences of Kantorovich MAX-product neural network operators
• Approximation of functions of finite variation by superpositions of a sigmoidal function.
• Multivariate \(n\)-term rational and piecewise polynomial approximation
• The rate of approximation of Gaussian radial basis neural networks in continuous function space
• Exponential convergence of the deep neural network approximation for analytic functions
• Optimal approximation of piecewise smooth functions using deep ReLU neural networks
• Almost optimal estimates for approximation and learning by radial basis function networks
• Error bounds for approximations with deep ReLU networks
• Convergence for a family of neural network operators in Orlicz spaces
• Approximation using scattered shifts of a multivariate function
• Ten Lectures on Wavelets
• Universal approximation bounds for superpositions of a sigmoidal function
• Matching pursuits with time-frequency dictionaries
• Compressed sensing
• Approximation by superpositions of a sigmoidal function

This page was built for publication: Nonlinear approximation via compositions