Approximation by series of sigmoidal functions with applications to neural networks

DOI10.1007/s10231-013-0378-yzbMath1321.41021OpenAlexW2058949080MaRDI QIDQ2255377

Danilo Costarelli, Renato Spigler

Publication date: 9 February 2015

Published in: Annali di Matematica Pura ed Applicata. Serie Quarta (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s10231-013-0378-y

zbMATH Keywords

neural networkssigmoidal functionstruncation errormultiresolution approximationwavelet-scaling functions

Mathematics Subject Classification ID

Nontrigonometric harmonic analysis involving wavelets and other special systems (42C40) Linear operator approximation theory (47A58) Rate of convergence, degree of approximation (41A25) Approximation by other special function classes (41A30)

Related Items (23)

Approximation theorems for a family of multivariate neural network operators in Orlicz-type spaces ⋮ Approximation by max-product neural network operators of Kantorovich type ⋮ Global Mittag-Leffler stability of complex valued fractional-order neural network with discrete and distributed delays ⋮ Max-product neural network and quasi-interpolation operators activated by sigmoidal functions ⋮ DENSITY RESULTS BY DEEP NEURAL NETWORK OPERATORS WITH INTEGER WEIGHTS ⋮ Degree of Approximation for Nonlinear Multivariate Sampling Kantorovich Operators on Some Functions Spaces ⋮ Solving numerically nonlinear systems of balance laws by multivariate sigmoidal functions approximation ⋮ Neural network interpolation operators activated by smooth ramp functions ⋮ Neural network operators: constructive interpolation of multivariate functions ⋮ Voronovskaja type theorems and high-order convergence neural network operators with sigmoidal functions ⋮ Saturation classes for MAX-product neural network operators activated by sigmoidal functions ⋮ Pointwise and uniform approximation by multivariate neural network operators of the max-product type ⋮ Convergence for a family of neural network operators in Orlicz spaces ⋮ Approximation results for neural network operators activated by sigmoidal functions ⋮ ExSpliNet: An interpretable and expressive spline-based neural network ⋮ Rate of approximation for multivariate sampling Kantorovich operators on some functions spaces ⋮ Estimates for the neural network operators of the max-product type with continuous and \(p\)-integrable functions ⋮ An adaptive learning rate backpropagation‐type neural network for solving n × n systems on nonlinear algebraic equations ⋮ Asymptotic expansion for neural network operators of the Kantorovich type and high order of approximation ⋮ Approximation by exponential sampling type neural network operators ⋮ Rates of approximation by neural network interpolation operators ⋮ Approximate solutions of Volterra integral equations by an interpolation method based on ramp functions ⋮ High-order approximation rates for shallow neural networks with cosine and \(\mathrm{ReLU}^k\) activation functions

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Solving Volterra integral equations of the second kind by sigmoidal functions approximation
• Approximation results for neural network operators activated by sigmoidal functions
• Multivariate neural network operators with sigmoidal activation functions
• Univariate hyperbolic tangent neural network approximation
• Multivariate hyperbolic tangent neural network approximation
• Numerical solution for high order differential equations using a hybrid neural network-optimization method
• The approximation operators with sigmoidal functions
• The sampling theorem and linear prediction in signal analysis
• Approximation by superposition of sigmoidal and radial basis functions
• Univariant approximation by superpositions of a sigmoidal function
• Approximation order to a function in \(\overline C({\mathbb R})\) by superposition of a sigmoidal function
• Approximation of functions of finite variation by superpositions of a sigmoidal function.
• Degree of approximation by neural and translation networks with a single hidden layer
• Simultaneous approximations of multivariate functions and their derivatives by neural networks with one hidden layer
• Multiresolution Approximations and Wavelet Orthonormal Bases of L 2 (R)
• Universal approximation bounds for superpositions of a sigmoidal function
• Constructive Approximation by Superposition of Sigmoidal Functions
• Mathematical modeling in economics, ecology and the environment
• Approximation by superpositions of a sigmoidal function
• Approximation by superpositions of a sigmoidal function
• Approximation by radial bases and neural networks
• A practical guide to splines.

This page was built for publication: Approximation by series of sigmoidal functions with applications to neural networks