Nonlinearity creates linear independence
From MaRDI portal
Publication:1923888
DOI10.1007/BF02124743zbMath0855.92007MaRDI QIDQ1923888
Publication date: 9 February 1997
Published in: Advances in Computational Mathematics (Search for Journal in Brave)
Fourier transformplane wavesscalinglinear independencenonlinear mappingactivation functionshiftingcomplete linear independencefinite mappingstrict linear independencestructural uniqueness of neural networks
Learning and adaptive systems in artificial intelligence (68T05) Neural networks for/in biological studies, artificial life and related topics (92B20)
Related Items
An associative memory readout for ESNs with applications to dynamical pattern recognition, Max-product neural network and quasi-interpolation operators activated by sigmoidal functions, Activation Functions Defined on Higher-Dimensional Spaces for Approximation on Compact Sets with and without Scaling, Neural network operators: constructive interpolation of multivariate functions, Asymptotics of Reinforcement Learning with Neural Networks, Time discretization in the solution of parabolic PDEs with ANNs, Normalization effects on deep neural networks, Approximation by sums of ridge functions with fixed directions, Extreme learning machine collocation for the numerical solution of elliptic PDEs with sharp gradients, Analysis and Design of Echo State Networks, Hermite interpolation by neural networks, Normalization effects on shallow neural networks and related asymptotic expansions, Constructive approximate interpolation by neural networks, Interpolation by ridge polynomials and its application in neural networks
Cites Work
- Multilayer feedforward networks are universal approximators
- Differentiable approximation by means of the Radon transformation and its applications to neural networks
- Approximation Capability of Layered Neural Networks with Sigmoid Units on Two Layers
- Learning representations by back-propagating errors
- A logical calculus of the ideas immanent in nervous activity
- Approximation by superpositions of a sigmoidal function
- Unnamed Item
- Unnamed Item
- Unnamed Item