Iterative Neural Networks with Bounded Weights
From MaRDI portal
Publication:6323767
arXiv1908.05982MaRDI QIDQ6323767FDOQ6323767
Authors: Tomasz Piotrowski, Krzysztof Rykaczewski
Publication date: 16 August 2019
Abstract: A recent analysis of a model of iterative neural network in Hilbert spaces established fundamental properties of such networks, such as existence of the fixed points sets, convergence analysis, and Lipschitz continuity. Building on these results, we show that under a single mild condition on the weights of the network, one is guaranteed to obtain a neural network converging to its unique fixed point. We provide a bound on the norm of this fixed point in terms of norms of weights and biases of the network. We also show why this model of a feed-forward neural network is not able to accomodate Hopfield networks under our assumption.
This page was built for publication: Iterative Neural Networks with Bounded Weights
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6323767)