Data-driven learning of feedforward neural networks with different activation functions
From MaRDI portal
Publication:2148705
Abstract: This work contributes to the development of a new data-driven method (D-DM) of feedforward neural networks (FNNs) learning. This method was proposed recently as a way of improving randomized learning of FNNs by adjusting the network parameters to the target function fluctuations. The method employs logistic sigmoid activation functions for hidden nodes. In this study, we introduce other activation functions, such as bipolar sigmoid, sine function, saturating linear functions, reLU, and softplus. We derive formulas for their parameters, i.e. weights and biases. In the simulation study, we evaluate the performance of FNN data-driven learning with different activation functions. The results indicate that the sigmoid activation functions perform much better than others in the approximation of complex, fluctuated target functions.
Recommendations
- Deep neural networks with a set of node-wise varying activation functions
- scientific article; zbMATH DE number 1304395
- Diffusion learning algorithms for feedforward neural networks
- Neural learning methods yielding functional invariance
- Data processing and feature screening in function approximation: An application to neural networks
Cited in
(2)
This page was built for publication: Data-driven learning of feedforward neural networks with different activation functions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2148705)
