A survey on modern trainable activation functions

DOI10.1016/j.neunet.2021.01.026zbMath1521.68107arXiv2005.00817OpenAlexW3023212902MaRDI QIDQ6078705

Francesco Isgrò, Francesco Donnarumma, Roberto Prevete, Andrea Apicella

Publication date: 28 September 2023

Published in: Neural Networks (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2005.00817

zbMATH Keywords

neural networksmachine learningactivation functionslearnable activation functionstrainable activation functions

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Related Items

Navigation system-based routing strategies in traffic flows on networks ⋮ Tree-structured neural networks: spatiotemporal dynamics and optimal control ⋮ Physics-informed deep learning for three-dimensional transient heat transfer analysis of functionally graded materials ⋮ Modeling of the thermal softening of metals under impact loads and their temperature-time correspondence ⋮ Discontinuous neural networks and discontinuity learning

Cites Work

• A class \(+1\) sigmoidal activation functions for FFANNs
• Multilayer feedforward networks are universal approximators
• Neural network with unbounded activation functions is universal approximator
• Local minima in hierarchical structures of complex-valued neural networks
• Designing Structured Sparse Dictionaries for Sparse Representation Modeling
• Approximation by superpositions of a sigmoidal function
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item