A weight initialization based on the linear product structure for neural networks
From MaRDI portal
Publication:2247166
DOI10.1016/J.AMC.2021.126722OpenAlexW3205063073MaRDI QIDQ2247166FDOQ2247166
Authors: Qipin Chen, Wenrui Hao, Juncai He 
Publication date: 16 November 2021
Published in: Applied Mathematics and Computation (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/2109.00125
Recommendations
- Structural, Syntactic, and Statistical Pattern Recognition
- Dying ReLU and initialization: theory and numerical examples
- Solving the linear interval tolerance problem for weight initialization of neural networks
- New Approach of Recurrent Neural Network Weight Initialization
- New weight learning strategy for fully connected feedforward neural networks
Numerical analysis (65-XX) Probabilistic methods, stochastic differential equations (65Cxx) Nonlinear algebraic or transcendental equations (65Hxx)
Cites Work
- Numerically solving polynomial systems with Bertini
- The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
- The Numerical Solution of Systems of Polynomials Arising in Engineering and Science
- A gradient descent method for solving a system of nonlinear equations
- An adaptive homotopy method for computing bifurcations of nonlinear parametric systems
- A homotopy training algorithm for fully connected neural networks
- Dying ReLU and Initialization: Theory and Numerical Examples
Cited In (9)
- Efficient Initialization of Artificial Neural Network Weights for Electrical Component Models
- A Weight Initialization Based on the Linear Product Structure for Neural Networks
- Global exponential stability for delayed Clifford-valued coupled neural networks with impulsive effects
- A new initialization method for neural networks with weight sharing
- Structural, Syntactic, and Statistical Pattern Recognition
- A mathematical framework for improved weight initialization of neural networks using Lagrange multipliers
- Solving the linear interval tolerance problem for weight initialization of neural networks
- Side effects of learning from low-dimensional data embedded in a Euclidean space
- Exponential synchronisation for delayed Clifford-valued coupled switched neural networks via static event-triggering rule
Uses Software
This page was built for publication: A weight initialization based on the linear product structure for neural networks
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2247166)
