Numerical computation of partial differential equations by hidden-layer concatenated extreme learning machine
From MaRDI portal
(Redirected from Publication:6159015)
extreme learning machinehidden layer concatenationleast squaresrandom basisrandom weight neural networksscientific machine learning
Algorithms for approximation of functions (65D15) Spectral, collocation and related methods for initial value and initial-boundary value problems involving PDEs (65M70) Numerical methods for partial differential equations, initial value and time-dependent initial-boundary value problems (65M99) Numerical methods for partial differential equations, boundary value problems (65N99) Artificial neural networks and deep learning (68T07)
Abstract: The extreme learning machine (ELM) method can yield highly accurate solutions to linear/nonlinear partial differential equations (PDEs), but requires the last hidden layer of the neural network to be wide to achieve a high accuracy. If the last hidden layer is narrow, the accuracy of the existing ELM method will be poor, irrespective of the rest of the network configuration. In this paper we present a modified ELM method, termed HLConcELM (hidden-layer concatenated ELM), to overcome the above drawback of the conventional ELM method. The HLConcELM method can produce highly accurate solutions to linear/nonlinear PDEs when the last hidden layer of the network is narrow and when it is wide. The new method is based on a type of modified feedforward neural networks (FNN), termed HLConcFNN (hidden-layer concatenated FNN), which incorporates a logical concatenation of the hidden layers in the network and exposes all the hidden nodes to the output-layer nodes. HLConcFNNs have the interesting property that, given a network architecture, when additional hidden layers are appended to the network or when extra nodes are added to the existing hidden layers the representation capacity of the HLConcFNN associated with the new architecture is guaranteed to be not smaller than that of the original network architecture. Here representation capacity refers to the set of all functions that can be exactly represented by the neural network of a given architecture. We present ample benchmark tests with linear/nonlinear PDEs to demonstrate the computational accuracy and performance of the HLConcELM method and the superiority of this method to the conventional ELM from previous works.
Recommendations
- Solving partial differential equation based on extreme learning machine
- Numerical solution and bifurcation analysis of nonlinear partial differential equations with extreme learning machines
- On computing the hyperparameter of extreme learning machines: algorithm and application to computational PDEs, and comparison with classical and high-order finite elements
- An exploratory study on machine learning to couple numerical solutions of partial differential equations
- Extreme learning machine collocation for the numerical solution of elliptic PDEs with sharp gradients
- Local extreme learning machines and domain decomposition for solving linear and nonlinear partial differential equations
- Deep learning methods for partial differential equations and related parameter identification problems
- Solving high-dimensional partial differential equations using deep learning
- Neural‐network‐based approximations for solving partial differential equations
- A novel numerical scheme for fractional differential equations using extreme learning machine
Cites work
- A family of second-order energy-stable schemes for Cahn-Hilliard type equations
- A method for representing periodic functions and enforcing exactly periodic boundary conditions with deep neural networks
- A modified batch intrinsic plasticity method for pre-training the random coefficients of extreme learning machines
- A novel improved extreme learning machine algorithm in solving ordinary differential equations by Legendre neural network methods
- A roadmap for discretely energy-stable schemes for dissipative systems based on a generalized auxiliary variable with guaranteed positivity
- A Subspace, Interior, and Conjugate Gradient Method for Large-Scale Bound-Constrained Minimization Problems
- Adaptive deep density approximation for Fokker-Planck equations
- An eigen-based high-order expansion basis for structured spectral elements
- An unconditionally energy-stable scheme based on an implicit auxiliary energy variable for incompressible two-phase flows with different densities involving only precomputable coefficient matrices
- Approximate solution of the trust region problem by minimization over two-dimensional subspaces
- Conservative physics-informed neural networks on discrete domains for conservation laws: applications to forward and inverse problems
- ConvPDE-UQ: convolutional neural networks with quantified uncertainty for heterogeneous elliptic partial differential equations on varied domains
- Deep learning
- DeepXDE: a deep learning library for solving differential equations
- DGM: a deep learning algorithm for solving partial differential equations
- Extreme learning machine collocation for the numerical solution of elliptic PDEs with sharp gradients
- Growing axons: greedy learning of neural networks with application to function approximation
- scientific article; zbMATH DE number 5060482 (Why is no real title available?)
- Local extreme learning machines and domain decomposition for solving linear and nonlinear partial differential equations
- MgNet: a unified framework of multigrid and convolutional neural network
- Nonlinear analysis of hydrodynamic instability in laminar flames—I. Derivation of basic equations
- Numerical approximation of partial differential equations by a variable projection method with artificial neural networks
- Numerical solution and bifurcation analysis of nonlinear partial differential equations with extreme learning machines
- On computing the hyperparameter of extreme learning machines: algorithm and application to computational PDEs, and comparison with classical and high-order finite elements
- On the computational power of circuits of spiking neurons
- Optimization and applications of echo state networks with leaky- integrator neurons
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Reservoir computing approaches to recurrent neural network training
- Spectral and finite difference solutions of the Burgers equations
- Spectral/hp Element Methods for Computational Fluid Dynamics
- The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
- Trends in extreme learning machines: a review
- VAE-KRnet and its applications to variational Bayes
- When and why PINNs fail to train: a neural tangent kernel perspective
Cited in
(23)- Solving partial differential equation based on extreme learning machine
- Numerical approximation of partial differential equations by a variable projection method with artificial neural networks
- Numerical solution and bifurcation analysis of nonlinear partial differential equations with extreme learning machines
- Local extreme learning machines and domain decomposition for solving linear and nonlinear partial differential equations
- Extreme learning machine collocation for the numerical solution of elliptic PDEs with sharp gradients
- On computing the hyperparameter of extreme learning machines: algorithm and application to computational PDEs, and comparison with classical and high-order finite elements
- Emulated digital CNN-UM solution of partial differential equations
- Time discretization in the solution of parabolic PDEs with ANNs
- A method for computing inverse parametric PDE problems with random-weight neural networks
- An extreme learning machine-based method for computational PDEs in higher dimensions
- A Chebyshev neural network-based numerical scheme to solve distributed-order fractional differential equations
- Numerical algorithm with fifth-order accuracy for axisymmetric Laplace equation with linear boundary value problem
- An accurate and efficient continuity-preserved method based on randomized neural networks for elliptic interface problems
- Least squares with equality constraints extreme learning machines for the resolution of PDEs
- A novel Fourier feature network for solving partial differential equations
- A functionally connected element method for solving boundary value problems
- Subspace method based on neural networks for solving the partial differential equation
- High-precision physics-informed extreme learning machines for evolving interface problems
- Overlapping Schwarz preconditioners for randomized neural networks with domain decomposition
- Error analysis and numerical algorithm for PDE approximation with hidden-layer concatenated physics informed neural networks
- Adaptive multilayer extreme learning machines
- A machine learning method for solving PDEs with a robust initial learning rate based on Lagrange multiplier optimization
- Neural network algorithm based on Legendre improved extreme learning machine for solving elliptic partial differential equations
This page was built for publication: Numerical computation of partial differential equations by hidden-layer concatenated extreme learning machine
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6159015)
