Learning Specialized Activation Functions for Physics-Informed Neural Networks

DOI10.4208/cicp.oa-2023-0058arXiv2308.04073MaRDI QIDQ6143615

Lu Lu, Gao Huang, Shi-ji Song, Honghui Wang

Publication date: 5 January 2024

Published in: Communications in Computational Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2308.04073

zbMATH Keywords

partial differential equationsdeep learningphysics-informed neural networksadaptive activation functions

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Numerical methods for partial differential equations, initial value and time-dependent initial-boundary value problems (65M99)

Cites Work

• Unnamed Item
• The Deep Ritz Method: a deep learning-based numerical algorithm for solving variational problems
• A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations
• When and why PINNs fail to train: a neural tangent kernel perspective
• Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
• Meta-learning PINN loss functions
• Conservative physics-informed neural networks on discrete domains for conservation laws: applications to forward and inverse problems
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Deep learning of vortex-induced vibrations
• A Limited Memory Algorithm for Bound Constrained Optimization
• Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
• A Rate of Convergence of Physics Informed Neural Networks for the Linear Second Order Elliptic PDEs
• MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEs
• DeepXDE: A Deep Learning Library for Solving Differential Equations
• Locally adaptive activation functions with slope recovery for deep and physics-informed neural networks
• Dying ReLU and Initialization: Theory and Numerical Examples
• Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
• A Multi-Scale DNN Algorithm for Nonlinear Elliptic Equations with Multiple Scales
• Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations
• On the Convergence of Physics Informed Neural Networks for Linear Second-Order Elliptic and Parabolic Type PDEs
• Physics-Informed Neural Networks with Hard Constraints for Inverse Design
• fPINNs: Fractional Physics-Informed Neural Networks
• Finite basis physics-informed neural networks (FBPINNs): a scalable domain decomposition approach for solving differential equations

This page was built for publication: Learning Specialized Activation Functions for Physics-Informed Neural Networks