Data driven governing equations approximation using deep neural networks

DOI10.1016/j.jcp.2019.06.042zbMath1455.65125arXiv1811.05537OpenAlexW2951629468WikidataQ127676911 ScholiaQ127676911MaRDI QIDQ2222362

Kailiang Wu, Dongbin Xiu, Tong Qin

Publication date: 26 January 2021

Published in: Journal of Computational Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1811.05537

zbMATH Keywords

recurrent neural networkresidual networkdeep neural networkgoverning equation discovery

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Dynamics induced by flows and semiflows (37C10) Time series analysis of dynamical systems (37M10) Numerical methods for ordinary differential equations (65L99)

Related Items (63)

Using deep learning to extend the range of air pollution monitoring and forecasting ⋮ Data-driven deep learning of partial differential equations in modal space ⋮ On generalized residual network for deep learning of unknown dynamical systems ⋮ DLGA-PDE: discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm ⋮ Deep learning of free boundary and Stefan problems ⋮ Weak SINDy for partial differential equations ⋮ System identification through Lipschitz regularized deep neural networks ⋮ Extended dynamic mode decomposition for inhomogeneous problems ⋮ Deep-learning based discovery of partial differential equations in integral form from sparse and noisy data ⋮ Clustered active-subspace based local Gaussian process emulator for high-dimensional and complex computer models ⋮ Dynamic calibration of differential equations using machine learning, with application to turbulence models ⋮ Deep neural network modeling of unknown partial differential equations in nodal space ⋮ A neural network multigrid solver for the Navier-Stokes equations ⋮ Discovery of subdiffusion problem with noisy data via deep learning ⋮ VPNets: volume-preserving neural networks for learning source-free dynamics ⋮ Randomized Newton's method for solving differential equations based on the neural network discretization ⋮ Robust Identification of Differential Equations by Numerical Techniques from a Single Set of Noisy Observation ⋮ Deep learning of biological models from data: applications to ODE models ⋮ Robust topology optimization with low rank approximation using artificial neural networks ⋮ Discovering phase field models from image data with the pseudo-spectral physics informed neural networks ⋮ Generative Adversarial Network for Probabilistic Forecast of Random Dynamical Systems ⋮ A hybrid objective function for robustness of artificial neural networks -- estimation of parameters in a mechanical system ⋮ The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimation ⋮ DeepParticle: learning invariant measure by a deep neural network minimizing Wasserstein distance on data generated from an interacting particle method ⋮ Data-driven sparse identification of nonlinear dynamical systems using linear multistep methods ⋮ Data-driven synchronization-avoiding algorithms in the explicit distributed structural analysis of soft tissue ⋮ DRIPS: a framework for dimension reduction and interpolation in parameter space ⋮ Adaptive group Lasso neural network models for functions of few variables and time-dependent data ⋮ Simultaneous neural network approximation for smooth functions ⋮ Sparse dynamical system identification with simultaneous structural parameters and initial condition estimation ⋮ Deep-OSG: deep learning of operators in semigroup ⋮ DNN modeling of partial differential equations with incomplete data ⋮ Accuracy and architecture studies of residual neural network method for ordinary differential equations ⋮ Learning black- and gray-box chemotactic PDEs/closures from agent based Monte Carlo simulation data ⋮ Structure-preserving recurrent neural networks for a class of Birkhoffian systems ⋮ A Review of Data‐Driven Discovery for Dynamic Systems ⋮ A Variational Neural Network Approach for Glacier Modelling with Nonlinear Rheology ⋮ Quadrature rule based discovery of dynamics by data-driven denoising ⋮ On the identification and optimization of nonsmooth superposition operators in semilinear elliptic PDEs ⋮ SPADE4: sparsity and delay embedding based forecasting of epidemics ⋮ Deep neural network based adaptive learning for switched systems ⋮ A learned conservative semi-Lagrangian finite volume scheme for transport simulations ⋮ Local parameter identification with neural ordinary differential equations ⋮ Learning the Dynamics for Unknown Hyperbolic Conservation Laws Using Deep Neural Networks ⋮ On mathematical modeling in image reconstruction and beyond ⋮ Approximation properties of residual neural networks for Kolmogorov PDEs ⋮ WeakIdent: weak formulation for identifying differential equation using narrow-fit and trimming ⋮ Methods to recover unknown processes in partial differential equations using data ⋮ PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network ⋮ Structure-Preserving Method for Reconstructing Unknown Hamiltonian Systems From Trajectory Data ⋮ Discovery of Dynamics Using Linear Multistep Methods ⋮ Artificial neural network approximations of Cauchy inverse problem for linear PDEs ⋮ Bayesian differential programming for robust systems identification under uncertainty ⋮ A Multi-Scale DNN Algorithm for Nonlinear Elliptic Equations with Multiple Scales ⋮ DL-PDE: Deep-Learning Based Data-Driven Discovery of Partial Differential Equations from Discrete and Noisy Data ⋮ A physics-informed operator regression framework for extracting data-driven continuum models ⋮ PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs ⋮ Data-Driven Learning of Nonautonomous Systems ⋮ Learning and meta-learning of stochastic advection–diffusion–reaction systems from sparse measurements ⋮ Probabilistic solutions to DAEs learning from physical data ⋮ Generalized Cell Mapping Method with Deep Learning for Global Analysis and Response Prediction of Dynamical Systems ⋮ Optimization with learning-informed differential equation constraints and its applications ⋮ Robust modeling of unknown dynamical systems via ensemble averaged learning

Uses Software

• TensorFlow
• VAMPnets
• torchdiffeq
• PDE-Net

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Detecting Causality in Complex Ecosystems
• Discovering governing equations from data by sparse identification of nonlinear dynamical systems
• Numerical differentiation of noisy, nonsmooth data
• Non-intrusive reduced order modeling of nonlinear problems using neural networks
• Machine learning of linear differential equations using Gaussian processes
• Hidden physics models: machine learning of nonlinear partial differential equations
• A machine learning approach for efficient uncertainty quantification using multiscale methods
• Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
• Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
• Numerical aspects for approximating governing equations using data
• An artificial neural network as a troubled-cell indicator
• Equation-free, coarse-grained multiscale computation: enabling microscopic simulators to perform system-level analysis
• Neural Networks and Statistical Learning
• Automated reverse engineering of nonlinear dynamical systems
• Universal approximation bounds for superpositions of a sigmoidal function
• Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
• Model selection for dynamical systems via sparse regression and information criteria
• Learning partial differential equations via data discovery and sparse optimization
• Nonlinear Laplacian spectral analysis for time series with intermittency and low-frequency variability

This page was built for publication: Data driven governing equations approximation using deep neural networks