Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks

DOI10.1016/j.jcp.2019.109056zbMath1454.65130arXiv1906.05747OpenAlexW2951392159WikidataQ126978599 ScholiaQ126978599MaRDI QIDQ2222972

Nicholas Zabaras, Nicholas Geneva

Publication date: 28 January 2021

Published in: Journal of Computational Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1906.05747

zbMATH Keywords

autoregressive modeluncertainty quantificationdeep neural networksdynamic partial differential equationsphysics-informed machine learningconvolutional encoder-decoder

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) PDEs in connection with fluid mechanics (35Q35) Numerical methods for partial differential equations, initial value and time-dependent initial-boundary value problems (65M99)

Related Items

Solving inverse problems using conditional invertible neural networks, Data-driven discovery of coarse-grained equations, PhyGeoNet: physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain, On obtaining sparse semantic solutions for inverse problems, control, and neural network training, Extended dynamic mode decomposition for inhomogeneous problems, Learning time-dependent PDEs with a linear and nonlinear separate convolutional neural network, A neural network multigrid solver for the Navier-Stokes equations, CAN-PINN: a fast physics-informed neural network based on coupled-automatic-numerical differentiation method, Scientific machine learning through physics-informed neural networks: where we are and what's next, A physically constrained variational autoencoder for geochemical pattern recognition, VI-DGP: a variational inference method with deep generative prior for solving high-dimensional inverse problems, PhySR: physics-informed deep super-resolution for spatiotemporal data, Transformers for modeling physical systems, On the use of graph neural networks and shape‐function‐based gradient computation in the deep energy method, Adaptive learning of effective dynamics for online modeling of complex systems, On the use of neural networks for full waveform inversion, Long-time integration of parametric evolution equations with physics-informed DeepONets, SeismicNET: physics-informed neural networks for seismic wave modeling in semi-infinite domain, Label-free learning of elliptic partial differential equation solvers with generalizability across boundary value problems, Bi-fidelity modeling of uncertain and partially unknown systems using DeepONets, Finite basis physics-informed neural networks (FBPINNs): a scalable domain decomposition approach for solving differential equations, Numerical Analysis for Convergence of a Sample-Wise Backpropagation Method for Training Stochastic Neural Networks, Physics-informed ConvNet: learning physical field from a shallow neural network, Bi-fidelity variational auto-encoder for uncertainty quantification, An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operator, Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks, Variational Inference Formulation for a Model-Free Simulation of a Dynamical System with Unknown Parameters by a Recurrent Neural Network, A hybrid partitioned deep learning methodology for moving interface and fluid-structure interaction, PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs, Mosaic flows: a transferable deep learning framework for solving PDEs on unseen domains, A Bayesian multiscale deep learning framework for flows in random media, Physics-informed graph neural Galerkin networks: a unified framework for solving PDE-governed forward and inverse problems, Physics-constrained deep learning forecasting: an application with capacitance resistive model

Uses Software

• FEniCS
• PyTorch
• Adam
• Tensor2Tensor
• DGM
• PRMLT

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A search for the simplest chaotic partial differential equation
• Exponential time differencing for stiff systems
• The Kuramoto-Sivashinsky equation: a bridge between PDE's and dynamical systems
• Order and complexity in the Kuramoto-Sivashinsky model of weakly turbulent interfaces
• Variational principles for nonpotential operators
• The numerical solution of linear ordinary differential equations by feedforward neural networks
• Solution of nonlinear ordinary differential equations by feedforward neural networks
• Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
• The Deep Ritz Method: a deep learning-based numerical algorithm for solving variational problems
• Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
• DGM: a deep learning algorithm for solving partial differential equations
• Quantifying model form uncertainty in Reynolds-averaged turbulence models with Bayesian deep neural networks
• Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data
• Adversarial uncertainty quantification in physics-informed neural networks
• Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Solving for high-dimensional committor functions using artificial neural networks
• Limit set of trajectories of the coupled viscous Burgers' equations
• A Computational Meshfree Technique for the Numerical Solution of the Two-Dimensional Coupled Burgers' Equations
• GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
• Nonlinear analysis of hydrodynamic instability in laminar flames—II. Numerical experiments
• Acceleration of Stochastic Approximation by Averaging
• 10.1162/15324430152748236
• Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
• Using machine learning to replicate chaotic attractors and calculate Lyapunov exponents from data
• Reynolds averaged turbulence modelling using deep neural networks with embedded invariance
• On the State Space Geometry of the Kuramoto–Sivashinsky Flow in a Periodic Domain
• A Proof that Artificial Neural Networks Overcome the Curse of Dimensionality in the Numerical Approximation of Black–Scholes Partial Differential Equations