Deep hidden physics models: deep learning of nonlinear partial differential equations
From MaRDI portal
Abstract: A long-standing problem at the interface of artificial intelligence and applied mathematics is to devise an algorithm capable of achieving human level or even superhuman proficiency in transforming observed data into predictive mathematical models of the physical world. In the current era of abundance of data and advanced machine learning capabilities, the natural question arises: How can we automatically uncover the underlying laws of physics from high-dimensional data generated from experiments? In this work, we put forth a deep learning approach for discovering nonlinear partial differential equations from scattered and potentially noisy observations in space and time. Specifically, we approximate the unknown solution as well as the nonlinear dynamics by two deep neural networks. The first network acts as a prior on the unknown solution and essentially enables us to avoid numerical differentiations which are inherently ill-conditioned and unstable. The second network represents the nonlinear dynamics and helps us distill the mechanisms that govern the evolution of a given spatiotemporal data-set. We test the effectiveness of our approach for several benchmark problems spanning a number of scientific domains and demonstrate how the proposed framework can help us accurately learn the underlying dynamics and forecast future states of the system. In particular, we study the Burgers', Korteweg-de Vries (KdV), Kuramoto-Sivashinsky, nonlinear Schr"{o}dinger, and Navier-Stokes equations.
Recommendations
- Hidden physics models: machine learning of nonlinear partial differential equations
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network
- Data-driven discovery of PDEs in complex datasets
- NeuralPDE: modelling dynamical systems from data
Cites work
- A fast immersed boundary method using a nullspace approach and multi-domain far-field boundary conditions
- Analysis of Fluid Flows via Spectral Properties of the Koopman Operator
- Applied Koopmanism
- Automated reverse engineering of nonlinear dynamical systems
- Compressed modes for variational problems in mathematics and physics
- Compressive sensing and low-rank libraries for classification of bifurcation regimes in nonlinear dynamical systems
- Deep hidden physics models: deep learning of nonlinear partial differential equations
- Deep learning
- Detecting causality in complex ecosystems
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems
- Equation-free, coarse-grained multiscale computation: enabling microscopic simulators to perform system-level analysis
- Hidden physics models: machine learning of nonlinear partial differential equations
- scientific article; zbMATH DE number 6678650 (Why is no real title available?)
- scientific article; zbMATH DE number 4105912 (Why is no real title available?)
- scientific article; zbMATH DE number 6982909 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Inferring solutions of differential equations using noisy multi-fidelity data
- Machine learning of linear differential equations using Gaussian processes
- Nonlinear Laplacian spectral analysis for time series with intermittency and low-frequency variability
- Normal forms for reduced stochastic climate models
- Numerical Gaussian processes for time-dependent and nonlinear partial differential equations
- On the Compressive Spectral Method
- Sparse dynamics for partial differential equations
- Spectral and finite difference solutions of the Burgers equations
- Spectral properties of dynamical systems, model reduction and decompositions
- The immersed boundary method: a projection approach
Cited in
(only showing first 100 items - show all)- Hidden physics models: machine learning of nonlinear partial differential equations
- IDENT: identifying differential equations with numerical time evolution
- A physics-informed operator regression framework for extracting data-driven continuum models
- SciANN: a Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks
- Deep learned finite elements
- Deep learning of thermodynamics-aware reduced-order models from data
- Overcoming the curse of dimensionality in the numerical approximation of Allen-Cahn partial differential equations via truncated full-history recursive multilevel Picard approximations
- Numerical solution of the parametric diffusion equation by deep neural networks
- POD-DL-ROM: enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition
- Limits of random walks with distributionally robust transition probabilities
- PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
- Interpretable machine learning: fundamental principles and 10 grand challenges
- Sparse methods for automatic relevance determination
- Error-correcting neural networks for semi-Lagrangian advection in the level-set method
- Stochastic modeling of inhomogeneities in the aortic wall and uncertainty quantification using a Bayesian encoder-decoder surrogate
- Self-adaptive physics-informed neural networks
- Stabilized neural ordinary differential equations for long-time forecasting of dynamical systems
- Robust modeling of unknown dynamical systems via ensemble averaged learning
- Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation
- Bridging the gap: machine learning to resolve improperly modeled dynamics
- A theoretical analysis of deep neural networks and parametric PDEs
- Using deep learning to extend the range of air pollution monitoring and forecasting
- Data-driven deep learning of partial differential equations in modal space
- DPM: a deep learning PDE augmentation method with application to large-eddy simulation
- On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton-Jacobi partial differential equations
- On generalized residual network for deep learning of unknown dynamical systems
- DLGA-PDE: discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm
- A derivative-free method for solving elliptic partial differential equations with deep neural networks
- Physics-informed machine learning with conditional Karhunen-Loève expansions
- DeepMoD: deep learning for model discovery in noisy data
- On semi analytical and numerical simulations for a mathematical biological model; the time-fractional nonlinear Kolmogorov-Petrovskii-Piskunov (KPP) equation
- System identification through Lipschitz regularized deep neural networks
- Hybrid FEM-NN models: combining artificial neural networks with the finite element method
- MIM: a deep mixed residual method for solving high-order partial differential equations
- DeLISA: deep learning based iteration scheme approximation for solving PDEs
- Learning time-dependent PDEs with a linear and nonlinear separate convolutional neural network
- A two-stage physics-informed neural network method based on conserved quantities and applications in localized wave solutions
- Thermodynamically consistent physics-informed neural networks for hyperbolic systems
- When and why PINNs fail to train: a neural tangent kernel perspective
- Deep neural network modeling of unknown partial differential equations in nodal space
- Revealing hidden dynamics from time-series data by ODENet
- CAN-PINN: a fast physics-informed neural network based on coupled-automatic-numerical differentiation method
- Choice of an initial guess for Newton's method to solve nonlinear differential equations
- Data-driven discovery of governing equations for transient heat transfer analysis
- Error estimates for deep learning methods in fluid dynamics
- Discovery of subdiffusion problem with noisy data via deep learning
- Numerical bifurcation analysis of PDEs from lattice Boltzmann model simulations: a parsimonious machine learning approach
- Deep neural network approximations for solutions of PDEs based on Monte Carlo algorithms
- Solving elliptic equations with Brownian motion: bias reduction and temporal difference learning
- Scientific machine learning through physics-informed neural networks: where we are and what's next
- Modelling spatiotemporal dynamics from Earth observation data with neural differential equations
- Five semi analytical and numerical simulations for the fractional nonlinear space-time telegraph equation
- Stochastic physics-informed neural ordinary differential equations
- Fractional Chebyshev deep neural network (FCDNN) for solving differential models
- A data-driven surrogate to image-based flow simulations in porous media
- Methods to recover unknown processes in partial differential equations using data
- Data-driven discovery of PDEs in complex datasets
- Adversarial uncertainty quantification in physics-informed neural networks
- Data driven governing equations approximation using deep neural networks
- Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
- PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network
- Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks
- Physics-informed multi-LSTM networks for metamodeling of nonlinear structures
- Prediction and identification of physical systems by means of physically-guided neural networks with meaningful internal layers
- Data-driven identification of 2D partial differential equations using extracted physical features
- On the eigenvector bias of Fourier feature networks: from regression to solving multi-scale PDEs with physics-informed neural networks
- A nonlocal physics-informed deep learning framework using the peridynamic differential operator
- Physics informed by deep learning: numerical solutions of modified Korteweg-de Vries equation
- Parametric deep energy approach for elasticity accounting for strain gradient effects
- General solutions for nonlinear differential equations: a rule-based self-learning approach using deep reinforcement learning
- A machine learning framework for data driven acceleration of computations of differential equations
- An energy approach to the solution of partial differential equations in computational mechanics via machine learning: concepts, implementation and applications
- Deep learning algorithm for data-driven simulation of noisy dynamical system
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Discovering phase field models from image data with the pseudo-spectral physics informed neural networks
- A hybrid inference system for improved curvature estimation in the level-set method using machine learning
- Physics and equality constrained artificial neural networks: application to forward and inverse problems with multi-fidelity data fusion
- Operator inference and physics-informed learning of low-dimensional models for incompressible flows
- ModalPINN: an extension of physics-informed neural networks with enforced truncated Fourier decomposition for periodic flow reconstruction using a limited number of imperfect sensors
- A physically constrained variational autoencoder for geochemical pattern recognition
- Wavelet neural operator for solving parametric partial differential equations in computational mechanics problems
- Sparse dynamical system identification with simultaneous structural parameters and initial condition estimation
- Extension of dynamic mode decomposition for dynamic systems with incomplete information based on t-model of optimal prediction
- CPINNs: a coupled physics-informed neural networks for the closed-loop geothermal system
- Long-time integration of parametric evolution equations with physics-informed DeepONets
- Neural network architectures using min-plus algebra for solving certain high-dimensional optimal control problems and Hamilton-Jacobi PDEs
- Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning
- Deep energy method in topology optimization applications
- An overview on deep learning-based approximation methods for partial differential equations
- Learning elliptic partial differential equations with randomized linear algebra
- Numerical Gaussian processes for time-dependent and nonlinear partial differential equations
- Deep hidden physics models: deep learning of nonlinear partial differential equations
- Deep learning of vortex-induced vibrations
- Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
- Deep splitting method for parabolic PDEs
- Robust and optimal sparse regression for nonlinear PDE models
- Data-driven learning of nonautonomous systems
- Learning interaction kernels in heterogeneous systems of agents from multiple trajectories
- Deep learning models for global coordinate transformations that linearise PDEs
- Generalized Cell Mapping Method with Deep Learning for Global Analysis and Response Prediction of Dynamical Systems
This page was built for publication: Deep hidden physics models: deep learning of nonlinear partial differential equations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4558167)