Numerical Gaussian processes for time-dependent and nonlinear partial differential equations
From MaRDI portal
Abstract: We introduce the concept of numerical Gaussian processes, which we define as Gaussian processes with covariance functions resulting from temporal discretization of time-dependent partial differential equations. Numerical Gaussian processes, by construction, are designed to deal with cases where: (1) all we observe are noisy data on black-box initial conditions, and (2) we are interested in quantifying the uncertainty associated with such noisy data in our solutions to time-dependent partial differential equations. Our method circumvents the need for spatial discretization of the differential operators by proper placement of Gaussian process priors. This is an attempt to construct structured and data-efficient learning machines, which are explicitly informed by the underlying physics that possibly generated the observed data. The effectiveness of the proposed approach is demonstrated through several benchmark problems involving linear and nonlinear time-dependent operators. In all examples, we are able to recover accurate approximations of the latent solutions, and consistently propagate uncertainty, even in cases involving very long time integration.
Recommendations
- Bayesian numerical methods for nonlinear partial differential equations
- Hidden physics models: machine learning of nonlinear partial differential equations
- Deep hidden physics models: deep learning of nonlinear partial differential equations
- Inferring solutions of differential equations using noisy multi-fidelity data
- Gaussian functional regression for linear partial differential equations
Cites work
- 10.1162/15324430152748236
- A First Course in the Numerical Analysis of Differential Equations
- Brittleness of Bayesian inference under finite information in a continuous world
- Diagonally Implicit Runge–Kutta Methods for Stiff O.D.E.’s
- Gaussian processes for machine learning.
- scientific article; zbMATH DE number 4098703 (Why is no real title available?)
- scientific article; zbMATH DE number 3551792 (Why is no real title available?)
- scientific article; zbMATH DE number 1391397 (Why is no real title available?)
- scientific article; zbMATH DE number 5055767 (Why is no real title available?)
- scientific article; zbMATH DE number 3227378 (Why is no real title available?)
- Inferring solutions of differential equations using noisy multi-fidelity data
- Machine learning of linear differential equations using Gaussian processes
- Machine learning. A probabilistic perspective
- Machine learning: Trends, perspectives, and prospects
- Numerical Methods for Ordinary Differential Equations
- Posterior consistency for Gaussian process approximations of Bayesian posterior distributions
- Probabilistic numerics and uncertainty in computations
- Regularization algorithms for learning that are equivalent to multilayer networks
- Spectral and finite difference solutions of the Burgers equations
- Statistical analysis of differential equations: introducing probability measures on numerical solutions
- Theory of Reproducing Kernels
- Theory of reproducing kernels and applications
Cited in
(only showing first 100 items - show all)- A new class of high-order methods for fluid dynamics simulations using Gaussian process modeling: one-dimensional case
- Inferring solutions of differential equations using noisy multi-fidelity data
- Gaussian functional regression for linear partial differential equations
- Bayesian numerical methods for nonlinear partial differential equations
- Optimally weighted loss functions for solving PDEs with neural networks
- Interpretable machine learning: fundamental principles and 10 grand challenges
- Monte Carlo fPINNs: deep learning method for forward and inverse problems involving high dimensional fractional partial differential equations
- Learning ``best kernels from data in Gaussian process regression. With application to aerodynamics
- The SPDE approach to Matérn fields: graph representations
- Bridging the gap: machine learning to resolve improperly modeled dynamics
- Active training of physics-informed neural networks to aggregate and interpolate parametric solutions to the Navier-Stokes equations
- Randomised one-step time integration methods for deterministic operator differential equations
- Augmented Gaussian random field: theory and computation
- Using neural networks to accelerate the solution of the Boltzmann equation
- System identification through Lipschitz regularized deep neural networks
- SPINN: sparse, physics-based, and partially interpretable neural networks for PDEs
- Solving and learning nonlinear PDEs with Gaussian processes
- Normalizing field flows: solving forward and inverse stochastic differential equations using physics-informed flow models
- Revealing hidden dynamics from time-series data by ODENet
- Learning biological dynamics from spatio-temporal data by Gaussian processes
- Retracted: Model order reduction method based on machine learning for parameterized time-dependent partial differential equations
- Scientific machine learning through physics-informed neural networks: where we are and what's next
- Stress-based topology optimization under uncertainty via simulation-based Gaussian process
- Conservative physics-informed neural networks on discrete domains for conservation laws: applications to forward and inverse problems
- Methods to recover unknown processes in partial differential equations using data
- Data-driven discovery of PDEs in complex datasets
- Neural-net-induced Gaussian process regression for function approximation and PDE solution
- Adversarial uncertainty quantification in physics-informed neural networks
- Approximate Bayesian model inversion for PDEs with heterogeneous and state-dependent coefficients
- Physics-informed cokriging: a Gaussian-process-regression-based multifidelity method for data-model convergence
- Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
- Enforcing constraints for interpolation and extrapolation in generative adversarial networks
- Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
- Sparse identification of truncation errors
- Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
- Data-driven rogue waves and parameter discovery in the defocusing nonlinear Schrödinger equation with a potential using the PINN deep learning
- Numerical solution and bifurcation analysis of nonlinear partial differential equations with extreme learning machines
- Hidden physics model for parameter estimation of elastic wave equations
- Bayesian learning of orthogonal embeddings for multi-fidelity Gaussian processes
- Bi-directional coupling between a PDE-domain and an adjacent data-domain equipped with multi-fidelity sensors
- A hybrid MGA-MSGD ANN training approach for approximate solution of linear elliptic PDEs
- Wasserstein generative adversarial uncertainty quantification in physics-informed neural networks
- A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
- The deep learning Galerkin method for the general Stokes equations
- On the influence of over-parameterization in manifold based surrogates and deep neural operators
- An overview on deep learning-based approximation methods for partial differential equations
- scientific article; zbMATH DE number 4056689 (Why is no real title available?)
- Deep hidden physics models: deep learning of nonlinear partial differential equations
- Deep learning of vortex-induced vibrations
- Data-driven learning of nonautonomous systems
- Learning interaction kernels in heterogeneous systems of agents from multiple trajectories
- Learning and meta-learning of stochastic advection–diffusion–reaction systems from sparse measurements
- Physics information aided kriging using stochastic simulation models
- On a multilevel Levenberg-Marquardt method for the training of artificial neural networks and its application to the solution of partial differential equations
- A new artificial neural network method for solving Schrödinger equations on unbounded domains
- APIK: Active Physics-Informed Kriging Model with Partial Differential Equations
- Autodifferentiable ensemble Kalman filters
- The discovery of dynamics via linear multistep methods and deep learning: error estimation
- Generative stochastic modeling of strongly nonlinear flows with non-Gaussian statistics
- Extracting Structured Dynamical Systems Using Sparse Optimization With Very Few Samples
- Structure-Preserving Method for Reconstructing Unknown Hamiltonian Systems From Trajectory Data
- Discovery of dynamics using linear multistep methods
- Bayesian differential programming for robust systems identification under uncertainty
- Physics-informed generative adversarial networks for stochastic differential equations
- Machine Learning of Space-Fractional Differential Equations
- Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings
- Data-driven identification of parametric partial differential equations
- A nonstationary space-time Gaussian process model for partially converged simulations
- Solving second-order nonlinear evolution partial differential equations using deep learning
- Numerical solution of nonlinear stochastic differential equations with fractional Brownian motion using fractional-order Genocchi deep neural networks
- Learning sparse nonlinear dynamics via mixed-integer optimization
- Three ways to solve partial differential equations with neural networks — A review
- Covariance models and Gaussian process regression for the wave equation. Application to related inverse problems
- Machine learning for a class of partial differential equations with multi-delays based on numerical Gaussian processes
- Gaussian process hydrodynamics
- Numerical Approximations of the Allen-Cahn-Ohta-Kawasaki Equation with Modified Physics-Informed Neural Networks (Pinns)
- Bi-Orthogonal fPINN: A Physics-Informed Neural Network Method for Solving Time-Dependent Stochastic Fractional PDEs
- \(\mathrm{U}^p\)-net: a generic deep learning-based time stepper for parameterized spatio-temporal dynamics
- Discovery of PDEs driven by data with sharp gradient or discontinuity
- Sparse Gaussian processes for solving nonlinear PDEs
- Data-driven model identification using forcing-induced limit cycles
- Images of Gaussian and other stochastic processes under closed, densely-defined, unbounded linear operators
- Data-driven modeling of partially observed biological systems
- Enhancing physics informed neural networks for solving Navier-Stokes equations
- Energy-informed graph transformer model for solid mechanical analyses
- A Bayesian approach to modeling finite element discretization error
- Laplace-fPINNs: Laplace-based fractional physics-informed neural networks for solving forward and inverse problems of a time fractional equation
- Statistical Learning for Nonlinear Dynamical Systems with Applications to Aircraft-UAV Collisions
- Parameter inference based on Gaussian processes informed by nonlinear partial differential equations
- Leveraging viscous Hamilton-Jacobi PDEs for uncertainty quantification in scientific machine learning
- A Kronecker product accelerated efficient sparse Gaussian process (E-SGP) for flow emulation
- Error analysis of kernel/GP methods for nonlinear and parametric PDEs
- The ADMM-PINNs algorithmic framework for nonsmooth PDE-constrained optimization: a deep learning approach
- The vanishing gradient problem for stiff neural differential equations
- An efficient physics-informed neural network solution to the time-space fractional Black-Scholes equation
- Learning surrogate potential mean field games via Gaussian processes: a data-driven approach to ill-posed inverse problems
- Training stiff neural ordinary differential equations with explicit rational Taylor series methods
- Physics-informed neural networks (PINNs) for fluid mechanics: a review
- Discovery of governing equations with recursive deep neural networks
- Sparse Cholesky factorization for solving nonlinear PDEs via Gaussian processes
This page was built for publication: Numerical Gaussian processes for time-dependent and nonlinear partial differential equations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3130409)
