Deep Surrogate Accelerated Delayed-Acceptance Hamiltonian Monte Carlo for Bayesian Inference of Spatio-Temporal Heat Fluxes in Rotating Disc Systems
From MaRDI portal
Publication:6062235
Bayesian inference (62F15) Probabilistic models, generic numerical methods in probability and statistics (65C20) Numerical methods for inverse problems for initial value and initial-boundary value problems involving PDEs (65M32) Applications to the sciences (65Z05) Artificial neural networks and deep learning (68T07)
Abstract: We introduce a deep learning accelerated methodology to solve PDE-based Bayesian inverse problems with guaranteed accuracy. This is motivated by the ill-posed problem of inferring a spatio-temporal heat-flux parameter known as the Biot number given temperature data, however the methodology is generalisable to other settings. To accelerate Bayesian inference, we develop a novel training scheme that uses data to adaptively train a neural-network surrogate simulating the parametric forward model. By simultaneously identifying an approximate posterior distribution over the Biot number, and weighting a physics-informed training loss according to this, our approach approximates forward and inverse solution together without any need for external solves. Using a random Chebyshev series, we outline how to approximate a Gaussian process prior, and using the surrogate we apply Hamiltonian Monte Carlo (HMC) to sample from the posterior distribution. We derive convergence of the surrogate posterior to the true posterior distribution in the Hellinger metric as our adaptive loss approaches zero. Additionally, we describe how this surrogate-accelerated HMC approach can be combined with traditional PDE solvers in a delayed-acceptance scheme to a-priori control the posterior accuracy. This overcomes a major limitation of deep learning-based surrogate approaches, which do not achieve guaranteed accuracy a-priori due to their non-convex training. Biot number calculations are involved in turbo-machinery design, which is safety critical and highly regulated, therefore it is important that our results have such mathematical guarantees. Our approach achieves fast mixing in high dimensions whilst retaining the convergence guarantees of a traditional PDE solver, and without the burden of evaluating this solver for proposals that are likely to be rejected. Numerical results are given using real and simulated data.
Recommendations
- Numerical realization of the Bayesian inversion accelerated using surrogate models.
- Convergence analysis of surrogate-based methods for Bayesian inverse problems
- Surrogate modeling for Bayesian inverse problems based on physics-informed neural networks
- An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
- Adaptive construction of surrogates for the Bayesian solution of inverse problems
Cites work
- A theoretical analysis of deep neural networks and parametric PDEs
- Adaptive construction of surrogates for the Bayesian solution of inverse problems
- An introduction to computational stochastic PDEs
- An Introduction to Partial Differential Equations
- Approximation theory and approximation practice
- B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data
- DGM: a deep learning algorithm for solving partial differential equations
- scientific article; zbMATH DE number 1318042 (Why is no real title available?)
- MCMC using Hamiltonian dynamics
- Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data
- Preconditioning Markov Chain Monte Carlo Simulations Using Coarse-Scale Models
Cited in
(1)
This page was built for publication: Deep Surrogate Accelerated Delayed-Acceptance Hamiltonian Monte Carlo for Bayesian Inference of Spatio-Temporal Heat Fluxes in Rotating Disc Systems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6062235)
