An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
From MaRDI portal
(Redirected from Publication:5162376)
Abstract: In Bayesian inverse problems, surrogate models are often constructed to speed up the computational procedure, as the parameter-to-data map can be very expensive to evaluate. However, due to the curse of dimensionality and the nonlinear concentration of the posterior, traditional surrogate approaches (such us the polynomial-based surrogates) are still not feasible for large scale problems. To this end, we present in this work an adaptive multi-fidelity surrogate modeling framework based on deep neural networks (DNNs), motivated by the facts that the DNNs can potentially handle functions with limited regularity and are powerful tools for high dimensional approximations. More precisely, we first construct offline a DNNs-based surrogate according to the prior distribution, and then, this prior-based DNN-surrogate will be adaptively & locally refined online using only a few high-fidelity simulations. In particular, in the refine procedure, we construct a new shallow neural network that view the previous constructed surrogate as an input variable -- yielding a composite multi-fidelity neural network approach. This makes the online computational procedure rather efficient. Numerical examples are presented to confirm that the proposed approach can obtain accurate posterior information with a limited number of forward simulations.
Recommendations
- Adaptive construction of surrogates for the Bayesian solution of inverse problems
- Scaling Up Bayesian Uncertainty Quantification for Inverse Problems Using Deep Neural Networks
- Convergence analysis of surrogate-based methods for Bayesian inverse problems
- Solution of inverse problems with limited forward solver evaluations: a Bayesian perspective
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
Cites work
- A composite neural network that learns from multi-fidelity data: application to function approximation and inverse PDE problems
- A stochastic collocation approach to Bayesian inference in inverse problems
- Adaptive construction of surrogates for the Bayesian solution of inverse problems
- Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
- An adaptive importance sampling algorithm for Bayesian inversion with multimodal distributions
- AN ADAPTIVE MULTIFIDELITY PC-BASED ENSEMBLE KALMAN INVERSION FOR INVERSE PROBLEMS
- Bayesian calibration of computer models. (With discussion)
- Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
- Bayesian inverse problems with l₁ priors: a randomize-then-optimize approach
- Bifidelity data-assisted neural networks in nonintrusive reduced-order modeling
- Convergence analysis of surrogate-based methods for Bayesian inverse problems
- Deep learning
- Deep learning in high dimension: neural network expression rates for generalized polynomial chaos expansions in UQ
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Ensemble Kalman methods for inverse problems
- Fast Bayesian approach for parameter estimation
- Inverse problems as statistics
- Inverse problems: a Bayesian perspective
- Large-scale machine learning with stochastic gradient descent
- Large‐Scale Inverse Problems and Quantification of Uncertainty
- Limitations of polynomial chaos expansions in the Bayesian solution of inverse problems
- Nonlinear model reduction for uncertainty quantification in large-scale inverse problems
- Parameter and state model reduction for large-scale statistical inverse problems
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Posterior consistency for Gaussian process approximations of Bayesian posterior distributions
- Randomize-then-optimize: a method for sampling from posterior distributions in nonlinear inverse problems
- Sequential Monte Carlo methods for Bayesian elliptic inverse problems
- Solving high-dimensional partial differential equations using deep learning
- Statistical and computational inverse problems.
- Stochastic collocation algorithms using \(l_1\)-minimization for Bayesian solution of inverse problems
- Stochastic spectral methods for efficient Bayesian solution of inverse problems
- Survey of multifidelity methods in uncertainty propagation, inference, and optimization
Cited in
(51)- Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Goal-oriented a-posteriori estimation of model error as an aid to parameter estimation
- Multifidelity data fusion in convolutional encoder/decoder networks
- Variable-order approach to nonlocal elasticity: theoretical formulation, order identification via deep learning, and applications
- Solving inverse problems using conditional invertible neural networks
- Calibrate, emulate, sample
- Multi-fidelity Bayesian neural networks: algorithms and applications
- Randomized approaches to accelerate MCMC algorithms for Bayesian inverse problems
- Image inversion and uncertainty quantification for constitutive laws of pattern formation
- Bayesian inversion using adaptive polynomial chaos kriging within subset simulation
- Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
- Bayesian inference of non-linear multiscale model parameters accelerated by a deep neural network
- Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
- Gradient-free Stein variational gradient descent with kernel approximation
- Theory-guided auto-encoder for surrogate construction and inverse modeling
- Stein variational gradient descent with local approximations
- MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources
- Surrogate modeling for Bayesian inverse problems based on physics-informed neural networks
- Adaptive construction of surrogates for the Bayesian solution of inverse problems
- An Acceleration Strategy for Randomize-Then-Optimize Sampling Via Deep Neural Networks
- Ensemble inference methods for models with noisy and expensive likelihoods
- Deep neural network surrogates for nonsmooth quantities of interest in shape uncertainty quantification
- Deep neural network expression of posterior expectations in Bayesian PDE inversion
- Cholesky-based experimental design for Gaussian process and kernel-based emulation and calibration
- Solution of inverse problems with limited forward solver evaluations: a Bayesian perspective
- Deep Surrogate Accelerated Delayed-Acceptance Hamiltonian Monte Carlo for Bayesian Inference of Spatio-Temporal Heat Fluxes in Rotating Disc Systems
- A Bayesian scheme for reconstructing obstacles in acoustic waveguides
- Adaptive weighting of Bayesian physics informed neural networks for multitask and multiscale forward and inverse problems
- Probabilistic neural data fusion for learning from an arbitrary number of multi-fidelity data sets
- Scaling Up Bayesian Uncertainty Quantification for Inverse Problems Using Deep Neural Networks
- An Adaptive Non-Intrusive Multi-Fidelity Reduced Basis Method for Parameterized Partial Differential Equations
- Adaptive Ensemble Kalman Inversion with Statistical Linearization
- Sequential Model Correction for Nonlinear Inverse Problems
- Residual-based error correction for neural operator accelerated Infinite-dimensional Bayesian inverse problems
- Scalable conditional deep inverse Rosenblatt transports using tensor trains and gradient-based dimension reduction
- Deep Importance Sampling Using Tensor Trains with Application to a Priori and a Posteriori Rare Events
- Efficient multifidelity likelihood-free Bayesian inference with adaptive computational resource allocation
- A MCMC method based on surrogate model and Gaussian process parameterization for infinite Bayesian PDE inversion
- Bayesian model error method for the passive inverse scattering problem
- Adaptive neural network surrogate model for solving the nonlinear elastic inverse problem via Bayesian inference
- Bayesian inversion with neural operator (BINO) for modeling subdiffusion: forward and inverse problems
- Numerical realization of the Bayesian inversion accelerated using surrogate models.
- Auto-weighted Bayesian physics-informed neural networks and robust estimations for multitask inverse problems in pore-scale imaging of dissolution
- Adaptive operator learning for infinite-dimensional Bayesian inverse problems
- MCMC-Net: accelerating Markov chain Monte Carlo with neural networks for inverse problems
- Stable derivative free Gaussian mixture variational inference for Bayesian inverse problems
- Physics-aware deep learning framework for the limited aperture inverse obstacle scattering problem
- ODE-DPS: ODE-based diffusion posterior sampling for linear inverse problems in partial differential equation
- A three-stage PINN for solving inverse problems of piecewise-continuous variable coefficients of PDEs
- GenPANIS: a latent-variable generative framework for forward and inverse PDE problems in multiphase media
This page was built for publication: An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5162376)
