A composite neural network that learns from multi-fidelity data: application to function approximation and inverse PDE problems
From MaRDI portal
Publication:2222703
Abstract: We propose a new composite neural network (NN) that can be trained based on multi-fidelity data. It is comprised of three NNs, with the first NN trained using the low-fidelity data and coupled to two high-fidelity NNs, one with activation functions and another one without, in order to discover and exploit nonlinear and linear correlations, respectively, between the low-fidelity and the high-fidelity data. We first demonstrate the accuracy of the new multi-fidelity NN for approximating some standard benchmark functions but also a 20-dimensional function. Subsequently, we extend the recently developed physics-informed neural networks (PINNs) to be trained with multi-fidelity data sets (MPINNs). MPINNs contain four fully-connected neural networks, where the first one approximates the low-fidelity data, while the second and third construct the correlation between the low- and high-fidelity data and produce the multi-fidelity approximation, which is then used in the last NN that encodes the partial differential equations (PDEs). Specifically, in the two high-fidelity NNs a relaxation parameter is introduced, which can be optimized to combine the linear and nonlinear sub-networks. By optimizing this parameter, the present model is capable of learning both the linear and complex nonlinear correlations between the low- and high-fidelity data adaptively. By training the MPINNs, we can:(1) obtain the correlation between the low- and high-fidelity data, (2) infer the quantities of interest based on a few scattered data, and (3) identify the unknown parameters in the PDEs. In particular, we employ the MPINNs to learn the hydraulic conductivity field for unsaturated flows as well as the reactive models for reactive transport. The results demonstrate that MPINNs can achieve relatively high accuracy based on a very small set of high-fidelity data.
Recommendations
- Multi-fidelity regression using artificial neural networks: efficient approximation of parameter-dependent output quantities
- Multi-fidelity meta modeling using composite neural network with online adaptive basis technique
- Bifidelity data-assisted neural networks in nonintrusive reduced-order modeling
- On the eigenvector bias of Fourier feature networks: from regression to solving multi-scale PDEs with physics-informed neural networks
- MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources
Cites work
- A multi-fidelity modelling approach for evaluation and optimization of wing stroke aerodynamics in flapping flight
- Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
- scientific article; zbMATH DE number 3810550 (Why is no real title available?)
- Identification of physical processes via combined data-driven and data-assimilation methods
- Inferring solutions of differential equations using noisy multi-fidelity data
- Multi-fidelity modelling of mixed convection based on experimental correlations and numerical simulations
- Multi-fidelity optimization via surrogate modelling
- Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Practical implementation of nonlinear time series methods: The TISEAN package
- Predicting the output from a complex computer code when fast approximations are available
- Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
- Surfaces Generated by Moving Least Squares Methods
- The approximation power of moving least-squares
Cited in
(only showing first 100 items - show all)- Multi-fidelity deep neural network surrogate model for aerodynamic shape optimization
- \textit{hp}-VPINNs: variational physics-informed neural networks with domain decomposition
- Discretizationnet: a machine-learning based solver for Navier-Stokes equations using finite volume discretization
- Non-invasive inference of thrombus material properties with physics-informed neural networks
- Multi-fidelity meta modeling using composite neural network with online adaptive basis technique
- A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations
- A physics-informed multi-fidelity approach for the estimation of differential equations parameters in low-data or large-noise regimes
- A generalized probabilistic learning approach for multi-fidelity uncertainty quantification in complex physical simulations
- Physics-based self-learning recurrent neural network enhanced time integration scheme for computing viscoplastic structural finite element response
- Multifidelity data fusion in convolutional encoder/decoder networks
- Use of multifidelity training data and transfer learning for efficient construction of subsurface flow surrogate models
- GINNs: graph-informed neural networks for multiscale physics
- B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data
- Multi-fidelity Bayesian neural networks: algorithms and applications
- Transfer learning based multi-fidelity physics informed deep neural network
- Active- and transfer-learning applied to microscale-macroscale coupling to simulate viscoelastic flows
- PhyGeoNet: physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain
- Mutual information for explainable deep learning of multiscale systems
- Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning method
- Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation
- Multifidelity modeling for physics-informed neural networks (PINNs)
- Physics constrained learning for data-driven inverse modeling from sparse observations
- Learning functional priors and posteriors from data and physics
- Thermodynamically consistent physics-informed neural networks for hyperbolic systems
- A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data
- Neural network training using \(\ell_1\)-regularization and bi-fidelity data
- Meta-learning PINN loss functions
- Learning finite element convergence with the multi-fidelity graph neural network
- Physics-informed neural networks for high-speed flows
- Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data
- A fast multi-fidelity method with uncertainty quantification for complex data correlations: application to vortex-induced vibrations of marine risers
- MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources
- Physics and equality constrained artificial neural networks: application to forward and inverse problems with multi-fidelity data fusion
- Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons
- Surrogate modeling for Bayesian inverse problems based on physics-informed neural networks
- Neural network architectures using min-plus algebra for solving certain high-dimensional optimal control problems and Hamilton-Jacobi PDEs
- Local parameter identification with neural ordinary differential equations
- Learning and meta-learning of stochastic advection–diffusion–reaction systems from sparse measurements
- SympOCnet: Solving Optimal Control Problems with Applications to High-Dimensional Multiagent Path Planning Problems
- AMS-Net: Adaptive Multiscale Sparse Neural Network with Interpretable Basis Expansion for Multiphase Flow Problems
- Solving time dependent Fokker-Planck equations via temporal normalizing flow
- Multifidelity Data Fusion via Gradient-Enhanced Gaussian Process Regression
- High-dimensional nonlinear multi-fidelity model with gradient-free active subspace method
- An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
- A machine learning approach to calculating the non-equilibrium diffusion coefficients in the state-to-state solution of the Navier-Stokes equations
- Multifidelity deep operator networks for data-driven and physics-informed problems
- Three ways to solve partial differential equations with neural networks — A review
- A stepwise physics‐informed neural network for solving large deformation problems of hypoelastic materials
- Adaptive deep density approximation for fractional Fokker-Planck equations
- Multi-fidelity surrogate-based optimal design of road vehicle suspension systems
- Probabilistic neural data fusion for learning from an arbitrary number of multi-fidelity data sets
- Reliable extrapolation of deep neural operators informed by physics or sparse observations
- A method for computing inverse parametric PDE problems with random-weight neural networks
- An Adaptive Non-Intrusive Multi-Fidelity Reduced Basis Method for Parameterized Partial Differential Equations
- Multifidelity Bayesian Experimental Design to Quantify Rare-Event Statistics
- Variational inference in neural functional prior using normalizing flows: application to differential equation and operator learning problems
- Forward sensitivity analysis and mode dependent control for closure modeling of Galerkin systems
- Multi‐fidelity data fusion through parameter space reduction with applications to automotive engineering
- MC-Nonlocal-PINNs: Handling Nonlocal Operators in PINNs Via Monte Carlo Sampling
- Neural-physics multi-fidelity model with active learning and uncertainty quantification for GPU-enabled microfluidic concentration gradient generator design
- NeuralUQ: A Comprehensive Library for Uncertainty Quantification in Neural Differential Equations and Operators
- Multifidelity Surrogate Modeling for Time-Series Outputs
- Feature-adjacent multi-fidelity physics-informed machine learning for partial differential equations
- CNN-DP: composite neural network with differential propagation for impulsive nonlinear dynamics
- Deep learning-enhanced efficient seismic analysis of structures with multi-fidelity modeling strategies
- A multi-fidelity transfer learning strategy based on multi-channel fusion
- Splitting physics-informed neural networks for inferring the dynamics of integer- and fractional-order neuron models
- CEENs: causality-enforced evolutional networks for solving time-dependent partial differential equations
- Learning scattering waves via coupling physics-informed neural networks and their convergence analysis
- Deep learning in computational mechanics: a review
- Physically guided neural network based on transfer learning (TL-PGNN) for hypersonic heat flux prediction
- GFN: a graph feedforward network for resolution-invariant reduced operator learning in multifidelity applications
- A multifidelity machine learning based semi-Lagrangian finite volume scheme for linear transport equations and the nonlinear Vlasov-Poisson system
- A multi-fidelity deep operator network for parametric transonic flow modeling with shock discontinuity
- On the construction of non-intrusive multifidelity models for computer codes with time-series output: comparison of three paradigms on a transient thermal problem
- Self-adaptive weights based on balanced residual decay rate for physics-informed neural networks and deep operator networks
- Covariate-informed bifidelity bias correction of distributional output
- Neural network-based Godunov corrections for approximate Riemann solvers using bifidelity learning
- Adaptive basis-inspired deep neural network for solving partial differential equations with localized features
- Rational function approximation with normalized positive denominators
- Physics-driven deep learning methods and numerically intractable ``bad Jaulent-Miodek equation
- Active Learning for a Recursive Non-Additive Emulator for Multi-Fidelity Computer Experiments
- MFPC-Net: multi-fidelity physics-constrained neural process
- Enhancing sparse identification of nonlinear dynamics with Earth-mover distance and group similarity
- GoRINNs: Godunov-Riemann informed neural networks for learning hyperbolic conservation laws
- Introducing a microstructure-embedded autoencoder approach for reconstructing high-resolution solution field data from a reduced parametric space
- MRF-PINN: a multi-receptive-field convolutional physics-informed neural network for solving partial differential equations
- Combining physics-based and data-driven models: advancing the frontiers of research with scientific machine learning
- Multi-fidelity reduced-order surrogate modelling
- Physics-informed neural networks (PINNs) for fluid mechanics: a review
- Worst-case learning under a multifidelity model
- Online multi-fidelity data aggregation via hierarchical neural network
- The deep finite element method: a deep learning framework integrating the physics-informed neural networks with the finite element method
- Boosting efficiency and reducing graph reliance: basis adaptation integration in Bayesian multi-fidelity networks
- Residual multi-fidelity neural network computing
- Generative adversarial physics-informed neural networks for solving forward and inverse problem with small labeled samples
- Graph Laplacian-based Bayesian multi-fidelity modeling
- Sparse discovery of differential equations based on multi-fidelity Gaussian process
- Multifidelity linear regression for scientific machine learning from scarce data
- Stacked networks improve physics-informed training: applications to neural networks and deep operator networks
This page was built for publication: A composite neural network that learns from multi-fidelity data: application to function approximation and inverse PDE problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2222703)
