Multi-level convolutional autoencoder networks for parametric prediction of spatio-temporal dynamics
From MaRDI portal
Publication:2020980
Abstract: A data-driven framework is proposed towards the end of predictive modeling of complex spatio-temporal dynamics, leveraging nested non-linear manifolds. Three levels of neural networks are used, with the goal of predicting the future state of a system of interest in a parametric setting. A convolutional autoencoder is used as the top level to encode the high dimensional input data along spatial dimensions into a sequence of latent variables. A temporal convolutional autoencoder (TCAE) serves as the second level, which further encodes the output sequence from the first level along the temporal dimension, and outputs a set of latent variables that encapsulate the spatio-temporal evolution of the dynamics. The use of dilated temporal convolutions grows the receptive field exponentially with network depth, allowing for efficient processing of long temporal sequences typical of scientific computations. A fully-connected network is used as the third level to learn the mapping between these latent variables and the global parameters from training data, and predict them for new parameters. For future state predictions, the second level uses a temporal convolutional network to predict subsequent steps of the output sequence from the top level. Latent variables at the bottom-most level are decoded to obtain the dynamics in physical space at new global parameters and/or at a future time. Predictive capabilities are evaluated on a range of problems involving discontinuities, wave propagation, strong transients, and coherent structures. The sensitivity of the results to different modeling choices is assessed. The results suggest that given adequate data and careful training, effective data-driven predictive models can be constructed. Perspectives are provided on the present approach and its place in the landscape of model reduction.
Recommendations
- Convolutional autoencoder and conditional random fields hybrid for predicting spatial-temporal chaos
- \(\mathrm{U}^p\)-net: a generic deep learning-based time stepper for parameterized spatio-temporal dynamics
- Physics-incorporated convolutional recurrent neural networks for source identification and forecasting of dynamical systems
- A comparison of neural network architectures for data-driven reduced-order modeling
- Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks
Cites work
- \textit{A priori} estimation of memory effects in reduced-order models of nonlinear systems using the Mori-Zwanzig formalism
- A basis for bounding the errors of proper generalised decomposition solutions in solid mechanics
- A new selection operator for the discrete empirical interpolation method -- improved a priori error bound and extensions
- A Schur method for balanced-truncation model reduction
- A survey of projection-based model reduction methods for parametric dynamical systems
- A survey of several finite difference methods for systems of nonlinear hyperbolic conservation laws
- An `empirical interpolation' method: Application to efficient reduced-basis discretization of partial differential equations
- An Introduction to Scientific Computing
- An Online Method for Interpolating Linear Parametric Reduced-Order Models
- Calibrated reduced-order POD-Galerkin system for fluid flow modelling
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems
- Efficient non linear model reduction via a least-squares Petrov-Galerkin projection and compressive tensor approximations
- Galerkin v. least-squares Petrov-Galerkin projection in nonlinear model reduction
- High dimensional polynomial interpolation on sparse grids
- Interpolatory projection methods for parameterized model reduction
- Missing Point Estimation in Models Described by Proper Orthogonal Decomposition
- Model reduction for compressible flows using POD and Galerkin projection
- MODEL REDUCTION FOR FLUIDS, USING BALANCED PROPER ORTHOGONAL DECOMPOSITION
- Non-intrusive reduced order modeling of nonlinear problems using neural networks
- Non-intrusive reduced order modeling of unsteady flows using artificial neural networks with application to a combustion problem
- Online adaptive model reduction for nonlinear systems via low-rank updates
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Physics-Informed Probabilistic Learning of Linear Embeddings of Nonlinear Dynamics with Guaranteed Stability
- Principal component analysis in linear systems: Controllability, observability, and model reduction
- Proper orthogonal decomposition closure models for turbulent flows: a numerical comparison
- Reassessment of the scale-determining equation for advanced turbulence models
- Recovering missing CFD data for high-order discretizations using deep neural networks and dynamics learning
- Reduced order modeling for nonlinear structural analysis using Gaussian process regression
- The Reduced Basis Method for Incompressible Viscous Flow Calculations
- Time-series learning of latent-space dynamics for reduced-order model closure
- Two-level discretizations of nonlinear closure models for proper orthogonal decomposition
Cited in
(38)- Physics-informed graph neural Galerkin networks: a unified framework for solving PDE-governed forward and inverse problems
- Model reduction of convection-dominated partial differential equations via optimization-based implicit feature tracking
- Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation
- Physics-informed machine learning for reduced-order modeling of nonlinear problems
- Parametric non-intrusive model order reduction for flow-fields using unsupervised machine learning
- Geometric learning for computational mechanics. II: Graph embedding for interpretable multiscale plasticity
- Physics-data combined machine learning for parametric reduced-order modelling of nonlinear dynamical systems in small-data regimes
- Data-driven spatiotemporal modeling for structural dynamics on irregular domains by stochastic dependency neural estimation
- scientific article; zbMATH DE number 7234578 (Why is no real title available?)
- Sparsity-promoting algorithms for the discovery of informative Koopman-invariant subspaces
- A deep learning modeling framework to capture mixing patterns in reactive-transport systems
- Sparse identification of nonlinear dynamics with low-dimensionalized flow representations
- Convolutional autoencoder and conditional random fields hybrid for predicting spatial-temporal chaos
- A two-stage deep learning architecture for model reduction of parametric time-dependent problems
- Transformers for modeling physical systems
- Predicting turbulent dynamics with the convolutional autoencoder echo state network
- Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution
- Multiscale graph neural network autoencoders for interpretable scientific machine learning
- Non‐intrusive reduced‐order modeling using convolutional autoencoders
- Data assimilation predictive GAN (DA-PredGAN) applied to a spatio-temporal compartmental model in epidemiology
- \textit{FastSVD-ML-ROM}: a reduced-order modeling framework based on machine learning for real-time applications
- Non-intrusive data-driven reduced-order modeling for time-dependent parametrized problems
- AI‐enhanced iterative solvers for accelerating the solution of large‐scale parametrized systems
- Non-linear manifold reduced-order models with convolutional autoencoders and reduced over-collocation method
- \(\mathrm{U}^p\)-net: a generic deep learning-based time stepper for parameterized spatio-temporal dynamics
- Accelerated solutions of convection-dominated partial differential equations using implicit feature tracking and empirical quadrature
- Long-time prediction of nonlinear parametrized dynamical systems by deep learning-based reduced order models
- Data-driven transient lift attenuation for extreme vortex gust-airfoil interactions
- Emulation of greenhouse-gas sensitivities using variational autoencoders
- Neural dynamical operator: continuous spatial-temporal model with gradient-based and derivative-free optimization methods
- Prediction of spatiotemporal dynamics using deep learning: coupled neural networks of long short-terms memory, auto-encoder and physics-informed neural networks
- An implicit GNN solver for Poisson-like problems
- A general reduced-order neural operator for spatio-temporal predictive learning on complex spatial domains
- DUE: a deep learning framework and library for modeling unknown equations
- \texttt{TAEN}: a model-constrained Tikhonov autoencoder network for forward and inverse problems
- Reduced basis approximations of parameterized dynamical partial differential equations via neural networks
- A reduced order modeling method with variable-separation-based domain decomposition for parametric dynamical systems
- Nonlinear model reduction for transport-dominated problems
This page was built for publication: Multi-level convolutional autoencoder networks for parametric prediction of spatio-temporal dynamics
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2020980)
