Model reduction with memory and the machine learning of dynamical systems
From MaRDI portal
Abstract: The well-known Mori-Zwanzig theory tells us that model reduction leads to memory effect. For a long time, modeling the memory effect accurately and efficiently has been an important but nearly impossible task in developing a good reduced model. In this work, we explore a natural analogy between recurrent neural networks and the Mori-Zwanzig formalism to establish a systematic approach for developing reduced models with memory. Two training models-a direct training model and a dynamically coupled training model-are proposed and compared. We apply these methods to the Kuramoto-Sivashinsky equation and the Navier-Stokes equation. Numerical experiments show that the proposed method can produce reduced model with good performance on both short-term prediction and long-term statistical properties.
Recommendations
- \textit{A priori} estimation of memory effects in reduced-order models of nonlinear systems using the Mori-Zwanzig formalism
- Recurrent neural network closure of parametric POD-Galerkin reduced-order models based on the Mori-Zwanzig formalism
- Effective Mori-Zwanzig equation for the reduced-order modeling of stochastic systems
- Renormalized reduced order models with memory for long time prediction
- Neural network closures for nonlinear model order reduction
Cites work
- A dynamic subgrid scale model for large eddy simulations based on the Mori-Zwanzig formalism
- A thermodynamic study of the two-dimensional pressure-driven channel flow
- Efficient implementation of essentially nonoscillatory shock-capturing schemes
- Optimal prediction with memory
- Quantifying and reducing model-form uncertainties in Reynolds-averaged Navier-Stokes simulations: a data-driven, physics-informed Bayesian approach
- Reynolds averaged turbulence modelling using deep neural networks with embedded invariance
- Transport, Collective Motion, and Brownian Motion
Cited in
(37)- A dynamical systems approach to machine learning
- Overview frequency principle/spectral bias in deep learning
- Data-driven stochastic closure modeling via conditional diffusion model and neural operator
- Shock trace prediction by reduced models for a viscous stochastic Burgers equation
- PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network
- Effective Mori-Zwanzig equation for the reduced-order modeling of stochastic systems
- Scientific machine learning for closure models in multiscale problems: a review
- scientific article; zbMATH DE number 7625195 (Why is no real title available?)
- Deconvolutional artificial-neural-network framework for subfilter-scale models of compressible turbulence
- Analytic continuation of noisy data using Adams Bashforth residual neural network
- Ml-GLE: a machine learning enhanced generalized Langevin equation framework for transient anomalous diffusion in polymer dynamics
- Memory-based reduced modelling and data-based estimation of opinion spreading
- Limits of learning dynamical systems
- A framework for machine learning of model error in dynamical systems
- NySALT: Nyström-type inference-based schemes adaptive to large time-stepping
- Learning Theory for Dynamical Systems
- Dynamically learning the parameters of a chaotic system using partial observations
- The deep learning Galerkin method for the general Stokes equations
- Data-driven learning for the Mori-Zwanzig formalism: a generalization of the Koopman learning framework
- Kernel-based prediction of non-Markovian time series
- Better approximations of high dimensional smooth functions by deep neural networks with rectified power units
- Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
- Regression-Based Projection for Learning Mori–Zwanzig Operators
- Recurrent neural network closure of parametric POD-Galerkin reduced-order models based on the Mori-Zwanzig formalism
- Using machine learning to predict extreme events in complex systems
- Learning vector fields of differential equations on manifolds with curvature-adaptive geometrically constrained SINDy
- Error bounds of the invariant statistics in machine learning of ergodic Itô diffusions
- Multi-level dynamical systems: connecting the Ruelle response theory and the Mori-Zwanzig approach
- An online manifold learning approach for model reduction of dynamical systems
- Renormalized reduced order models with memory for long time prediction
- Simultaneous neural network approximation for smooth functions
- Dimension reduction in recurrent networks by canonicalization
- Machine learning for prediction with missing dynamics
- Problem reduction, renormalization, and memory
- \textit{A priori} estimation of memory effects in reduced-order models of nonlinear systems using the Mori-Zwanzig formalism
- Memory-based parameterization with differentiable solver: application to Lorenz '96
- Applied unsupervised learning in model reduction of linear dynamic systems
This page was built for publication: Model reduction with memory and the machine learning of dynamical systems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5161393)
