Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks

DOI10.1098/rspa.2017.0844zbMath1402.92030arXiv1802.07486OpenAlexW3105919389WikidataQ89056306 ScholiaQ89056306MaRDI QIDQ4557699

Wonmin Byeon, Zhong Yi Wan, Pantelis R. Vlachas, Themistoklis P. Sapsis, Petros Koumoutsakos

Publication date: 26 November 2018

Published in: Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1802.07486

zbMATH Keywords

Gaussian processeslong short-term memoryT21 barotropic climate modeldata-driven forecastingLorenz 96

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Neural networks for/in biological studies, artificial life and related topics (92B20) Geostatistics (86A32)

Related Items (59)

Calibration of projection-based reduced-order models for unsteady compressible flows ⋮ Robustness of LSTM neural networks for multi-step forecasting of chaotic time series ⋮ Deep learning of the spanwise-averaged Navier-Stokes equations ⋮ A long short-term memory embedding for hybrid uplifted reduced order models ⋮ Machine learning for prediction with missing dynamics ⋮ A data-driven, physics-informed framework for forecasting the spatiotemporal evolution of chaotic dynamics with nonlinearities modeled as exogenous forcings ⋮ Machine learning the kinematics of spherical particles in fluid flows ⋮ A homotopy gated recurrent unit for predicting high dimensional hyperchaos ⋮ Predicting spatio-temporal time series using dimension reduced local states ⋮ Generative Adversarial Network for Probabilistic Forecast of Random Dynamical Systems ⋮ LaSDI: parametric latent space dynamics identification ⋮ Data-driven synchronization-avoiding algorithms in the explicit distributed structural analysis of soft tissue ⋮ Mitigating Model Error via a Multimodel Method and Application to Tropical Intraseasonal Oscillations ⋮ Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution ⋮ Robust optimization and validation of echo state networks for learning chaotic dynamics ⋮ Physics-agnostic and physics-infused machine learning for thin films flows: modelling, and predictions from small data ⋮ Modern Strategies for Time Series Regression ⋮ CD-ROM: complemented deep -- reduced order model ⋮ Adaptive learning of effective dynamics for online modeling of complex systems ⋮ On the universal transformation of data-driven models to control systems ⋮ Accuracy and architecture studies of residual neural network method for ordinary differential equations ⋮ Reduction methods in climate dynamics -- a brief review ⋮ Learning black- and gray-box chemotactic PDEs/closures from agent based Monte Carlo simulation data ⋮ Parsimony as the ultimate regularizer for physics-informed machine learning ⋮ Accelerating inverse inference of ensemble Kalman filter via reduced-order model trained using adaptive sparse observations ⋮ Stability analysis of chaotic systems from data ⋮ Quantum Mechanics for Closure of Dynamical Systems ⋮ Data-driven control of agent-based models: an equation/variable-free machine learning approach ⋮ SPADE4: sparsity and delay embedding based forecasting of epidemics ⋮ Koopman Operator Inspired Nonlinear System Identification ⋮ Predicting observed and hidden extreme events in complex nonlinear dynamical systems with partial observations and short training time series ⋮ Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings ⋮ Deep learning of dynamics and signal-noise decomposition with time-stepping constraints ⋮ Data-driven identification of 2D partial differential equations using extracted physical features ⋮ Deep learning of vortex-induced vibrations ⋮ Shallow neural networks for fluid flow reconstruction with limited sensors ⋮ SINDy-PI: a robust algorithm for parallel implicit sparse identification of nonlinear dynamics ⋮ Data-driven nonintrusive reduced order modeling for dynamical systems with moving boundaries using Gaussian process regression ⋮ Diffusion maps-aided neural networks for the solution of parametrized PDEs ⋮ A review on computational intelligence for identification of nonlinear dynamical systems ⋮ Neural machine-based forecasting of chaotic dynamics ⋮ Bayesian framework for simulation of dynamical systems from multidimensional data using recurrent neural network ⋮ Convolutional autoencoder and conditional random fields hybrid for predicting spatial-temporal chaos ⋮ Analysis of 20th century surface air temperature using linear dynamical modes ⋮ Predicting critical transitions in multiscale dynamical systems using reservoir computing ⋮ Forecasting models for chaotic fractional-order oscillators using neural networks ⋮ A nonintrusive hybrid neural-physics modeling of incomplete dynamical systems: Lorenz equations ⋮ Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations ⋮ On explaining the surprising success of reservoir computing forecaster of chaos? The universal machine learning dynamical system with contrast to VAR and DMD ⋮ Construction of reduced-order models for fluid flows using deep feedforward neural networks ⋮ 9 From the POD-Galerkin method to sparse manifold models ⋮ Error bounds of the invariant statistics in machine learning of ergodic Itô diffusions ⋮ Kernel-based prediction of non-Markovian time series ⋮ Recurrent neural network closure of parametric POD-Galerkin reduced-order models based on the Mori-Zwanzig formalism ⋮ A dilated convolution network-based LSTM model for multi-step prediction of chaotic time series ⋮ On the role of nonlinear correlations in reduced-order modelling ⋮ Stabilized neural ordinary differential equations for long-time forecasting of dynamical systems ⋮ Data-driven predictions of the Lorenz system ⋮ Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation

Uses Software

• Adam
• GNMT
• Evolino

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Discovering governing equations from data by sparse identification of nonlinear dynamical systems
• Least squares shadowing sensitivity analysis of a modified Kuramoto-Sivashinsky equation
• A data-driven approximation of the koopman operator: extending dynamic mode decomposition
• Reduced-space Gaussian process regression for data-driven probabilistic forecast of chaotic dynamical systems
• Neural network modeling for near wall turbulent flow.
• The method of proper orthogonal decomposition for dynamical characterization and order reduction of mechanical systems: an overview
• On dynamic mode decomposition: theory and applications
• Robust extended Kalman filtering
• Multiresolution Dynamic Mode Decomposition
• Reduced-order precursors of rare events in unidirectional nonlinear water waves
• Analog forecasting with dynamics-adapted kernels
• Quantification and prediction of extreme events in a one-dimensional nonlinear dispersive wave model
• Conceptual dynamical models for turbulence
• Back in the Saddle Again: A Computer Assisted Study of the Kuramoto–Sivashinsky Equation
• Automated reverse engineering of nonlinear dynamical systems
• Nonlinear analysis of hydrodynamic instability in laminar flames—I. Derivation of basic equations
• Using machine learning to replicate chaotic attractors and calculate Lyapunov exponents from data
• Ergodic Theory, Dynamic Mode Decomposition, and Computation of Spectral Properties of the Koopman Operator
• State estimation and prediction using clustered particle filters
• Learning partial differential equations via data discovery and sparse optimization
• Statistically accurate low-order models for uncertainty quantification in turbulent dynamical systems
• MODEL REDUCTION FOR FLUIDS, USING BALANCED PROPER ORTHOGONAL DECOMPOSITION
• Filtering Complex Turbulent Systems
• Information Theory and Stochastics for Multiscale Nonlinear Systems
• Control of chaotic dynamical systems using radial basis function network approximators

This page was built for publication: Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks