Deep learning algorithm for data-driven simulation of noisy dynamical system
From MaRDI portal
Abstract: We present a deep learning model, DE-LSTM, for the simulation of a stochastic process with an underlying nonlinear dynamics. The deep learning model aims to approximate the probability density function of a stochastic process via numerical discretization and the underlying nonlinear dynamics is modeled by the Long Short-Term Memory (LSTM) network. It is shown that, when the numerical discretization is used, the function estimation problem can be solved by a multi-label classification problem. A penalized maximum log likelihood method is proposed to impose a smoothness condition in the prediction of the probability distribution. We show that the time evolution of the probability distribution can be computed by a high-dimensional integration of the transition probability of the LSTM internal states. A Monte Carlo algorithm to approximate the high-dimensional integration is outlined. The behavior of DE-LSTM is thoroughly investigated by using the Ornstein-Uhlenbeck process and noisy observations of nonlinear dynamical systems; Mackey-Glass time series and forced Van der Pol oscillator. It is shown that DE-LSTM makes a good prediction of the probability distribution without assuming any distributional properties of the stochastic process. For a multiple-step forecast of the Mackey-Glass time series, the prediction uncertainty, denoted by the 95% confidence interval, first grows, then dynamically adjusts following the evolution of the system, while in the simulation of the forced Van der Pol oscillator, the prediction uncertainty does not grow in time even for a 3,000-step forecast.
Recommendations
- Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
- Variational inference formulation for a model-free simulation of a dynamical system with unknown parameters by a recurrent neural network
- Deep hidden physics models: deep learning of nonlinear partial differential equations
- Using machine learning to predict statistical properties of non-stationary dynamical processes: System climate,regime transitions, and the effect of stochasticity
- Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks
Cites work
- Chaotic attractors of an infinite-dimensional dynamical system
- Data based identification and prediction of nonlinear and complex dynamical systems
- Deep learning
- Detecting causality in complex ecosystems
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems
- scientific article; zbMATH DE number 3810550 (Why is no real title available?)
- scientific article; zbMATH DE number 3984294 (Why is no real title available?)
- scientific article; zbMATH DE number 48318 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- Oscillation and chaos in physiological control systems
- Pattern recognition and machine learning.
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Reservoir computing approaches to recurrent neural network training
- Spatio-temporal phenomena in complex systems with time delays
- Synthesis of recurrent neural networks for dynamical system simulation
- Time series analysis by state space methods.
- Time series analysis. Forecasting and control
Cited in
(18)- Time-series learning of latent-space dynamics for reduced-order model closure
- A long short-term memory embedding for hybrid uplifted reduced order models
- Data-driven reconstruction of nonlinear dynamics from sparse observation
- Coercing machine learning to output physically accurate results
- On explaining the surprising success of reservoir computing forecaster of chaos? The universal machine learning dynamical system with contrast to VAR and DMD
- Variational inference formulation for a model-free simulation of a dynamical system with unknown parameters by a recurrent neural network
- Generative Adversarial Network for Probabilistic Forecast of Random Dynamical Systems
- Statistical Modeling for Spatio-Temporal Data From Stochastic Convection-Diffusion Processes
- Physics-incorporated convolutional recurrent neural networks for source identification and forecasting of dynamical systems
- An energy-based deep splitting method for the nonlinear filtering problem
- A deep learning method for computing mean exit time excited by weak Gaussian noise
- A data-driven framework for learning hybrid dynamical systems
- Deep Latent Factor Model for Spatio-Temporal Forecasting
- SDYN-GANs: adversarial learning methods for multistep generative models for general order stochastic dynamics
- Hybrid hiking sparse particle swarm optimization for dynamic system identification
- Model-free learning of random dynamical system from noisy observations
- Adaptive normalizing flows for solving Fokker-Planck equation
- Next generation equation-free multiscale modelling of crowd dynamics via machine learning
This page was built for publication: Deep learning algorithm for data-driven simulation of noisy dynamical system
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2311511)
