Deep-OSG: deep learning of operators in semigroup

DOI10.1016/J.JCP.2023.112498arXiv2302.03358OpenAlexW4386814111MaRDI QIDQ6094763FDOQ6094763

Authors: Junfeng Chen, Kailiang Wu 

Publication date: 10 October 2023

Published in: Journal of Computational Physics (Search for Journal in Brave)

Abstract: This paper proposes a novel deep learning approach for approximating evolution operators and modeling unknown autonomous dynamical systems using time series data collected at varied time lags. It is a sequel to the previous works [T. Qin, K. Wu, and D. Xiu, J. Comput. Phys., 395:620--635, 2019], [K. Wu and D. Xiu, J. Comput. Phys., 408:109307, 2020], and [Z. Chen, V. Churchill, K. Wu, and D. Xiu, J. Comput. Phys., 449:110782, 2022], which focused on learning single evolution operator with a fixed time step. This paper aims to learn a family of evolution operators with variable time steps, which constitute a semigroup for an autonomous system. The semigroup property is very crucial and links the system's evolutionary behaviors across varying time scales, but it was not considered in the previous works. We propose for the first time a framework of embedding the semigroup property into the data-driven learning process, through a novel neural network architecture and new loss functions. The framework is very feasible, can be combined with any suitable neural networks, and is applicable to learning general autonomous ODEs and PDEs. We present the rigorous error estimates and variance analysis to understand the prediction accuracy and robustness of our approach, showing the remarkable advantages of semigroup awareness in our model. Moreover, our approach allows one to arbitrarily choose the time steps for prediction and ensures that the predicted results are well self-matched and consistent. Extensive numerical experiments demonstrate that embedding the semigroup property notably reduces the data dependency of deep learning models and greatly improves the accuracy, robustness, and stability for long-time prediction.

Full work available at URL: https://arxiv.org/abs/2302.03358

Recommendations

• Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
• Data-driven learning of nonautonomous systems
• Long-time integration of parametric evolution equations with physics-informed DeepONets
• Learning Stochastic Dynamical System via Flow Map Operator
• Deep hidden physics models: deep learning of nonlinear partial differential equations

zbMATH Keywords

deep learningneural networksemigroupoperator learningflow map learninglearning ODE and PDE

Mathematics Subject Classification ID

Approximation methods and numerical treatment of dynamical systems (37Mxx) Artificial intelligence (68Txx) Numerical methods for ordinary differential equations (65Lxx)

Cites Work

• PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network
• Title not available (Why is that?)
• Stable signal recovery from incomplete and inaccurate measurements
• Discovering governing equations from data by sparse identification of nonlinear dynamical systems
• Automated reverse engineering of nonlinear dynamical systems
• Compressed sensing
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Machine learning of linear differential equations using Gaussian processes
• Deep hidden physics models: deep learning of nonlinear partial differential equations
• Numerical aspects for approximating governing equations using data
• Model selection for dynamical systems via sparse regression and information criteria
• Learning partial differential equations via data discovery and sparse optimization
• Data-driven deep learning of partial differential equations in modal space
• Data driven governing equations approximation using deep neural networks
• Discovery of dynamics using linear multistep methods
• DLGA-PDE: discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm
• Structure-Preserving Method for Reconstructing Unknown Hamiltonian Systems From Trajectory Data
• DeepM\&Mnet: inferring the electroconvection multiphysics fields based on operator approximation by neural networks
• DeepM\&Mnet for hypersonics: predicting the coupled flow and finite-rate chemistry behind a normal shock using neural-network approximation of operators
• Deep neural network modeling of unknown partial differential equations in nodal space
• Data-driven learning of nonautonomous systems
• DEEP LEARNING OF PARAMETERIZED EQUATIONS WITH APPLICATIONS TO UNCERTAINTY QUANTIFICATION
• On generalized residual network for deep learning of unknown dynamical systems
• Deep learning of biological models from data: applications to ODE models
• Nonlocal kernel network (NKN): a stable and resolution-independent deep neural network

Cited In (1)

• Improved architectures and training algorithms for deep operator networks

This page was built for publication: Deep-OSG: deep learning of operators in semigroup

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6094763)