Discovering governing equations from data by sparse identification of nonlinear dynamical systems

DOI10.1073/PNAS.1517384113zbMATH Open1355.94013arXiv1509.03580OpenAlexW2239232218WikidataQ31066590 ScholiaQ31066590MaRDI QIDQ137310FDOQ137310

Authors: Steven L. Brunton, Joshua L. Proctor, J. Nathan Kutz, S. L. Brunton, J. L. Proctor, J. N. Kutz 

Publication date: 28 March 2016

Published in: Proceedings of the National Academy of Sciences (Search for Journal in Brave)

Abstract: The ability to discover physical laws and governing equations from data is one of humankind's greatest intellectual achievements. A quantitative understanding of dynamic constraints and balances in nature has facilitated rapid development of knowledge and enabled advanced technological achievements, including aircraft, combustion engines, satellites, and electrical power. In this work, we combine sparsity-promoting techniques and machine learning with nonlinear dynamical systems to discover governing physical equations from measurement data. The only assumption about the structure of the model is that there are only a few important terms that govern the dynamics, so that the equations are sparse in the space of possible functions; this assumption holds for many physical systems. In particular, we use sparse regression to determine the fewest terms in the dynamic governing equations required to accurately represent the data. The resulting models are parsimonious, balancing model complexity with descriptive ability while avoiding overfitting. We demonstrate the algorithm on a wide range of problems, from simple canonical systems, including linear and nonlinear oscillators and the chaotic Lorenz system, to the fluid vortex shedding behind an obstacle. The fluid example illustrates the ability of this method to discover the underlying dynamics of a system that took experts in the community nearly 30 years to resolve. We also show that this method generalizes to parameterized, time-varying, or externally forced systems.

Full work available at URL: https://arxiv.org/abs/1509.03580

Recommendations

• Data-driven discovery of coordinates and governing equations
• Learning partial differential equations via data discovery and sparse optimization
• IDENT: identifying differential equations with numerical time evolution
• SINDy-PI: a robust algorithm for parallel implicit sparse identification of nonlinear dynamics
• Constrained sparse Galerkin regression

Mathematics Subject Classification ID

Signal theory (characterization, reconstruction, filtering, etc.) (94A12) Local and nonlocal bifurcation theory for dynamical systems (37G99)

Cites Work

• An introduction to statistical learning. With applications in R
• Detecting causality in complex ecosystems
• Nonlinear total variation based noise removal algorithms
• Title not available (Why is that?)
• Title not available (Why is that?)
• Nonlinear oscillations, dynamical systems, and bifurcations of vector fields
• The Optimal Hard Threshold for Singular Values is <inline-formula> <tex-math notation="TeX">\(4/\sqrt {3}\) </tex-math></inline-formula>
• Stable signal recovery from incomplete and inaccurate measurements
• A fast immersed boundary method using a nullspace approach and multi-domain far-field boundary conditions
• The Hopf bifurcation and its applications. With contributions by P. Chernoff, G. Childs, S. Chow, J. R. Dorroh, J. Guckenheimer, L. Howard, N. Kopell, O. Lanford, J. Mallet-Paret, G. Oster, O. Ruiz, S. Schecter, D. Schmidt, and S. Smale
• Spectral compressive sensing
• The immersed boundary method: a projection approach
• On the nature of turbulence
• Equation-free, coarse-grained multiscale computation: enabling microscopic simulators to perform system-level analysis
• Compressive sensing and low-rank libraries for classification of bifurcation regimes in nonlinear dynamical systems
• Machine learning: Trends, perspectives, and prospects
• Dynamic mode decomposition of numerical and experimental data
• Normal forms for reduced stochastic climate models
• Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
• Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit
• Spectral analysis of nonlinear flows
• Information flow between subspaces of complex dynamical systems
• Automated reverse engineering of nonlinear dynamical systems
• A finite-element study of the onset of vortex shedding in flow past variously shaped bodies
• Title not available (Why is that?)
• Numerical differentiation of noisy, nonsmooth data
• A hierarchy of low-dimensional models for the transient and post-transient cylinder wake
• Deterministic Nonperiodic Flow
• Analysis of Fluid Flows via Spectral Properties of the Koopman Operator
• Sparse dynamics for partial differential equations
• Compressed modes for variational problems in mathematics and physics
• On the Compressive Spectral Method
• Turbulence, coherent structures, dynamical systems and symmetry.
• Compressed sensing

Cited In (only showing first 100 items - show all)

• A study on data-driven identification and representation of nonlinear dynamical systems with a physics-integrated deep learning approach: Koopman operators and nonlinear normal modes
• Machine Learning Moment Closure Models for the Radiative Transfer Equation II: Enforcing Global Hyperbolicity in Gradient-Based Closures
• Parsimony as the ultimate regularizer for physics-informed machine learning
• Data-driven resolvent analysis
• From snapshots to modal expansions -- bridging low residuals and pure frequencies
• Deep-OSG: deep learning of operators in semigroup
• A data-driven physics-informed finite-volume scheme for nonclassical undercompressive shocks
• On generalized residual network for deep learning of unknown dynamical systems
• Symplectic neural networks in Taylor series form for Hamiltonian systems
• Deep-learning based discovery of partial differential equations in integral form from sparse and noisy data
• Sparse identification of truncation errors
• Data-driven closure of projection-based reduced order models for unsteady compressible flows
• Sparse recovery and dictionary learning to identify the nonlinear dynamical systems: one step toward finding bifurcation points in real systems
• Learning chemical reaction networks from trajectory data
• Learning non-Markovian physics from data
• SubTSBR to tackle high noise and outliers for data-driven discovery of differential equations
• A data-driven, physics-informed framework for forecasting the spatiotemporal evolution of chaotic dynamics with nonlinearities modeled as exogenous forcings
• Image inversion and uncertainty quantification for constitutive laws of pattern formation
• Asymptotic theory of \(\ell_1\)-regularized PDE identification from a single noisy trajectory
• System identification through Lipschitz regularized deep neural networks
• A robust framework for identification of PDEs from noisy data
• CFD-driven symbolic identification of algebraic Reynolds-stress models
• Revealing hidden dynamics from time-series data by ODENet
• Cluster-based feedback control of turbulent post-stall separated flows
• Learning equations from biological data with limited time samples
• Discrete data-adaptive approximation of hyperelastic energy functions
• Learning biological dynamics from spatio-temporal data by Gaussian processes
• Sparse feature map-based Markov models for nonlinear fluid flows
• Data-driven, variational model reduction of high-dimensional reaction networks
• Interpolatory tensorial reduced order models for parametric dynamical systems
• Data-driven discovery of governing equations for transient heat transfer analysis
• Numerical bifurcation analysis of PDEs from lattice Boltzmann model simulations: a parsimonious machine learning approach
• Machine learning moment closure models for the radiative transfer equation. III: enforcing hyperbolicity and physical characteristic speeds
• Physics-informed regularization and structure preservation for learning stable reduced models from data with operator inference
• Physics-informed neural networks for data-driven simulation: advantages, limitations, and opportunities
• Data-driven identification of 2D partial differential equations using extracted physical features
• Data-driven learning of differential equations: combining data and model uncertainty
• Retracted: Model order reduction method based on machine learning for parameterized time-dependent partial differential equations
• Inadequacy of linear methods for minimal sensor placement and feature selection in nonlinear systems: a new approach using secants
• A joint estimation approach to sparse additive ordinary differential equations
• Assessment of end-to-end and sequential data-driven learning for non-intrusive modeling of fluid flows
• Automated learning of interpretable models with quantified uncertainty
• DL-PDE: Deep-Learning Based Data-Driven Discovery of Partial Differential Equations from Discrete and Noisy Data
• Model selection for hybrid dynamical systems via sparse regression
• Title not available (Why is that?)
• Robust and optimal sparse regression for nonlinear PDE models
• Interpreting neural network models of residual scalar flux
• Reconstruction of normal forms by learning informed observation geometries from data
• Data-Driven Discovery of Governing Equations for Coarse-Grained Heterogeneous Network Dynamics
• Symplectic learning for Hamiltonian neural networks
• A dynamic mode decomposition based reduced-order model for parameterized time-dependent partial differential equations
• Reduced-order variational mode decomposition to reveal transient and non-stationary dynamics in fluid flows
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• An efficient descent method for locally Lipschitz multiobjective optimization problems
• A multidimensional data-driven sparse identification technique: the sparse proper generalized decomposition
• Applied Koopman theory for partial differential equations and data-driven modeling of spatio-temporal systems
• Learning nonlinear turbulent dynamics from partial observations via analytically solvable conditional statistics
• Data-driven non-linear elasticity: constitutive manifold construction and problem discretization
• A few techniques to improve data-driven reduced-order simulations for unsteady flows
• Hybrid FEM-NN models: combining artificial neural networks with the finite element method
• Full and reduced order model consistency of the nonlinearity discretization in incompressible flows
• Scalable uncertainty quantification for deep operator networks using randomized priors
• PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network
• Neural machine-based forecasting of chaotic dynamics
• Data-driven sparse identification of nonlinear dynamical systems using linear multistep methods
• Detecting the maximum likelihood transition path from data of stochastic dynamical systems
• Multiscale model reduction for incompressible flows
• Projection-based model reduction: formulations for physics-based machine learning
• On the convergence of the SINDy algorithm
• Data-driven reduced model construction with time-domain Loewner models
• Data-driven, multi-moment fluid modeling of Landau damping
• A manifold learning approach to data-driven computational elasticity and inelasticity
• Sparse reduced-order modelling: sensor-based dynamics to full-state estimation
• Time-series learning of latent-space dynamics for reduced-order model closure
• Projection-based model reduction of dynamical systems using space-time subspace and machine learning
• Extended dynamic mode decomposition with dictionary learning: A data-driven adaptive spectral decomposition of the Koopman operator
• Machine learning for fast and reliable solution of time-dependent differential equations
• Structure-preserving neural networks
• Sparse identification of nonlinear dynamical systems via reweighted \(\ell_1\)-regularized least squares
• Data-driven operator inference for nonintrusive projection-based model reduction
• Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks
• Compressed sensing and dynamic mode decomposition
• Numerical aspects for approximating governing equations using data
• tgEDMD: approximation of the Kolmogorov operator in tensor train format
• Data-Driven Filtered Reduced Order Modeling of Fluid Flows
• Residual dynamic mode decomposition: robust and verified Koopmanism
• Sparse dynamical system identification with simultaneous structural parameters and initial condition estimation
• Reduced-order models for coupled dynamical systems: data-driven methods and the Koopman operator
• Generalizing dynamic mode decomposition: balancing accuracy and expressiveness in Koopman approximations
• Automated reverse engineering of nonlinear dynamical systems
• Shortcuts to thermodynamic computing: the cost of fast and faithful information processing
• Constrained sparse Galerkin regression
• Online Dynamic Mode Decomposition for Time-Varying Systems
• Sparse methods for automatic relevance determination
• A method for computing inverse parametric PDE problems with random-weight neural networks
• SINDy-PI: a robust algorithm for parallel implicit sparse identification of nonlinear dynamics
• fPINNs: Fractional Physics-Informed Neural Networks
• \textit{A priori} analysis of reduced description of dynamical systems using approximate inertial manifolds
• Constraint-aware neural networks for Riemann problems
• Extracting non-Gaussian governing laws from data on mean exit time

This page was built for publication: Discovering governing equations from data by sparse identification of nonlinear dynamical systems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q137310)