Discovering governing equations from data by sparse identification of nonlinear dynamical systems

DOI10.1073/PNAS.1517384113zbMATH Open1355.94013arXiv1509.03580OpenAlexW2239232218WikidataQ31066590 ScholiaQ31066590MaRDI QIDQ137310FDOQ137310

Authors: Steven L. Brunton, Joshua L. Proctor, J. Nathan Kutz, S. L. Brunton, J. L. Proctor, J. N. Kutz 

Publication date: 28 March 2016

Published in: Proceedings of the National Academy of Sciences (Search for Journal in Brave)

Abstract: The ability to discover physical laws and governing equations from data is one of humankind's greatest intellectual achievements. A quantitative understanding of dynamic constraints and balances in nature has facilitated rapid development of knowledge and enabled advanced technological achievements, including aircraft, combustion engines, satellites, and electrical power. In this work, we combine sparsity-promoting techniques and machine learning with nonlinear dynamical systems to discover governing physical equations from measurement data. The only assumption about the structure of the model is that there are only a few important terms that govern the dynamics, so that the equations are sparse in the space of possible functions; this assumption holds for many physical systems. In particular, we use sparse regression to determine the fewest terms in the dynamic governing equations required to accurately represent the data. The resulting models are parsimonious, balancing model complexity with descriptive ability while avoiding overfitting. We demonstrate the algorithm on a wide range of problems, from simple canonical systems, including linear and nonlinear oscillators and the chaotic Lorenz system, to the fluid vortex shedding behind an obstacle. The fluid example illustrates the ability of this method to discover the underlying dynamics of a system that took experts in the community nearly 30 years to resolve. We also show that this method generalizes to parameterized, time-varying, or externally forced systems.

Full work available at URL: https://arxiv.org/abs/1509.03580

Recommendations

• Data-driven discovery of coordinates and governing equations
• Learning partial differential equations via data discovery and sparse optimization
• IDENT: identifying differential equations with numerical time evolution
• SINDy-PI: a robust algorithm for parallel implicit sparse identification of nonlinear dynamics
• Constrained sparse Galerkin regression

Mathematics Subject Classification ID

Signal theory (characterization, reconstruction, filtering, etc.) (94A12) Local and nonlocal bifurcation theory for dynamical systems (37G99)

Cites Work

• An introduction to statistical learning. With applications in R
• Detecting causality in complex ecosystems
• Nonlinear total variation based noise removal algorithms
• Title not available (Why is that?)
• Title not available (Why is that?)
• Nonlinear oscillations, dynamical systems, and bifurcations of vector fields
• The Optimal Hard Threshold for Singular Values is <inline-formula> <tex-math notation="TeX">\(4/\sqrt {3}\) </tex-math></inline-formula>
• Stable signal recovery from incomplete and inaccurate measurements
• A fast immersed boundary method using a nullspace approach and multi-domain far-field boundary conditions
• The Hopf bifurcation and its applications. With contributions by P. Chernoff, G. Childs, S. Chow, J. R. Dorroh, J. Guckenheimer, L. Howard, N. Kopell, O. Lanford, J. Mallet-Paret, G. Oster, O. Ruiz, S. Schecter, D. Schmidt, and S. Smale
• Spectral compressive sensing
• The immersed boundary method: a projection approach
• On the nature of turbulence
• Equation-free, coarse-grained multiscale computation: enabling microscopic simulators to perform system-level analysis
• Compressive sensing and low-rank libraries for classification of bifurcation regimes in nonlinear dynamical systems
• Machine learning: Trends, perspectives, and prospects
• Dynamic mode decomposition of numerical and experimental data
• Normal forms for reduced stochastic climate models
• Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
• Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit
• Spectral analysis of nonlinear flows
• Information flow between subspaces of complex dynamical systems
• Automated reverse engineering of nonlinear dynamical systems
• A finite-element study of the onset of vortex shedding in flow past variously shaped bodies
• Title not available (Why is that?)
• Numerical differentiation of noisy, nonsmooth data
• A hierarchy of low-dimensional models for the transient and post-transient cylinder wake
• Deterministic Nonperiodic Flow
• Analysis of Fluid Flows via Spectral Properties of the Koopman Operator
• Sparse dynamics for partial differential equations
• Compressed modes for variational problems in mathematics and physics
• On the Compressive Spectral Method
• Turbulence, coherent structures, dynamical systems and symmetry.
• Compressed sensing

Cited In (only showing first 100 items - show all)

• Prediction accuracy of dynamic mode decomposition
• Design of the monodomain model by artificial neural networks
• Weak SINDy for partial differential equations
• A Bayesian approach for data-driven dynamic equation discovery
• Finite-data error bounds for Koopman-based prediction and control
• Discovering phase field models from image data with the pseudo-spectral physics informed neural networks
• Data-driven learning of nonautonomous systems
• Weak SINDy: Galerkin-based data-driven model selection
• Online interpolation point refinement for reduced-order models using a genetic algorithm
• One-shot learning of stochastic differential equations with data adapted kernels
• Robust modeling of unknown dynamical systems via ensemble averaged learning
• Stabilized neural ordinary differential equations for long-time forecasting of dynamical systems
• Commutation error in reduced order modeling of fluid flows
• Spatiotemporally dynamic implicit large eddy simulation using machine learning classifiers
• Deep neural network modeling of unknown partial differential equations in nodal space
• Computing the invariant distribution of randomly perturbed dynamical systems using deep learning
• The discovery of dynamics via linear multistep methods and deep learning: error estimation
• Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
• Reconstruction of ensembles of nonlinear neurooscillators with sigmoid coupling function
• Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems
• Data-driven discovery of emergent behaviors in collective dynamics
• LaSDI: parametric latent space dynamics identification
• Hamiltonian operator inference: physics-preserving learning of reduced-order models for canonical Hamiltonian systems
• Operator inference and physics-informed learning of low-dimensional models for incompressible flows
• On the universal transformation of data-driven models to control systems
• Data-driven discovery of coarse-grained equations
• Non-intrusive reduced-order modeling using uncertainty-aware deep neural networks and proper orthogonal decomposition: application to flood modeling
• Data-driven surrogate modeling of multiphase flows using machine learning techniques
• Kernel-based parameter estimation of dynamical systems with unknown observation functions
• Structure-Preserving Method for Reconstructing Unknown Hamiltonian Systems From Trajectory Data
• How entropic regression beats the outliers problem in nonlinear system identification
• Searching turbulence for periodic orbits with dynamic mode decomposition
• Extracting stochastic dynamical systems with α-stable Lévy noise from data
• Sparse identification of nonlinear dynamics with low-dimensionalized flow representations
• A neural network approach for the blind deconvolution of turbulent flows
• Adaptive weighting of Bayesian physics informed neural networks for multitask and multiscale forward and inverse problems
• Learning dynamical systems from data: a simple cross-validation perspective. IV: Case with partial observations
• Extracting Structured Dynamical Systems Using Sparse Optimization With Very Few Samples
• Title not available (Why is that?)
• Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networks
• Poincaré maps for multiscale physics discovery and nonlinear Floquet theory
• Data-driven discovery of governing equations for fluid dynamics based on molecular simulation
• Deep learning‐based reduced order models for the real‐time simulation of the nonlinear dynamics of microstructures
• gLaSDI: parametric physics-informed greedy latent space dynamics identification
• Reduced-order autodifferentiable ensemble Kalman filters
• Physics-constrained, data-driven discovery of coarse-grained dynamics
• Enforcing imprecise constraints on generative adversarial networks for emulating physical systems
• Bayesian system ID: optimal management of parameter, model, and measurement uncertainty
• What machine learning can do for computational solid mechanics
• Surrogate parametric metamodel based on optimal transport
• Learning dynamical systems from data: a simple cross-validation perspective. I: Parametric kernel flows
• Intrusive and data-driven reduced order modelling of the rotating thermal shallow water equation
• Sparse parameter identification of stochastic dynamical systems
• Towards out of distribution generalization for problems in mechanics
• Bridging the gap: machine learning to resolve improperly modeled dynamics
• DLGA-PDE: discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm
• Quantifying truncation-related uncertainties in unsteady fluid dynamics reduced order models
• On data-driven computation of information transfer for causal inference in discrete-time dynamical systems
• Parametric deep energy approach for elasticity accounting for strain gradient effects
• Some applications of compressed sensing in computational mechanics: model order reduction, manifold learning, data-driven applications and nonlinear dimensionality reduction
• Learning Hamiltonians of constrained mechanical systems
• Deep learning algorithm for data-driven simulation of noisy dynamical system
• Extended dynamic mode decomposition for inhomogeneous problems
• Machine learning moment closure models for the radiative transfer equation. I: Directly learning a gradient based closure
• Using neural networks to accelerate the solution of the Boltzmann equation
• Synchronization of reservoir computing models via a nonlinear controller
• Calibration of projection-based reduced-order models for unsteady compressible flows
• Modern Koopman theory for dynamical systems
• Learning slosh dynamics by means of data
• Learning partial differential equations for biological transport models from noisy spatio-temporal data
• Peridynamics enabled learning partial differential equations
• Koopman analysis of nonlinear systems with a neural network representation
• IDENT: identifying differential equations with numerical time evolution
• Reconstruction of ensembles of generalized van der Pol oscillators from vector time series
• Learning latent dynamics for partially observed chaotic systems
• Sampling Low-Dimensional Markovian Dynamics for Preasymptotically Recovering Reduced Models from Data with Operator Inference
• Machine learning subsurface flow equations from data
• Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings
• Learning the tangent space of dynamical instabilities from data
• Identification of physical processes via combined data-driven and data-assimilation methods
• Linearly recurrent autoencoder networks for learning dynamics
• Data-driven identification of parametric partial differential equations
• Time-delay observables for Koopman: theory and applications
• A physics-informed operator regression framework for extracting data-driven continuum models
• Hierarchical deep learning neural network (HiDeNN): an artificial intelligence (AI) framework for computational science and engineering
• Machine learning materials physics: multi-resolution neural networks learn the free energy and nonlinear elastic response of evolving microstructures
• Multi-level convolutional autoencoder networks for parametric prediction of spatio-temporal dynamics
• Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms
• Non-invasive inference of thrombus material properties with physics-informed neural networks
• Memory-based reduced modelling and data-based estimation of opinion spreading
• Variational approach for learning Markov processes from time series data
• Lift \& learn: physics-informed machine learning for large-scale nonlinear dynamical systems
• Data-driven deep learning of partial differential equations in modal space
• Discovering transition phenomena from data of stochastic dynamical systems with Lévy noise
• Variational system identification of the partial differential equations governing the physics of pattern-formation: inference under varying fidelity and noise
• A framework for machine learning of model error in dynamical systems
• Data-driven discovery of PDEs in complex datasets
• Data driven governing equations approximation using deep neural networks
• Recovering missing CFD data for high-order discretizations using deep neural networks and dynamics learning
• Discovering mean residence time and escape probability from data of stochastic dynamical systems

This page was built for publication: Discovering governing equations from data by sparse identification of nonlinear dynamical systems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q137310)