On the Koopman operator of algorithms
From MaRDI portal
Publication:5109369
Newton-Raphson methodKoopman operatorextended dynamic mode decompositionNesterov methodgradient descent optimizationEDMD algorithm
Analysis of algorithms and problem complexity (68Q25) Functional analytic techniques in dynamical systems; zeta functions, (Ruelle-Frobenius) transfer operators, etc. (37C30) Applications of operator theory in optimization, convex analysis, mathematical programming, economics (47N10) One-parameter semigroups and linear evolution equations (47D06) Numerical solutions to abstract evolution equations (65J08)
Abstract: A systematic mathematical framework for the study of numerical algorithms would allow comparisons, facilitate conjugacy arguments, as well as enable the discovery of improved, accelerated, data-driven algorithms. Over the course of the last century, the Koopman operator has provided a mathematical framework for the study of dynamical systems, which facilitates conjugacy arguments and can provide efficient reduced descriptions. More recently, numerical approximations of the operator have enabled the analysis of a large number of deterministic and stochastic dynamical systems in a completely data-driven, essentially equation-free pipeline. Discrete or continuous time numerical algorithms (integrators, nonlinear equation solvers, optimization algorithms) are themselves dynamical systems. In this paper, we use this insight to leverage the Koopman operator framework in the data-driven study of such algorithms and discuss benefits for analysis and acceleration of numerical computation. For algorithms acting on high-dimensional spaces by quickly contracting them towards low-dimensional manifolds, we demonstrate how basis functions adapted to the data help to construct efficient reduced representations of the operator. Our illustrative examples include the gradient descent and Nesterov optimization algorithms, as well as the Newton-Raphson algorithm.
Recommendations
- Applied Koopmanism
- A data-driven approximation of the koopman operator: extending dynamic mode decomposition
- Two methods to approximate the Koopman operator with a reservoir computer
- Koopman operator, geometry, and learning of dynamical systems
- The mpEDMD Algorithm for Data-Driven Computations of Measure-Preserving Dynamical Systems
Cites work
- scientific article; zbMATH DE number 3533448 (Why is no real title available?)
- scientific article; zbMATH DE number 979834 (Why is no real title available?)
- scientific article; zbMATH DE number 5485920 (Why is no real title available?)
- scientific article; zbMATH DE number 3382096 (Why is no real title available?)
- A data-driven approximation of the koopman operator: extending dynamic mode decomposition
- A generalized eigenvalue algorithm for tridiagonal matrix pencils based on a nonautonomous discrete integrable system
- A kernel-based method for data-driven Koopman spectral analysis
- A short course on operator semigroups
- Analysis of Fluid Flows via Spectral Properties of the Koopman Operator
- Applied Koopmanism
- Data-driven model reduction and transfer operator approximation
- Data-driven spectral analysis of the Koopman operator
- Data-driven spectral decomposition and forecasting of ergodic dynamical systems
- Differential equations for roaming pseudospectra: paths to extremal points and boundary tracking
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems
- Dynamic mode decomposition of numerical and experimental data
- Dynamical systems that sort lists, diagonalize matrices, and solve linear programming problems
- Eine Spektraltheorie für allgemeine Operatoren eines unitären Raumes. Erhard Schmidt zum 75. Geburtstag in Verehrung gewidmet
- Extended dynamic mode decomposition with dictionary learning: A data-driven adaptive spectral decomposition of the Koopman operator
- Finite-time stable versions of the continuous Newton method and applications to neural networks
- Global linearization and fiber bundle structure of invariant manifolds
- Isostables, isochrons, and Koopman spectrum for the action-angle representation of stable fixed point dynamics
- Koopman Operator Family Spectrum for Nonautonomous Systems
- Koopman-Based Lifting Techniques for Nonlinear Systems Identification
- Linear algebra algorithms as dynamical systems
- New algorithms for macromolecular simulation. Selected papers based on the presentation at 4th international symposium, Leicester, UK, August 18--21, 2004.
- Nonparametric uncertainty quantification for stochastic gradient flows
- On Matching, and Even Rectifying, Dynamical Systems through Koopman Operator Eigenfunctions
- On the equivalence between SOR-type methods for linear systems and the discrete gradient methods for gradient systems
- Short note: An integrable numerical algorithm for computing eigenvalues of a specially structured matrix.
- Solving equations through particle dynamics
- Spectral properties of dynamical systems, model reduction and decompositions
- Study of dynamical systems from the viewpoint of complexity and computational capabilities
- Towards tensor-based methods for the numerical approximation of the Perron-Frobenius and Koopman operator
- Zur Operatorenmethode in der klassischen Mechanik
Cited in
(15)- Modern Koopman theory for dynamical systems
- Dynamical Systems Theory and Algorithms for NP-hard Problems
- Systematic construction of continuous-time neural networks for linear dynamical systems
- Time-series forecasting using manifold learning, radial basis function interpolation, and geometric harmonics
- On the Approximability of Koopman-Based Operator Lyapunov Equations
- A Recursively Recurrent Neural Network (R2N2) Architecture for Learning Iterative Algorithms
- On Koopman mode decomposition and tensor component analysis
- Neural dynamic mode decomposition for end-to-end modeling of nonlinear dynamics
- The sparse-grid-based adaptive spectral Koopman method
- Numerical methods to evaluate Koopman matrix from system equations
- A gradient-based optimization method using the Koopman operator
- Data-driven control of agent-based models: an equation/variable-free machine learning approach
- Quantum process tomography of unitary maps from time-delayed measurements
- Modeling partially observed nonlinear dynamical systems and efficient data assimilation via discrete-time conditional Gaussian Koopman network
- Mini-workshop: Applied Koopmanism. Abstracts from the mini-workshop held February 7--13, 2016
This page was built for publication: On the Koopman operator of algorithms
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5109369)
