Optimal control of multiscale systems using reduced-order models
From MaRDI portal
Abstract: We study optimal control of diffusions with slow and fast variables and address a question raised by practitioners: is it possible to first eliminate the fast variables before solving the optimal control problem and then use the optimal control computed from the reduced-order model to control the original, high-dimensional system? The strategy "first reduce, then optimize"--rather than "first optimize, then reduce"--is motivated by the fact that solving optimal control problems for high-dimensional multiscale systems is numerically challenging and often computationally prohibitive. We state sufficient and necessary conditions, under which the "first reduce, then control" strategy can be employed and discuss when it should be avoided. We further give numerical examples that illustrate the "first reduce, then optmize" approach and discuss possible pitfalls.
Recommendations
- Model reduction algorithms for optimal control and importance sampling of diffusions
- On the order reduction approach for singularly perturbed optimal control systems
- Order reduction is invalid for singularly perturbed control problems with a vector fast variable
- On nonlinear control systems with multiple time scales
- Singularly Perturbed Control Systems with One-Dimensional Fast Dynamics
Cites work
- scientific article; zbMATH DE number 1577097 (Why is no real title available?)
- scientific article; zbMATH DE number 3976052 (Why is no real title available?)
- scientific article; zbMATH DE number 4006060 (Why is no real title available?)
- scientific article; zbMATH DE number 4010368 (Why is no real title available?)
- scientific article; zbMATH DE number 193190 (Why is no real title available?)
- scientific article; zbMATH DE number 3627589 (Why is no real title available?)
- scientific article; zbMATH DE number 3638903 (Why is no real title available?)
- scientific article; zbMATH DE number 1557967 (Why is no real title available?)
- scientific article; zbMATH DE number 1856209 (Why is no real title available?)
- scientific article; zbMATH DE number 3265711 (Why is no real title available?)
- scientific article; zbMATH DE number 2222868 (Why is no real title available?)
- A General Convergence Result for a Functional Related to the Theory of Homogenization
- A Survey of Model Reduction by Balanced Truncation and Some New Results
- A minimum principle for the principal eigenvalue for second-order linear elliptic equations with natural boundary conditions
- A stochastic representation for fully nonlinear PDEs and its application to homogenization
- A structure-preserving numerical discretization of reversible diffusions
- All optimal Hankel-norm approximations of linear multivariable systems and theirL,∞-error bounds†
- An ergodic control problem arising from the principal eigenfunction of an elliptic operator
- Applications of Singular Perturbation Techniques to Control Problems
- Approximation of Large-Scale Dynamical Systems
- Averaging of singularly perturbed systems
- Balanced averaging of bilinear systems with applications to stochastic control
- Balanced model reduction of partially observed Langevin equations: an averaging principle
- Balanced truncation of linear second-order systems: a Hamiltonian approach
- Connections between stochastic control and dynamic games
- Continuous-time stochastic control and optimization with financial applications
- Controlled Markov processes and viscosity solutions
- Correctors for the homogenization of Hamilton-Jacobi equations in the stationary ergodic setting
- Dimensional reduction in nonlinear filtering
- Dimensional reduction in nonlinear filtering: a homogenization approach
- Exit problem and control theory
- Importance Sampling, Large Deviations, and Differential Games
- Importance sampling for multiscale diffusions
- Limits of Singularly Perturbed Control Problems with Statistical Dynamics of Fast Motions
- Long-term average cost control problems for continuous time Markov processes: A survey
- Martingales, the Malliavin calculus and hypoellipticity under general H�rmander's conditions
- Maximum likelihood drift estimation for multiscale diffusions
- Multiscale Methods
- Multiscale problems and homogenization for second-order Hamilton-Jacobi equations
- Multiscale singular perturbations and homogenization of optimal control problems
- On singular perturbations for differential inclusions on the infinite interval
- On singularly perturbed ordinary differential equations with measure-valued limits
- Optimal control of diffusion processes and hamilton–jacobi–bellman equations part 2 : viscosity solutions and uniqueness
- Optimal control of molecular dynamics using Markov state models
- Optimal control of robot guided laser material treatment
- Parameter estimation for multiscale diffusions
- Portfolio Selection with Transaction Costs
- Principal component analysis in linear systems: Controllability, observability, and model reduction
- Probabilistic approach to homogenization of viscosity solutions of parabolic PDEs
- Probabilistic approach to homogenizations of systems of quasilinear parabolic PDEs with periodic structures
- Risk-Sensitive Control on an Infinite Time Horizon
- Stationary solutions and forward equations for controlled and singular martingale problems
- Stochastic differential equations. An introduction with applications.
- Suboptimization of Singularly Perturbed Control Systems
- The perturbed test function method for viscosity solutions of nonlinear PDE
- Viscosity Solutions Methods for Singular Perturbations in Deterministic and Stochastic Control
- Weak convergence methods and singularly perturbed stochastic control and filtering problems
Cited in
(11)- scientific article; zbMATH DE number 5269096 (Why is no real title available?)
- Solving high-dimensional Hamilton-Jacobi-Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path space
- Sequential Reduced-Order Modeling for Time-Dependent Optimization Problems with Initial Value Controls
- scientific article; zbMATH DE number 4018852 (Why is no real title available?)
- Mean field limits for interacting diffusions in a two-scale potential
- A new framework for extracting coarse-grained models from time series with multiscale structure
- A sparse Markov chain approximation of LQ-type stochastic control problems.
- Perturbation-based inference for diffusion processes: obtaining effective models from multiscale data
- A reduced-order model for advection-dominated problems based on the Radon cumulative distribution transform
- Importance sampling in path space for diffusion processes with slow-fast variables
- Error bounds for model reduction of feedback-controlled linear stochastic dynamics on Hilbert spaces
This page was built for publication: Optimal control of multiscale systems using reduced-order models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2513918)
