A first-order approximation to stochastic optimal control of reservoirs
A new approximate method of solution for stochastic optimal control problems with many state and control variables is introduced. The method is based on the expansion of the optimal control into the deterministic feedback control plus a caution term. The analytic, small-perturbation calculation of the caution term is at the heart of the new method. The developed approximation depends only on the first two statistical moments of the random inputs and up to the third derivatives of the cost functions. Its computational requirements do not exhibit the exponential growth exhibited by discrete stochastic DP and can be used as a suboptimal solution to problems for which application of stochastic DP is not feasible. The method is accurate when the cost-to-go functions are approximately cubic in a neighbourhood around the deterministic trajectory whose size depends on forecasting uncertainty. Furthermore, the method elucidates the stochastic optimization problem yielding insights which cannot be easily obtained from the numerical application of discrete DP.
- A new formulation for the stochastic control of systems with bounded state variables: An application to a single reservoir system
- Stochastic differential dynamic programming for multi-reservoir system control
- scientific article; zbMATH DE number 3952640
- Controlled approximation of the value function in stochastic dynamic programming for multi-reservoir systems
- Publication:3476557
- Discretional Convexity and the Maximum Principle for Discrete Systems
- scientific article; zbMATH DE number 3126094 (Why is no real title available?)
- scientific article; zbMATH DE number 3174053 (Why is no real title available?)
- scientific article; zbMATH DE number 3354103 (Why is no real title available?)
- scientific article; zbMATH DE number 3200675 (Why is no real title available?)
- scientific article; zbMATH DE number 3097872 (Why is no real title available?)
- Perturbation methods and non-linear hyperbolic waves
- Piecewise affine approximations for the control of a one-reservoir hydroelectric system
- Lower bounding aggregation and direct computation for an infinite horizon one-reservoir model
- A new formulation for the stochastic control of systems with bounded state variables: An application to a single reservoir system
- Controlled approximation of the value function in stochastic dynamic programming for multi-reservoir systems
- Stochastic dynamic programming approach to managing power system uncertainty with distributed storage
- Efficient real-time reservoir management using adjoint-based optimal control and model updating
- Particle methods for stochastic optimal control problems
- Optimal feedback solution of a constrained stochastic one-storage model
- Reservoir optimization and Machine Learning methods
- Management of water resource systems in the presence of uncertainties by nonlinear approximation techniques and deterministic sampling
This page was built for publication: A first-order approximation to stochastic optimal control of reservoirs
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1111882)
