Particle methods for stochastic optimal control problems

DOI10.1007/S10589-013-9579-YzbMATH Open1284.93259arXiv0907.4663OpenAlexW1996950539MaRDI QIDQ2636612FDOQ2636612

Guy Cohen, Anes Dallagi, Pierre Carpentier

Publication date: 30 January 2014

Published in: Computational Optimization and Applications (Search for Journal in Brave)

Abstract: To tackle the difficulties faced by both stochastic dynamic programming and scenario tree methods, we present some variational approach for numerical solution of stochastic optimal control problems. We consider two different interpretations of the control problem, an algebraic and a functional one from which we derive optimality conditions. An adaptative mesh discretization method will be used to propose a tractable solution algorithm. An application to a hydro-electric dam production management problem will be presented.

Full work available at URL: https://arxiv.org/abs/0907.4663

Recommendations

• scientific article; zbMATH DE number 854116
• A first-order approximation to stochastic optimal control of reservoirs
• A forward method for optimal stochastic nonlinear and adaptive control
• scientific article; zbMATH DE number 854115
• A stochastic minimum principle and an adaptive pathwise algorithm for stochastic optimal control

zbMATH Keywords

numerical solutionoptimality conditionsfeedback synthesisstochastic dynamic programmingstochastic optimal control problemsadaptive mesh discretization method

Mathematics Subject Classification ID

Stochastic programming (90C15) Optimality conditions for problems involving randomness (49K45) Dynamic programming in optimal control and differential games (49L20) Feedback control (93B52) Optimal stochastic control (93E20) Numerical methods based on necessary conditions (49M05)

Cites Work

• Variational Analysis
• Title not available (Why is that?)
• Title not available (Why is that?)
• Scenario tree modeling for multistage stochastic programs
• Scenario reduction in stochastic programming
• Scenario reduction algorithms in stochastic programming
• Title not available (Why is that?)
• Title not available (Why is that?)
• Set-valued analysis
• Dynamic programming and stochastic control
• On the convergence of stochastic dual dynamic programming and related methods
• Stochastic optimal control. The discrete time case
• Multi-stage stochastic optimization applied to energy planning
• Convergent cutting-plane and partial-sampling algorithm for multistage stochastic linear programs with recourse
• Step decision rules for multistage stochastic programming: a heuristic approach
• The abridged nested decomposition method for multistage stochastic linear programs with relatively complete recourse
• Survey of Measurable Selection Theorems
• Title not available (Why is that?)
• Approximate Dynamic Programming
• On complexity of multistage stochastic programs
• Scenario tree generation for multiperiod financial optimization of optimal discretization
• Variational approaches and other contributions in stochastic optimization.
• On optimality conditions for some nonsmooth optimization problems over \(L^p\) spaces
• Multifunctions of Souslin type
• Title not available (Why is that?)
• Dual effect free stochastic controls

Cited In (5)

• PF-MPC: particle filter-model predictive control
• Particle Algorithms for Optimization on Binary Spaces
• An Efficient Gradient Projection Method for Stochastic Optimal Control Problems
• Space mapping-based optimization with the macroscopic limit of interacting particle systems
• A stochastic minimum principle and an adaptive pathwise algorithm for stochastic optimal control

This page was built for publication: Particle methods for stochastic optimal control problems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2636612)