Optimal control under uncertainty and Bayesian parameters adjustments

DOI10.1137/16M1070815MaRDI QIDQ4608239zbMATH OpenWikidataFDO

Authors Nicolas Baradel, Bruno Bouchard, Ngoc Minh Dang

Publication date 16 March 2018

Published in SIAM Journal on Control and Optimization (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1604.06340

zbMATH Keywords

uncertaintyBayesian filteringoptimal impulse control problem

Mathematics Subject Classification ID

Dynamic programming in optimal control and differential games (49L20) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25)

Abstract: We propose a general framework for studying optimal impulse control problem in the presence of uncertainty on the parameters. Given a prior on the distribution of the unknown parameters, we explain how it should evolve according to the classical Bayesian rule after each impulse. Taking these progressive prior-adjustments into account, we characterize the optimal policy through a quasi-variational parabolic equation, which can be solved numerically. The derivation of the dynamic programming equation seems to be new in this context. The main difficulty lies in the nature of the set of controls which depends in a non trivial way on the initial data through the filtration itself.

Recommendations

• Impulse control of a diffusion with a change point
• scientific article; zbMATH DE number 5159430
• Optimal Impulse Control When Control Actions Have Random Consequences
• Optimal control with learning on the fly: a toy problem
• Learning and control in a changing economic environment.

Cites work

• scientific article; zbMATH DE number 3778410 (Why is no real title available?)
• scientific article; zbMATH DE number 4125214 (Why is no real title available?)
• A stochastic target formulation for optimal switching problems in finite horizon
• Adaptive Markov control processes
• An Introduction to the Theory of Viscosity Solutions for First-Order Hamilton–Jacobi Equations and Applications
• Controlling a Stochastic Process with Unknown Parameters
• Stochastic optimal control. The discrete time case
• User’s guide to viscosity solutions of second order partial differential equations
• Weak dynamic programming principle for viscosity solutions

Cited in

(6)

• Cost-efficient monitoring of continuous-time stochastic processes based on discrete observations
• Optimal inventory management and order book modeling
• Optimal control under uncertainty: application to the issue of CAT bonds
• Monte-Carlo methods for the pricing of American options: a semilinear BSDE point of view
• Classical and restricted impulse control for the exchange rate under a stochastic trend model
• On the convexity of the value function in Bayesian optimal control problems

This page was built for publication: Optimal control under uncertainty and Bayesian parameters adjustments

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4608239)