Dynamic Programming Conditions for Partially Observable Stochastic Systems
From MaRDI portal
Publication:5675611
DOI10.1137/0311020zbMath0258.93029OpenAlexW2067726964WikidataQ56814053 ScholiaQ56814053MaRDI QIDQ5675611
Mark H. A. Davis, Pravin P. Varaiya
Publication date: 1973
Published in: SIAM Journal on Control (Search for Journal in Brave)
Full work available at URL: https://semanticscholar.org/paper/37d6ee0f9076487526c6cc358b8ac627bc001ba2
Related Items (71)
A general problem of an optimal equivalent change of measure and contingent claim pricing in an incomplete market. ⋮ A partial history of the early development of continuous-time nonlinear stochastic systems theory ⋮ The probabilistic structure of controlled diffusion processes ⋮ Unnamed Item ⋮ The optimal control of diffusions ⋮ Decentralized optimality conditions of stochastic differential decision problems via Girsanov's measure transformation ⋮ Optimal compensation with hidden action and lump-sum payment in a continuous-time model ⋮ Control problem for diffusion-type random fields ⋮ Optimal switching problems of tandem type ⋮ On the stochastic control-stopping problem ⋮ Zero-sum path-dependent stochastic differential games in weak formulation ⋮ Geometry of information structures, strategic measures and associated stochastic control topologies ⋮ Simulation-based optimization of Markov decision processes: an empirical process theory approach ⋮ Optimal locally absolutely continuous change of measure. finite set of decisions. part i ⋮ Conjugate convex functions in optimal stochastic control ⋮ Optimal stopping of continuous time stochastic processes and stochastic differential representations for the value functions ⋮ Young, timid, and risk takers ⋮ Encounters with Martingales in Stochastic Control ⋮ Dissipative stochastic dynamical systems ⋮ Optimality criteria for controlled discontinuous processes ⋮ Operational absolutely optimal dynamic control of the stochastic differential plant's state by its output ⋮ Optimal finite-dimensional controller of the stochastic differential object's state by its output. I: Incomplete precise measurements ⋮ Stochastic control by measure transformation: A general existence result ⋮ On the optimal control of stochastic systems with an exponential-of- integral performance index ⋮ Optimal locally absolutely continuous change of measure. finite set of decisions. part ii:optimization problems ⋮ Sequential stochastic control (single or multi-agent) problems nearly admit change of measures with independent measurement ⋮ Nash-equilibrium in stochastic differential games ⋮ Nonanticipative risk sensitive control: the martingale method. ⋮ Existence and uniqueness results for BSDE with jumps: the whole nine yards ⋮ Transaction costs, trading volume, and the liquidity premium ⋮ Unnamed Item ⋮ Application of conditional-optimal filter for synthesis of suboptimal control in the problem of optimizing the output of a nonlinear differential stochastic system ⋮ Optimal compensation with adverse selection and dynamic actions ⋮ An invariance principle in large population stochastic dynamic games ⋮ Martingale approach to stochastic differential games of control and stopping ⋮ Lagrange lemma and the optimal control of diffusions. II: Nonlinear Lagrange functionals ⋮ Zero-sum stochastic differential games and backward equations ⋮ The optimal investment, liability and dividends in insurance ⋮ Optimal control of semi-Markov processes with a backward stochastic differential equations approach ⋮ Adjoint processes in stochastic optimal control problems ⋮ A necessary condition for optimality in a problem of stochastic control with discretized observations ⋮ Optimal control of a jump process ⋮ Backward stochastic partial differential equations related to utility maximization and hedging ⋮ A stochastic minimum principle ⋮ On the existence of solutions to stochastic differential equations on Loeb spaces ⋮ The limits of leverage ⋮ Finite-dimensional attainable sets for stochastic control systems ⋮ Optimal control of diffusion processes with reflection ⋮ Stochastic control of system with unobserved jump parameter process ⋮ On the separation principle with bounded controls ⋮ Risk-Sensitive Mean-Field Type Control Under Partial Observation ⋮ Exit probabilities and optimal stochastic control ⋮ A unified approach to well-posedness of type-I backward stochastic Volterra integral equations ⋮ Dynamic programming optimality criteria for stochastic systems in Riemannian manifolds ⋮ Techniques probabilistes dans le contrôle impulsionnel ⋮ The value function in ergodic control of diffusion processes with partial observations ⋮ Singular stochastic control and optimal stopping ⋮ Strong envelopes of stochastic processes and a penalty method† ⋮ Strategies using an observer for steering a random motion of a point in a multitarget environment ⋮ Computation of suboptimal randomized strategies for steering the random motion of a point under partial observation ⋮ Optimal contracting under mean-volatility joint ambiguity uncertainties ⋮ Bang-bang partially observable feedback strategies for a rendezvous problem† ⋮ Separation principle for impulse control with partial information ⋮ Dynamic programming for ergodic control with partial observations. ⋮ BSDEs and risk-sensitive control, zero-sum and nonzero-sum game problems of stochastic functional differential equations. ⋮ Local optimality conditions for optimal stopping ⋮ Least-squares state estimation of systems with state-dependent observation noise ⋮ Portfolio optimization for an investor with a benchmark ⋮ Interview with Ulf Hashagen: exhibitions and mathematical models in the nineteenth and twentieth centuries ⋮ Lagrange approach to the optimal control of diffusions ⋮ Forward and backward semimartingale models for gaussian processes with stationary increments
This page was built for publication: Dynamic Programming Conditions for Partially Observable Stochastic Systems