Finite Horizon Decision Timing with Partially Observable Poisson Processes
From MaRDI portal
Abstract: We study decision timing problems on finite horizon with Poissonian information arrivals. In our model, a decision maker wishes to optimally time her action in order to maximize her expected reward. The reward depends on an unobservable Markovian environment, and information about the environment is collected through a (compound) Poisson observation process. Examples of such systems arise in investment timing, reliability theory, Bayesian regime detection and technology adoption models. We solve the problem by studying an optimal stopping problem for a piecewise-deterministic process which gives the posterior likelihoods of the unobservable environment. Our method lends itself to simple numerical implementation and we present several illustrative numerical examples.
Recommendations
- Finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates
- scientific article; zbMATH DE number 1091564
- Finite Horizon Markov Decision Processes with Uncertain Terminal Payoffs
- Finite horizon continuous-time Markov decision processes with mean and variance criteria
- Partially observable Markov decision processes and periodic policies with applications
- Performance bounds for mismatched decision schemes with Poisson process observations
- Stochastic optimal control under Poisson-distributed observations
- Risk-sensitive finite-horizon piecewise deterministic Markov decision processes
Cites work
- scientific article; zbMATH DE number 425394 (Why is no real title available?)
- scientific article; zbMATH DE number 49106 (Why is no real title available?)
- scientific article; zbMATH DE number 3607222 (Why is no real title available?)
- Adaptive Poisson disorder problem
- Adoption and diffusion of an innovation of uncertain profitability
- An optimal stopping problem in risk theory
- An optimal stopping problem with two levels of incomplete information
- Approximations for optimal stopping of a piecewise-deterministic process
- Approximations of the optimal stopping problem in partial observation
- Compound Poisson Disorder Problem
- Doubly stochastic Poisson processes
- Dynamic programming and stochastic control
- Filtering the histories of a partially observed marked point process
- Finite Horizon Decision Timing with Partially Observable Poisson Processes
- Finite-dimensional models for hidden Markov chains
- General smoothing formulas for Markov-modulated Poisson observations
- Hidden Markov models in finance
- Inference in hidden Markov models.
- Information Acquisition and the Adoption of New Technology
- Integro-differential equations associated with optimal stopping time of a piecewise-deterministic process
- Investment Timing Under Incomplete Information
- Maximal wearing-out of a deteriorating system: An optimal stopping approach
- Monotone stopping rules forstochastic processes in a semimartingale representation with applications
- Multisource Bayesian sequential change detection
- Online Change Detection for a Poisson Process with a Phase-Type Change-Time Prior Distribution
- Optimal Replacement Under Partial Observations
- Optimal Stopping by Means of Point Process Observations with Applications in Reliability
- Optimal Stopping in a Partially Observable Markov Process with Costly Information
- Optimal Stopping of a Risk Reserve Process with Interest and Cost Rates
- Optimal stopping of a piecewise-deterministic markov process
- Passage-time generating functions for continuous-time finite Markov chains
- Point processes and queues. Martingale dynamics
- SPRT and CUSUM in hidden Markov models
- Sequential Detection and Identification of a Change in the Distribution of a Markov-Modulated Random Sequence
- Sequential testing problems for Poisson processes.
- State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms
- The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
- The Wiener Sequential Testing Problem with Finite Horizon
- Uncertainty, information acquisition, and technology adoption
Cited in
(12)- Sequential Bayesian inference in hidden Markov stochastic kinetic models with application to detection and response to seasonal epidemics
- Optimal timing of decisions: a general theory based on continuation values
- Finite horizon sequential detection with exponential penalty for the delay
- Optimal stopping for partially observed piecewise-deterministic Markov processes
- Compound Poisson disorder problem with uniformly distributed disorder time
- Short communication: the price of information
- Sequential tracking of a hidden Markov chain using point process observations
- Compound Poisson disorder problem with general disorder prior density
- Finite Horizon Decision Timing with Partially Observable Poisson Processes
- Optimal sequential testing for an inverse Gaussian process
- Multisource Bayesian sequential binary hypothesis testing problem
- Bayesian quickest detection in sensor arrays
This page was built for publication: Finite Horizon Decision Timing with Partially Observable Poisson Processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2904311)
