Optimal stopping model with unknown transition probabilities

MaRDI QIDQ5501005zbMATH OpenFDO

Authors Masayuki Horiguchi, A. B. Piunovskiy

Publication date 10 August 2015

zbMATH Keywords

dynamic programmingBayesian methodoptimal stoppingMarkov Decision Process (MDP)unknown transition matrices

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Dynamic programming in optimal control and differential games (49L20) Discrete-time control/observation systems (93C55) Optimal stochastic control (93E20)

Recommendations

• The problem of optimal stopping in a partially observable Markov chain
• Optimal stopping problem on finite Markov chain
• Stability estimating in optimal stopping problem
• Statistical inference for a finite optimal stopping problem with unknown transition probabilities
• Partially observed optimal stopping problem for discrete-time Markov processes

Cited in

(10)

• Stopping problems with an unknown state
• Optimal stopping under model uncertainty: randomized stopping times approach
• Optimal models with maximizing probability of first achieving target value in the preceding stages
• scientific article; zbMATH DE number 4036827 (Why is no real title available?)
• Decision model on optimal stopping of business opportunity digging under imperfect information
• Statistical inference for a finite optimal stopping problem with unknown transition probabilities
• The problem of optimal stopping in a partially observable Markov chain
• Continue, quit, restart probability model
• Stability estimating in optimal stopping problem
• scientific article; zbMATH DE number 4080679 (Why is no real title available?)

This page was built for publication: Optimal stopping model with unknown transition probabilities

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5501005)