Optimal risk probability for first passage models in semi-Markov decision processes (Q2272058): Difference between revisions
From MaRDI portal
Created a new Item |
Added link to MaRDI item. |
||
links / mardi / name | links / mardi / name | ||
Revision as of 10:08, 2 February 2024
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Optimal risk probability for first passage models in semi-Markov decision processes |
scientific article |
Statements
Optimal risk probability for first passage models in semi-Markov decision processes (English)
0 references
5 August 2009
0 references
The authors are concerned with the risk minimization problem in semi-Markov denumerable state decision processes. The criterion to be optimized is the risk probability that a fist passage time to some target set does not exceed a threshold value. They characterize such risk functions and the corresponding optimal value function, and prove that the latter satisfies the optimality equation by using a successive approximation technique. Then some properties of optimal policies are presented and conditions for their existence are given. In addition, a value iteration algortihm and a policy improvement method for obtaining respectively, the optimal value function and optimal policies are developed. Two examples are given to illustrate the value iteration procedure and essential characterization of the risk function.
0 references
semi-Markov decision process
0 references
first passage time
0 references
risk probability
0 references
optimal policy
0 references