Optimal risk probability for first passage models in semi-Markov decision processes (Q2272058): Difference between revisions

From MaRDI portal
Set OpenAlex properties.
ReferenceBot (talk | contribs)
Changed an Item
 
Property / cites work
 
Property / cites work: Q5425954 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach / rank
 
Normal rank
Property / cites work
 
Property / cites work: Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes / rank
 
Normal rank
Property / cites work
 
Property / cites work: Optimal Control of Ergodic Continuous-Time Markov Chains with Average Sample-Path Rewards / rank
 
Normal rank
Property / cites work
 
Property / cites work: First passage models for denumerable semi-Markov decision processes with nonnegative discounted costs / rank
 
Normal rank
Property / cites work
 
Property / cites work: Existence of Optimal Policies for Semi-Markov Decision Processes Using Duality for Infinite Linear Programming / rank
 
Normal rank
Property / cites work
 
Property / cites work: Semi-Markov processes and reliability / rank
 
Normal rank
Property / cites work
 
Property / cites work: Optimal models for the first arrival time distribution function in continuous time -- with a special case / rank
 
Normal rank
Property / cites work
 
Property / cites work: Semi-Markov Decision Processes with Unbounded Rewards / rank
 
Normal rank
Property / cites work
 
Property / cites work: Markov decision processes with distribution function criterion of first-passage time / rank
 
Normal rank
Property / cites work
 
Property / cites work: Optimal policy for minimizing risk models in Markov decision processes / rank
 
Normal rank
Property / cites work
 
Property / cites work: Optimal threshold probability in undiscounted Markov decision processes with a target set. / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q4315289 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Average cost semi-markov decision processes / rank
 
Normal rank
Property / cites work
 
Property / cites work: Minimizing risk models in Markov decision processes with policies depending on target values / rank
 
Normal rank

Latest revision as of 20:14, 1 July 2024

scientific article
Language Label Description Also known as
English
Optimal risk probability for first passage models in semi-Markov decision processes
scientific article

    Statements

    Optimal risk probability for first passage models in semi-Markov decision processes (English)
    0 references
    0 references
    0 references
    5 August 2009
    0 references
    The authors are concerned with the risk minimization problem in semi-Markov denumerable state decision processes. The criterion to be optimized is the risk probability that a fist passage time to some target set does not exceed a threshold value. They characterize such risk functions and the corresponding optimal value function, and prove that the latter satisfies the optimality equation by using a successive approximation technique. Then some properties of optimal policies are presented and conditions for their existence are given. In addition, a value iteration algortihm and a policy improvement method for obtaining respectively, the optimal value function and optimal policies are developed. Two examples are given to illustrate the value iteration procedure and essential characterization of the risk function.
    0 references
    semi-Markov decision process
    0 references
    first passage time
    0 references
    risk probability
    0 references
    optimal policy
    0 references

    Identifiers