Interval-valued finite Markov chains
From MaRDI portal
Publication:1597639
The authors develop the theory of interval valued probabilities in the framework of finite Markov chains when the elements of the transition matrix are given by intervals between lower and upper probabilities. It is shown how to find a conventional transition matrix with elements lying with the given bounds by solving of a linear programming problem. Ergodicity conditions for the chains with interval-valued transition functions are also found.
Recommendations
Cited in
(41)- Robust topological policy iteration for infinite horizon bounded Markov decision processes
- Qualitative reachability for open interval Markov chains
- Coefficients of ergodicity for Markov chains with uncertain parameters
- A formal approach to adaptive software: continuous assurance of non-functional requirements
- Finding provably optimal Markov chains
- Computing lower and upper expected first-passage and return times in imprecise birth-death chains
- Reachability analysis of uncertain systems using bounded-parameter Markov decision processes
- Imprecise probability trees: bridging two theories of imprecise probability
- Bounded densities and their derivatives: extension to other domains
- Time-homogeneous birth-death processes with probability intervals and absorbing state
- Min-max decision rules for choice under complete uncertainty: axiomatic characterizations for preferences over utility intervals
- Interval-valued Markov processes
- Interval type-2 fuzzy Markov chains
- Killed Markov Decision Processes on Finite Time Interval for Countable Models
- Decision Problems for Interval Markov Chains
- Genetic algorithms for condition-based maintenance optimization under uncertainty
- Finite discrete time Markov chains with interval probabilities
- Computing interval-valued statistical characteristics: what is the stumbling block for reliability applications?
- IMPRECISE MARKOV CHAINS AND THEIR LIMIT BEHAVIOR
- Probabilistic Model Checking of Biological Systems with Uncertain Kinetic Rates
- scientific article; zbMATH DE number 4088657 (Why is no real title available?)
- Three-valued abstraction for probabilistic systems
- Maximizing entropy over Markov processes
- An interval-valued reliability model with bounded failure rates
- Maintenance policy performance assessment in presence of imprecision based on Dempster-Shafer theory of evidence
- Probabilistic timed automata with one clock and initialised clock-dependent probabilities
- Probabilistic timed automata with one clock and initialised clock-dependent probabilities
- Stochastic dynamics simulation with generalized interval probability
- Model-Checking ω-Regular Properties of Interval Markov Chains
- Approximate verification of the symbolic dynamics of Markov chains
- Markov interval chain (MIC) for solving a decision problem
- Parameter synthesis in Markov models: a gentle survey
- Imprecise Markov chains with absorption
- Parameter synthesis for Markov models: covering the parameter space
- Interval Markov decision processes with multiple objectives: from robust strategies to Pareto curves
- From verification to causality-based explications (invited talk)
- Reversible imprecise Markov chains
- Probabilistic model checking of biological systems with uncertain kinetic rates
- Lumpability for uncertain continuous-time Markov chains
- Verified stochastic methods
- Discrete time Markov chains with interval probabilities
This page was built for publication: Interval-valued finite Markov chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1597639)