Continuous-time Markov chains. An applications-oriented approach
From MaRDI portal
Publication:1189368
zbMath0731.60067MaRDI QIDQ1189368
Publication date: 18 September 1992
Published in: Springer Series in Statistics (Search for Journal in Brave)
monotonicityinvariant measuresreversibilityexistence and uniqueness criteriamultidimensional population processes
Continuous-time Markov processes on discrete state spaces (60J27) Research exposition (monographs, survey articles) pertaining to probability theory (60-02)
Related Items
Large deviations, central limit, and dynamical phase transitions in the atom maser, Random population dynamics under catastrophic events, Exponential convergence to a quasi-stationary distribution for birth–death processes with an entrance boundary at infinity, ZIPF AND LERCH LIMIT OF BIRTH AND DEATH PROCESSES, On a gateway between the Laguerre process and dynamics on partitions, Extinction Probability in A Birth-Death Process with Killing, Unnamed Item, Unnamed Item, Stability and ergodicity of a stochastic Gilpin–Ayala model under regime switching on patches, A new matrix-infinite-product-form solution for upper block-Hessenberg Markov chains and its quasi-algorithmic constructibility, Numerical solutions of stochastic functional differential equations with impulsive perturbations and Markovian switching, MATRIX-MFO tandem workshop: Stochastic reinforcement processes and graphs. Abstracts from the MATRIX-MFO tandem workshop held March 5--10, 2023, Stochastic stabilization and destabilization of nonlinear and time‐varying hybrid systems by noise, Ergodicity and approximations of invariant measures for stochastic lattice systems with Markovian switching, Pseudo-Marginal Inference for CTMCs on Infinite Spaces via Monotonic Likelihood Approximations, Explicit convergence rates for the \(M/G/1\) queue under perturbation, Hahn polynomials and the Burnside process, Harnack type inequalities for SDEs driven by fractional Brownian motion with Markovian switching, Stabilisation in distribution by delay feedback controls for hybrid stochastic delay differential equations, Recurrence property for Galton-Watson processes in which individuals have variable lifetimes, Reproduction of initial distributions from the first hitting time distribution for birth-and-death processes, On contraction of functional differential equations with Markovian switching, Sufficient conditions for regularity, positive recurrence, and absorption in level‐dependent QBD processes and related block‐structured Markov chains, LINEAR BIRTH/IMMIGRATION-DEATH PROCESS WITH BINOMIAL CATASTROPHES, HITTING TIME DISTRIBUTIONS FOR BIRTH–DEATH PROCESSES WITH BILATERAL ABSORBING BOUNDARIES, Full classification of dynamics for one-dimensional continuous-time Markov chains with polynomial transition rates, Discrete-time feedback control for highly nonlinear hybrid stochastic systems with non-differentiable delays, Stabilization in distribution of hybrid stochastic systems by intermittent feedback controls, Subsampling in ensemble Kalman inversion, Multimodal dynamics of nonhomogeneous absorbing Markov chains evolving at stochastic transition rates, Unnamed Item, Delay Feedback Control for Switching Diffusion Systems Based on Discrete-Time Observations, Periodically driven jump processes conditioned on large deviations, Decay property of stopped Markovian bulk-arriving queues, On geometric and algebraic transience for block-structured Markov chains, Birth-death processes and $q$-continued fractions, Nonzero-sum games for continuous-time Markov chains with unbounded discounted payoffs, Asymptotic Fluid Optimality and Efficiency of the Tracking Policy for Bandwidth-Sharing Networks, Stationary Distributions of Continuous-Time Markov Chains: A Review of Theory and Truncation-Based Approximations, Stochastic ordering for birth–death processes with killing, Optimal Stopping Problems for a Family of Continuous-Time Markov Processes, Orthogonal polynomials in Stein's method, Zero-sum games for continuous-time jump Markov processes in Polish spaces: discounted payoffs, A Class of Multidimensional Q-Processes, A Remark on the Uniqueness of Weighted Markov Branching Processes, Computable Bounds for the Decay Parameter of a Birth–Death Process, Reaction-diffusion processes, On the α-Classification of Birth-Death and Quasi-Birth-Death Processes, Discriminatory Processor Sharing Queues and the DREB Method, Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates, The Limit Behavior of Dual Markov Branching Processes, Projektowanie systemów inżynierskich w polskich kopalniach w trzecim kwartale XX wieku, Advances in Stabilization of Hybrid Stochastic Differential Equations by Delay Feedback Control, Uniqueness criteria for continuous-time Markov chains with general transition structures, Light-tailed asymptotics of stationary probability vectors of Markov chains of GI/G/1 type, Stability of reaction–diffusion systems with stochastic switching, Robust quantised control of hybrid stochastic systems based on discrete-time state and mode observations, Boundary effect in competition processes, Several Types of Ergodicity for M/G/1-Type Markov Chains and Markov Processes, On the Limit Structure of Continuous-time Markov Branching Process, Stabilization of Hybrid Systems by Feedback Control Based on Discrete-Time State Observations, From entropic to energetic barriers in glassy dynamics: the Barrat–Mézard trap model on sparse networks, Ergodic risk-sensitive control of Markov processes on countable state space revisited, Stabilisation of nonlinear hybrid stochastic systems with time-varying delay by discrete-time feedback controls with a time delay, Eigentime identity for transient Markov chains, Spectral gap for open Jackson networks, Modelling the effect of telegraph noise in the SIRS epidemic model using Markovian switching, Approximation of Markov dynamics on the dual object of the infinite-dimensional unitary group, Estimates on the amplitude of the first Dirichlet eigenvector in discrete frameworks, Retracted: Fixed point theorems and explicit estimates for convergence rates of continuous time Markov chains, Computationally exact methods for stochastic periodic dynamics: spatiotemporal dispersal and temporally forced transmission, Markov branching processes with killing and resurrection, Convergence of controlled models and finite-state approximation for discounted continuous-time Markov decision processes with constraints, Asymptotic properties of stochastic hybrid Gilpin-Ayala system with jumps, Shell polynomials and dual birth-death processes, Random record processes and state dependent thinning, Kolmogorov-type systems with regime-switching jump diffusion perturbations, Positivity and contractivity in the dynamics of clusters' splitting with derivative of fractional order, Duplication in a model of rock fracture with fractional derivative without singular kernel, Average break-even concentration in a simple chemostat model with telegraph noise, On the approximations of solutions to neutral SDEs with Markovian switching and jumps under non-Lipschitz conditions, Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates, Dynamics of hybrid switching diffusions SIRS model, Kolmogorov forward equation and explosiveness in countable state Markov processes, Uniform ergodicity of continuous-time controlled Markov chains: a survey and new results, Convergence rates in strong ergodicity for Markov processes, On variation of single birth processes, Dynamics of a switching diffusion modified Leslie-Gower predator-prey system with Beddington-DeAngelis functional response, Continuous-time block-monotone Markov chains and their block-augmented truncations, Convergence rates and limit theorems for the dual Markov branching process, Asymptotic behaviors of stochastic periodic differential equation with Markovian switching, The decay parameter and invariant measures for Markovian bulk-arrival queues with control at idle time, The spectral gap for quasi-birth and death processes, Law of large numbers for random walk with unbounded jumps and birth and death process with bounded jumps in random environment, Necessary and sufficient conditions for consistent root reconstruction in Markov models on trees, Stationary in distributions of numerical solutions for stochastic partial differential equations with Markovian switching, Transient probability functions of finite birth-death processes with catastrophes, Birth-multiple catastrophe processes, Spectral gap and convergence rate for discrete-time Markov chains, Decay properties and quasi-stationary distributions for stopped Markovian bulk-arrival and bulk-service queues, \(R\)-positivity of nearest neighbor matrices and applications to Gibbs states, Uniqueness, recurrence and decay properties of collision branching processes with immigration, On parameter estimation in population models, Eigentime identity for asymmetric finite Markov chains, Ergodicity of quasi-birth and death processes. I, Optimal harvesting for a stochastic regime-switching logistic diffusion system with jumps, A mathematical analysis of fractional fragmentation dynamics with growth, Factorized time-dependent distributions for certain multiclass queueing networks and an application to enzymatic processing networks, Gibbs sampling, exponential families and orthogonal polynomials, When are two Markov chains similar?, Conditions for the existence of quasi-stationary distributions for birth-death processes with killing, Markov processes on the path space of the Gelfand-Tsetlin graph and on its boundary, Transient Markov arrival processes, Domain of attraction of the quasi-stationary distribution for the linear birth and death process, Total reward criteria for unconstrained/constrained continuous-time Markov decision processes, Conservative interacting particles system with anomalous rate of ergodicity, Stochastic monotonicity and duality for one-dimensional Markov processes, Limit properties of transition functions of continuous-time Markov branching processes, Stabilization of hybrid stochastic differential equations by feedback control based on discrete-time state observations, Convergence of the Euler--Maruyama method for stochastic differential equations with Markovian switching., Anomalous dissipation in a stochastic inviscid dyadic model, Tests for nonergodicity of denumerable continuous time Markov processes, Asymptotic behaviour of flows on reducible networks, Euler-Maruyama approximations in mean-reverting stochastic volatility model under regime-switching, Quasi-stationary distributions for birth-death processes with killing, The crash-NIG factor model, Numerical solutions of neutral stochastic functional differential equations with Markovian switching, Nonequilibrium Markov processes conditioned on large deviations, Constructing transient birth-death processes by means of suitable transformations, Existence, uniqueness and ergodicity of Markov branching processes with immigration and instantaneous resurrection, Stability in distribution of a stochastic hybrid competitive Lotka-Volterra model with Lévy jumps, A survey of retrial queueing systems, Metropolis-Hastings from a stochastic population dynamics perspective, The limit behaviour of imprecise continuous-time Markov chains, Convergence of numerical solutions to stochastic age-structured population equations with diffusions and Markovian switching, Asymptotic and spectral properties of exponentially \(\phi\)-ergodic Markov processes, Markov branching processes with immigration-migration and resurrection, New optimality conditions for average-payoff continuous-time Markov games in Polish spaces, Subgeometric ergodicity for continuous-time Markov chains, A class of stochastic functional differential equations with Markovian switching, On batch queueing systems: a combinatorial approach, Non-ergodicity criteria for denumerable continuous time Markov processes., The limiting conditional probability distribution in a stochastic model of T cell repertoire maintenance, Uniqueness, extinction and explosivity of generalised Markov branching processes with pairwise interaction, Numerical analysis for stochastic age-dependent population equations with Poisson jump and phase semi-Markovian switching, Some new results on strong ergodicity, Controlling number of particles in fragmentation equations, \(M^X/M/c\) queue with catastrophes and state-dependent control at idle time, A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder), Average optimality for continuous-time Markov decision processes in Polish spaces, Additive two-way hazards model with varying coefficients, On time dynamics of coagulation-fragmentation processes, A birth and death process related to the Rogers-Ramanujan continued fraction, Spectral approximation of solutions to the chemical master equation, Ultrametric and tree potential, Quasi-stationary distributions and diffusion models in population dynamics, Self-consistent feedback Stackelberg equilibria for infinite horizon stochastic games, Decay parameter and related properties of 2-type branching processes, Spectral gap for jump processes by decomposition method, General collision branching processes with two parameters, A birth-death process suggested by a chain sequence, Stochastic comparability and dual \(Q\)-functions, New methods for determining quasi-stationary distributions for Markov chains., Absorbing Markov and branching processes with instantaneous resurrection, Continuous-time controlled Markov chains., Integrals for continuous-time Markov chains., Equivalence of exponential ergodicity and \(L^ 2\)-exponential convergence for Markov chains., Stabilisation in distribution of hybrid stochastic differential equations by feedback control based on discrete-time state observations, Dynamics of a stochastic Gilpin-Ayala population model with Markovian switching and impulsive perturbations, Markov branching processes regulated by emigration and large immigration, The stochastic \(\theta\) method for stationary distribution of stochastic differential equations with Markovian switching, Stability analysis of the \(\theta\)-method for hybrid neutral stochastic functional differential equations with jumps, Quasi-stationary distributions for queueing and other models, On the explosion of the number of fragments in simple exchangeable fragmentation-coagulation processes, The determination of quasistationary distributions directly from the transition rates of an absorbing Markov chain, The threshold dynamics in a stochastic SIS epidemic model with vaccination and nonlinear incidence under regime switching, Long-term concentration of measure and cut-off, Some properties of 2-type Markov branching processes with immigration and instantaneous resurrection, Modeling host-parasitoid interactions with correlated events, Average cost criterion induced by the regular utility function for continuous-time Markov decision processes, Intervention to maximise the probability of epidemic fade-out, Existence of a unique quasi-stationary distribution in stochastic reaction networks, Hitting time distributions for denumerable birth and death processes, Dynamics of a stochastic SIRS epidemic model with regime switching and specific functional response, The risk probability criterion for discounted continuous-time Markov decision processes, Decay parameter and related properties of \(n\)-type branching processes, Nonzero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates, A nonhomogeneous quasi-birth-death process approach for an \((s,S)\) policy for a perishable inventory system with retrial demands, The transformation method for continuous-time Markov decision processes, Multilevel mutation-selection systems and set-valued duals, Decay properties of \(n\)-type Markov branching processes with disasters, Kemeny's constant for countable Markov chains, Reaction-diffusion approach to modeling of the spread of early tumors along linear or tubular structures, Resolvent decomposition theorems and their application in denumerable Markov processes with instantaneous states, Markovian bulk-arrival and bulk-service queues with general state-dependent control, Existence results for a Michaud fractional, nonlocal, and randomly position structured fragmentation model, Preserving global exponential stability of hybrid BAM neural networks with reaction diffusion terms in the presence of stochastic noise and connection weight matrices uncertainty, An inverse problem in birth and death processes, Branching collision processes with immigration, Families of \(\nu\)-similar birth-death processes and limiting conditional distributions, On the separating variables method for Markov death-process equations, The decay function of nonhomogeneous birth-death processes, with application to mean-field models, Strategic behavior in the partially observable Markovian queues with partial breakdowns, Backward Euler-Maruyama method applied to nonlinear hybrid stochastic differential equations with time-variable delay, Impact of demography on extinction/fixation events, Approximation of invariant measure for a stochastic population model with Markov chain and diffusion in a polluted environment, Generalized Markov interacting branching processes, Mean field interaction on random graphs with dynamically changing multi-color edges, Stabilization and destabilization of hybrid systems by periodic stochastic controls, On-the-fly verification and optimization of DTA-properties for large Markov chains, Asymptotic boundedness and stability of solutions to hybrid stochastic differential equations with jumps and the Euler-Maruyama approximation, Recurrence for switching diffusion with past dependent switching and countable state space, Exponential and strong ergodicity for Markov processes with an application to queues, Limiting process of absorbing Markov chains, Unified representation of formulas for single birth processes, Decay properties of Markovian bulk-arrival and bulk-service queues with state-independent control, Optimal reinsurance and investment strategies for insurers with regime-switching and state-dependent utility function, Market selection of constant proportions investment strategies in continuous time, Markovian bulk-arrival and bulk-service queues with state-dependent control, On solutions of Kolmogorov's equations for nonhomogeneous jump Markov processes, Ergodic degrees for continuous-time Markov chains, On time-discretized versions of the stochastic SIS epidemic model: a comparative analysis, Proof of the conjecture on the stability of a multiserver retrial queue, Hard-edge asymptotics of the Jacobi growth process, Integral-type functionals of first hitting times for continuous-time Markov chains, A sequential update algorithm for computing the stationary distribution vector in upper block-Hessenberg Markov chains, First-passage times and related moments for continuous-time birth-death chains, Siegmund duality for continuous time Markov chains on \(\mathbb{Z}_+^d\), Synchronization for complex networks with Markov switching via matrix measure approach, Switching-dominated stability of numerical solutions for hybrid neutral stochastic differential delay equations, Variational principles of hitting times for non-reversible Markov chains, A stochastic differential equation SIS epidemic model with regime switching, Dynamical properties of a biological population with a protected area under ecological uncertainty, Linear stochastic dyadic model, Time-changed spectrally positive Lévy processes started from infinity, On the nonexplosion and explosion for nonhomogeneous Markov pure jump processes, Existence condition of strong stationary times for continuous time Markov chains on discrete graphs, Entropy-information inequalities under curvature-dimension conditions for continuous-time Markov chains, Variance reduction with array-RQMC for tau-leaping simulation of stochastic biological and chemical reaction networks, Global analysis and optimal harvesting for a hybrid stochastic phytoplankton-zooplankton-fish model with distributed delays, Hoeffding's inequality for Markov processes via solution of Poisson's equation, Statistically consistent and computationally efficient inference of ancestral DNA sequences in the TKF91 model under dense taxon sampling, Scaling features of two special Markov chains involving total disasters, Bounding inferences for large-scale continuous-time Markov chains: a new approach based on lumping and imprecise Markov chains, Analysis of stochastic gradient descent in continuous time, Approximate adaptive uniformization of continuous-time Markov chains, Asymptotic behavior of SIRS models in state-dependent random environments, The entropy method under curvature-dimension conditions in the spirit of Bakry-Émery in the discrete setting of Markov chains, Bidirectional sliding of two parallel microtubules generated by multiple identical motors, Linear competition processes and generalized Pólya urns with removals, Intermittent stochastic stabilization of Markovian jump systems via sampled data, Decay parameter for general stopped Markovian bulk-arrival and bulk-service queues, Approximate solutions of hybrid stochastic pantograph equations with Levy jumps, Strictly substochastic semigroups with application to conservative and shattering solutions to fragmentation equations with mass loss, On the quasi-ergodic distribution of absorbing Markov processes, Analysis of dynamic service system between regular and retrial queues with impatient customers, Ergodic property of a Lotka-Volterra predator-prey model with white noise higher order perturbation under regime switching, Approximation of stochastic processes by nonexpansive flows and coming down from infinity, On first passage times in discrete skeletons and uniformized versions of a continuous-time Markov chain, Kolmogorov's equations for jump Markov processes with unbounded jump rates, On Stein's factors for Poisson approximation in Wasserstein distance with nonlinear transportation costs, Convergence rates in uniform ergodicity by hitting times and \(L^2\)-exponential convergence rates, The \(N\)-player war of attrition in the limit of infinitely many players, Uniqueness and extinction properties of generalised Markov branching processes, Kolmogorov's Equations for Jump Markov Processes and Their Applications to Control Problems, An orthogonal-polynomial approach to first-hitting times of birth-death processes, Count Data Time Series Models Based on Expectation Thinning, A stochastic model for a progressive chronic disease, Bounded truncation error for long-run averages in infinite Markov chains, Constrained Continuous-Time Markov Control Processes with Discounted Criteria, Unnamed Item, A New Type of Discrete Self-Decomposability and Its Application to Continuous-Time Markov Processes for Modeling Count Data Time Series, Branching Structures Within Random Walks and Their Applications, OPTIMAL CONTROL OF STOCHASTIC FLUCTUATIONS IN BIOCHEMICAL REACTIONS, Markovian bulk-arriving queues with state-dependent control at idle time, Uniqueness and Decay Properties of Markov Branching Processes with Disasters, Stability of a queue with discriminatory random order service discipline and heterogeneous servers, An epidemic model for an evolving pathogen with strain-dependent immunity, Nonlinear branching processes with immigration, Perturbations of continuous-time Markov chains, The birth-death processes with regular boundary: stationarity and quasi-stationarity, The generalized Fibonacci oscillator as an open quantum system, Error bounds for augmented truncation approximations of continuous-time Markov chains, Invariant probability measures for path-dependent random diffusions, Asymptotic properties of the Markov branching process with immigration, Uniqueness and extinction of weighted Markov branching processes, Analysis of a stochastic hybrid population model with impulsive perturbations and Allee effect, Why is Kemeny’s constant a constant?, Explicit Formulas for a Continuous Stochastic Maturation Model: Application to Anticancer Drug Pharmacokinetics/Pharmacodynamics, Unnamed Item, An iterative aggregation/disaggregation procedure for modelling the long-term behaviour of continuous-time evanescent random processes, Large deviations and related problems for absorbing Markov chains, Computing Continuous-Time Markov Chains as Transformers of Unbounded Observables, COMPUTABLE STRONGLY ERGODIC RATES OF CONVERGENCE FOR CONTINUOUS-TIME MARKOV CHAINS, The Exit Time Finite State Projection Scheme: Bounding Exit Distributions and Occupation Measures of Continuous-Time Markov Chains, On finite long run costs and rewards in infinite Markov chains, Risk-sensitive average continuous-time Markov decision processes with unbounded rates, Dynamics of stochastic hybrid Gilpin-Ayala system with impulsive perturbations, Population Dynamics and Random Genealogies, Skip-free Markov chains, The variance constant for continuous-time level dependent quasi-birth-and-death processes, An Overview for Markov Decision Processes in Queues and Networks, Preserving exponential mean-square stability in the simulation of hybrid stochastic differential equations, Alternative proof and interpretations for a recent state-dependent importance sampling scheme, Convergence rate estimation for the TKF91 model of biological sequence length evolution, Fast-slow asymptotics for a Markov chain model of fast sodium current, Continuous-time QBD processes with continuous phase variable, Random surface growth with a wall and Plancherel measures for O (∞), Large deviations for a feed-forward network, Birth and Death (BDP) Process Models with Applications, The protection zone for biological population in random environment, Domain of Attraction of the Quasistationary Distribution for Birth-and-Death Processes, BIAS CALCULATIONS FOR ADAPTIVE URN DESIGNS, Critical markov branching process limit theorems allowing infinite variance, Exponential ergodicity for single-birth processes, The collision branching process, The eigentime identity for continuous-time ergodic Markov chains, Extinction times for a general birth, death and catastrophe process, Probabilistic approach in weighted Markov branching processes, Exponential stability of numerical solutions to SDDEs with Markovian switching, Approximating persistence in a general class of population processes, Extinction and explosion of nonlinear Markov branching processes, Convergence and stability of numerical solutions to SDDEs with Markovian switching, Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations, Height and the total mass of the forest of genealogical trees of a large population with general competition, Diffusion Models for Double-ended Queues with Renewal Arrival Processes, Stability in distribution of stochastic differential delay equations with Markovian switching, Note on discounted continuous-time Markov decision processes with a lower bounding function, \(\alpha\)-transience and \(\alpha\)-recurrence of right processes, Genetic noise mechanism for power-law switching in bacterial flagellar motors, Extinction times for a birth--death process with two phases, The M/M/c queue with mass exodus and mass arrivals when empty, Fitting timeseries by continuous-time Markov chains: a quadratic programming approach, Stability of neutral stochastic functional differential equations with Markovian switching driven by G-Brownian motion, Blackwell optimality in the class of Markov policies for continuous-time controlled Markov chains, Total Variation Approximation for Quasi-Stationary Distributions, Asymptotic properties of switching diffusion epidemic model with varying population size, On the existence of uni-instantaneous Q-processes with a given finite μ-invariant measure, A stochastic SIS infection model incorporating indirect transmission, Zero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates, New discount and average optimality conditions for continuous-time Markov decision processes, The Markov chain Monte Carlo revolution, Decay property of stopped Markovian bulk-arriving queues withc-servers, Risk-Sensitive Discounted Continuous-Time Markov Decision Processes with Unbounded Rates, The λ-classification of continuous-time birth-and-death processes, Some Theoretical Properties of the Geometric and α-Series Processes, Stabilization of nonlinear hybrid stochastic delay systems by feedback control based on discrete-time state and mode observations, Quasi-stationary distributions of a pair of Markov chains related to time evolution of a DNA locus, Birth-death processes with disaster and instantaneous resurrection, Formalisms for Specifying Markovian Population Models, Risk-sensitive average continuous-time Markov decision processes with unbounded transition and cost rates, Dual processes to solve single server systems, Level product form QSF processes and an analysis of queues with <scp>C</scp> oxian interarrival distribution, On The Numerical Solution Of Transient Probabilities Of Quadratic Birth And Death Processes, Asymptotic stability in distribution of stochastic differential equations with Markovian switching., Markovian Switching of Mutation Rates in Evolutionary Network Dynamics, A biomathematical view on the fractional dynamics of cellulose degradation, LaSalle-type theorems for stochastic functional differential equations with Markovian switching, Explicit transient probabilities of various Markov models, The exponential-dual matrix method: Applications to Markov chain analysis, A new approach in analyzing extinction probability of Markov branching process with immigration and migration, Recurrence and decay properties of a star-typed queueing model with refusal, Quasi-stationary distributions for discrete-state models, Extinction Probability of Interacting Branching Collision Processes
