Markov chains: models, algorithms and applications

DOI10.1007/0-387-29337-XzbMath1089.60003OpenAlexW1523742540MaRDI QIDQ820232

Wai-Ki Ching, Michael Kwok-Po Ng

Publication date: 6 April 2006

Published in: International Series in Operations Research \& Management Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/0-387-29337-x

zbMATH Keywords

hidden Markov modelsmultivariate Markov chainshigher-order Markov chainsMarkov chains with discrete and continuous time

Mathematics Subject Classification ID

Introductory exposition (textbooks, tutorial papers, etc.) pertaining to probability theory (60-01) Queueing theory (aspects of probability theory) (60K25) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Markov and semi-Markov decision processes (90C40) Continuous-time Markov processes on discrete state spaces (60J27) Applications of queueing theory (congestion, allocation, storage, traffic, etc.) (60K30)

Related Items (39)

Convergence of a second order Markov chain ⋮ Switching Regression Models and Causal Inference in the Presence of Discrete Latent Variables ⋮ A new improved parsimonious multivariate Markov chain model ⋮ A higher-order interactive hidden Markov model and its applications ⋮ Exact and inexact iterative methods for finding the largest eigenpair of a weakly irreducible nonnegative tensor ⋮ Modeling vehicular traffic networks. I. ⋮ Markov frameworks and stock market decision making ⋮ A survey on the spectral theory of nonnegative tensors ⋮ The perturbation bound for the Perron vector of a transition probability tensor ⋮ Two queues with weighted one-way overflow ⋮ Second order Markov chains with finite vectors known stationary ⋮ Estimation and inference in multivariate Markov chains ⋮ Convergence of a transition probability tensor of a higher-order Markov chain to the stationary probability vector ⋮ A matrix perturbation method for computing the steady-state probability distributions of probabilistic Boolean networks with gene perturbations ⋮ Inducing high service capacities in outsourcingviapenalty and competition ⋮ A \(C\)-eigenvalue problem for tensors with applications to higher-order multivariate Markov chains ⋮ A multivariate Markov chain stock model ⋮ On computation of the steady-state probability distribution of probabilistic Boolean networks with gene perturbation ⋮ Proposing a two-level stochastic model for epileptic seizure genesis ⋮ On the existence of proper stochastic Markov models for statistical reconstruction and prediction of chaotic time series ⋮ Marginal distributions of genetic coalgebras ⋮ On the uniqueness of the positive Z-eigenvector for nonnegative tensors ⋮ Stationary Probability Vectors of Higher-Order Two-Dimensional Symmetric Transition Probability Tensors ⋮ On evolution operators of genetic coalgebras ⋮ Construction of Probabilistic Boolean Networks from a Prescribed Transition Probability Matrix: A Maximum Entropy Rate Approach ⋮ Incentive Effects of Multiple-Server Queueing Networks: The Principal-Agent Perspective ⋮ On Construction of Sparse Probabilistic Boolean Networks ⋮ On Generating Optimal Sparse Probabilistic Boolean Networks with Maximum Entropy from a Positive Stationary Distribution ⋮ Intra frame compression and video restoration based on conditional Markov processes theory ⋮ A high-order Markov-switching model for risk measurement ⋮ A Simulation Study on Fuzzy Markov Chains ⋮ A coalgebraic structure on bisexual populations ⋮ An iterative algorithm based on strong \(\mathcal{H} \)-tensors for identifying positive definiteness of irreducible homogeneous polynomial forms ⋮ Statistical analysis of multivariate discrete-valued time series ⋮ The generalized HSS method for solving singular linear systems ⋮ Markov chains and rough sets ⋮ Pseudospectra localizations for generalized tensor eigenvalues to seek more positive definite tensors ⋮ New uniqueness conditions for the stationary probability matrix of transition probability tensors ⋮ Stationary probability vectors of higher-order Markov chains

This page was built for publication: Markov chains: models, algorithms and applications