Publication:3876725

60-01: Introductory exposition (textbooks, tutorial papers, etc.) pertaining to probability theory

60J10: Markov chains (discrete-time Markov processes on discrete state spaces)

60J20: Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.)

60J27: Continuous-time Markov processes on discrete state spaces

Related Items

Discrete-time singularly perturbed Markov chains: aggregation, occupation measures, and switching diffusion limit, A Markov chain model for traffic equilibrium problems, Conditional phase-type distributions for modelling patient length of stay in hospital, A Poisson Limit Theorem for Reliability Models Based on Markov Chains, Recursive estimation algorithms for power controls of wireless communication networks, Reward distributions associated with some block tridiagonal transition matrices with applications to identity by descent, On the Reliability of an n-Component System, Reconstructing the nonlinear dynamical systems by evolutionary computation techniques, A Computing Procedure for Quantification Theory, On controllability with respect to the expectation of discrete time jump linear systems, Asymptotically optimal controls of hybrid linear quadratic regulators in discrete time., Ergodicity of Finite-Energy Diffusions, Limit theorems for Markov chains of finite rank, Towards an analytic framework for analysing the computation time of evolutionary algorithms, A comparative runtime analysis of heuristic algorithms for satisfiability problems, Extinction times and moment closure in the stochastic logistic process, Using the tangle: A consistent construction of phylogenetic distance matrices for quartets, An effective hybrid DE-based algorithm for multi-objective flow shop scheduling with limited buffers, A generalization of a result concerning the asymptotic behavior of finite Markov chains, Interacting with an artificial partner: modeling the role of emotional aspects, Modelling spatio-temporal movement of tourists using finite Markov chains, On a discrete version of the Laugesen-Morpurgo conjecture, Random matching in adaptive dynamics, An effective multiagent evolutionary algorithm integrating a novel roulette inversion operator for engineering optimization, Asymptotic expansions of backward equations for two-time-scale Markov chains in continuous time, \(H_\infty \) estimation for discrete-time piecewise homogeneous Markov jump linear systems, Asymptotic variability of nonhomogeneous Markov systems under cyclic behaviour, Strong uniform times and finite random walks, On the representation of finite multiple Markov chains by weighted circuits, Exponential convergence to equilibrium for a class of random-walk models, Periodicity of the profile process in Markov manpower systems, The coalescent, A survey on computer generation of some classes of stochastic processes, Tuning distributed control algorithms for optimal functioning, Relative entropy under mappings by stochastic matrices, Cost models in nonhomogeneous Markov systems, Reconstructing phylogenies from nucleotide pattern probabilities: A survey and some new results, Periodic Markovian replacement chains, Asymptotic behavior of nonhomogeneous semi-Markov systems, Characteristic analysis and prevention on premature convergence in genetic algorithms, The evolution of rationality and the Red Queen., Stability of Markov modulated discrete-time dynamic systems., Improved bounds for a condition number for Markov chains, Kac's moment formula and the Feynman-Kac formula for additive functionals of a Markov process, Martingale generating functions for Markov chains, Singularly perturbed diffusisons: Rapid switchings and fast diffusions., Morgan's problem for a type of nonsquare systems, Exponential bounds for discrete-time singularly perturbed Markov chains, A linear transformation and its properties with special applications in time series filtering, Optimum Markov replacement policies for using the most reliable components, Remarks on the ergodicity of simulated annealing algorithms on a graph, A dichotomy property for Markov measures, The pivot algorithm: a highly efficient Monte Carlo method for the self-avoiding walk., Nonlocal Monte Carlo algorithm for self-avoiding walks with fixed endpoints., Singularly perturbed Markov chains: Convergence and aggregation, Convergence of some time inhomogeneous Markov chains via spectral techniques, Recent advances in evolutionary computation, Sequential estimation for continuous time finite markov processes, An analysis of international data encryption algorithm(IDEA) security against differential cryptanalysis, Probabilistic models for pattern statistics, Graph fibrations, graph isomorphism, and PageRank, Average Value and Variance of Pattern Statistics in Rational Models, Traps and Pitfalls of Topic-Biased PageRank, Stability of Discrete-Time Regime-Switching Dynamic Systems with Delays, On circuit chains defined by forward and backward passages