Markov Chains

DOI10.1017/CBO9780511810633zbMath0938.60058OpenAlexW755194005WikidataQ56769020 ScholiaQ56769020MaRDI QIDQ4216130

Publication date: 20 October 1998

Full work available at URL: https://doi.org/10.1017/cbo9780511810633

Introductory exposition (textbooks, tutorial papers, etc.) pertaining to probability theory (60-01) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Related Items (only showing first 100 items - show all)

The generalized distance spectrum of a graph and applications ⋮ Stochastic algorithms for self-consistent calculations of electronic structures ⋮ Keeping random walks safe from extinction and overpopulation in the presence of life-taking disasters ⋮ Arcsine and Darling–Kac laws for piecewise linear random interval maps ⋮ Classical and Quantum Random-Walk Centrality Measures in Multilayer Networks ⋮ Structural classification of continuous time Markov chains with applications ⋮ Robust and consistent estimation of generators in credit risk ⋮ Optimal Control of Continuous-Time Markov Chains with Noise-Free Observation ⋮ Some harmonic functions for killed Markov branching processes with immigration and culling ⋮ Optimal Liquidity-Based Trading Tactics ⋮ Quantifying transient spreading dynamics on networks ⋮ Inference on autoregulation in gene expression with variance-to-mean ratio ⋮ Slowest first passage times, redundancy, and menopause timing ⋮ Lines of descent in a Moran model with frequency-dependent selection and mutation ⋮ Expansion and flooding in dynamic random networks with node churn ⋮ Aggregation Methods for Computing Steady States in Statistical Physics ⋮ Markov chains under nonlinear expectation ⋮ Almost Sure and Moment Exponential Stability of Regime-Switching Jump Diffusions ⋮ Transaction time models in multi-state life insurance ⋮ How well-connected is the surface of the global ocean? ⋮ Fitting feature-dependent Markov chains ⋮ Signed network representation with novel node proximity evaluation ⋮ Queuing models with Mittag-Leffler inter-event times ⋮ A greedy chip‐firing game ⋮ A parallel variable neighborhood search approach for the obnoxious p‐median problem ⋮ Asymptotic decomposition of substochastic semigroups and applications ⋮ Deep learning's shallow gains: a comparative evaluation of algorithms for automatic music generation ⋮ The scaling limit of a critical random directed graph ⋮ Sensitivity of Steady States in Networks with Application to Markov Chains and Chemical Reaction Networks ⋮ Random amenable C^*-algebras ⋮ Delta-Bose gas from the viewpoint of the two-dimensional stochastic heat equation ⋮ Scaling limit of an adaptive contact process ⋮ Unnamed Item ⋮ Stochastic filtering and optimal control of pure jump Markov processes with noise-free partial observation ⋮ Approximately counting and sampling knowledge states ⋮ Quasi-equilibria and click times for a variant of Muller's ratchet ⋮ Almost triangular Markov chains on \(\mathbb{N}\) ⋮ On the estimation of partially observed continuous-time Markov chains ⋮ Harnack inequality and one-endedness of UST on reversible random graphs ⋮ Markovian persuasion with two states ⋮ A combinatorial representation for the invariant measure of diffusion processes on metric graphs ⋮ DIFFUSION LIMITS FOR A MARKOV MODULATED BINOMIAL COUNTING PROCESS ⋮ Full classification of dynamics for one-dimensional continuous-time Markov chains with polynomial transition rates ⋮ Fluctuation bounds for continuous time branching processes and evolution of growing trees with a change point ⋮ On the φ-Selmer groups of the elliptic curvesy²=x³−Dx ⋮ Asymptotic and Numerical Analysis of a Stochastic PDE Model of Volume Transmission ⋮ Unnamed Item ⋮ Opinion Manipulation in Social Networks ⋮ Sequential Noise-Induced Escapes for Oscillatory Network Dynamics ⋮ A Probabilistic Analysis of Volume Transmission in the Brain ⋮ Unnamed Item ⋮ Unnamed Item ⋮ A Transition to Sharp Timing in Stochastic Leaky Integrate-and-Fire Neurons Driven by Frozen Noisy Input ⋮ Concentration of quantum states from quantum functional and transportation cost inequalities ⋮ Usual and stochastic tail orders between hitting times for two Markov chains ⋮ Decay property of stopped Markovian bulk-arriving queues ⋮ Longitudinal data analysis of mean passage time among malnutrition states: an application of Markov chains ⋮ An extended likelihood framework for modelling discretely observed credit rating transitions ⋮ Random walk Green kernels in the neutral Moran model conditioned on survivors at a random time to origin ⋮ Quantum mixing of Markov chains for special distributions ⋮ Fast Non-mean-field Networks: Uniform in Time Averaging ⋮ Learning-Based Mean-Payoff Optimization in an Unknown MDP under Omega-Regular Constraints ⋮ Model Decomposition and Stochastic Fragments ⋮ Continuum Approximation of Invasion Probabilities ⋮ Ideal flow of Markov Chain ⋮ Geometric fluid approximation for general continuous-time Markov chains ⋮ Equilibrium and termination II: the case of Petri nets ⋮ On the exponential stability of switching-diffusion processes with jumps ⋮ Generalized product-form stationary distributions for Markov chains in random environments with queueing applications ⋮ A reversible allelic partition process and Pitman sampling formula ⋮ 𝑊-Markov measures, transfer operators, wavelets and multiresolutions ⋮ Graphically Balanced Equilibria and Stationary Measures of Reaction Networks ⋮ Analysis of Nonprocessive Molecular Motor Transport Using Renewal Reward Theory ⋮ Analytic-geometric methods for finite Markov chains with applications to quasi-stationarity ⋮ Fluctuations in a general preferential attachment model via Stein's method ⋮ Data Uncertainty in Markov Chains: Application to Cost-Effectiveness Analyses of Medical Innovations ⋮ General Contact Process with Rapid Stirring ⋮ Symbolic computation of differential equivalences ⋮ Behaviour of the Gibbs sampler when conditional distributions are potentially incompatible ⋮ M-estimator and its weak consistency for a (2, 1) random walk in a parametric random environment ⋮ Cluster-based feedback control of turbulent post-stall separated flows ⋮ Mapping Return Values of Extreme Wind Speeds ⋮ User-Optimal State-Dependent Routeing in Parallel Tandem Queues with Loss ⋮ Self-Sustaining Iterated Learning ⋮ Bounded-Size Rules: The Barely Subcritical Regime ⋮ Markov loops in discrete spaces ⋮ Coarse-Graining Open Markov Processes ⋮ Synchronisation conditions in the Kuramoto model and their relationship to seminorms ⋮ Tail of a linear diffusion with Markov switching ⋮ Multiscale Modeling of Wear Degradation in Cylinder Liners ⋮ A General Framework for Consistent Estimation of Charge Transport Properties via Random Walks in Random Environments ⋮ Unnamed Item ⋮ A generating function approach to Markov chains undergoing binomial catastrophes ⋮ Probabilistic Foundations of Spatial Mean-Field Models in Ecology and Applications ⋮ Interacting Particle Systems: Hydrodynamic Limit Versus High Density Limit ⋮ Reaction-Subdiffusion Equations with Species-Dependent Movement ⋮ Sharp Entrywise Perturbation Bounds for Markov Chains ⋮ The Buck-Passing Game ⋮ Adversarial Patrolling in a Uniform ⋮ Estimation of steady-state quantities of an HMM with some rarely generated emissions

This page was built for publication: Markov Chains