scientific article; zbMATH DE number 3543391

A. W. Knapp, John G. Kemeny, J. Laurie Snell

Publication date: 1976

Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.

Discrete-time Markov processes on general state spaces (60J05) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Research exposition (monographs, survey articles) pertaining to probability theory (60-02)

Related Items

The mixture transition distribution model for high-order Markov chains and non-Gaussian time series, Doob-Martin compactification of a Markov chain for growing random words sequentially, Analysis of faults in cyber-physical systems by finite discrete-time Markov chains, A unified perturbation analysis framework for countable Markov chains, Asymptotic periodicity of recurrent flows in infinite networks, On the incipient cluster of the binary tree, Spanning the spectrum from safety to liveness, Symbolic model checking for probabilistic timed automata, Microscopic stationary states for stochastic systems with particle flux, A Semantics for Every GSPN, Automatic verification of concurrent stochastic systems, Performance analysis of probabilistic timed automata using digital clocks, Martin Boundaries of Random Walks: Ends of Trees and Groups, On the Global Asymptotic Behavior of Brownian Local Time on the Circle, FINDING NONSTATIONARY STATE PROBABILITIES OF OPEN MARKOV NETWORKS WITH MULTIPLE CLASSES OF CUSTOMERS AND VARIOUS FEATURES, Random walks on generalized lattices, The Shannon–McMillan theorem for Markov chains in Markovian environments indexed by homogeneous trees, Queueing Network Controls via Deep Reinforcement Learning, A game-based abstraction-refinement framework for Markov decision processes, A discrete Gauss-Green identity for unbounded Laplace operators, and the transience of random walks, Compositional probabilistic verification through multi-objective model checking, Eigentime identity for asymmetric finite Markov chains, A zero-one law for Markov chains, Symbolic Minimum Expected Time Controller Synthesis for Probabilistic Timed Automata, On conditional independence and log-convexity, Difference Equations, Isoperimetric Inequality and Transience of Certain Random Walks, A scaling analysis of a cat and mouse Markov chain, Formally verified animation for RoboChart using interaction trees, Probabilistic verification of Herman's self-stabilisation algorithm, Lumpability abstractions of rule-based systems, Collaborative models for autonomous systems controller synthesis, Multivariate risk processes with interacting intensities, Generalization of a fundamental matrix, Unnamed Item, Some limit properties of the harmonic mean of transition probabilities for Markov chains in Markovian environments indexed by Cayley's trees, Topological groups and recurrence of quasi transitive graphs, Termination Problems in Chemical Kinetics, Harmonic functions on infinite graphs, Modelling the dynamics of stochastic local search on \(k\)-SAT, Local abstraction refinement for probabilistic timed programs, Strong law of large numbers for Markov chains indexed by an infinite tree with uniformly bounded degree, Thermodynamic formalism for transient potential functions, Skip-free Markov chains, Saddle-point approximations and space-time Martin boundary for nearest- neighbor random walk on a homogeneous tree, Decidable and expressive classes of probabilistic automata, Symbolic optimal expected time reachability computation and controller synthesis for probabilistic timed automata, An extension of the inverse method to probabilistic timed automata, Probabilistic guarantees for safe deep reinforcement learning, Explicit criteria for several types of ergodicity of the embedded M/G/1 and GI/M/n queues, Investigation of continuous-time quantum walk by using Krylov subspace-Lanczos algorithm, Ergodic degrees for continuous-time Markov chains, Fusion, propagation, and structuring in belief networks, The Minimal Harmonic Functions of Sojourn Processes of Certain Finite State Markov Chains, Model-Checking ω-Regular Properties of Interval Markov Chains, Probabilistic mobile ambients, Infinite-dimensional diffusions as limits of random walks on partitions, Boundaries of random walks on graphs and groups with infinitely many ends, Ultrametric and tree potential, Recurrence and transience of the edge graph of a tiling of the Euclidean plane, Doob equivalence and non-commutative peaking for Markov chains, Gittins Index for Simple Family of Markov Bandit Processes with Switching Cost and No Discounting, Different clustering regimes in systems of hierarchically interacting diffusions, A Converse to the Mean Value Property on Homogeneous Trees, A Metric on Directed Graphs and Markov Chains Based on Hitting Probabilities, The 4-class ranks of quadratic fields, On the scheme of rare events for a homogeneous Markov chain, Unnamed Item, Convergence of \(\text{U}(1)_ 3\) lattice gauge theory to its continuum limit, The Martin boundary for general isotropic random walks in a tree, Morphisms and currents in infinite nonlinear resistive networks