Markov Chains

From MaRDI portal
Publication:4337696


DOI10.1017/CBO9780511810633zbMath0873.60043WikidataQ56769020 ScholiaQ56769020MaRDI QIDQ4337696

James R. Norris

Publication date: 26 May 1997



60-01: Introductory exposition (textbooks, tutorial papers, etc.) pertaining to probability theory

60J10: Markov chains (discrete-time Markov processes on discrete state spaces)


Related Items

Analysis of multivariable controllers using degree of freedom data, Haplotypes: the joint distribution of alleles at linked loci, Similar States in Continuous-Time Markov Chains, Model-based Clustering of Sequential Data with an Application to Contraceptive Use Dynamics, Data-based modeling of the failure rate of repairable equipment, An oscillation criterion for linear difference equations with oscillating coefficients, Chemomechanical coupling of molecular motors: thermodynamics, network representations, and balance conditions, Probabilistic approximations of ODEs based bio-pathway dynamics, A stochastic min-driven coalescence process and its hydrodynamical limit, Gallavotti-Cohen-type symmetry related to cycle decompositions for Markov chains and biochemical applications, Applying Brownian motion to the study of birth-death chains, Metastability of reversible finite state Markov processes, Random walks and the effective resistance sum rules, Runs of Markov chains and streaks in baseball, On parameter estimation in population models. II: Multi-dimensional processes and transient dynamics, Efficient methods for studying stochastic disease and population dynamics, The conditional ancestral selection graph with strong balancing selection, The topological susceptibility from grand canonical simulations in the interacting instanton liquid model: strongly associating fluids and biased Monte Carlo, Stochastic observability in network state estimation and control, A random walk model for infection on graphs: spread of epidemics \& rumours with mobile agents, Markov property of continuous dislocation band propagation, Tunneling and metastability of continuous time Markov chains, The cost of probabilistic agreement in oblivious robot networks, The complexity of relating quantum channels to master equations, Google PageRank as mean playing time for pinball on the reverse web, Universality behaviour for polarity formation in channel-type inclusion compounds, An analysis of the exponential decay principle in probabilistic trust models, Coalescent process with fluctuating population size and its effective size, Shattering and non-uniqueness in fragmentation models -- an analytic approach, The infection time of graphs, Random talk: Random walk and synchronizability in a moving neighborhood network, Translated Poisson approximation for Markov chains, An ergodic theorem for filtering with applications to stability, Controlled risk processes in discrete time: lower and upper approximations to the optimal probability of ruin, On parameter estimation in population models, Single-crossover dynamics: finite versus infinite populations, Memoryless search algorithms in a network with faulty advice, The evolution of bet-hedging adaptations to rare scenarios, Modeling biological systems in stochastic concurrent constraint programming, Cubical token systems, Learning from dependent observations, Random walks on discrete cylinders with large bases and random interlacements, Hybrid dynamics of stochastic programs, Controlling number of particles in fragmentation equations, Maximum likelihood estimation for social network dynamics, Dynamic contracting with persistent shocks, Genetic clustering of social networks using random walks, Polarity formation by a higher order interaction Markov-like chain, An evolutionary approach to learning in a changing environment., Measure and probability for concurrency theorists, Matrix Lie theory and measure chains, Random walks on a finite graph with congestion points, Strictly substochastic semigroups with application to conservative and shattering solutions to fragmentation equations with mass loss, A characterization for mixtures of semi-Markov processes., Integrals for continuous-time Markov chains., An asymptotic study for path reversal., Diagnostic tools for evaluating and updating hidden Markov models, Markov processes on the adeles and representations of Euler products, The survival of the weakest in networks, Stochastic learning-based weak estimation of multinomial random variables and its applications to pattern recognition in non-stationary environments, Commute times for a directed graph using an asymmetric Laplacian, Markov chain approximations for symmetric jump processes, Past states of continuous-time Markov models for ecological communities, Approximating persistence in a general class of population processes, Quantitative analysis of probabilistic lossy channel systems, Greedy pathlengths and small world graphs, Extinction times for a birth--death process with two phases, Stability of the nonlinear filter for slowly switching Markov chains, Fitting timeseries by continuous-time Markov chains: a quadratic programming approach, Hitting probabilities and hitting times for stochastic fluid flows, Long-Time Behaviour in a Model of Microtubule Growth, Stochastic Programs and Hybrid Automata for (Biological) Modeling, Dynamical Systems and Stochastic Programming: To Ordinary Differential Equations and Back