An Introduction to Markov Processes
DOI10.1007/B138428zbMATH Open1068.60003OpenAlexW1580044631MaRDI QIDQ4831227FDOQ4831227
Authors: Daniel W. Stroock 
Publication date: 22 December 2004
Published in: Graduate Texts in Mathematics (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/b138428
Recommendations
simulated annealingMarkov chainsergodic theoryrandom walksperiodicityrecurrencetransienceGlauber dynamicsreversible Markov processesGibbs statesDoeblin's theory
Discrete-time Markov processes on general state spaces (60J05) Continuous-time Markov processes on general state spaces (60J25) Ergodic theorems, spectral theory, Markov operators (37A30) Introductory exposition (textbooks, tutorial papers, etc.) pertaining to probability theory (60-01)
Cited In (51)
- Symmetry breaking and the emergence of path-dependence
- Explosion, implosion, and moments of passage times for continuous-time Markov chains: a semimartingale approach
- A model for genome size evolution
- Stochastic stability in asymmetric binary choice coordination games
- Title not available (Why is that?)
- Method of Lyapunov functions for analysis of absorption and explosion in Markov chains
- Markov process models of the dynamics of HIV reservoirs
- A two-species hydrodynamic model of particles interacting through self-alignment
- Equivalent description and stability analysis for discrete-time systems with uniformly distributed uncertainty
- Blackwell optimal strategies in priority mean-payoff games
- Denumerable Markov chains. Generating functions, boundary theory, random walks on trees.
- Potential games in volatile environments
- Affinity and fluctuations in a mesoscopic noria
- Markov Processes, Brownian Motion, and Time Symmetry
- A non-homogeneous Markov early epidemic growth dynamics model. Application to the SARS-CoV-2 pandemic
- A Noether theorem for Markov processes
- Escape rate of Markov chains on infinite graphs
- Cash flow techniques for asset liability management
- Asymptotic behaviour of neuron population models structured by elapsed-time
- Continuous Semi‐Markov Processes
- Symmetric Markov processes, time change, and boundary theory
- Market selection of constant proportions investment strategies in continuous time
- Markov chain process. Theory and cases. With forewords by Vladimir N. Uversky and Thomas Buhse
- Adiabatic theorems for generators of contracting evolutions
- Conditional multivariate distributions of phase-type for a finite mixture of Markov jump processes given observations of sample path
- Dynamic sensor transmission power scheduling for remote state estimation
- Structure-preserving model reduction of nonlinear building thermal models
- Ergodic behavior of Markov processes. With applications to limit theorems
- Q-matrices as pseudo-differential operators with negative definite symbols
- Computing the joint distribution of the total tree length across loci in populations with variable size
- Explicit solutions to dynamic diffusion-type equations and their time integrals
- A large deviations analysis of certain qualitative properties of parallel tempering and infinite swapping algorithms
- Quantum Markov chains associated with Open Quantum random walks
- TESTING FOR REVERSIBILITY IN MARKOV CHAIN DATA
- On total progeny of multitype Galton-Watson process and the first passage time of random walk on lattice
- Dynamics and kinetic limit for a system of noiseless \(d\)-dimensional Vicsek-type particles
- Robust adaptive switching control for Markovian jump nonlinear systems via backstepping technique
- Markov chains on metric spaces. A short course
- Robustness of Markov processes on large networks
- Harris-type results on geometric and subgeometric convergence to equilibrium for stochastic semigroups
- An Introduction to Markov Processes
- Percolation Operators and Related Models
- An averaging principle for combined interaction graphs-connectivity and applications to genetic switches
- Stationary processes and discrete parameter Markov processes
- Heavy traffic approximations of a queue with varying service rates and general arrivals
- A monotonicity in reversible Markov chains
- Probabilistic relaxation labelling using the Fokker-Planck equation
- Evolution of social networks
- A thermodynamic formalism for continuous time Markov chains with values on the Bernoulli space: entropy, pressure and large deviations
- Existence of geometric ergodic periodic measures of stochastic differential equations
- Introduction to ergodic rates for Markov chains and processes. With applications to limit theorems
This page was built for publication: An Introduction to Markov Processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4831227)
