Markov Chains
From MaRDI portal
Random fields (60G60) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Research exposition (monographs, survey articles) pertaining to probability theory (60-02) Applications of renewal theory (reliability, demand theory, etc.) (60K10) Continuous-time Markov processes on discrete state spaces (60J27)
Recommendations
Cited in
(only showing first 100 items - show all)- Binomial-Poisson entropic inequalities and the M/M/∞queue
- A longitudinal transition imputation model for categorical data applied to a large registry dataset
- First hitting time of a high level by a catalytic branching walk
- Propagation of extrinsic fluctuations in biochemical birth-death processes
- Risk-sensitive stopping problems for continuous-time Markov chains
- W-Markov measures, transfer operators, wavelets and multiresolutions
- On classes of Bitcoin-inspired infinite-server queueing systems
- Approximately counting and sampling knowledge states
- Error bounds for augmented truncations of discrete-time block-monotone Markov chains under subgeometric drift conditions
- A sequential update algorithm for computing the stationary distribution vector in upper block-Hessenberg Markov chains
- Error bounds for augmented truncations of discrete-time block-monotone Markov chains under geometric drift conditions
- Resolving Ambiguities in Reconstructed Grain Maps using Discrete Tomography
- Variational image inpainting
- Stationary Averaging for Multiscale Continuous Time Markov Chains Using Parallel Replica Dynamics
- Analysis of Relaxation Time in Random Walk with Jumps
- Stability of parallel server systems
- Induction: From Kolmogorov and Solomonoff to De Finetti and Back to Kolmogorov
- Zero-automatic networks
- Distributed computation with continual population growth
- Distributed computation with continual population growth
- A direct solution to the stochastic inverse eigenvalue problem for complex-valued eigenspectra
- Collective proposal distributions for nonlinear MCMC samplers: mean-field theory and fast implementation
- Multi-type branching models to describe cell differentiation programs
- Sequential stratified regeneration: \textit{MCMC} for large state spaces with an application to subgraph count estimation
- Bayesian selection probability estimation for probabilistic Boolean networks
- The compound Poisson immigration process subject to binomial catastrophes
- On randomised strategies in the -calculus
- Multiple testing for neuroimaging via hidden Markov random field
- Hypergroups and distance distributions of random walks on graphs
- A constrained hybrid Monte‐Carlo algorithm and the problem of calculating the free energy in several variables
- Turing instability in a model with two interacting Ising lines: non-equilibrium fluctuations
- Generalized Markov chain tree theorem and Kemeny's constant for a class of non-Markovian matrices
- Random walk distances in data clustering and applications
- Statistical estimation with bounded memory
- Markovian models and algorithms
- Generalized gambler's ruin problem: explicit formulas via Siegmund duality
- First crossing times of telegraph processes with jumps
- Random walks systems with finite lifetime on \(\mathbb {Z}\)
- Optimal inventory control with path-dependent cost criteria
- A Bayesian beta Markov random field calibration of the term structure of implied risk neutral densities
- Majority consensus thresholds in competitive Lotka-Volterra populations
- Probability distributions of extinction times, species richness, and immigration and extinction rates in neutral ecological models
- Hopf algebras and Markov chains: two examples and a theory
- The order book as a queueing system: average depth and influence of the size of limit orders
- Sample path optimality for a Markov optimization problem
- Systems of ergodic BSDEs arising in regime switching forward performance processes
- Piecewise linear process with renewal starting points
- Frog models on trees through renewal theory
- Stability of the bipartite matching model
- On balance relations for irreversible chemical reaction networks
- Metastability in Markov processes
- Multiple pattern matching: a Markov chain approach
- Competing first passage percolation on random regular graphs
- The mixture transition distribution model for high-order Markov chains and non-Gaussian time series
- Change point dynamics for financial data: an indexed Markov chain approach
- \(M/M/\infty\) queues in semi-Markovian random environment
- Realizable monotonicity for continuous-time Markov processes
- Markov chains. Analytic and Monte Carlo computations
- Stationary Distributions of Discrete-Time Markov Chains in Random Environment: Exact Computations and Bounds
- Phase transitions in the Ising model on a hierarchical random graph based on the triangle
- Stability in the self-organized evolution of networks
- Entanglement in the quantum Ising model
- Almost-invariant sets and invariant manifolds - connecting probabilistic and geometric descriptions of coherent structures in flows
- Detectability in stochastic discrete event systems
- Join the shortest queue among \(k\) parallel queues: tail asymptotics of its stationary distribution
- Strong Convergence for Split-Step Methods in Stochastic Jump Kinetics
- Spread of (mis)information in social networks
- Networked gain-scheduled fault diagnosis under control input dropouts without data delivery acknowledgment
- Markov chains. Gibbs fields, Monte Carlo simulation and queues
- Randomized and relaxed strategies in continuous-time Markov decision processes
- Ricci curvature of Markov chains on metric spaces
- Spectral and graph-theoretic bounds on steady-state-probability estimation performance for an ergodic Markov chain
- Production-inventory systems with imperfect advance demand information and updating
- Estimation of steady-state quantities of an HMM with some rarely generated emissions
- Convergence of value functions for finite horizon Markov decision processes with constraints
- Safe navigation in adversarial environments
- A multi-cluster time aggregation approach for Markov chains
- Long term behaviour of locally interacting birth-and-death processes
- On-Line Process Control using Attributes with Misclassification Errors: An Economical Design for Short-Run Production
- A Markovian arrival stream approach to stochastic gene expression in cells
- Fcfs infinite bipartite matching of servers and customers
- Learning Markov models via low-rank optimization
- Asymptotic periodicity of recurrent flows in infinite networks
- Probability and random processes.
- The Wright-Fisher site frequency spectrum as a perturbation of the coalescent's
- Random talk: Random walk and synchronizability in a moving neighborhood network
- Hitting times with taboo for a random walk
- Simplicial gauge theory on spacetime
- Cycles and communicating classes in membrane systems and molecular dynamics
- Modeling hybrid network dynamics under random perturbations
- Novel advancements in the Markov chain stock model: analysis and inference
- Rarity and exponentiality: an extension of Keilson's theorem, with applications
- Pattern hit-and-run for sampling efficiently on polytopes
- On the infinitesimal dispersion of multivariate Markov counting systems
- Chaos, spatial extension, transport, and nonequilibrium thermodynamics
- Usual and stochastic tail orders between hitting times for two Markov chains
- Applications of Page Ranking in P Systems
- On the spectral radius and stiffness of Markov jump process rate matrices
- Efficient search and responsiveness trade-offs in a Markov chain model of evolution in dynamic environments
- Equilibrium and non-equilibrium Ising models by means of PCA
This page was built for publication: Markov Chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4256220)
