Stability of Markovian processes I: criteria for discrete-time Chains

DOI10.2307/1427479zbMath0757.60061OpenAlexW1974469893MaRDI QIDQ4014076

Richard L. Tweedie, Sean P. Meyn

Publication date: 4 October 1992

Published in: Advances in Applied Probability (Search for Journal in Brave)

Full work available at URL: https://semanticscholar.org/paper/005ce6a8630e94062d2096a09eeddce70db949ba

zbMATH Keywords

law of the iterated logarithmstrong mixingpositive Harris recurrenceHarris recurrenceDynkin's formulastochastic Lyapunov functionsDoeblin decomposition

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Stability theory for ordinary differential equations (34D99)

Related Items

A Model of Seasonal Savanna Dynamics ⋮ MTTF and availability of semi-Markov missions with non-identical generally distributed component lifetimes ⋮ Multivariate self-exciting jump processes with applications to financial data ⋮ Using Stein's method to analyze Euler-Maruyama approximations of regime-switching jump diffusion processes ⋮ Stability of overshoots of Markov additive processes ⋮ Approximation of the invariant measure of stable SDEs by an Euler-Maruyama scheme ⋮ Lévy Langevin Monte Carlo ⋮ Polynomial convergence rates of Markov chains ⋮ A note on a simple Markov bilinear stochastic process ⋮ Stochastic Liénard equations with state-dependent switching ⋮ Design of stabilizing strategies for discrete-time dual switching linear systems ⋮ Third-order asymptotic expansion of \(M\)-estimators for diffusion processes ⋮ Second order multiscale stochastic volatility asymptotics: stochastic terminal layer analysis and calibration ⋮ The stochastic \(\theta\) method for stationary distribution of stochastic differential equations with Markovian switching ⋮ On Foster–Lyapunov criteria for exponential ergodicity of regime-switching jump diffusion processes with countable regimes ⋮ Asymptotic properties of jump-diffusion processes with state-dependent switching ⋮ Polling on a space with general arrival and service time distribution ⋮ Strict Kantorovich contractions for Markov chains and Euler schemes with general noise ⋮ Stationarity and Ergodicity for an Affine Two-Factor Model ⋮ Coexistence and extinction for stochastic Kolmogorov systems ⋮ On the stability of diffusion processes with state-dependent switching ⋮ Nested stochastic simulation algorithms for chemical kinetic systems with multiple time scales ⋮ Wavelet linear density estimator for a discrete-time stochastic process: \(L_ p\)-losses ⋮ Ergodicity and exponential \(\beta\)-mixing bounds for multidimensional diffusions with jumps ⋮ When control and state variations increase uncertainty: modeling and stochastic control in discrete time ⋮ Moments and ergodicity of the jump-diffusion CIR process ⋮ Threshold dynamics and ergodicity of an SIRS epidemic model with Markovian switching ⋮ Reflected Brownian motion in a convex polyhedral cone: tail estimates for the stationary distribution ⋮ Geometric ergodicity of affine processes on cones ⋮ Stability for Hawkes processes with inhibition ⋮ Ergodic properties of generalized Ornstein-Uhlenbeck processes ⋮ Jump-diffusions with state-dependent switching: existence and uniqueness, Feller property, linearization, and uniform ergodicity ⋮ Ergodicity and limit theorems for degenerate diffusions with time periodic drift. Application to a stochastic Hodgkin−Huxley model ⋮ Harris-type results on geometric and subgeometric convergence to equilibrium for stochastic semigroups ⋮ The transition from ergodic to explosive behavior in a family of stochastic differential equations ⋮ NONLINEAR TRANSFORMATIONS OF INTEGRATED TIME SERIES:A RECONSIDERATION ⋮ T. E. Harris's contributions to recurrent Markov processes and stochastic flows ⋮ On geometric and algebraic transience for discrete-time Markov chains ⋮ Existence of geometric ergodic periodic measures of stochastic differential equations ⋮ Feller property and exponential ergodicity of diffusion processes with state-dependent switching ⋮ Positive Harris recurrence for degenerate diffusions with internal variables and randomly perturbed time-periodic input ⋮ Quantitative Harris-type theorems for diffusions and McKean–Vlasov processes ⋮ Ergodicity of one-dimensional regime-switching diffusion processes ⋮ Stationary Distributions of Continuous-Time Markov Chains: A Review of Theory and Truncation-Based Approximations ⋮ Inverse problems for ergodicity of Markov chains ⋮ Cluster based inference for extremes of time series ⋮ Stochastic methods for the neutron transport equation. I: Linear semigroup asymptotics ⋮ Self-exciting jump processes with applications to energy markets ⋮ Stability of token passing rings ⋮ Criteria for ergodicity of Lévy type operators in dimension one ⋮ A LINEAR PROGRAMMING APPROACH TO THE STEADY-STATE ANALYSIS OF REFLECTED BROWNIAN MOTION ⋮ MARKOV CHAINS SATISFYING SIMPLE DRIFT CONDITIONS FOR SUBGEOMETRIC ERGODICITY ⋮ Convergence of contrastive divergence algorithm in exponential family ⋮ Exponential ergodicity for SDEs under the total variation ⋮ Recurrence and ergodicity of switching diffusions with past-dependent switching having a countable state space ⋮ On the stability of jump-diffusions with Markovian switching ⋮ Singular behavior of the leading Lyapunov exponent of a product of random \({2 \times 2}\) matrices ⋮ Strong convergence rate of principle of averaging for jump-diffusion processes ⋮ Markov Systems in a General State Space ⋮ Asymptotic properties of nonlinear autoregressive Markov processes with state-dependent switching ⋮ On the ergodic decomposition for a class of Markov chains ⋮ Edgeworth expansions of suitably normalized sample mean statistics for atomic Markov chains ⋮ The Numerical Invariant Measure of Stochastic Differential Equations With Markovian Switching ⋮ On strong Feller property, exponential ergodicity and large deviations principle for stochastic damping Hamiltonian systems with state-dependent switching ⋮ Ergodic properties and ergodic decompositions of continuous-time Markov processes ⋮ Ergodic BSDE with unbounded and multiplicative underlying diffusion and application to large time behaviour of viscosity solution of HJB equation ⋮ Coexistence, extinction, and optimal harvesting in discrete-time stochastic population models ⋮ Weak law of large numbers for some Markov chains along non homogeneous genealogies ⋮ Necessary and sufficient conditions for non-singular invariant probability measures for Feller Markov chains ⋮ Stationarity and geometric ergodicity of BEKK multivariate GARCH models ⋮ A general theory of coexistence and extinction for stochastic ecological communities ⋮ Local asymptotic normality for shape and periodicity of a signal in the drift of a degenerate diffusion with internal variables ⋮ Simulation studies of some Voronoi point processes ⋮ The role of noise in finite ensembles of nanomagnetic particles ⋮ Positive Harris recurrence and exponential ergodicity of the basic affine jump-diffusion ⋮ Ergodicity for a stochastic Hodgkin-Huxley model driven by Ornstein-Uhlenbeck type input ⋮ Exponential Ergodicity of the Jump-Diffusion CIR Process ⋮ Nonzero-Sum Expected Average Discrete-Time Stochastic Games: The Case of Uncountable Spaces ⋮ A sufficient condition for the existence of an invariant probability measure for Markov processes ⋮ GEOMETRIC ERGODICITY OF A DOUBLY STOCHASTIC TIME SERIES MODEL ⋮ Small time central limit theorems for semimartingales with applications ⋮ Asymptotic Properties of a Mean-Field Model with a Continuous-State-Dependent Switching Process ⋮ Hawkes process and Edgeworth expansion with application to maximum likelihood estimator ⋮ Stability of piecewise deterministic Markovian metapopulation processes on networks ⋮ Epidemic SIS model in air-polluted environment ⋮ Recurrence relations for generalized hitting times for semi-Markov processes ⋮ Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation ⋮ On Feller and strong Feller properties and irreducibility of regime-switching jump diffusion processes with countable regimes ⋮ Exponential ergodicity of an affine two-factor model based on the α-root process ⋮ The Vanishing Discount Approach for the Average Continuous Control of Piecewise Deterministic Markov Processes ⋮ Exponential ergodicity for diffusions with jumps driven by a Hawkes process ⋮ Strong stochastic persistence of some Lévy-driven Lotka-Volterra systems ⋮ Criteria for geometric and algebraic transience for discrete-time Markov chains ⋮ A Liapounov bound for solutions of the Poisson equation ⋮ Stochastic persistence in degenerate stochastic Lotka-Volterra food chains ⋮ Mixtures of Nonlinear Poisson Autoregressions ⋮ Delay asymptotics and bounds for multitask parallel jobs ⋮ Ergodicity of the zigzag process ⋮ A MATHEMATICAL APPROACH TO ORDER BOOK MODELING ⋮ On subexponential convergence to equilibrium of Markov processes ⋮ Ergodicity for SDEs and approximations: locally Lipschitz vector fields and degenerate noise. ⋮ Birth and death processes in interactive random environments ⋮ A Convergent Interacting Particle Method and Computation of KPP Front Speeds in Chaotic Flows ⋮ Structural Laplace Transform and Compound Autoregressive Models ⋮ On the stability of open networks: A unified approach by stochastic dominance ⋮ Topological conditions enabling use of Harris methods in discrete and continuous time ⋮ Polynomial type large deviation inequalities and quasi-likelihood analysis for stochastic differential equations