Stability of Markovian processes I: criteria for discrete-time Chains

DOI10.2307/1427479MaRDI QIDQ4014076zbMATH OpenOpenAlexFDO

Authors R. L. Tweedie, Sean P. Meyn

Publication date 4 October 1992

Published in Advances in Applied Probability (Search for Journal in Brave)

Full work available at URL https://semanticscholar.org/paper/005ce6a8630e94062d2096a09eeddce70db949ba

zbMATH Keywords

strong mixinglaw of the iterated logarithmpositive Harris recurrenceHarris recurrenceDynkin's formulastochastic Lyapunov functionsDoeblin decomposition

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Stability theory for ordinary differential equations (34D99)

Recommendations

• Stability of Markovian processes II: continuous-time processes and sampled chains
• Foster-type criteria for Markov chains on general spaces
• Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
• scientific article; zbMATH DE number 27013
• On some conditions of stability of Markov chains

Cited in

(only showing first 100 items - show all)

• Harris-type results on geometric and subgeometric convergence to equilibrium for stochastic semigroups
• Wavelet linear density estimator for a discrete-time stochastic process: \(L_ p\)-losses
• A subgeometric estimate of the stability for time-homogeneous Markov chains
• scientific article; zbMATH DE number 37797 (Why is no real title available?)
• Epidemic SIS model in air-polluted environment
• Quantitative Harris-type theorems for diffusions and McKean-Vlasov processes
• Ergodicity for SDEs and approximations: locally Lipschitz vector fields and degenerate noise.
• MARKOV CHAINS SATISFYING SIMPLE DRIFT CONDITIONS FOR SUBGEOMETRIC ERGODICITY
• Using Stein's method to analyze Euler-Maruyama approximations of regime-switching jump diffusion processes
• Criteria for geometric and algebraic transience for discrete-time Markov chains
• Ergodic BSDE with unbounded and multiplicative underlying diffusion and application to large time behaviour of viscosity solution of HJB equation
• Edgeworth expansions of suitably normalized sample mean statistics for atomic Markov chains
• Persistence and neutrality in interacting replicator dynamics
• Longtime behavior of impulsive stochastic vegetation ecosystem with jump-diffusion
• Ergodicity of the zigzag process
• Recurrence and ergodicity of switching diffusions with past-dependent switching having a countable state space
• Structural Laplace Transform and Compound Autoregressive Models
• Coexistence and extinction for stochastic Kolmogorov systems
• Strong stability and perturbation bounds for discrete Markov chains
• Exponential ergodicity for diffusions with jumps driven by a Hawkes process
• A Convergent Interacting Particle Method and Computation of KPP Front Speeds in Chaotic Flows
• Stationarity and geometric ergodicity of BEKK multivariate GARCH models
• Cluster based inference for extremes of time series
• Stochastic methods for the neutron transport equation. I: Linear semigroup asymptotics
• Existence of geometric ergodic periodic measures of stochastic differential equations
• State-dependent criteria for convergence of Markov chains
• Singular behavior of the leading Lyapunov exponent of a product of random \({2 \times 2}\) matrices
• Recurrence relations for generalized hitting times for semi-Markov processes
• scientific article; zbMATH DE number 1408895 (Why is no real title available?)
• scientific article; zbMATH DE number 440430 (Why is no real title available?)
• The numerical invariant measure of stochastic differential equations with Markovian switching
• Stability of token passing rings
• Convergence of contrastive divergence algorithm in exponential family
• Nonzero-Sum Expected Average Discrete-Time Stochastic Games: The Case of Uncountable Spaces
• Polling on a space with general arrival and service time distribution
• Polynomial type large deviation inequalities and quasi-likelihood analysis for stochastic differential equations
• On geometric and algebraic transience for discrete-time Markov chains
• T. E. Harris's contributions to recurrent Markov processes and stochastic flows
• scientific article; zbMATH DE number 475324 (Why is no real title available?)
• Markov Systems in a General State Space
• Approximation of the invariant measure of stable SDEs by an Euler-Maruyama scheme
• Stability of overshoots of Markov additive processes
• Asymptotic properties of nonlinear autoregressive Markov processes with state-dependent switching
• Strong convergence rate of principle of averaging for jump-diffusion processes
• Unraveling the forces shaping foraging dynamics in harvester ant colonies: recruitment efficiency and environmental variability
• Third-order asymptotic expansion of \(M\)-estimators for diffusion processes
• Reflected Brownian motion in a convex polyhedral cone: tail estimates for the stationary distribution
• Threshold dynamics and ergodicity of an SIRS epidemic model with Markovian switching
• A sufficient condition for the existence of an invariant probability measure for Markov processes
• SMALL AND PSEUDO-SMALL SETS FOR MARKOV CHAINS
• Birth and death processes in interactive random environments
• Foster-type criteria for Markov chains on general spaces
• On subexponential convergence to equilibrium of Markov processes
• The vanishing discount approach for the average continuous control of piecewise deterministic Markov processes
• Nested stochastic simulation algorithms for chemical kinetic systems with multiple time scales
• Positive Harris recurrence and exponential ergodicity of the basic affine jump-diffusion
• On the stability of open networks: A unified approach by stochastic dominance
• Ergodic properties of generalized Ornstein-Uhlenbeck processes
• On some conditions of stability of Markov chains
• Safe adaptive output-feedback optimal control of a class of linear systems
• On the ergodic decomposition for a class of Markov chains
• Ergodicity for a stochastic Hodgkin-Huxley model driven by Ornstein-Uhlenbeck type input
• Design of stabilizing strategies for discrete-time dual switching linear systems
• Ergodicity and exponential -mixing bounds for multidimensional diffusions with jumps
• Polynomial convergence rates of Markov chains
• Self-exciting jump processes with applications to energy markets
• The transition from ergodic to explosive behavior in a family of stochastic differential equations
• NONLINEAR TRANSFORMATIONS OF INTEGRATED TIME SERIES:A RECONSIDERATION
• Inverse problems for ergodicity of Markov chains
• Drift conditions and invariant measures for Markov chains.
• A Model of Seasonal Savanna Dynamics
• Multivariate self-exciting jump processes with applications to financial data
• Necessary and sufficient conditions for non-singular invariant probability measures for Feller Markov chains
• Weak law of large numbers for some Markov chains along non homogeneous genealogies
• On the stability of diffusion processes with state-dependent switching
• Feller property and exponential ergodicity of diffusion processes with state-dependent switching
• Stochastic persistence in degenerate stochastic Lotka-Volterra food chains
• Simulation studies of some Voronoi point processes
• Stationary distributions of continuous-time Markov chains: a review of theory and truncation-based approximations
• Moments and ergodicity of the jump-diffusion CIR process
• On strong Feller property, exponential ergodicity and large deviations principle for stochastic damping Hamiltonian systems with state-dependent switching
• Coexistence, extinction, and optimal harvesting in discrete-time stochastic population models
• Recurrence and transience criteria for two cases of stable-like Markov chains
• Stability for Hawkes processes with inhibition
• Second order multiscale stochastic volatility asymptotics: stochastic terminal layer analysis and calibration
• Stochastic Liénard equations with state-dependent switching
• Exponential ergodicity for SDEs under the total variation
• The stochastic \(\theta\) method for stationary distribution of stochastic differential equations with Markovian switching
• The role of noise in finite ensembles of nanomagnetic particles
• A LINEAR PROGRAMMING APPROACH TO THE STEADY-STATE ANALYSIS OF REFLECTED BROWNIAN MOTION
• Exponential ergodicity of an affine two-factor model based on the α-root process
• Jump-diffusions with state-dependent switching: existence and uniqueness, Feller property, linearization, and uniform ergodicity
• GEOMETRIC ERGODICITY OF A DOUBLY STOCHASTIC TIME SERIES MODEL
• Asymptotic Properties of a Mean-Field Model with a Continuous-State-Dependent Switching Process
• Lévy Langevin Monte Carlo
• The Euler-Maruyama approximation of state-dependent regime switching diffusions
• Stationarity and ergodicity for an affine two-factor model
• Strict Kantorovich contractions for Markov chains and Euler schemes with general noise
• Criteria for ergodicity of Lévy type operators in dimension one
• When control and state variations increase uncertainty: modeling and stochastic control in discrete time

This page was built for publication: Stability of Markovian processes I: criteria for discrete-time Chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4014076)