Stability of Markovian processes I: criteria for discrete-time Chains

DOI10.2307/1427479MaRDI QIDQ4014076zbMATH OpenOpenAlexFDO

Authors R. L. Tweedie, Sean P. Meyn

Publication date 4 October 1992

Published in Advances in Applied Probability (Search for Journal in Brave)

Full work available at URL https://semanticscholar.org/paper/005ce6a8630e94062d2096a09eeddce70db949ba

zbMATH Keywords

strong mixinglaw of the iterated logarithmpositive Harris recurrenceHarris recurrenceDynkin's formulastochastic Lyapunov functionsDoeblin decomposition

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Stability theory for ordinary differential equations (34D99)

Recommendations

• Stability of Markovian processes II: continuous-time processes and sampled chains
• Foster-type criteria for Markov chains on general spaces
• Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
• scientific article; zbMATH DE number 27013
• On some conditions of stability of Markov chains

Cited in

(only showing first 100 items - show all)

• Recurrence relations for generalized hitting times for semi-Markov processes
• scientific article; zbMATH DE number 1408895 (Why is no real title available?)
• scientific article; zbMATH DE number 440430 (Why is no real title available?)
• The numerical invariant measure of stochastic differential equations with Markovian switching
• Stability of token passing rings
• Convergence of contrastive divergence algorithm in exponential family
• Nonzero-Sum Expected Average Discrete-Time Stochastic Games: The Case of Uncountable Spaces
• Polling on a space with general arrival and service time distribution
• Polynomial type large deviation inequalities and quasi-likelihood analysis for stochastic differential equations
• On geometric and algebraic transience for discrete-time Markov chains
• T. E. Harris's contributions to recurrent Markov processes and stochastic flows
• scientific article; zbMATH DE number 475324 (Why is no real title available?)
• Markov Systems in a General State Space
• Approximation of the invariant measure of stable SDEs by an Euler-Maruyama scheme
• Stability of overshoots of Markov additive processes
• Asymptotic properties of nonlinear autoregressive Markov processes with state-dependent switching
• Strong convergence rate of principle of averaging for jump-diffusion processes
• Unraveling the forces shaping foraging dynamics in harvester ant colonies: recruitment efficiency and environmental variability
• Third-order asymptotic expansion of \(M\)-estimators for diffusion processes
• Reflected Brownian motion in a convex polyhedral cone: tail estimates for the stationary distribution
• Threshold dynamics and ergodicity of an SIRS epidemic model with Markovian switching
• A sufficient condition for the existence of an invariant probability measure for Markov processes
• SMALL AND PSEUDO-SMALL SETS FOR MARKOV CHAINS
• Birth and death processes in interactive random environments
• Foster-type criteria for Markov chains on general spaces
• On subexponential convergence to equilibrium of Markov processes
• The vanishing discount approach for the average continuous control of piecewise deterministic Markov processes
• Nested stochastic simulation algorithms for chemical kinetic systems with multiple time scales
• Positive Harris recurrence and exponential ergodicity of the basic affine jump-diffusion
• On the stability of open networks: A unified approach by stochastic dominance
• Ergodic properties of generalized Ornstein-Uhlenbeck processes
• On some conditions of stability of Markov chains
• Safe adaptive output-feedback optimal control of a class of linear systems
• On the ergodic decomposition for a class of Markov chains
• Ergodicity for a stochastic Hodgkin-Huxley model driven by Ornstein-Uhlenbeck type input
• Design of stabilizing strategies for discrete-time dual switching linear systems
• Ergodicity and exponential -mixing bounds for multidimensional diffusions with jumps
• Polynomial convergence rates of Markov chains
• Self-exciting jump processes with applications to energy markets
• The transition from ergodic to explosive behavior in a family of stochastic differential equations
• NONLINEAR TRANSFORMATIONS OF INTEGRATED TIME SERIES:A RECONSIDERATION
• Inverse problems for ergodicity of Markov chains
• Drift conditions and invariant measures for Markov chains.
• A Model of Seasonal Savanna Dynamics
• Multivariate self-exciting jump processes with applications to financial data
• Necessary and sufficient conditions for non-singular invariant probability measures for Feller Markov chains
• Weak law of large numbers for some Markov chains along non homogeneous genealogies
• On the stability of diffusion processes with state-dependent switching
• Feller property and exponential ergodicity of diffusion processes with state-dependent switching
• Stochastic persistence in degenerate stochastic Lotka-Volterra food chains
• Simulation studies of some Voronoi point processes
• Stationary distributions of continuous-time Markov chains: a review of theory and truncation-based approximations
• Moments and ergodicity of the jump-diffusion CIR process
• On strong Feller property, exponential ergodicity and large deviations principle for stochastic damping Hamiltonian systems with state-dependent switching
• Coexistence, extinction, and optimal harvesting in discrete-time stochastic population models
• Recurrence and transience criteria for two cases of stable-like Markov chains
• Stability for Hawkes processes with inhibition
• Second order multiscale stochastic volatility asymptotics: stochastic terminal layer analysis and calibration
• Stochastic Liénard equations with state-dependent switching
• Exponential ergodicity for SDEs under the total variation
• The stochastic \(\theta\) method for stationary distribution of stochastic differential equations with Markovian switching
• The role of noise in finite ensembles of nanomagnetic particles
• A LINEAR PROGRAMMING APPROACH TO THE STEADY-STATE ANALYSIS OF REFLECTED BROWNIAN MOTION
• Exponential ergodicity of an affine two-factor model based on the α-root process
• Jump-diffusions with state-dependent switching: existence and uniqueness, Feller property, linearization, and uniform ergodicity
• GEOMETRIC ERGODICITY OF A DOUBLY STOCHASTIC TIME SERIES MODEL
• Asymptotic Properties of a Mean-Field Model with a Continuous-State-Dependent Switching Process
• Lévy Langevin Monte Carlo
• The Euler-Maruyama approximation of state-dependent regime switching diffusions
• Stationarity and ergodicity for an affine two-factor model
• Strict Kantorovich contractions for Markov chains and Euler schemes with general noise
• Criteria for ergodicity of Lévy type operators in dimension one
• When control and state variations increase uncertainty: modeling and stochastic control in discrete time
• Exponential ergodicity of the jump-diffusion CIR process
• Positive Harris recurrence for degenerate diffusions with internal variables and randomly perturbed time-periodic input
• MTTF and availability of semi-Markov missions with non-identical generally distributed component lifetimes
• Hawkes process and Edgeworth expansion with application to maximum likelihood estimator
• Local asymptotic normality for shape and periodicity of a signal in the drift of a degenerate diffusion with internal variables
• A Liapounov bound for solutions of the Poisson equation
• A note on a simple Markov bilinear stochastic process
• Ergodicity and limit theorems for degenerate diffusions with time periodic drift. Application to a stochastic Hodgkin-Huxley model
• Strong stochastic persistence of some Lévy-driven Lotka-Volterra systems
• A mathematical approach to order book modeling
• Small time central limit theorems for semimartingales with applications
• Ergodicity of one-dimensional regime-switching diffusion processes
• The mean-field ensemble Kalman filter: near-Gaussian setting
• On Foster-Lyapunov criteria for exponential ergodicity of regime-switching jump diffusion processes with countable regimes
• Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation
• On Feller and strong Feller properties and irreducibility of regime-switching jump diffusion processes with countable regimes
• Asymptotic properties of jump-diffusion processes with state-dependent switching
• A general theory of coexistence and extinction for stochastic ecological communities
• Stability of Markovian processes II: continuous-time processes and sampled chains
• On the stability of jump-diffusions with Markovian switching
• Geometric ergodicity of affine processes on cones
• Stability of piecewise deterministic Markovian metapopulation processes on networks
• Delay asymptotics and bounds for multitask parallel jobs
• Ergodic properties and ergodic decompositions of continuous-time Markov processes
• The Efficient Covariate-Adaptive Design for high-order balancing of quantitative and qualitative covariates
• Mixtures of nonlinear Poisson autoregressions
• Topological conditions enabling use of Harris methods in discrete and continuous time

This page was built for publication: Stability of Markovian processes I: criteria for discrete-time Chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4014076)