A Liapounov bound for solutions of the Poisson equation

DOI10.1214/aop/1039639370zbMath0863.60063OpenAlexW2022478817WikidataQ110738371 ScholiaQ110738371MaRDI QIDQ2563941

Publication date: 20 February 1997

Published in: The Annals of Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aop/1039639370

zbMATH Keywords

Lyapunov function functional central limit theorem perturbation theory Markov process Markov chain Poisson equation Foster's criterion

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Performance evaluation, queueing, and scheduling in the context of computer systems (68M20)

Related Items

Polynomial convergence rates of Markov chains ⋮ Technical Note—Approximating Systems Fed by Poisson Processes with Rapidly Changing Arrival Rates ⋮ On Functional Central Limit Theorems for Semi-Markov and Related Processes ⋮ Multiplicative ergodicity and large deviations for an irreducible Markov chain. ⋮ Estimation Methods for Delays in Non-regenerative Discrete-Event Systems ⋮ Long time asymptotics for constrained diffusions in polyhedral domains ⋮ Variance reduction using nonreversible Langevin samplers ⋮ Perturbation analysis for continuous-time Markov chains ⋮ Resource allocation and routing in parallel multi-server queues with abandonments for cloud profit maximization ⋮ Multivariable feedback particle filter ⋮ Long-Time Behavior of a Hawkes Process--Based Limit Order Book ⋮ Averaging of a Stochastic Slow-Fast Model for Population Dynamics: Application to the Development of Ovarian Follicles ⋮ Uniform ergodicity of continuous-time controlled Markov chains: a survey and new results ⋮ Inference for a class of partially observed point process models ⋮ On the ergodicity properties of some adaptive MCMC algorithms ⋮ Stability of Constrained Markov-Modulated Diffusions ⋮ Blackwell Optimality for Controlled Diffusion Processes ⋮ Geometric ergodicity of the bouncy particle sampler ⋮ On the reflected random walk on R₊ ⋮ Geometric ergodicity in a weighted Sobolev space ⋮ Error bounds for augmented truncation approximations of continuous-time Markov chains ⋮ Sequentially interacting Markov chain Monte Carlo methods ⋮ Spectral gaps and error estimates for infinite-dimensional Metropolis-Hastings with non-Gaussian priors ⋮ Hoeffding's inequality for non-irreducible Markov models ⋮ Matrix-Analytic Methods for Solving Poisson’s Equation with Applications to Markov Chains of GI/G/1-Type ⋮ Speed up Zig-Zag ⋮ The ODE method for stability of skip-free Markov chains with applications to MCMC ⋮ Bridging the gap between constant step size stochastic gradient descent and Markov chains ⋮ Explicit bounds for spectral theory of geometrically ergodic Markov kernels and applications ⋮ Likelihood Ratio Gradient Estimation for Steady-State Parameters ⋮ Consistency of the maximum likelihood estimator for general hidden Markov models ⋮ On the dynamics of a finite buffer queue conditioned on the amount of loss ⋮ Stochastic control via direct comparison ⋮ Diffusion Map-based Algorithm for Gain Function Approximation in the Feedback Particle Filter ⋮ On nonlinear Markov chain Monte Carlo ⋮ Bayesian Static Parameter Estimation for Partially Observed Diffusions via Multilevel Monte Carlo ⋮ Constrained stochastic differential games with additive structure: average and discount payoffs ⋮ Steady-State Sensitivity Analysis of Continuous Time Markov Chains ⋮ Poisson's equation for discrete-time single-birth processes ⋮ Penalization of Nonsmooth Dynamical Systems with Noise: Ergodicity and Asymptotic Formulae for Threshold Crossings Probabilities ⋮ Central limit theorems and diffusion approximations for multiscale Markov chain models ⋮ On Poisson equation and diffusion approximation. II. ⋮ Semi-additive functionals of semi-Markov processes and measure-valued Poisson equation ⋮ Scheduling control for Markov-modulated single-server multiclass queueing systems in heavy traffic ⋮ On probabilistic properties of nonlinear \(\text{ARMA}(p,q)\) models ⋮ Almost sure functional central limit theorem for the linear random walk on the torus ⋮ A unified approach to Markov decision problems and performance sensitivity analysis ⋮ Policy iteration algorithms for zero-sum stochastic differential games with long-run average payoff criteria ⋮ Parameter estimation for reflected Ornstein-Uhlenbeck processes with discrete observations ⋮ Hitting times, functional inequalities, Lyapunov conditions and uniform ergodicity ⋮ On the rate of convergence to equilibrium for reflected Brownian motion ⋮ Augmented truncation approximations to the solution of Poisson's equation for Markov chains ⋮ Performance optimization of semi-Markov decision processes with discounted-cost criteria ⋮ Stability and probability. I: Convergence for queueing networks via Lyapunov optimization ⋮ Deviation matrix and asymptotic variance for \(\mathrm{GI}/\mathrm{M}/1\)-type Markov chains ⋮ A regularity condition and a limit theorem for Harris ergodic Markov chains ⋮ \(V\)-uniform ergodicity for state-dependent single class queueing networks ⋮ Multiscale diffusion approximations for stochastic networks in heavy traffic ⋮ On the validity of the batch quantile method for Markov chains ⋮ Large deviation asymptotics and control variates for simulating large functions ⋮ Strict stationarity of ar(p) processes generated by nonlinear random functions with additive perturbations ⋮ Probabilistic Properties of a Nonlinear ARMA Process with Markov Switching ⋮ The tamed unadjusted Langevin algorithm ⋮ Kinetic walks for sampling ⋮ Algorithms for optimization and stabilization of controlled Markov chains. ⋮ Reliability by design in distributed power transmission networks ⋮ Diffusion approximation for fully coupled stochastic differential equations ⋮ A Note on Convergence of the Equi-Energy Sampler ⋮ Lévy Processes with Two-Sided Reflection ⋮ Ergodic Control, Bias, and Sensitive Discount Optimality for Markov Diffusion Processes ⋮ Error bounds for augmented truncation approximations of Markov chains via the perturbation method ⋮ Hoeffding's inequality for Markov processes via solution of Poisson's equation ⋮ Some Remarks on Preconditioning Molecular Dynamics ⋮ Peskun-Tierney ordering for Markovian Monte Carlo: beyond the reversible scenario ⋮ Characterizations of overtaking optimality for controlled diffusion processes ⋮ Laws of Large Numbers and Functional Central Limit Theorems for Generalized Semi-Markov Processes ⋮ Constructing Sampling Schemes via Coupling: Markov Semigroups and Optimal Transport ⋮ The Lagrange approach to ergodic control of diffusions with cost constraints ⋮ Limit theorems for the zig-zag process ⋮ Markov chain simulation for multilevel Monte Carlo ⋮ Dispatching to parallel servers. Solutions of Poisson's equation for first-policy improvement ⋮ A Hoeffding's inequality for uniformly ergodic diffusion process ⋮ Ergodicity of the zigzag process ⋮ Dynamic safety-stocks for asymptotic optimality in stochastic networks ⋮ Poisson's Equation in Nonlinear Filtering ⋮ NonReversible Sampling Schemes on Submanifolds ⋮ On the use of stochastic differential games against nature to ergodic control problems with unknown parameters ⋮ Large Deviations for Additive Functionals of Reflected Jump-Diffusions ⋮ Nonzero-sum stochastic differential games with additive structure and average payoffs

Cites Work