scientific article; zbMATH DE number 939782
From MaRDI portal
Publication:4713990
zbMath0858.60060MaRDI QIDQ4713990
Richard L. Tweedie, David John Scott
Publication date: 18 March 1997
Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.
random walksinvariant measuresstate space modelsirreducible Markov chainsgeometric ergodicitysubgeometric ergodicitymultiplicative time series
Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Renewal theory (60K05)
Related Items
Retracted: Fixed point theorems and explicit estimates for convergence rates of continuous time Markov chains, Bias optimality and strong \(n\) \((n= -1,0)\) discount optimality for Markov decision processes, Zero-sum stochastic games with average payoffs: new optimality conditions, Explicit convergence rates of the embedded \(\mathrm{M}/\mathrm{G}/1\) queue, Rates of convergence of the Hastings and Metropolis algorithms, Sample-path optimality and variance-maximization for Markov decision processes, Renewal theory and computable convergence rates for geometrically erdgodic Markov chains, Another set of conditions for Markov decision processes with average sample-path costs, Unnamed Item, Several Types of Ergodicity for M/G/1-Type Markov Chains and Markov Processes, Average optimality for Markov decision processes in borel spaces: a new condition and approach