General Irreducible Markov Chains and Non-Negative Operators
From MaRDI portal
Publication:3344930
DOI10.1017/CBO9780511526237zbMath0551.60066MaRDI QIDQ3344930
Publication date: 1984
Discrete-time Markov processes on general state spaces (60J05) Research exposition (monographs, survey articles) pertaining to probability theory (60-02)
Related Items (only showing first 100 items - show all)
Approximating a diffusion by a finite-state hidden Markov model ⋮ Tail Asymptotics of the Occupation Measure for a Markov Additive Process with anM/G/1-Type Background Process ⋮ Bayesian economists \dots Bayesian agents. An alternative approach to optimal learning ⋮ Symmetric Measures, Continuous Networks, and Dynamics ⋮ On Block Skip Free Transition Matrices and First Passage Times ⋮ Local composite quantile regression smoothing for Harris recurrent Markov processes ⋮ UNIFORM CONSISTENCY FOR NONPARAMETRIC ESTIMATORS IN NULL RECURRENT TIME SERIES ⋮ NONSTANDARD CENTRAL LIMIT THEOREMS FOR MARKOV CHAINS ⋮ Harmonic analysis on graphs via Bratteli diagrams and path-space measures ⋮ Recurrence conditions for Markov decision processes with Borel state space: A survey ⋮ Regenerative queueing processes and their qualitative and quantitative analysis ⋮ NONPARAMETRIC STOCHASTIC VOLATILITY ⋮ On improved bounds and conditions for the convergence of Markov chains ⋮ Transition functions for evolutionary algorithms on continuous state-space ⋮ The law of iterated logarithm for additive functionals and martingale additive functionals of Harris recurrent Markov processes ⋮ The Impact of Stress Factors on the Price of Widow’s Pensions ⋮ Maximal coupling procedure and stability of discrete Markov chains. I ⋮ Maximal coupling procedure and stability of discrete Markov chains. II ⋮ An estimate of the stability for nonhomogeneous Markov chains under classical minorization condition ⋮ Second-order discretization schemes of stochastic differential systems for the computation of the invariant law ⋮ General linear-fractional branching processes with discrete time ⋮ Weak Convergence Rates of Population Versus Single-Chain Stochastic Approximation MCMC Algorithms ⋮ Controllability implies mixing. I. Convergence in the total variation metric ⋮ Estimating normal means with a conjugate style dirichlet process prior ⋮ An inequality for the coupling moment in the case of two inhomogeneous Markov chains ⋮ Stochastic Operators and Semigroups and Their Applications in Physics and Biology ⋮ NULL RECURRENT UNIT ROOT PROCESSES ⋮ Orlicz Integrability of Additive Functionals of Harris Ergodic Markov Chains ⋮ Ergodicity and limit theorems for degenerate diffusions with time periodic drift. Application to a stochastic Hodgkin−Huxley model ⋮ Asymptotic decomposition of substochastic semigroups and applications ⋮ A New Condition and Approach for Zero-Sum Stochastic Games with Average Payoffs ⋮ Large and moderate deviations for bounded functions of slowly mixing Markov chains ⋮ Maximal coupling and $V$-stability of discrete nonhomogeneous Markov chains ⋮ Ordinary Differential Equation Methods for Markov Decision Processes and Application to Kullback--Leibler Control Cost ⋮ T. E. Harris's contributions to recurrent Markov processes and stochastic flows ⋮ Hopf type lemmas for subsolutions of integro-differential equations ⋮ Renewal type bootstrap for increasing degree \(U\)-process of a Markov chain ⋮ Local consistency of Markov chain Monte Carlo methods ⋮ Approximating Markov chains and \(V\)-geometric ergodicity via weak perturbation theory ⋮ Moment based regression algorithms for drift and volatility estimation in continuous-time Markov switching models ⋮ Further criteria for positive Harris recurrence of Markov chains ⋮ Identification of an additive nonlinear system and its applications in generalized Hammerstein models ⋮ Uniform convergence rates for a class of martingales with application in non-linear cointegrating regression ⋮ Average Cost Optimality Inequality for Markov Decision Processes with Borel Spaces and Universally Measurable Policies ⋮ Tail estimates for stochastic fixed point equations via nonlinear renewal theory ⋮ On asymptotics for Vaserstein coupling of Markov chains ⋮ Perron–Frobenius theory for kernels and Crump–Mode–Jagers processes with macro-individuals ⋮ One-dimensional linear recursions with Markov-dependent coefficients ⋮ Fuzzy optimality relation for perceptive MDPs-the average case ⋮ Irreducibility and continuity assumptions for positive operators with application to threshold GARCH time series models ⋮ Pathwise accuracy and ergodicity of metropolized integrators for SDEs ⋮ Rates in almost sure invariance principle for slowly mixing dynamical systems ⋮ On Generalized Bellman Equations and Temporal-Difference Learning ⋮ Nonparametric estimation of the stationary density and the transition density of a Markov chain ⋮ SMALL AND PSEUDO-SMALL SETS FOR MARKOV CHAINS ⋮ An Alternative Method of the Proof of the Ergodic Theorem for General Markov Chains ⋮ Discrete-Time Semi-Markov Random Evolutions and their Applications ⋮ Tail Asymptotics of the Stationary Distribution of a Two-Dimensional Reflecting Random Walk with Unbounded Upward Jumps ⋮ Markov Chain Monte Carlo for Computing Rare-Event Probabilities for a Heavy-Tailed Random Walk ⋮ Evolutionary algorithms for continuous-space optimisation ⋮ A regularity condition and a limit theorem for Harris ergodic Markov chains ⋮ Markov-chain monte carlo: Some practical implications of theoretical results ⋮ Spectral gap of positive operators and applications ⋮ Unnamed Item ⋮ Large deviation asymptotics and control variates for simulating large functions ⋮ Strict stationarity of ar(p) processes generated by nonlinear random functions with additive perturbations ⋮ Exponential concentration inequalities for additive functionals of Markov chains ⋮ Maximal coupling and stability of discrete non-homogeneous Markov chains ⋮ Occupation measures in average cost Markov decision processes ⋮ Ergodicity of Markov chain Monte Carlo with reversible proposal ⋮ Large deviations for empirical measures of not necessarily irreducible countable Markov chains with arbitrary initial measures ⋮ Stationary distributions in the atom-on-demand problem ⋮ Adaptive control for time-varying systems: A combination of Martingale and Markov chain techniques ⋮ Unnamed Item ⋮ GEOMETRIC ERGODICITY OF A DOUBLY STOCHASTIC TIME SERIES MODEL ⋮ The rate of convergence to stationarity forM/G/1 models with admission controls via coupling ⋮ Positive Eigenfunctions of Markovian Pricing Operators: Hansen-Scheinkman Factorization, Ross Recovery, and Long-Term Pricing ⋮ Pinning and wetting transition for (1\(+\)1)-dimensional fields with Laplacian interaction ⋮ Postmodel selection estimators of variance function for nonlinear autoregression ⋮ Optimal scaling of Metropolis algorithms: Heading toward general target distributions ⋮ Integral estimation based on Markovian design ⋮ Asymptotic behaviors of randomly perturbed dynamical systems ⋮ Classification of Asymptotic Behavior in a Stochastic SIR Model ⋮ A unified stability theory for classical and monotone Markov chains ⋮ ASYMPTOTIC PROPERTIES FOR MAXIMUM LIKELIHOOD ESTIMATORS FOR RELIABILITY AND FAILURE RATES OF MARKOV CHAINS ⋮ Coupling and ergodic theorems for Markov chains with damping component ⋮ Simulated Stochastic Approximation Annealing for Global Optimization With a Square-Root Cooling Schedule ⋮ Unnamed Item ⋮ Using a Markov Chain to Construct a Tractable Approximation of an Intractable Probability Distribution ⋮ A Liapounov bound for solutions of the Poisson equation ⋮ Regeneration-based statistics for Harris recurrent Markov chains ⋮ Structural characterization of taboo-stationarity for general processes in two-sided time. ⋮ SPECTRAL CONDITIONS FOR UNIFORM P-ERGODICITIES OF MARKOV OPERATORS ON ABSTRACT STATES SPACES ⋮ The extraction of information from multiple point estimates ⋮ Nonlinear regressions with nonstationary time series ⋮ On mixing and convergence rates for a family of Markov processes approximating SDEs ⋮ Unnamed Item ⋮ Slow convergence of the Gibbs sampler ⋮ Generalization of discrete-time geometric bounds to convergence rate of Markov processes on Rn ⋮ Langevin dynamics with space-time periodic nonequilibrium forcing
This page was built for publication: General Irreducible Markov Chains and Non-Negative Operators
