Continuous-time Markov chains and applications. A two-time-scale approach
From MaRDI portal
Publication:424648
zbMath1277.60127MaRDI QIDQ424648
Publication date: 4 June 2012
Published in: Stochastic Modelling and Applied Probability (Search for Journal in Brave)
time-scale separationasymptotic expansionsMarkovian switchingsingularly perturbed continuous time Markov chains
Continuous-time Markov processes on general state spaces (60J25) Continuous-time Markov processes on discrete state spaces (60J27) Transition functions, generators and resolvents (60J35) Research exposition (monographs, survey articles) pertaining to probability theory (60-02) Applications of continuous-time Markov processes on discrete state spaces (60J28)
Related Items (61)
Moderate deviations for the Langevin equations: Strong damping and fast Markovian switching ⋮ Large deviations for Markov-modulated diffusion processes with rapid switching ⋮ Near-optimal controls of differential systems with switching and random jumps subject to fast switching and wideband noise perturbation ⋮ Fast-slow-coupled stochastic functional differential equations ⋮ Hybrid optimal impulse control ⋮ Near Optimality of Stochastic Control for Singularly Perturbed McKean--Vlasov Systems ⋮ On stochastic multi-group Lotka-Volterra ecosystems with regime switching ⋮ An optimal pricing policy under a Markov chain model ⋮ Proximal constrained optimization approach with time penalization ⋮ A class of generalized Ginzburg-Landau equations with random switching ⋮ An optimal mean-reversion trading rule under a Markov chain model ⋮ The Dynkin game with regime switching and applications to pricing game options ⋮ Backward stochastic differential equations with Markov chains and related asymptotic properties ⋮ Stochastic Kolmogorov systems driven by wideband noises ⋮ Non-Archimedean reaction-ultradiffusion equations and complex hierarchic systems ⋮ Asymptotic expansions for solutions of parabolic systems associated with multi-scale switching diffusions ⋮ Certain properties related to well posedness of switching diffusions ⋮ Wiener-Hopf factorization for time-inhomogeneous Markov chains and its application ⋮ Two-player zero-sum stochastic differential games with regime switching ⋮ Optimal stopping of two-time scale Markovian systems: analysis, numerical methods, and applications ⋮ Averaging principles for SPDEs driven by fractional Brownian motions with random delays modulated by two-time-scale Markov switching processes ⋮ A survey of numerical solutions for stochastic control problems: some recent progress ⋮ Perturbation Analysis for Investment Portfolios Under Partial Information with Expert Opinions ⋮ Milstein-Type Procedures for Numerical Solutions of Stochastic Differential Equations with Markovian Switching ⋮ Convergence of nonlinear filtering for multiscale systems with correlated Lévy noises ⋮ Explicit solutions for an optimal stock selling problem under a Markov chain model ⋮ An averaging principle for fast-slow-coupled neutral stochastic differential equations with time-varying delay ⋮ Almost Sure and Moment Exponential Stability of Regime-Switching Jump Diffusions ⋮ Stochastic maximum principle for hybrid optimal control problems under partial observation ⋮ Sequences of random matrices modulated by a discrete-time Markov chain* ⋮ Singular perturbation for a two-class processor-sharing queue with impatience ⋮ Unnamed Item ⋮ Time-discretization approximation enriches continuous-time discrete-space models for animal movement ⋮ Flows of rare events for regularly perturbed semi-Markov processes ⋮ Stochastic systems arising from Markov modulated empirical measures ⋮ Strong convergence of the tamed Euler method for nonlinear hybrid stochastic differential equations with piecewise continuous arguments ⋮ Dynamics of a stochastic phytoplankton–toxic phytoplankton–zooplankton system under regime switching ⋮ Limit theorems of additive functionals for regime-switching diffusions with infinite delay ⋮ Markovian-switching systems: backward and forward-backward stochastic differential equations, mean-field interactions, and nonzero-sum differential games ⋮ Ginzburg-Landau equations with random switching and impulsive perturbations ⋮ Ergodicity for functional stochastic differential equations and applications ⋮ Mobility can drastically improve the heavy traffic performance from \(\frac{1}{1-\varrho}\) to \(\log(1/(1-\varrho))\) ⋮ Integration by parts and martingale representation for a Markov chain ⋮ Tamed-Euler method for hybrid stochastic differential equations with Markovian switching ⋮ Numerical Methods for Controlled Switching Diffusions ⋮ A general stochastic maximum principle for mean-field controls with regime switching ⋮ An averaging principle for two-time-scale stochastic functional differential equations ⋮ Perturbed Markov chains with damping component ⋮ Hybrid competitive Lotka–Volterra ecosystems: countable switching states and two-time-scale models ⋮ Asymptotic expansions for stationary distributions of nonlinearly perturbed semi-Markov processes. I. ⋮ Optimal switching under a hybrid diffusion model and applications to stock trading ⋮ On laws of large numbers for systems with mean-field interactions and Markovian switching ⋮ Fractional differential equation approach for convex optimization with convergence rate analysis ⋮ Coupling and ergodic theorems for Markov chains with damping component ⋮ Switching diffusions with mean-field interactions: limit results, maximum principle, and non-Markov systems ⋮ Controllable Markov jump processes. I: Optimum filtering based on complex observations ⋮ Moment bounds and ergodicity of switching diffusion systems involving two-time-scale Markov chains ⋮ Nonzero-sum impulse games with regime switching ⋮ Open-loop solvability for mean-field stochastic linear quadratic optimal control problems of Markov regime-switching system ⋮ Asymptotic expansions for power-exponential moments of hitting times for nonlinearly perturbed semi-Markov processes ⋮ Constrained stochastic LQ control on infinite time horizon with regime switching
This page was built for publication: Continuous-time Markov chains and applications. A two-time-scale approach
