The following pages link to Discrete-Time Markov Chains (Q4831226):
Displaying 40 items.
- Sign-error adaptive filtering algorithms involving Markovian parameters (Q256310) (← links)
- Stochastic competitive Lotka-Volterra ecosystems under partial observation: feedback controls for permanence and extinction (Q402006) (← links)
- System identification: regime switching, unmodeled dynamics, and binary sensors (Q419930) (← links)
- Asymptotic properties of hybrid random processes modulated by Markov chains (Q419985) (← links)
- Pathwise convergence rates for numerical solutions of Markovian switching stochastic differential equations (Q425955) (← links)
- Singular perturbation for the discounted continuous control of piecewise deterministic Markov processes (Q538474) (← links)
- A novel HMM-based learning framework for improving dynamic wireless push system performance (Q651508) (← links)
- Numerical methods for controlled regime-switching diffusions and regime-switching jump diffusions (Q856532) (← links)
- Option pricing in a regime-switching model using the fast Fourier transform (Q937475) (← links)
- Stochastic optimization algorithms for barrier dividend strategies (Q953387) (← links)
- Balanced realizations of regime-switching linear systems (Q998619) (← links)
- How does a stochastic optimization/approximation algorithm adapt to a randomly evolving optimum/root with jump Markov sample paths (Q1016349) (← links)
- Tracking and identification of regime-switching systems using binary sensors (Q1023359) (← links)
- Bounding the lumping error in Markov chain dynamics (Q1033046) (← links)
- Dissipative control of a three-species food chain stochastic system with a hidden Markov chain (Q1628664) (← links)
- Fast computation of stationary joint probability distribution of sparse Markov chains (Q1686210) (← links)
- Stochastic systems arising from Markov modulated empirical measures (Q1697658) (← links)
- Integration by parts and martingale representation for a Markov chain (Q1724128) (← links)
- Ergodic theory for controlled Markov chains with stationary inputs (Q1751963) (← links)
- Analytic approximations of queues with lightly- and heavily-correlated autoregressive service times (Q1945562) (← links)
- Discrete-time hybrid control in Borel spaces (Q1987330) (← links)
- Perturbed Markov chains with damping component (Q2241517) (← links)
- Asymptotic properties of consensus-type algorithms for networked systems with regime-switching topologies (Q2276105) (← links)
- Asymptotic expansions for stationary distributions of nonlinearly perturbed semi-Markov processes. I. (Q2283684) (← links)
- From random Poincaré maps to stochastic mixed-mode-oscillation patterns (Q2340288) (← links)
- Convergence of Markov chain approximation on generalized HJB equation and its applications (Q2440656) (← links)
- Adaptive stepsize selection for tracking in a regime-switching environment (Q2470042) (← links)
- On the notion of weak stability and related issues of hybrid diffusion systems (Q2643426) (← links)
- Persistent tracking and identification of regime-switching systems with structural uncertainties: unmodeled dynamics, observation bias, and nonlinear model mismatch (Q2857514) (← links)
- Optimal stopping of Markov switching Lévy processes (Q2875272) (← links)
- Discrete-Time Semi-Markov Random Evolutions – Average and Diffusion Approximation of Difference Equations and Additive Functionals (Q2890075) (← links)
- A stochastic approximation algorithm for option pricing model calibration with a switchable market (Q3066992) (← links)
- Asymptotic properties of Markov-modulated random sequences with fast and slow timescales (Q3080996) (← links)
- Weak convergence of Markov-modulated random sequences (Q3080998) (← links)
- Asymptotic expansions for power-exponential moments of hitting times for nonlinearly perturbed semi-Markov processes (Q3120628) (← links)
- Coupling and ergodic theorems for Markov chains with damping component (Q3387884) (← links)
- Discrete-Time Semi-Markov Random Evolutions and their Applications (Q4915656) (← links)
- A Fluid-Diffusion-Hybrid Limiting Approximation for Priority Systems with Fast and Slow Customers (Q5106384) (← links)
- Asymptotic optimality for consensus-type stochastic approximation algorithms using iterate averaging (Q5399296) (← links)
- Safety verification for regime-switching jump diffusions via barrier certificates (Q6052173) (← links)
