Fast simulation of Markov chains with small transition probabilities

DOI10.1287/MNSC.47.4.547.9827MaRDI QIDQ3114686zbMATH OpenOpenAlexFDO

Authors S. Juneja, Perwez Shahabuddin

Publication date 19 February 2012

Published in Management Science (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1287/mnsc.47.4.547.9827

zbMATH Keywords

simulationMarkov chainsreliability modelsimportance-samplingsteady-state measures

Mathematics Subject Classification ID

Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Reliability, availability, maintenance, inspection in operations research (90B25)

Recommendations

• Fast simulation of rare events in queueing and reliability models
• Importance sampling simulations of Markovian reliability systems using cross-entropy
• Importance Sampling for the Simulation of Highly Reliable Markovian Systems
• The cross-entropy method with patching for rare-event simulation of large Markov chains
• Dynamic importance sampling for uniformly recurrent Markov chains

Cited in

(11)

• Path-ZVA: general, efficient, and automated importance sampling for highly reliable Markovian systems
• Simulating Markov-reward processes with rare events
• Spare parts allocation by improved genetic algorithm and Monte Carlo simulation
• Command-based importance sampling for statistical model checking
• The cross-entropy method with patching for rare-event simulation of large Markov chains
• Dynamic importance sampling for uniformly recurrent Markov chains
• Simulation of program execution using popular Markov chains
• Approximating zero-variance importance sampling in a reliability setting
• Fast simulation of Markov fluid models
• QUICK SIMULATION METHODS FOR ESTIMATING THE UNRELIABILITY OF REGENERATIVE MODELS OF LARGE, HIGHLY RELIABLE SYSTEMS
• Importance sampling simulations of Markovian reliability systems using cross-entropy

This page was built for publication: Fast simulation of Markov chains with small transition probabilities

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3114686)