Markov limid processes for representing and solving renewal problems

DOI10.1007/S10479-012-1220-4MaRDI QIDQ475217zbMATH OpenOpenAlexWikidataFDO

Authors Erik Jørgensen, Dennis Nilsson, Anders Ringgaard Kristensen

Publication date 26 November 2014

Published in Annals of Operations Research (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/s10479-012-1220-4

zbMATH Keywords

Markov decision processMDPlimidlimited memory influence diagramMLHMPmultilevel hierarchical Markov processpig production

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Recommendations

• Markov renewal and piecewise deterministic processes
• scientific article; zbMATH DE number 4145083
• Approximate Solution of Markov Renewal Programs with Finite Time Horizon
• A Diffusion Approximation for Markov Renewal Processes
• Upper and lower bounds for the solutions of Markov renewal equations
• scientific article; zbMATH DE number 1487748
• On the Theory of Markov Renewal
• Asymptotic and Structural Theorems for the Markov Renewal Equation

Cites work

• scientific article; zbMATH DE number 700091 (Why is no real title available?)
• A survey of algorithmic methods for partially observed Markov decision processes
• Dynamic programming and influence diagrams
• Embedding a state space model into a Markov decision process
• Hierarchic Markov processes and their applications in replacement models
• Multi-level hierarchic Markov processes as a framework for herd management support
• Planning and acting in partially observable stochastic domains
• Representing and solving decision problems with limited information
• Valuation-Based Systems for Bayesian Decision Analysis

Cited in

(8)

• The minimal solution of a Markov renewal equation
• Upper and lower bounds for the solutions of Markov renewal equations
• A solvable class of renewal processes
• Markov Renewal Methods in Restart Problems in Complex Systems
• Decision programming for mixed-integer multi-stage optimization under uncertainty
• Replacement process decomposition for discounted Markov renewal programming
• Renewal representations for Markov operators
• Some characterizations for Markov processes as mixed renewal processes

This page was built for publication: Markov limid processes for representing and solving renewal problems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q475217)