On fractional flow models and equivalent finite state processes

DOI10.1016/0022-247X(88)90410-6MaRDI QIDQ1106740zbMATH OpenOpenAlexFDO

Authors James Flynn, Jacob Wijngaard

Publication date 1988

Published in Journal of Mathematical Analysis and Applications (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/0022-247x(88)90410-6

zbMATH Keywords

\((n+1)\)-state semi-Markov decision processequivalencefinite-state processesfractional flowsn-sector systemn-state Markov decision process

Mathematics Subject Classification ID

Dynamic programming (90C39) Markov and semi-Markov decision processes (90C40)

Review text

The relations between a dynamic programming model of fractional flows in an n-sector system and certain finite-state processes are considered. Under certain conditions, the flow model is ``equivalent to an n-state Markov decision process, allowing for simpler computation. Where ``equivalence fails, a partial solution to the flow model follows from the solution to an (n\(+1)\)-state semi-Markov decision process.

Recommendations

• A Dynamic Programming Model of Fractional Flows with Application to Maintenance and Replacement Problems
• An Algorithm for a Dynamic Programming Model of Fractional Flows
• Computing efficient steady state policies for deterministic dynamic programs. II
• Finite state approximation algorithms for average cost denumerable state Markov decision processes
• scientific article; zbMATH DE number 3970555

Cites work

• A Dynamic Programming Model of Fractional Flows with Application to Maintenance and Replacement Problems
• Affine Structure and Invariant Policies for Dynamic Programs
• An Algorithm for a Dynamic Programming Model of Fractional Flows
• Analytical solution of A dynamic transaction flow problem
• Discrete Dynamic Programming with Sensitive Discount Optimality Criteria
• scientific article; zbMATH DE number 3438176 (Why is no real title available?)
• scientific article; zbMATH DE number 3338194 (Why is no real title available?)
• On optimality criteria for dynamic programs with long finite horizons
• Optimal Control of a Graded Manpower System
• Optimization of Multitype Branching Processes

Cited in

(3)

• Computing efficient steady state policies for deterministic dynamic programs. II
• A Dynamic Programming Model of Fractional Flows with Application to Maintenance and Replacement Problems
• An Algorithm for a Dynamic Programming Model of Fractional Flows

This page was built for publication: On fractional flow models and equivalent finite state processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1106740)