Derman's book as inspiration: some results on LP for MDPs

DOI10.1007/S10479-011-1047-4MaRDI QIDQ378728zbMATH OpenOpenAlexFDO

Authors Lodewijk Kallenberg

Publication date 12 November 2013

Published in Annals of Operations Research (Search for Journal in Brave)

Copyright license Creative Commons Attribution-NonCommercial 4.0 International

Full work available at URL https://doi.org/10.1007/s10479-011-1047-4

zbMATH Keywords

Markov decision processeslinear programming methods

Mathematics Subject Classification ID

Linear programming (90C05) Markov and semi-Markov decision processes (90C40)

Recommendations

• Examples in Markov decision processes
• scientific article; zbMATH DE number 420890
• scientific article; zbMATH DE number 4154239
• scientific article; zbMATH DE number 1348599
• scientific article; zbMATH DE number 3906232

Cites work

• scientific article; zbMATH DE number 4131489 (Why is no real title available?)
• scientific article; zbMATH DE number 3148886 (Why is no real title available?)
• scientific article; zbMATH DE number 3152615 (Why is no real title available?)
• scientific article; zbMATH DE number 3474804 (Why is no real title available?)
• scientific article; zbMATH DE number 3638998 (Why is no real title available?)
• scientific article; zbMATH DE number 3793773 (Why is no real title available?)
• scientific article; zbMATH DE number 2189770 (Why is no real title available?)
• scientific article; zbMATH DE number 3277112 (Why is no real title available?)
• A Note on M. N. Katehakis' and Y.-R. Chen's Computation of the Gittins Index
• Algorithmic Equivalence in Linear Fractional Programming
• An $O(N^3 )$ Algorithm for Optimal Replacement Problems
• Communicating MDPs: Equivalence and LP properties
• Constrained Undiscounted Stochastic Dynamic Programming
• Extensions of the multiarmed bandit problem: The discounted case
• Finite state Markovian decision processes
• Linear Programming Solutions for Separable Markovian Decision Problems
• Linear Programming and Markov Decision Chains
• Linear Programming for Finite State Multi-Armed Bandit Problems
• Linear programming and sequential decisions
• Multichain Markov Renewal Programs
• NP-hardness of checking the unichain condition in average cost MDPs
• On Linear Programming in a Markov Decision Problem
• On sequential decisions and Markov chains
• Programming with linear fractional functionals
• Separable Markovian Decision Problems
• Separable Markovian decision problems. The linear programming method in the multichain case
• Survey of linear programming for standard and nonstandard Markovian control problems. Part II: Applications
• The Multi-Armed Bandit Problem: Decomposition and Computation

Cited in

(1)

• A model for equilibrium in some service-provider user-set interactions

This page was built for publication: Derman's book as inspiration: some results on LP for MDPs

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q378728)