Derman's book as inspiration: some results on LP for MDPs

DOI10.1007/S10479-011-1047-4zbMATH Open1306.90167OpenAlexW1978804045MaRDI QIDQ378728FDOQ378728

Authors: Lodewijk Kallenberg 

Publication date: 12 November 2013

Published in: Annals of Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s10479-011-1047-4

Recommendations

• Examples in Markov decision processes
• scientific article; zbMATH DE number 420890
• scientific article
• scientific article; zbMATH DE number 1348599
• scientific article; zbMATH DE number 3906232

zbMATH Keywords

Markov decision processeslinear programming methods

Mathematics Subject Classification ID

Linear programming (90C05) Markov and semi-Markov decision processes (90C40)

Cites Work

• Title not available (Why is that?)
• Programming with linear fractional functionals
• Title not available (Why is that?)
• Extensions of the multiarmed bandit problem: The discounted case
• Linear Programming for Finite State Multi-Armed Bandit Problems
• Title not available (Why is that?)
• Finite state Markovian decision processes
• On sequential decisions and Markov chains
• Constrained Undiscounted Stochastic Dynamic Programming
• The Multi-Armed Bandit Problem: Decomposition and Computation
• Title not available (Why is that?)
• Communicating MDPs: Equivalence and LP properties
• Separable Markovian decision problems. The linear programming method in the multichain case
• NP-hardness of checking the unichain condition in average cost MDPs
• Linear programming and sequential decisions
• An $O(N^3 )$ Algorithm for Optimal Replacement Problems
• Title not available (Why is that?)
• A Note on M. N. Katehakis' and Y.-R. Chen's Computation of the Gittins Index
• Linear Programming and Markov Decision Chains
• Survey of linear programming for standard and nonstandard Markovian control problems. Part II: Applications
• Title not available (Why is that?)
• Title not available (Why is that?)
• Algorithmic Equivalence in Linear Fractional Programming
• Title not available (Why is that?)
• On Linear Programming in a Markov Decision Problem
• Multichain Markov Renewal Programs
• Linear Programming Solutions for Separable Markovian Decision Problems
• Separable Markovian Decision Problems

Cited In (1)

• A model for equilibrium in some service-provider user-set interactions

This page was built for publication: Derman's book as inspiration: some results on LP for MDPs

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q378728)