Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach (Q457293): Difference between revisions

Latest revision as of 18:06, 9 December 2024

scientific article

Language	Label	Description	Also known as
English	Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach	scientific article

Statements

instance of

scholarly article

0 references

title

Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach (English)

0 references

author

Yi Zhang

0 references

Aleksey B. Piunovskiy

0 references

published in

4OR

0 references

publication date

26 September 2014

0 references

full work available at URL

https://arxiv.org/abs/1103.0134

0 references

zbMATH Keywords

Bellman equation

0 references

continuous-time Markov decision process

0 references

dynamic programming

0 references

dynkin's formula

0 references

MaRDI profile type

MaRDI publication profile

0 references

cites work

Stochastic optimal control. The discrete time case

0 references

Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach

0 references

Reduction of Discounted Continuous-Time MDPs with Unbounded Jump and Reward Rates to Discrete-Time Total-Reward MDPs

0 references

Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces

0 references

Continuous-time Markov decision processes. Theory and applications

0 references

Discounted Continuous-Time Markov Decision Processes with Constraints: Unbounded Transition and Loss Rates

0 references

Discounted continuous-time constrained Markov decision processes in Polish spaces

0 references

Denumerable-state continuous-time Markov decision processes with unbounded transition and reward rates under the discounted criterion

0 references

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)

0 references

Linear Programming and Constrained Average Optimality for General Continuous-Time Markov Decision Processes in History-Dependent Policies

0 references

Absorbing Continuous-Time Markov Decision Processes with Total Cost Criteria

0 references

Q4255598

0 references

Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales

0 references

Continuously Discounted Markov Decision Model with Countable State and Action Space

0 references

Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion

0 references

Q4331806

0 references

Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case

0 references

Discounted Continuous-Time Markov Decision Processes with Unbounded Rates: The Convex Analytic Approach

0 references

Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach

0 references

The transformation method for continuous-time Markov decision processes

0 references

Selected Topics on Continuous-Time Controlled Markov Chains and Markov Games

0 references

Q4315289

0 references

Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates

0 references

Identifiers

zbMATH Open document ID

1297.90174

0 references

Mathematics Subject Classification ID

0 references

0 references

0 references

0 references

0 references

10.1007/S10288-013-0236-1

0 references

Sitelinks

Mathematics(1 entry)

mardi Publication:457293

@@ Property / DOI @@
-.1007/s10288-013-0236-1
@@ Property / DOI: 10.1007/s10288-013-0236-1 / rank @@
-Normal rank
@@ Property / author @@
-Aleksey B. Piunovskiy
@@ Property / author: Aleksey B. Piunovskiy / rank @@
-Normal rank
@@ Property / author @@
-Yi Zhang
@@ Property / author: Yi Zhang / rank @@
-Normal rank
@@ Property / author @@
+Yi Zhang
@@ Property / author: Yi Zhang / rank @@
+Normal rank
@@ Property / author @@
+Aleksey B. Piunovskiy
@@ Property / author: Aleksey B. Piunovskiy / rank @@
+Normal rank
@@ Property / Mathematics Subject Classification ID @@
+C40
@@ Property / Mathematics Subject Classification ID: 90C40 / rank @@
+Normal rank
@@ Property / Mathematics Subject Classification ID @@
+J25
@@ Property / Mathematics Subject Classification ID: 60J25 / rank @@
+Normal rank
@@ Property / zbMATH DE Number @@
+6348523
@@ Property / zbMATH DE Number: 6348523 / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+Bellman equation
@@ Property / zbMATH Keywords: Bellman equation / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+continuous-time Markov decision process
@@ Property / zbMATH Keywords: continuous-time Markov decision process / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+dynamic programming
@@ Property / zbMATH Keywords: dynamic programming / rank @@
+Normal rank
@@ Property / zbMATH Keywords @@
+dynkin's formula
@@ Property / zbMATH Keywords: dynkin's formula / rank @@
+Normal rank
@@ Property / MaRDI profile type @@
+MaRDI publication profile
@@ Property / MaRDI profile type: MaRDI publication profile / rank @@
+Normal rank
@@ Property / OpenAlex ID @@
+W2016588739
@@ Property / OpenAlex ID: W2016588739 / rank @@
+Normal rank
@@ Property / arXiv ID @@
+.0134
@@ Property / arXiv ID: 1103.0134 / rank @@
+Normal rank
@@ Property / cites work @@
+Stochastic optimal control. The discrete time case
+Normal rank
@@ Property / cites work @@
+Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach
+Normal rank
@@ Property / cites work @@
+Reduction of Discounted Continuous-Time MDPs with Unbounded Jump and Reward Rates to Discrete-Time Total-Reward MDPs
+Normal rank
@@ Property / cites work @@
+Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
+Normal rank
@@ Property / cites work @@
+Continuous-time Markov decision processes. Theory and applications
+Normal rank
@@ Property / cites work @@
+Discounted Continuous-Time Markov Decision Processes with Constraints: Unbounded Transition and Loss Rates
+Normal rank
@@ Property / cites work @@
+Discounted continuous-time constrained Markov decision processes in Polish spaces
+Normal rank
@@ Property / cites work @@
+Denumerable-state continuous-time Markov decision processes with unbounded transition and reward rates under the discounted criterion
+Normal rank
@@ Property / cites work @@
+A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
+Normal rank
@@ Property / cites work @@
+Linear Programming and Constrained Average Optimality for General Continuous-Time Markov Decision Processes in History-Dependent Policies
+Normal rank
@@ Property / cites work @@
+Absorbing Continuous-Time Markov Decision Processes with Total Cost Criteria
+Normal rank
@@ Property / cites work @@
+Q4255598
@@ Property / cites work: Q4255598 / rank @@
+Normal rank
@@ Property / cites work @@
+Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
+Normal rank
@@ Property / cites work @@
+Continuously Discounted Markov Decision Model with Countable State and Action Space
+Normal rank
@@ Property / cites work @@
+Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
+Normal rank
@@ Property / cites work @@
+Q4331806
@@ Property / cites work: Q4331806 / rank @@
+Normal rank
@@ Property / cites work @@
+Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case
+Normal rank
@@ Property / cites work @@
+Discounted Continuous-Time Markov Decision Processes with Unbounded Rates: The Convex Analytic Approach
+Normal rank
@@ Property / cites work @@
+Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach
+Normal rank
@@ Property / cites work @@
+The transformation method for continuous-time Markov decision processes
+Normal rank
@@ Property / cites work @@
+Selected Topics on Continuous-Time Controlled Markov Chains and Markov Games
+Normal rank
@@ Property / cites work @@
+Q4315289
@@ Property / cites work: Q4315289 / rank @@
+Normal rank
@@ Property / cites work @@
+Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates
+Normal rank
@@ Property / DOI @@
+.1007/S10288-013-0236-1
@@ Property / DOI: 10.1007/S10288-013-0236-1 / rank @@
+Normal rank
@@ links / mardi / name / links / mardi / name @@
+Publication:457293