Robust Dynamic Programming
From MaRDI portal
Publication:5704221
DOI10.1287/moor.1040.0129zbMath1082.90123OpenAlexW2168565265WikidataQ92161991 ScholiaQ92161991MaRDI QIDQ5704221
Publication date: 11 November 2005
Published in: Mathematics of Operations Research (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1287/moor.1040.0129
Minimax problems in mathematical programming (90C47) Dynamic programming (90C39) Markov and semi-Markov decision processes (90C40)
Related Items
Dynamic Programming Deconstructed: Transformations of the Bellman Equation and Computational Efficiency ⋮ Robust and reliable portfolio optimization formulation of a chance constrained problem ⋮ Robust optimization in countably infinite linear programs ⋮ Ambiguous partially observable Markov decision processes: structural results and applications ⋮ Tight Approximations of Dynamic Risk Measures ⋮ Risk-Sensitive Markov Decision Problems under Model Uncertainty: Finite Time Horizon Case ⋮ Partially observable Markov decision processes incorporating ⋮ GENERATION OF STATIONARY CONTROL POLICIES WITH BEST EXPECTED PERFORMANCE FOR A FAMILY OF MARKOV CHAINS ⋮ Optimal Information Blending with Measurements in the L2 Sphere ⋮ Deterministic policies based on maximum regrets in MDPs with imprecise rewards ⋮ When are static and adjustable robust optimization problems with constraint-wise uncertainty equivalent? ⋮ Robust Markov Decision Processes with Data-Driven, Distance-Based Ambiguity Sets ⋮ A central limit theorem for sets of probability measures ⋮ Bounding fixed points of set-based Bellman operator and Nash equilibria of stochastic games ⋮ Poisoning finite-horizon Markov decision processes at design time ⋮ Minimax and risk averse multistage stochastic programming ⋮ Constrained Markov decision processes with uncertain costs ⋮ Markov control models with unknown random state-action-dependent discount factors ⋮ Robust Markov control processes ⋮ Risk-Sensitive Reinforcement Learning via Policy Gradient Search ⋮ Risk-Averse Stochastic Programming: Time Consistency and Optimal Stopping ⋮ Distributions with maximum spread subject to Wasserstein distance constraints ⋮ ON ROBUST MULTI-PERIOD PRE-COMMITMENT AND TIME-CONSISTENT MEAN-VARIANCE PORTFOLIO OPTIMIZATION ⋮ Explicit explore, exploit, or escape \((E^4)\): near-optimal safety-constrained reinforcement learning in polynomial time ⋮ Data-driven remanufacturing planning with parameter uncertainty ⋮ Unnamed Item ⋮ Weight reduction technology and supply chain network design under carbon emission restriction ⋮ Robustness to Incorrect System Models in Stochastic Control ⋮ Joint chance-constrained Markov decision processes ⋮ Optimization-Based Calibration of Simulation Input Models ⋮ Online First-Order Framework for Robust Convex Optimization ⋮ Learning parametric policies and transition probability models of Markov decision processes from data ⋮ Robust topological policy iteration for infinite horizon bounded Markov decision processes ⋮ Computation of weighted sums of rewards for concurrent MDPs ⋮ Technical Note—Time Inconsistency of Optimal Policies of Distributionally Robust Inventory Models ⋮ Distributionally Robust Partially Observable Markov Decision Process with Moment-Based Ambiguity ⋮ A dynamic inventory rationing problem with uncertain demand and production rates ⋮ Q-Learning for Distributionally Robust Markov Decision Processes ⋮ Robust bounds and optimization at the large deviations scale for queueing models via Rényi divergence ⋮ A survey of decision making and optimization under uncertainty ⋮ Bayesian filtering for multi-period mean-variance portfolio selection ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Robust optimization model for uncertain multiobjective linear programs ⋮ Policy iteration for robust nonstationary Markov decision processes ⋮ Stochastic games with unbounded payoffs: applications to robust control in economics ⋮ Light robustness in the optimization of Markov decision processes with uncertain parameters ⋮ Rectangular Sets of Probability Measures ⋮ Robust Actuarial Risk Analysis ⋮ A dynamic programming approach to adjustable robust optimization ⋮ Policy-based branch-and-bound for infinite-horizon multi-model Markov decision processes ⋮ Tutorial on risk neutral, distributionally robust and risk averse multistage stochastic programming ⋮ Time (in)consistency of multistage distributionally robust inventory models with moment constraints ⋮ Asymptotic optimality of the generalized \(c\mu\) rule under model uncertainty ⋮ Likelihood robust optimization for data-driven problems ⋮ Selected topics in robust convex optimization ⋮ Robust response-guided dosing ⋮ Robust analysis of discounted Markov decision processes with uncertain transition probabilities ⋮ Robust Adversarial Risk Analysis: A Level-k Approach ⋮ Continuous-Time Robust Dynamic Programming ⋮ Robust Adaptive Routing Under Uncertainty ⋮ Wald's mighty maximin: a tutorial ⋮ Discrete Approximation and Quantification in Distributionally Robust Optimization ⋮ Quantifying Distributional Model Risk via Optimal Transport ⋮ Data Uncertainty in Markov Chains: Application to Cost-Effectiveness Analyses of Medical Innovations ⋮ Robust Analysis in Stochastic Simulation: Computation and Performance Guarantees ⋮ Distributionally robust optimal control and MDP modeling ⋮ Robust Control of Partially Observable Failing Systems ⋮ Game-Theoretic Learning and Allocations in Robust Dynamic Coalitional Games ⋮ Testing exchangeability: fork-convexity, supermartingales and e-processes ⋮ Robust Sensitivity Analysis for Stochastic Systems ⋮ Reinforcement Learning in Robust Markov Decision Processes ⋮ Robust MDPs with k-Rectangular Uncertainty ⋮ Challenges of real-world reinforcement learning: definitions, benchmarks and analysis ⋮ Markov decision processes under ambiguity ⋮ Distributionally robust optimization for sequential decision-making ⋮ Sensitivity Analysis in Markov Decision Processes with Uncertain Reward Parameters ⋮ Gittins' theorem under uncertainty ⋮ An active-set strategy to solve Markov decision processes with good-deal risk measure ⋮ Distributionally robust modeling of optimal control ⋮ Adaptive Robust Control under Model Uncertainty ⋮ Robust linear programming with norm uncertainty ⋮ A Sufficient Statistic for Influence in Structured Multiagent Environments ⋮ Robust control of the multi-armed bandit problem ⋮ Concurrent MDPs with Finite Markovian Policies ⋮ Distributionally Robust Markov Decision Processes and Their Connection to Risk Measures ⋮ Distributionally Robust Inventory Control When Demand Is a Martingale ⋮ Toward theoretical understandings of robust Markov decision processes: sample complexity and asymptotics ⋮ Algorithmic aspects of mean-variance optimization in Markov decision processes ⋮ Robust risk measurement and model risk
This page was built for publication: Robust Dynamic Programming