Adaptive Markov control processes
From MaRDI portal
Publication:1801301
DOI10.1007/978-1-4419-8714-3zbMath0698.90053OpenAlexW4245744559MaRDI QIDQ1801301
Publication date: 5 June 1993
Published in: Applied Mathematical Sciences (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/978-1-4419-8714-3
contrast functionnonstationary value iterationdiscount optimalityasymptotic discount optimalityadaptive controlled Markov processesMinimum contrast estimators
Adaptive control/observation systems (93C40) Research exposition (monographs, survey articles) pertaining to systems and control theory (93-02) Markov and semi-Markov decision processes (90C40) Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming (90-02) Research exposition (monographs, survey articles) pertaining to probability theory (60-02) Markov processes (60Jxx)
Related Items (only showing first 100 items - show all)
Optimal Control of Partially Observable Semi-Markovian Failing Systems: An Analysis Using a Phase Methodology ⋮ Unnamed Item ⋮ Markov Decision Processes with Variance Minimization: A New Condition and Approach ⋮ Adaptive policy-iteration and policy-value-iteration for discounted Markov decision processes ⋮ STOCHASTIC SETUP-COST INVENTORY MODEL WITH BACKORDERS AND QUASICONVEX COST FUNCTIONS ⋮ Minimizing capital injections by investment and reinsurance for a piecewise deterministic reserve process model ⋮ Controlled Markov processes on the infinite planning horizon: Weighted and overtaking cost criteria ⋮ Stochastic control of an epidemic process ⋮ From Infinite to Finite Programs: Explicit Error Bounds with Applications to Approximate Dynamic Programming ⋮ Markov Decision Processes with Incomplete Information and Semiuniform Feller Transition Probabilities ⋮ Contractive approximations in average Markov decision chains driven by a risk-seeking controller ⋮ Formalization of methods for the development of autonomous artificial intelligence systems ⋮ Partially observed discrete-time risk-sensitive mean field games ⋮ Continuity of discounted values and the structure of optimal policies for <scp>periodic‐review</scp> inventory systems with setup costs ⋮ Stochastic Mitra-Wan forestry models analyzed as a mean field optimal control problem ⋮ Unnamed Item ⋮ Distorted probability operator for dynamic portfolio optimization in times of socio-economic crisis ⋮ Semi-uniform Feller stochastic kernels ⋮ Equivalent conditions for weak continuity of nonlinear filters ⋮ A New Condition and Approach for Zero-Sum Stochastic Games with Average Payoffs ⋮ Approximate Nash Equilibria in Partially Observed Stochastic Games with Mean-Field Interactions ⋮ Adaptive discounted control for piecewise deterministic Markov processes ⋮ Long-Run Impulse Control with Generalized Discounting ⋮ Characterization of the optimal average cost in Markov decision chains driven by a risk-seeking controller ⋮ Optimal Control Under Uncertainty and Bayesian Parameters Adjustments ⋮ The Vanishing Discount Approach in a class of Zero-Sum Finite Games with Risk-Sensitive Average Criterion ⋮ Another Set of Conditions for Strongn(n = −1, 0) Discount Optimality in Markov Decision Processes ⋮ Optimal Control of Partially Observable Piecewise Deterministic Markov Processes ⋮ Discounted Continuous-Time Controlled Markov Chains: Convergence of Control Models ⋮ Average Cost Markov Decision Processes with Semi-Uniform Feller Transition Probabilities ⋮ Unnamed Item ⋮ Denumerable continuous-time Markov decision processes with multiconstraints on average costs ⋮ Unnamed Item ⋮ On‐line parameter estimation for a partially observable system subject to random failure ⋮ Unnamed Item ⋮ Occupation measures in average cost Markov decision processes ⋮ Denumerable controlled Markov chains with average reward criterion: Sample path optimality ⋮ Vanishing discount approximations in controlled Markov chains with risk-sensitive average criterion ⋮ Characterization of the Optimal Risk-Sensitive Average Cost in Denumerable Markov Decision Chains ⋮ Nonstationary value iteration in controlled Markov chains with risk-sensitive average criterion ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Robustness to Incorrect Priors in Partially Observed Stochastic Control ⋮ Unnamed Item ⋮ Partially Observable Semi-Markov Games with Discounted Payoff ⋮ Sequential design with applications to the trim-loss problem ⋮ Unnamed Item ⋮ Ergodic risk-sensitive control of Markov processes on countable state space revisited ⋮ Distributionally Robust Markov Decision Processes and Their Connection to Risk Measures ⋮ A Moreau-Yosida regularization for Markov decision processes ⋮ Partially observable Markov decision processes with partially observable random discount factors ⋮ On the optimality equation for average cost Markov control processes with Feller transition probabilities ⋮ On nearly self-optimizing strategies for a discrete-time uniformly ergodic adaptive model ⋮ Long run risk sensitive portfolio with general factors ⋮ A note on the Ross-Taylor theorem ⋮ Bias optimality and strong \(n\) \((n= -1,0)\) discount optimality for Markov decision processes ⋮ Computable approximations for continuous-time Markov decision processes on Borel spaces based on empirical measures ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Discrete-time control for systems of interacting objects with unknown random disturbance distributions: a mean field approach ⋮ Risk sensitive control of Markov processes in countable state space ⋮ A note on risk-sensitive control of invariant models ⋮ Density estimation and adaptive control of Markov processes: Average and discounted criteria ⋮ On ordinal comparison of policies in Markov reward processes ⋮ A perturbation approach to a class of discounted approximate value iteration algorithms with Borel spaces ⋮ Approximation of average cost optimal policies for general Markov decision processes with unbounded costs ⋮ Value iteration in average cost Markov control processes on Borel spaces ⋮ Markovian real-time adaptive control of signal systems ⋮ Approximation of noncooperative semi-Markov games ⋮ A semimartingale characterization of average optimal stationary policies for Markov decision processes ⋮ On confidence intervals from simulation of finite Markov chains ⋮ Discounted approximations to the risk-sensitive average cost in finite Markov chains ⋮ Robustness inequality for Markov control processes with unbounded costs ⋮ A pause control approach to the value iteration scheme in average Markov decision processes ⋮ A note on the convergence rate of the value iteration scheme in controlled Markov chains ⋮ Simulation-based optimal sensor scheduling with application to observer trajectory planning ⋮ Characterization and computation of infinite-horizon specifications over Markov processes ⋮ Partially observed optimal stopping problem for discrete-time Markov processes ⋮ First passage problems for nonstationary discrete-time stochastic control systems ⋮ Markov control models with unknown random state-action-dependent discount factors ⋮ Reduction of total-cost and average-cost MDPs with weakly continuous transition probabilities to discounted mdps ⋮ Sample-Path Optimal Stationary Policies in Stable Markov Decision Chains with the Average Reward Criterion ⋮ Optimality Conditions for Partially Observable Markov Decision Processes ⋮ Stationary Markov perfect equilibria in risk sensitive stochastic overlapping generations models ⋮ Near optimality of quantized policies in stochastic control under weak continuity conditions ⋮ Discounted approximations in risk-sensitive average Markov cost chains with finite state space ⋮ Discrete-time zero-sum games for Markov chains with risk-sensitive average cost criterion ⋮ Value iteration algorithm for mean-field games ⋮ Approximate receding horizon approach for Markov decision processes: average reward case ⋮ Stochastic switching for partially observable dynamics and optimal asset allocation ⋮ Semi-Markov control processes with unknown holding times distribution under an average cost criterion ⋮ STRONG AVERAGE OPTIMALITY FOR CONTROLLED NONHOMOGENEOUS MARKOV CHAINS* ⋮ A bi-level approach for the design of event-triggered control systems over a shared network ⋮ Adaptive control of constrained Markov chains: Criteria and policies ⋮ Partially observed semi-Markov zero-sum games with average payoff ⋮ Average cost Markov decision processes: Optimality conditions ⋮ A counterexample on the optimality equation in Markov decision chains with the average cost criterion ⋮ Approximation of Markov decision processes with general state space ⋮ A policy improvement method for constrained average Markov decision processes
This page was built for publication: Adaptive Markov control processes
