Constrained discounted stochastic games
From MaRDI portal
Abstract: In this paper, we consider a large class of constrained non-cooperative stochastic Markov games with countable state spaces and discounted cost criteria. In one-player case, i.e., constrained discounted Markov decision models, it is possible to formulate a static optimisation problem whose solution determines a stationary optimal strategy (alias control or policy) in the dynamical infinite horizon model. This solution lies in the compact convex set of all occupation measures induced by strategies, defined on the set of state-action pairs. In case of n-person discounted games the occupation measures are induced by strategies of all players. Therefore, it is difficult to generalise the approach for constrained discounted Markov decision processes directly. It is not clear how to define the domain for the best-response correspondence whose fixed point induces a stationary equilibrium in the Markov game. This domain should be the Cartesian product of compact convex sets in locally convex topological vector spaces. One of our main results shows how to overcome this difficulty and define a constrained non-cooperative static game whose Nash equilibrium induces by a stationary Nash equilibrium in the Markov game. This is done for games with bounded cost functions and positive initial state distribution. An extension to a class of Markov games with unbounded costs and arbitrary initial state distribution relies on approximation of the unbounded game by bounded ones with positive initial state distributions. In the unbounded case, we assume the uniform integrability of the discounted costs with respect to all probability measures induced by strategies of the players, defined on the space of plays (histories) of the game. Our assumptions are weaker than those applied in earlier works on discounted dynamic programming or stochastic games using so-called weighted norm approaches.
Recommendations
- scientific article; zbMATH DE number 1507320
- On approximate and weak correlated equilibria in constrained discounted stochastic games
- Nonzero-sum constrained discrete-time Markov games: the case of unbounded costs
- Existence of Nash equilibria for constrained stochastic games
- Continuous-time constrained stochastic games under the discounted cost criteria
Cites work
- scientific article; zbMATH DE number 1348599 (Why is no real title available?)
- scientific article; zbMATH DE number 1119444 (Why is no real title available?)
- scientific article; zbMATH DE number 1507320 (Why is no real title available?)
- scientific article; zbMATH DE number 3793773 (Why is no real title available?)
- scientific article; zbMATH DE number 3205836 (Why is no real title available?)
- scientific article; zbMATH DE number 3215739 (Why is no real title available?)
- scientific article; zbMATH DE number 3245885 (Why is no real title available?)
- scientific article; zbMATH DE number 3301983 (Why is no real title available?)
- scientific article; zbMATH DE number 3186512 (Why is no real title available?)
- A convex analytic approach to Markov decision processes
- A survey on networking games in telecommunications
- Constrained Discounted Dynamic Programming
- Constrained Discounted Markov Decision Chains
- Constrained Games: The Impact of the Attitude to Adversary's Constraints
- Constrained admission control to a queueing system
- Constrained discounted Markov decision processes with Borel state spaces
- Denumerable Constrained Markov Decision Processes and Finite Approximations
- Discounted Dynamic Programming
- Dynamic Games With Asymmetric Information and Resource Constrained Players With Applications to Security of Cyberphysical Systems
- Existence and Uniqueness of Equilibrium Points for Concave N-Person Games
- Existence of Nash equilibria for constrained stochastic games
- Finite-state approximations for denumerable state discounted Markov decision processes
- Infinite dimensional analysis. A hitchhiker's guide.
- Markov programming by successive approximations with respect to weighted supremum norms
- Noncooperative Stochastic Games
- Nonzero-sum constrained discrete-time Markov games: the case of unbounded costs
- On N-person stochastic games by denumerable state space
- On dynamic programming and statistical decision theory
- On dynamic programming: Compactness of the space of policies
- On the expected total reward with unbounded returns for Markov decision processes
- Optimal flow control of a class of queueing networks in equilibrium
- Optimal scheduling of interactive and noninteractive traffic in telecommunication systems
- Some Remarks on Finite Horizon Markovian Decision Models
- Stochastic games with unbounded payoffs: applications to robust control in economics
- Stochastic optimal control. The discrete time case
Cited in
(9)- Discounted stochastic games with voluntary transfers
- Nonzero-sum constrained discrete-time Markov games: the case of unbounded costs
- Constrained stochastic games with the average payoff criteria
- Constrained Games: The Impact of the Attitude to Adversary's Constraints
- Constrained cost-coupled stochastic games with independent state processes
- Nash equilibria for total expected reward absorbing Markov games: the constrained and unconstrained cases
- Continuous-Time Discounted Mirror Descent Dynamics in Monotone Concave Games
- On approximate and weak correlated equilibria in constrained discounted stochastic games
- scientific article; zbMATH DE number 1080094 (Why is no real title available?)
This page was built for publication: Constrained discounted stochastic games
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2128611)
