Boltzmann distributed replicator dynamics: population games in a microgrid context

DOI10.3390/G12010008MaRDI QIDQ2052487zbMATH OpenOpenAlexFDO

Authors Gustavo Chica-Pedraza, Eduardo Mojica-Nava, Ernesto Cadena-Muñoz

Publication date 26 November 2021

Published in Games (Search for Journal in Brave)

Full work available at URL https://doi.org/10.3390/g12010008

zbMATH Keywords

Boltzmann distributioneconomic dispatch problemmulti-agent systemspopulation dynamicsrevision protocol

Mathematics Subject Classification ID

Evolutionary games (91A22) Population dynamics (general) (92D25) Multi-agent systems (93A16)

Review text

Summary: Multi-agent systems (MAS) have been used to solve several optimization problems in control systems. MAS allow understanding the interactions between agents and the complexity of the system, thus generating functional models that are closer to reality. However, these approaches assume that information between agents is always available, which means the employment of a full-information model. Some tendencies have been growing in importance to tackle scenarios where information constraints are relevant issues. In this sense, game theory approaches appear as a useful technique that use a strategy concept to analyze the interactions of the agents and achieve the maximization of agent outcomes. In this paper, we propose a distributed control method of learning that allows analyzing the effect of the exploration concept in MAS. The dynamics obtained use Q-learning from reinforcement learning as a way to include the concept of exploration into the classic exploration-less replicator dynamics equation. Then, the Boltzmann distribution is used to introduce the Boltzmann-based distributed replicator dynamics as a tool for controlling agents behaviors. This distributed approach can be used in several engineering applications, where communications constraints between agents are considered. The behavior of the proposed method is analyzed using a smart grid application for validation purposes. Results show that despite the lack of full information of the system, by controlling some parameters of the method, it has similar behavior to the traditional centralized approaches.

Recommendations

• Distributed optimization with information-constrained population dynamics
• scientific article; zbMATH DE number 2088149
• Distributed constraint optimization on networked multi-agent systems
• Game-Theoretic Learning and Distributed Optimization in Memoryless Multi-Agent Systems
• Extended replicator dynamics as a key to reinforcement learning in multi-agent systems.

Cites work

• A survey on transfer learning for multiagent reinforcement learning systems
• Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism
• Distributed robust adaptive equilibrium computation for generalized convex games
• Evolutionary dynamics of multi-agent learning: a survey
• Evolutionary game theory: a renaissance
• Evolutionary Games and Population Dynamics
• Game theory. A multi-leveled approach
• Handbook of game theory. Vol. 4
• scientific article; zbMATH DE number 5869530 (Why is no real title available?)
• scientific article; zbMATH DE number 544186 (Why is no real title available?)
• scientific article; zbMATH DE number 1915402 (Why is no real title available?)
• scientific article; zbMATH DE number 903638 (Why is no real title available?)
• Introduction to evolutionary computing
• Reinforcement learning. An introduction
• State based potential games
• The Role of Population Games and Evolutionary Dynamics in Distributed Control Systems: The Advantages of Evolutionary Game Theory

Cited in

(1)

• Optimal control theory: introduction to the special issue

This page was built for publication: Boltzmann distributed replicator dynamics: population games in a microgrid context

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2052487)