Discovering agents
From MaRDI portal
Publication:6136104
DOI10.1016/J.ARTINT.2023.103963arXiv2208.08345OpenAlexW4381893005MaRDI QIDQ6136104FDOQ6136104
Authors: Zachary Kenton, Ramana Kumar, Sebastian Farquhar, Jonathan Richens, Matt MacDermott, Tom Everitt 
Publication date: 28 August 2023
Published in: Artificial Intelligence (Search for Journal in Brave)
Abstract: Causal models of agents have been used to analyse the safety aspects of machine learning systems. But identifying agents is non-trivial -- often the causal model is just assumed by the modeler without much justification -- and modelling failures can lead to mistakes in the safety analysis. This paper proposes the first formal causal definition of agents -- roughly that agents are systems that would adapt their policy if their actions influenced the world in a different way. From this we derive the first causal discovery algorithm for discovering agents from empirical data, and give algorithms for translating between causal models and game-theoretic influence diagrams. We demonstrate our approach by resolving some previous confusions caused by incorrect causal modelling of agents.
Full work available at URL: https://arxiv.org/abs/2208.08345
Cites Work
- Causality. Models, reasoning, and inference
- Title not available (Why is that?)
- Influence Diagrams for Causal Modelling and Inference
- Settable systems: an extension of Pearl's causal model with optimization, equilibrium, and learning
- Title not available (Why is that?)
- Multi-agent influence diagrams for representing and solving games.
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Information-geometric approach to inferring causal directions
- Causal Inference Using the Algorithmic Markov Condition
- Actual causation and the art of modeling
- Reasoning about causality in games
- Bayesian Networks and Influence Diagrams
- Graphs for margins of Bayesian networks
- Causality for Machine Learning
- Foundations of structural causal models with cycles and latent variables
Cited In (1)
This page was built for publication: Discovering agents
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6136104)
