Smart Choices and the Selection Monad

From MaRDI portal
Publication:6135751

DOI10.46298/LMCS-19(2:3)2023arXiv2007.08926OpenAlexW3042976617MaRDI QIDQ6135751FDOQ6135751


Authors: Martín Abadi, Gordon D. Plotkin Edit this on Wikidata


Publication date: 26 August 2023

Published in: Logical Methods in Computer Science (Search for Journal in Brave)

Abstract: Describing systems in terms of choices and their resulting costs and rewards offers the promise of freeing algorithm designers and programmers from specifying how those choices should be made; in implementations, the choices can be realized by optimization techniques and, increasingly, by machine-learning methods. We study this approach from a programming-language perspective. We define two small languages that support decision-making abstractions: one with choices and rewards, and the other additionally with probabilities. We give both operational and denotational semantics. In the case of the second language we consider three denotational semantics, with varying degrees of correlation between possible program values and expected rewards. The operational semantics combine the usual semantics of standard constructs with optimization over spaces of possible execution strategies. The denotational semantics, which are compositional, rely on the selection monad, to handle choice, augmented with an auxiliary monad to handle other effects, such as rewards or probability. We establish adequacy theorems that the two semantics coincide in all cases. We also prove full abstraction at base types, with varying notions of observation in the probabilistic case corresponding to the various degrees of correlation. We present axioms for choice combined with rewards and probability, establishing completeness at base types for the case of rewards without probability.


Full work available at URL: https://arxiv.org/abs/2007.08926




Recommendations



Cites Work


Cited In (2)





This page was built for publication: Smart Choices and the Selection Monad

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6135751)