On the detection of Markov decision processes

DOI10.1016/J.AUTOMATICA.2025.112196MaRDI QIDQ7012301zbMATH OpenFDO

Authors Xiaoming Duan, Yagiz Savas, Rui Yan, Zhe Xu, Ufuk Topcu

Publication date 17 March 2025

Published in Automatica (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/J.AUTOMATICA.2025.112196

zbMATH Keywords

algorithm designasymptotic detectiondecision makingMarkov decision processespolicy synthesis

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Decision theory (91B06)

Cites work

• An MDP-based recommender system
• Computation of weighted sums of rewards for concurrent MDPs
• Dynamic programming and optimal control. Vol. 1.
• Faster and dynamic algorithms for maximal end-component decomposition and related graph problems in probabilistic verification
• scientific article; zbMATH DE number 5585443 (Why is no real title available?)
• scientific article; zbMATH DE number 3064553 (Why is no real title available?)
• scientific article; zbMATH DE number 3103176 (Why is no real title available?)
• Markov Decision Processes with Imprecise Transition Probabilities
• Markovian Decision Processes with Uncertain Transition Probabilities
• On the best finite set of linear observables for discriminating two Gaussian signals
• Robust Control of Markov Decision Processes with Uncertain Transition Matrices
• Robust Dynamic Programming
• Robust Markov Decision Processes
• Some properties of affinity and applications
• Statistical Inference about Markov Chains
• The Bhattacharyya distance and detection between Markov chains
• What is decidable about partially observable Markov decision processes with \(\omega\)-regular objectives

Cited in

(1)

• A sharp gap for limiting threshold probabilities with application to discrimination for MDPs

This page was built for publication: On the detection of Markov decision processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q7012301)