The Value of Information and Efficient Switching in Channel Selection

arXiv2101.03888MaRDI QIDQ6358014FDOQ6358014

Yoni Nazarathy, Thomas Taimre, Jiesen Wang

Publication date: 22 December 2020

Abstract: We consider a collection of statistically identical two-state continuous time Markov chains (channels). A controller continuously selects a channel with the view of maximizing infinite horizon average reward. A switching cost is paid upon channel changes. We consider two cases: full observation (all channels observed simultaneously) and partial observation (only the current channel observed). We analyze the difference in performance between these cases for various policies. For the partial observation case with two channels, or an infinite number of channels, we explicitly characterize an optimal threshold for two sensible policies which we name "call-gapping" and "cool-off". Our results present a qualitative view on the interaction of the number of channels, the available information, and the switching costs.

Has companion code repository: https://github.com/yoninazarathy/valueofinformationandefficientswitching

This page was built for publication: The Value of Information and Efficient Switching in Channel Selection

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6358014)