Cheap Bandits
Manjesh Kumar Hanawal, Venkatesh Saligrama, Michal Valko, R\', emi Munos

TL;DR
This paper introduces CheapUCB, an algorithm for bandit problems where average rewards of groups of actions are observed, optimizing reward maximization while reducing sensing costs in smooth graph-structured environments.
Contribution
The paper proposes CheapUCB, a novel algorithm that achieves regret bounds comparable to existing methods but with significantly lower sensing costs in graph-based bandit settings.
Findings
CheapUCB matches regret guarantees of known algorithms.
It guarantees a linear reduction in sensing costs.
Established a lower bound on spectral bandit regret.
Abstract
We consider stochastic sequential learning problems where the learner can observe the \textit{average reward of several actions}. Such a setting is interesting in many applications involving monitoring and surveillance, where the set of the actions to observe represent some (geographical) area. The importance of this setting is that in these applications, it is actually \textit{cheaper} to observe average reward of a group of actions rather than the reward of a single action. We show that when the reward is \textit{smooth} over a given graph representing the neighboring actions, we can maximize the cumulative reward of learning while \textit{minimizing the sensing cost}. In this paper we propose CheapUCB, an algorithm that matches the regret guarantees of the known algorithms for this setting and at the same time guarantees a linear cost again over them. As a by-product of our analysis,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Bandit Algorithms Research · Distributed Sensor Networks and Detection Algorithms · Machine Learning and Algorithms
