Bandit problems with fidelity rewards
G\'abor Lugosi, Ciara Pike-Burke, Pierre-Andr\'e Savalle

TL;DR
This paper explores the fidelity bandits problem, a variant of the multi-armed bandit, introducing loyalty-based reward models and analyzing regret bounds for stochastic and adversarial settings.
Contribution
It proposes two fidelity reward models, analyzes regret in different scenarios, and provides algorithms with regret bounds for cases with sublinear regret.
Findings
Sublinear regret bounds are achievable in certain fidelity models.
Lower bounds are established for models without sublinear regret.
Algorithms are developed for models with sublinear regret.
Abstract
The fidelity bandits problem is a variant of the -armed bandit problem in which the reward of each arm is augmented by a fidelity reward that provides the player with an additional payoff depending on how 'loyal' the player has been to that arm in the past. We propose two models for fidelity. In the loyalty-points model the amount of extra reward depends on the number of times the arm has previously been played. In the subscription model the additional reward depends on the current number of consecutive draws of the arm. We consider both stochastic and adversarial problems. Since single-arm strategies are not always optimal in stochastic problems, the notion of regret in the adversarial setting needs careful adjustment. We introduce three possible notions of regret and investigate which can be bounded sublinearly. We study in detail the special cases of increasing, decreasing and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Bandit Algorithms Research · Reinforcement Learning in Robotics · Optimization and Search Problems
