Graph Feedback Bandits with Similar Arms
Han Qi, Guo Fei, Li Zhu

TL;DR
This paper investigates a graph feedback multi-armed bandit problem where arms are connected if their means are similar, introducing algorithms with regret bounds and applications to online Q&A and review platforms.
Contribution
It establishes regret lower bounds and proposes two UCB-based algorithms tailored for graph feedback with similar arms, including scenarios with increasing arms over time.
Findings
D-UCB achieves problem-independent regret bounds.
C-UCB provides problem-dependent regret bounds.
Experimental results validate theoretical bounds.
Abstract
In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by the clinical trials and recommendation problem, we assume that two arms are connected if and only if they are similar (i.e., their means are close enough). We establish a regret lower bound for this novel feedback structure and introduce two UCB-based algorithms: D-UCB with problem-independent regret upper bounds and C-UCB with problem-dependent upper bounds. Leveraging the similarity structure, we also consider the scenario where the number of arms increases over time. Practical applications related to this scenario include Q\&A platforms (Reddit, Stack Overflow, Quora) and product reviews in Amazon and Flipkart. Answers (product reviews) continually appear on the website, and the goal is to display the best answers (product reviews) at the top. When the means of arms are independently…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Bandit Algorithms Research · Data Stream Mining Techniques · Game Theory and Applications
