Thresholded Lasso Bandit
Kaito Ariu, Kenshi Abe, Alexandre Prouti\`ere

TL;DR
This paper introduces the Thresholded Lasso bandit algorithm for sparse linear bandit problems, achieving improved regret bounds and outperforming existing methods without prior knowledge of sparsity.
Contribution
The paper presents a novel sparse bandit algorithm that estimates the reward vector and its support using thresholded Lasso, with non-asymptotic regret bounds and no need for prior sparsity knowledge.
Findings
Regret bounds scale as O(log d + sqrt(T)) and O(log d + log T) under different conditions.
Algorithm outperforms existing methods in numerical experiments.
Does not require prior knowledge of sparsity index s_0.
Abstract
In this paper, we revisit the regret minimization problem in sparse stochastic contextual linear bandits, where feature vectors may be of large dimension , but where the reward function depends on a few, say , of these features only. We present Thresholded Lasso bandit, an algorithm that (i) estimates the vector defining the reward function as well as its sparse support, i.e., significant feature elements, using the Lasso framework with thresholding, and (ii) selects an arm greedily according to this estimate projected on its support. The algorithm does not require prior knowledge of the sparsity index and can be parameter-free under some symmetric assumptions. For this simple algorithm, we establish non-asymptotic regret upper bounds scaling as in general, and as under the so-called margin condition…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Bandit Algorithms Research · Age of Information Optimization · Reinforcement Learning in Robotics
