Contextual Multi-armed Bandits for the Prevention of Spam in VoIP Networks
Tobias Jung, Sylvain Martin, Damien Ernst, Guy Leduc

TL;DR
This paper introduces a new approach using contextual multi-armed bandit algorithms to develop self-learning security modules for VoIP networks, specifically targeting spam prevention without relying on labeled data.
Contribution
It formulates SPIT prevention as a contextual bandit problem and presents CMABFAS, a novel algorithm for finite-action domains, with initial simulation results.
Findings
Proposes a new formulation of SPIT prevention as a contextual bandit problem.
Introduces the CMABFAS algorithm tailored for finite actions.
Provides initial simulation results demonstrating the approach's potential.
Abstract
In this paper we argue that contextual multi-armed bandit algorithms could open avenues for designing self-learning security modules for computer networks and related tasks. The paper has two contributions: a conceptual one and an algorithmical one. The conceptual contribution is to formulate -- as an example -- the real-world problem of preventing SPIT (Spam in VoIP networks), which is currently not satisfyingly addressed by standard techniques, as a sequential learning problem, namely as a contextual multi-armed bandit. Our second contribution is to present CMABFAS, a new algorithm for general contextual multi-armed bandit learning that specifically targets domains with finite actions. We illustrate how CMABFAS could be used to design a fully self-learning SPIT filter that does not rely on feedback from the end-user (i.e., does not require labeled data) and report first simulation…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Bandit Algorithms Research · Machine Learning and Algorithms · Data Stream Mining Techniques
