With a Little Help From My Friends: Collective Manipulation in Risk-Controlling Recommender Systems

TL;DR

This paper reveals vulnerabilities in risk-controlling recommender systems to coordinated user manipulation, demonstrating how small groups can degrade recommendation quality and proposing user-level mitigation strategies.

Contribution

It identifies a new security weakness in risk-controlling recommenders and introduces a mitigation approach to enhance individual safety against coordinated attacks.

Findings

A small 1% user group can reduce recommendation quality by 20%.

Simple attack strategies can harm overall recommendation performance.

User-level mitigation can reduce the impact of coordinated manipulation.

Abstract

Recommendation systems have become central gatekeepers of online information, shaping user behaviour across a wide range of activities. In response, users increasingly organize and coordinate to steer algorithmic outcomes toward diverse goals, such as promoting relevant content or limiting harmful material, relying on platform affordances -- such as likes, reviews, or ratings. While these mechanisms can serve beneficial purposes, they can also be leveraged for adversarial manipulation, particularly in systems where such feedback directly informs safety guarantees. In this paper, we study this vulnerability in recently proposed risk-controlling recommender systems, which use binary user feedback (e.g., "Not Interested") to provably limit exposure to unwanted content via conformal risk control. We empirically demonstrate that their reliance on aggregate feedback signals makes them inherently susceptible to coordinated adversarial user behaviour. Using data from a large-scale online video-sharing platform, we show that a small coordinated group (comprising only 1% of the user population) can induce up to a 20% degradation in nDCG for non-adversarial users by exploiting the affordances provided by risk-controlling recommender systems. We evaluate simple, realistic attack strategies that require little to no knowledge of the underlying recommendation algorithm and find that, while coordinated users can significantly harm overall recommendation quality, they cannot selectively suppress specific content groups through reporting alone. Finally, we propose a mitigation strategy that shifts guarantees from the group level to the user level, showing empirically how it can reduce the impact of adversarial coordinated behaviour while ensuring personalized safety for individuals.