Backdooring Bias in Large Language Models

TL;DR

This paper investigates backdoor attacks in large language models within a white-box setting, analyzing the effectiveness of syntactic and semantic triggers and evaluating defense methods' impact on utility and security.

Contribution

It provides a comprehensive analysis of syntactic and semantic backdoor attacks in LLMs under white-box conditions, including evaluation of defense strategies and their trade-offs.

Findings

Semantic backdoors are more effective at inducing negative biases.

Both attack types can preserve model utility while inducing biases.

Defense methods either reduce utility significantly or are computationally expensive.

Abstract

Large language models (LLMs) are increasingly deployed in settings where inducing a bias toward a certain topic can have significant consequences, and backdoor attacks can be used to produce such models. Prior work on backdoor attacks has largely focused on a black-box threat model, with an adversary targeting the model builder's LLM. However, in the bias manipulation setting, the model builder themselves could be the adversary, warranting a white-box threat model where the attacker's ability to poison, and manipulate the poisoned data is substantially increased. Furthermore, despite growing research in semantically-triggered backdoors, most studies have limited themselves to syntactically-triggered attacks. Motivated by these limitations, we conduct an analysis consisting of over 1000 evaluations using higher poisoning ratios and greater data augmentation to gain a better understanding of the potential of syntactically- and semantically-triggered backdoor attacks in a white-box setting. In addition, we study whether two representative defense paradigms, model-intrinsic and model-extrinsic backdoor removal, are able to mitigate these attacks. Our analysis reveals numerous new findings. We discover that while both syntactically- and semantically-triggered attacks can effectively induce the target behaviour, and largely preserve utility, semantically-triggered attacks are generally more effective in inducing negative biases, while both backdoor types struggle with causing positive biases. Furthermore, while both defense types are able to mitigate these backdoors, they either result in a substantial drop in utility, or require high computational overhead.