Better Safe than Sorry: Pre-training CLIP against Targeted Data Poisoning and Backdoor Attacks

TL;DR

This paper introduces SAFECLIP, a novel pre-training method that significantly enhances CLIP's robustness against targeted data poisoning and backdoor attacks by identifying and isolating risky data during training.

Contribution

SAFECLIP is a new defense approach that uses unimodal contrastive learning and Gaussian Mixture Models to prevent poisoning attacks during CLIP pre-training.

Findings

Reduces targeted poisoning attack success rate from 93.75% to 0%.

Eliminates backdoor attack success from up to 100% to 0%.

Maintains CLIP's original performance on benchmark datasets.

Abstract

Contrastive Language-Image Pre-training (CLIP) on large image-caption datasets has achieved remarkable success in zero-shot classification and enabled transferability to new domains. However, CLIP is extremely more vulnerable to targeted data poisoning and backdoor attacks, compared to supervised learning. Perhaps surprisingly, poisoning 0.0001% of CLIP pre-training data is enough to make targeted data poisoning attacks successful. This is four orders of magnitude smaller than what is required to poison supervised models. Despite this vulnerability, existing methods are very limited in defending CLIP models during pre-training. In this work, we propose a strong defense, SAFECLIP, to safely pre-train CLIP against targeted data poisoning and backdoor attacks. SAFECLIP warms up the model by applying unimodal contrastive learning (CL) on image and text modalities separately. Then, it divides the data into safe and risky sets, by applying a Gaussian Mixture Model to the cosine similarity of image-caption pair representations. SAFECLIP pre-trains the model by applying the CLIP loss to the safe set and applying unimodal CL to image and text modalities of the risky set separately. By gradually increasing the size of the safe set during pre-training, SAFECLIP effectively breaks targeted data poisoning and backdoor attacks without harming the CLIP performance. Our extensive experiments on CC3M, Visual Genome, and MSCOCO demonstrate that SAFECLIP significantly reduces the success rate of targeted data poisoning attacks from 93.75% to 0% and that of various backdoor attacks from up to 100% to 0%, without harming CLIP's performance.