NT-ML: Backdoor Defense via Non-target Label Training and Mutual Learning

TL;DR

This paper introduces NT-ML, a novel backdoor defense method that uses non-target label training and mutual learning to effectively purify poisoned models against various attacks with limited clean data.

Contribution

NT-ML is a new defense approach combining non-target label training and mutual learning to restore models compromised by backdoor attacks.

Findings

Effectively defends against 6 backdoor attacks

Outperforms 5 state-of-the-art defenses

Works with limited clean samples

Abstract

Recent studies have shown that deep neural networks (DNNs) are vulnerable to backdoor attacks, where a designed trigger is injected into the dataset, causing erroneous predictions when activated. In this paper, we propose a novel defense mechanism, Non-target label Training and Mutual Learning (NT-ML), which can successfully restore the poisoned model under advanced backdoor attacks. NT aims to reduce the harm of poisoned data by retraining the model with the outputs of the standard training. At this stage, a teacher model with high accuracy on clean data and a student model with higher confidence in correct prediction on poisoned data are obtained. Then, the teacher and student can learn the strengths from each other through ML to obtain a purified student model. Extensive experiments show that NT-ML can effectively defend against 6 backdoor attacks with a small number of clean samples, and outperforms 5 state-of-the-art backdoor defenses.