EVE: Efficient Verification of Data Erasure through Customized Perturbation in Approximate Unlearning

TL;DR

EVE is a novel, efficient method for verifying machine unlearning by perturbing data to detect changes in model predictions, eliminating the need for initial training involvement and outperforming existing techniques.

Contribution

The paper introduces EVE, a new verification approach that uses adversarial perturbations to confirm unlearning without initial training data, improving efficiency and accuracy.

Findings

EVE outperforms state-of-the-art verification methods.

EVE significantly speeds up verification process.

EVE enhances verification accuracy.

Abstract

Verifying whether the machine unlearning process has been properly executed is critical but remains underexplored. Some existing approaches propose unlearning verification methods based on backdooring techniques. However, these methods typically require participation in the model's initial training phase to backdoor the model for later verification, which is inefficient and impractical. In this paper, we propose an efficient verification of erasure method (EVE) for verifying machine unlearning without requiring involvement in the model's initial training process. The core idea is to perturb the unlearning data to ensure the model prediction of the specified samples will change before and after unlearning with perturbed data. The unlearning users can leverage the observation of the changes as a verification signal. Specifically, the perturbations are designed with two key objectives: ensuring the unlearning effect and altering the unlearned model's prediction of target samples. We formalize the perturbation generation as an adversarial optimization problem, solving it by aligning the unlearning gradient with the gradient of boundary change for target samples. We conducted extensive experiments, and the results show that EVE can verify machine unlearning without involving the model's initial training process, unlike backdoor-based methods. Moreover, EVE significantly outperforms state-of-the-art unlearning verification methods, offering significant speedup in efficiency while enhancing verification accuracy. The source code of EVE is released at \uline{https://anonymous.4open.science/r/EVE-C143}, providing a novel tool for verification of machine unlearning.