Can Encrypted Images Still Train Neural Networks? Investigating Image Information and Random Vortex Transformation

TL;DR

This paper introduces a framework to measure image information content, proposes a novel encryption method that preserves training utility, and demonstrates that encrypted images can still effectively train neural networks with minimal accuracy loss.

Contribution

The paper presents a new framework for quantifying image information content and a novel encryption algorithm that maintains training effectiveness for neural networks.

Findings

Encrypted images allow neural network training with minimal accuracy loss (0.3% to 6.5%).

Swapping pixel positions reduces image information content.

Positive correlation between information loss and accuracy degradation.

Abstract

Vision is one of the essential sources through which humans acquire information. In this paper, we establish a novel framework for measuring image information content to evaluate the variation in information content during image transformations. Within this framework, we design a nonlinear function to calculate the neighboring information content of pixels at different distances, and then use this information to measure the overall information content of the image. Hence, we define a function to represent the variation in information content during image transformations. Additionally, we utilize this framework to prove the conclusion that swapping the positions of any two pixels reduces the image's information content. Furthermore, based on the aforementioned framework, we propose a novel image encryption algorithm called Random Vortex Transformation. This algorithm encrypts the image using random functions while preserving the neighboring information of the pixels. The encrypted images are difficult for the human eye to distinguish, yet they allow for direct training of the encrypted images using machine learning methods. Experimental verification demonstrates that training on the encrypted dataset using ResNet and Vision Transformers only results in a decrease in accuracy ranging from 0.3\% to 6.5\% compared to the original data, while ensuring the security of the data. Furthermore, there is a positive correlation between the rate of information loss in the images and the rate of accuracy loss, further supporting the validity of the proposed image information content measurement framework.