SDLog: A Deep Learning Framework for Detecting Sensitive Information in Software Logs

TL;DR

SDLog is a deep learning framework that effectively detects sensitive information in software logs, surpassing traditional regex-based methods and requiring minimal fine-tuning data.

Contribution

This paper introduces SDLog, the first deep learning approach for log anonymization that outperforms regex-based techniques with limited training samples.

Findings

SDLog correctly identifies 99.5% of sensitive attributes with minimal data.

Achieves an F1-score of 98.4% in sensitive information detection.

Outperforms existing regex-based methods in accuracy and generalizability.

Abstract

Software logs are messages recorded during the execution of a software system that provide crucial run-time information about events and activities. Although software logs have a critical role in software maintenance and operation tasks, publicly accessible log datasets remain limited, hindering advance in log analysis research and practices. The presence of sensitive information, particularly Personally Identifiable Information (PII) and quasi-identifiers, introduces serious privacy and re-identification risks, discouraging the publishing and sharing of real-world logs. In practice, log anonymization techniques primarily rely on regular expression patterns, which involve manually crafting rules to identify and replace sensitive information. However, these regex-based approaches suffer from significant limitations, such as extensive manual efforts and poor generalizability across diverse log formats and datasets. To mitigate these limitations, we introduce SDLog, a deep learning-based framework designed to identify sensitive information in software logs. Our results show that SDLog overcomes regex limitations and outperforms the best-performing regex patterns in identifying sensitive information. With only 100 fine-tuning samples from the target dataset, SDLog can correctly identify 99.5% of sensitive attributes and achieves an F1-score of 98.4%. To the best of our knowledge, this is the first deep learning alternative to regex-based methods in software log anonymization.