Evaluating Latent Knowledge of Public Tabular Datasets in Large Language Models

TL;DR

This paper introduces a framework to detect dataset contamination in large language models' performance on tabular data, revealing significant contamination in several widely used datasets and raising concerns about evaluation reliability.

Contribution

It proposes a novel method for assessing contamination in tabular datasets using controlled queries and transformations, with statistical testing to detect significant deviations.

Findings

Contamination detected in 4 out of 8 datasets analyzed.

Performance inflation due to contamination may affect evaluation reliability.

Framework enables systematic detection of dataset contamination in LLMs.

Abstract

Large language models (LLMs) are increasingly exposed to data contamination, i.e., performance gains driven by prior exposure of test datasets rather than generalization. However, in the context of tabular data, this problem is largely unexplored. Existing approaches primarily rely on memorization tests, which are too coarse to detect contamination. In contrast, we propose a framework for assessing contamination in tabular datasets by generating controlled queries and performing comparative evaluation. Given a dataset, we craft multiple-choice aligned queries that preserve task structure while allowing systematic transformations of the underlying data. These transformations are designed to selectively disrupt dataset information while preserving partial knowledge, enabling us to isolate performance attributable to contamination. We complement this setup with non-neural baselines that provide reference performance, and we introduce a statistical testing procedure to formally detect significant deviations indicative of contamination. Empirical results on eight widely used tabular datasets reveal clear evidence of contamination in four cases. These findings suggest that performance on downstream tasks involving such datasets may be substantially inflated, raising concerns about the reliability of current evaluation practices.