TREB: a BERT attempt for imputing tabular data imputation

TL;DR

TREB is a novel BERT-based framework designed specifically for imputing missing values in tabular data, leveraging contextual interrelations to improve accuracy and efficiency.

Contribution

The paper introduces TREB, a BERT fine-tuned model tailored for real-valued tabular data imputation, addressing limitations of previous methods and emphasizing efficiency and environmental impact.

Findings

TREB effectively preserves feature relationships during imputation.

It demonstrates high accuracy on the California Housing dataset.

TREB offers insights into computational and environmental costs.

Abstract

TREB, a novel tabular imputation framework utilizing BERT, introduces a groundbreaking approach for handling missing values in tabular data. Unlike traditional methods that often overlook the specific demands of imputation, TREB leverages the robust capabilities of BERT to address this critical task. While many BERT-based approaches for tabular data have emerged, they frequently under-utilize the language model's full potential. To rectify this, TREB employs a BERT-based model fine-tuned specifically for the task of imputing real-valued continuous numbers in tabular datasets. The paper comprehensively addresses the unique challenges posed by tabular data imputation, emphasizing the importance of context-based interconnections. The effectiveness of TREB is validated through rigorous evaluation using the California Housing dataset. The results demonstrate its ability to preserve feature interrelationships and accurately impute missing values. Moreover, the authors shed light on the computational efficiency and environmental impact of TREB, quantifying the floating-point operations (FLOPs) and carbon footprint associated with its training and deployment.