Retrieval & Interaction Machine for Tabular Data Prediction

TL;DR

This paper introduces the Retrieval & Interaction Machine (RIM), a novel framework that leverages both cross-row and cross-column patterns in tabular data to improve prediction accuracy across various tasks.

Contribution

RIM is the first general framework to exploit both cross-row and cross-column patterns in tabular data for prediction tasks.

Findings

RIM outperforms state-of-the-art models on 11 datasets.

RIM improves prediction accuracy in classification, ranking, and regression tasks.

Experimental results confirm the effectiveness of leveraging cross-row patterns.

Abstract

Prediction over tabular data is an essential task in many data science applications such as recommender systems, online advertising, medical treatment, etc. Tabular data is structured into rows and columns, with each row as a data sample and each column as a feature attribute. Both the columns and rows of the tabular data carry useful patterns that could improve the model prediction performance. However, most existing models focus on the cross-column patterns yet overlook the cross-row patterns as they deal with single samples independently. In this work, we propose a general learning framework named Retrieval & Interaction Machine (RIM) that fully exploits both cross-row and cross-column patterns among tabular data. Specifically, RIM first leverages search engine techniques to efficiently retrieve useful rows of the table to assist the label prediction of the target row, then uses feature interaction networks to capture the cross-column patterns among the target row and the retrieved rows so as to make the final label prediction. We conduct extensive experiments on 11 datasets of three important tasks, i.e., CTR prediction (classification), top-n recommendation (ranking) and rating prediction (regression). Experimental results show that RIM achieves significant improvements over the state-of-the-art and various baselines, demonstrating the superiority and efficacy of RIM.