Variational Bayesian Filtering with Subspace Information for Extreme Spatio-Temporal Matrix Completion

TL;DR

This paper introduces a Bayesian matrix completion method that leverages spatiotemporal and periodic structures, automatically tunes model parameters, and robustly handles outliers, significantly improving data imputation in extreme sampling scenarios.

Contribution

The paper proposes a novel Variational Bayesian filtering approach with subspace information for spatiotemporal matrix completion, including automatic rank determination and robustness to outliers.

Findings

Outperforms recent state-of-the-art methods in real-world data imputation.

Effectively handles low sampling rates, achieving accurate results with as little as 15% data.

Fusing subspace evolution over days enhances imputation accuracy.

Abstract

Missing data is a common problem in real-world sensor data collection. The performance of various approaches to impute data degrade rapidly in the extreme scenarios of low data sampling and noisy sampling, a case present in many real-world problems in the field of traffic sensing and environment monitoring, etc. However, jointly exploiting the spatiotemporal and periodic structure, which is generally not captured by classical matrix completion approaches, can improve the imputation performance of sensor data in such real-world conditions. We present a Bayesian approach towards spatiotemporal matrix completion wherein we estimate the underlying temporarily varying subspace using a Variational Bayesian technique. We jointly couple the low-rank matrix completion with the state space autoregressive framework along with a penalty function on the slowly varying subspace to model the temporal and periodic evolution in the data. A major advantage of our method is that a critical parameter like the rank of the model is automatically tuned using the automatic relevance determination (ARD) approach, unlike most matrix/tensor completion techniques. We also propose a robust version of the above formulation, which improves the performance of imputation in the presence of outliers. We evaluate the proposed Variational Bayesian Filtering with Subspace Information (VBFSI) method to impute matrices in real-world traffic and air pollution data. Simulation results demonstrate that the proposed method outperforms the recent state-of-the-art methods and provides a sufficiently accurate imputation for different sampling rates. In particular, we demonstrate that fusing the subspace evolution over days can improve the imputation performance with even 15% of the data sampling.