A Statistical Approach for Modeling Irregular Multivariate Time Series with Missing Observations

TL;DR

This paper introduces a simple, effective method for modeling irregular multivariate time series with missing data by using time-agnostic summary statistics, achieving state-of-the-art results in biomedical datasets.

Contribution

The authors propose a novel approach that replaces complex temporal models with fixed-dimensional statistical features, simplifying modeling and improving performance.

Findings

Outperforms recent transformer and graph-based models in biomedical datasets.

Feature extraction, not classifier complexity, drives performance gains.

Missing data patterns can encode significant predictive information, as in sepsis prediction.

Abstract

Irregular multivariate time series with missing values present significant challenges for predictive modeling in domains such as healthcare. While deep learning approaches often focus on temporal interpolation or complex architectures to handle irregularities, we propose a simpler yet effective alternative: extracting time-agnostic summary statistics to eliminate the temporal axis. Our method computes four key features per variable-mean and standard deviation of observed values, as well as the mean and variability of changes between consecutive observations to create a fixed-dimensional representation. These features are then utilized with standard classifiers, such as logistic regression and XGBoost. Evaluated on four biomedical datasets (PhysioNet Challenge 2012, 2019, PAMAP2, and MIMIC-III), our approach achieves state-of-the-art performance, surpassing recent transformer and graph-based models by 0.5-1.7% in AUROC/AUPRC and 1.1-1.7% in accuracy/F1-score, while reducing computational complexity. Ablation studies demonstrate that feature extraction-not classifier choice-drives performance gains, and our summary statistics outperform raw/imputed input in most benchmarks. In particular, we identify scenarios where missing patterns themselves encode predictive signals, as in sepsis prediction (PhysioNet, 2019), where missing indicators alone can achieve 94.2% AUROC with XGBoost, only 1.6% lower than using original raw data as input. Our results challenge the necessity of complex temporal modeling when task objectives permit time-agnostic representations, providing an efficient and interpretable solution for irregular time series classification.