VitalBench: A Rigorous Multi-Center Benchmark for Long-Term Vital Sign Prediction in Intraoperative Care

TL;DR

VitalBench is a comprehensive benchmark dataset and evaluation framework for intraoperative vital sign prediction, promoting standardized, robust, and cross-center validated deep learning models in clinical settings.

Contribution

We introduce VitalBench, the first standardized multi-center benchmark for intraoperative vital sign prediction, facilitating fair comparison and development of robust predictive models.

Findings

VitalBench includes data from over 4,000 surgeries across two centers.

The benchmark supports evaluation on complete, incomplete, and cross-center data.

VitalBench promotes model robustness and generalization in clinical environments.

Abstract

Intraoperative monitoring and prediction of vital signs are critical for ensuring patient safety and improving surgical outcomes. Despite recent advances in deep learning models for medical time-series forecasting, several challenges persist, including the lack of standardized benchmarks, incomplete data, and limited cross-center validation. To address these challenges, we introduce VitalBench, a novel benchmark specifically designed for intraoperative vital sign prediction. VitalBench includes data from over 4,000 surgeries across two independent medical centers, offering three evaluation tracks: complete data, incomplete data, and cross-center generalization. This framework reflects the real-world complexities of clinical practice, minimizing reliance on extensive preprocessing and incorporating masked loss techniques for robust and unbiased model evaluation. By providing a standardized and unified platform for model development and comparison, VitalBench enables researchers to focus on architectural innovation while ensuring consistency in data handling. This work lays the foundation for advancing predictive models for intraoperative vital sign forecasting, ensuring that these models are not only accurate but also robust and adaptable across diverse clinical environments. Our code and data are available at https://github.com/XiudingCai/VitalBench.