Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes

TL;DR

This paper introduces the SUMS dataset for multi-camera biosensing at high altitudes, demonstrating improved accuracy in estimating vital signs like SpO2 and heart rate through video fusion techniques.

Contribution

It provides a new dataset and validation framework for non-contact vital sign estimation in challenging high-altitude environments, highlighting multi-signal fusion benefits.

Findings

Video fusion reduces SpO2 MAE by up to 10.6%.

Achieved less than 0.5 BPM MAE for HR estimation.

Multi-signal training reduces SpO2 MAE by 17.8%.

Abstract

Video photoplethysmography (vPPG) is an emerging method for non-invasive and convenient measurement of physiological signals, utilizing two primary approaches: remote video PPG (rPPG) and contact video PPG (cPPG). Monitoring vitals in high-altitude environments, where heart rates tend to increase and blood oxygen levels often decrease, presents significant challenges. To address these issues, we introduce the SUMS dataset comprising 80 synchronized non-contact facial and contact finger videos from 10 subjects during exercise and oxygen recovery scenarios, capturing PPG, respiration rate (RR), and SpO2. This dataset is designed to validate video vitals estimation algorithms and compare facial rPPG with finger cPPG. Additionally, fusing videos from different positions (i.e., face and finger) reduces the mean absolute error (MAE) of SpO2 predictions by 7.6\% and 10.6\% compared to only face and only finger, respectively. In cross-subject evaluation, we achieve an MAE of less than 0.5 BPM for HR estimation and 2.5\% for SpO2 estimation, demonstrating the precision of our multi-camera fusion techniques. Our findings suggest that simultaneous training on multiple indicators, such as PPG and blood oxygen, can reduce MAE in SpO2 estimation by 17.8\%.