Vital Sign Monitoring in Dynamic Environment via mmWave Radar and Camera Fusion
Yingqi Wang, Zhongqin Wang, J. Andrew Zhang, Haimin Zhang, Min Xu

TL;DR
This paper presents a fusion system combining mmWave radar and camera data to reliably monitor vital signs in dynamic environments, overcoming movement and environmental challenges with advanced signal processing.
Contribution
It introduces a novel multi-modal fusion approach with a specialized WMC-VMD algorithm for robust vital sign detection amidst movement and environmental changes.
Findings
Respiration rate error < 0.5 RPM
Heartbeat rate error < 6 BPM
Effective in dynamic scenarios with subject movement
Abstract
Contact-free vital sign monitoring, which uses wireless signals for recognizing human vital signs (i.e, breath and heartbeat), is an attractive solution to health and security. However, the subject's body movement and the change in actual environments can result in inaccurate frequency estimation of heartbeat and respiratory. In this paper, we propose a robust mmWave radar and camera fusion system for monitoring vital signs, which can perform consistently well in dynamic scenarios, e.g., when some people move around the subject to be tracked, or a subject waves his/her arms and marches on the spot. Three major processing modules are developed in the system, to enable robust sensing. Firstly, we utilize a camera to assist a mmWave radar to accurately localize the subjects of interest. Secondly, we exploit the calculated subject position to form transmitting and receiving beamformers,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNon-Invasive Vital Sign Monitoring · Microwave Imaging and Scattering Analysis · Traumatic Ocular and Foreign Body Injuries
