# Real-time sleep disorder monitoring design using dynamic temporal graphs with facial and acoustic feature fusion

**Authors:** Fei Pei, Ying Zhou, Qiangqiang Fu, Hong Zhou

PMC · DOI: 10.3389/frai.2025.1681759 · Frontiers in Artificial Intelligence · 2025-11-11

## TL;DR

This paper introduces a non-invasive system using facial and audio data to monitor sleep disorders in real-time, offering a more comfortable alternative to traditional methods.

## Contribution

A novel multimodal system using dynamic temporal graphs for real-time sleep disorder detection with high clinical accuracy.

## Key findings

- The system detected sleep apnea, restless leg syndrome, and cardiovascular irregularities with 94.6% clinical agreement.
- It achieved a 10.7-second average delay, suitable for real-time monitoring.
- The framework offers diagnostic accuracy comparable to traditional polysomnography.

## Abstract

Sleep disorders pose significant risks to patient safety, yet traditional polysomnography imposes substantial discomfort and laboratory constraints. We developed a non-invasive multimodal monitoring system for real-time sleep pathology detection.

We integrated facial expression analysis via deep convolutional neural networks with audio signal processing for breathing pattern detection. Heterogeneous data streams were unified into dynamic graph representations, with graph neural networks modeling spatiotemporal patterns of sleep pathologies.

The system accurately detected sleep apnea, restless leg syndrome, and cardiovascular irregularities with 10.7-s average delay and 94.6% clinical agreement, achieving diagnostic accuracy comparable to polysomnography.

This framework enables continuous non-invasive monitoring for point-of-care screening and home-based management, potentially expanding sleep medicine access for underserved populations.

## Linked entities

- **Diseases:** sleep apnea (MONDO:0005296), restless leg syndrome (MONDO:0005391)

## Full-text entities

- **Diseases:** Sleep disorders (MESH:D012893), cardiovascular irregularities (MESH:D002318), restless leg syndrome (MESH:D012148), sleep apnea (MESH:D012891)
- **Species:** Homo sapiens (human, species) [taxon 9606]

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/PMC12644054/full.md

## Figures

4 figures with captions in the complete paper: https://tomesphere.com/paper/PMC12644054/full.md

## References

46 references — full list in the complete paper: https://tomesphere.com/paper/PMC12644054/full.md

---
Source: https://tomesphere.com/paper/PMC12644054