SenseRay-3D: Generalizable and Physics-Informed Framework for End-to-End Indoor Propagation Modeling

TL;DR

SenseRay-3D introduces a physics-informed, end-to-end framework that predicts 3D indoor radio path-loss heatmaps directly from RGB-D scans, improving scalability and efficiency over manual modeling methods.

Contribution

This work presents a novel sensing-driven voxelized scene representation and a neural network that jointly encodes environmental features for accurate, real-time indoor propagation modeling.

Findings

Achieves 4.27 dB mean absolute error on unseen environments

Supports real-time inference at 217 ms per sample

Provides a synthetic dataset as a standardized benchmark

Abstract

Modeling indoor radio propagation is crucial for wireless network planning and optimization. However, existing approaches often rely on labor-intensive manual modeling of geometry and material properties, resulting in limited scalability and efficiency. To overcome these challenges, this paper presents SenseRay-3D, a generalizable and physics-informed end-to-end framework that predicts three-dimensional (3D) path-loss heatmaps directly from RGB-D scans, thereby eliminating the need for explicit geometry reconstruction or material annotation. The proposed framework builds a sensing-driven voxelized scene representation that jointly encodes occupancy, electromagnetic material characteristics, and transmitter-receiver geometry, which is processed by a SwinUNETR-based neural network to infer environmental path-loss relative to free-space path-loss. A comprehensive synthetic indoor propagation dataset is further developed to validate the framework and to serve as a standardized benchmark for future research. Experimental results show that SenseRay-3D achieves a mean absolute error of 4.27 dB on unseen environments and supports real-time inference at 217 ms per sample, demonstrating its scalability, efficiency, and physical consistency. SenseRay-3D paves a new path for sense-driven, generalizable, and physics-consistent modeling of indoor propagation, marking a major leap beyond our pioneering EM DeepRay framework.