Timely Communication from Sensors for Wireless Networked Control in Cloud-Based Digital Twins
Van-Phuc Bui, Shashi Raj Pandey, Pedro M. de Sant Ana, Beatriz Soret,, and Petar Popovski

TL;DR
This paper introduces AoL-REVERB, a novel reinforcement learning and filtering approach for sensor data scheduling in wireless networked control systems, enhancing timely updates for digital twins while reducing communication costs.
Contribution
It proposes AoL-REVERB, combining uncertainty-control reinforcement learning and VoI-based sensor selection to optimize control and data acquisition in digital twin environments.
Findings
Halves communication overhead compared to baseline methods.
Maintains satisfactory digital twin performance with optimized data scheduling.
Effective in managing limited network resources and measurement errors.
Abstract
We consider a Wireless Networked Control System (WNCS) where sensors provide observations to build a DT model of the underlying system dynamics. The focus is on control, scheduling, and resource allocation for sensory observation to ensure timely delivery to the DT model deployed in the cloud. \phuc{Timely and relevant information, as characterized by optimized data acquisition policy and low latency, are instrumental in ensuring that the DT model can accurately estimate and predict system states. However, optimizing closed-loop control with DT and acquiring data for efficient state estimation and control computing pose a non-trivial problem given the limited network resources, partial state vector information, and measurement errors encountered at distributed sensing agents.} To address this, we propose the \emph{Age-of-Loop REinforcement learning and Variational Extended Kalman filter…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsIoT and Edge/Fog Computing · Network Time Synchronization Technologies · Wireless Body Area Networks
