TL;DR
SMA-X is a real-time, high-throughput data sharing system for telescopes, enabling efficient hierarchical data access and integration across observatory systems, and is openly available for community use.
Contribution
It introduces SMA-X, a versatile, low-latency data sharing platform built on Redis, with server-side scripting and tools for observatory data management and sharing.
Findings
Shared ~10,000 variables across 100+ computers since 2021
Supports real-time data updates every 10 ms
Open-source with multi-language libraries and tools
Abstract
We developed the SMA eXchange (SMA-X) as a real-time data sharing solution, built atop a central Redis database. SMA-X is a storage convention, facilitated by a set of server-side Lua scripts (or Redis functions) which enable efficient low-latency and high-throughput real-time sharing of hierarchically structured data among the various systems and subsystems of the telescope. It enables fast, atomic retrievals of specific leaf elements, branches, and sub-trees, including associated metadata (types, dimensions, timestamps, and origins, and more). At the Submillimer Array (SMA) we rely on it since 2021 to share a diverse set of ~10,000 real-time variables, including arrays, across more than 100 computers, with information being published every 10 ms in some cases. SMA-X is open-source, and is freely available to everyone through a set of public GitHub repositories, including C/C++ and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
