Direct Telemetry Access
Jonatan Langlet, Ran Ben Basat, Gabriele Oliaro, Michael Mitzenmacher,, Minlan Yu, Gianni Antichi

TL;DR
This paper presents Direct Telemetry Access (DTA), a high-performance system leveraging RDMA to efficiently collect and aggregate fine-grained network telemetry data at unprecedented scales, enabling scalable network monitoring.
Contribution
DTA introduces a lightweight, RDMA-based telemetry collection method with novel primitives, significantly enhancing data collection rates and scalability over existing solutions.
Findings
DTA can collect over 400 million reports per second with a single server.
DTA improves telemetry collection rates by up to 16 times compared to previous methods.
DTA integrates easily with existing telemetry mechanisms like INT and Marple.
Abstract
Fine-grained network telemetry is becoming a modern datacenter standard and is the basis of essential applications such as congestion control, load balancing, and advanced troubleshooting. As network size increases and telemetry gets more fine-grained, there is a tremendous growth in the amount of data needed to be reported from switches to collectors to enable network-wide view. As a consequence, it is progressively hard to scale data collection systems. We introduce Direct Telemetry Access (DTA), a solution optimized for aggregating and moving hundreds of millions of reports per second from switches into queryable data structures in collectors' memory. DTA is lightweight and it is able to greatly reduce overheads at collectors. DTA is built on top of RDMA, and we propose novel and expressive reporting primitives to allow easy integration with existing state-of-the-art telemetry…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSoftware-Defined Networks and 5G · Advanced Optical Network Technologies · Caching and Content Delivery
