PEERNet: An End-to-End Profiling Tool for Real-Time Networked Robotic Systems

TL;DR

PEERNet is a real-time profiling tool designed for networked robotic systems that helps monitor and adapt to performance variations, improving task offloading decisions in cloud robotics applications.

Contribution

PEERNet introduces an end-to-end, adaptive profiling framework for heterogeneous hardware in networked robotics, enabling real-time performance monitoring and analysis.

Findings

Revealed asymmetric network transmission behaviors.

Identified bimodal outputs in vision-language models.

Demonstrated PEERNet's effectiveness in real robotic tasks.

Abstract

Networked robotic systems balance compute, power, and latency constraints in applications such as self-driving vehicles, drone swarms, and teleoperated surgery. A core problem in this domain is deciding when to offload a computationally expensive task to the cloud, a remote server, at the cost of communication latency. Task offloading algorithms often rely on precise knowledge of system-specific performance metrics, such as sensor data rates, network bandwidth, and machine learning model latency. While these metrics can be modeled during system design, uncertainties in connection quality, server load, and hardware conditions introduce real-time performance variations, hindering overall performance. We introduce PEERNet, an end-to-end and real-time profiling tool for cloud robotics. PEERNet enables performance monitoring on heterogeneous hardware through targeted yet adaptive profiling of system components such as sensors, networks, deep-learning pipelines, and devices. We showcase PEERNet's capabilities through networked robotics tasks, such as image-based teleoperation of a Franka Emika Panda arm and querying vision language models using an Nvidia Jetson Orin. PEERNet reveals non-intuitive behavior in robotic systems, such as asymmetric network transmission and bimodal language model output. Our evaluation underscores the effectiveness and importance of benchmarking in networked robotics, demonstrating PEERNet's adaptability. Our code is open-source and available at github.com/UTAustin-SwarmLab/PEERNet.