# Network Offloading Policies for Cloud Robotics: a Learning-based Approach

## TL;DR

This paper introduces a deep reinforcement learning approach for optimizing cloud offloading decisions in robotic systems, balancing accuracy improvements with communication costs in congested networks.

## Contribution

It formulates the robot offloading problem as a sequential decision process and proposes a novel learning-based solution that outperforms existing strategies.

## Key findings

- Improves vision task performance by 1.3-2.6x over benchmarks.
- Demonstrates effectiveness in both simulations and hardware experiments.
- Balances accuracy gains with communication costs effectively.

## Abstract

Today's robotic systems are increasingly turning to computationally expensive models such as deep neural networks (DNNs) for tasks like localization, perception, planning, and object detection. However, resource-constrained robots, like low-power drones, often have insufficient on-board compute resources or power reserves to scalably run the most accurate, state-of-the art neural network compute models. Cloud robotics allows mobile robots the benefit of offloading compute to centralized servers if they are uncertain locally or want to run more accurate, compute-intensive models. However, cloud robotics comes with a key, often understated cost: communicating with the cloud over congested wireless networks may result in latency or loss of data. In fact, sending high data-rate video or LIDAR from multiple robots over congested networks can lead to prohibitive delay for real-time applications, which we measure experimentally. In this paper, we formulate a novel Robot Offloading Problem --- how and when should robots offload sensing tasks, especially if they are uncertain, to improve accuracy while minimizing the cost of cloud communication? We formulate offloading as a sequential decision making problem for robots, and propose a solution using deep reinforcement learning. In both simulations and hardware experiments using state-of-the art vision DNNs, our offloading strategy improves vision task performance by between 1.3-2.6x of benchmark offloading strategies, allowing robots the potential to significantly transcend their on-board sensing accuracy but with limited cost of cloud communication.