Low latency communication over commercially available LTE and remote driving

TL;DR

This paper demonstrates a low-latency communication system for remote vehicle control over LTE, achieving sub-50ms roundtrip latency for high-quality video streaming, enabling practical teleoperation of real cars.

Contribution

It presents a novel communication and streaming system optimized for LTE networks that significantly reduces latency for remote vehicle teleoperation.

Findings

Achieved sub-50ms roundtrip latency for 720p, 60FPS video

Maintained an average PSNR of 36dB in video quality

Enabled real-time remote control of a vehicle over LTE

Abstract

In addition to autonomous car operation, in many cases it is desirable to let a human drive the vehicle remotely. To make remote operation possible, it is very critical to have a low and predictable latency to transmit video from the car cameras and receive control commands back. In this paper, we analyze the problem and present a communication and video streaming system that addresses the latency challenges and enables teleoperation of a real car over commercially available LTE network; demonstrating sub-50ms roundtrip latencies for 720p, 60FPS video, with average PSNR 36db.