Reason-to-Transmit: Deliberative Adaptive Communication for Cooperative Perception

TL;DR

This paper presents Reason-to-Transmit (R2T), a transformer-based framework that enables autonomous agents to make context-aware, bandwidth-efficient communication decisions for cooperative perception, significantly improving performance under challenging conditions.

Contribution

R2T introduces a novel reasoning-based communication policy that considers scene context and bandwidth constraints, advancing beyond reactive methods in cooperative perception.

Findings

R2T achieves near-oracle performance under high occlusion scenarios.

All methods degrade gracefully under 50% packet loss, demonstrating robustness.

Communication improves perception accuracy by approximately 58% AP over no communication.

Abstract

Cooperative perception among autonomous agents overcomes the limitations of single-agent sensing, but bandwidth constraints in vehicle-to-everything (V2X) networks require efficient communication policies. Existing approaches rely on reactive mechanisms, such as confidence maps, learned gating, or sparse masks, to decide what to transmit, without reasoning about why a message benefits the receiver. We introduce Reason-to-Transmit (R2T), a framework that equips each agent with a lightweight transformer-based module that reasons over local scene context, estimated neighbor information gaps, and bandwidth budget to make per-region transmission decisions. Trained end-to-end with a bandwidth-aware objective, R2T is evaluated against nine baselines in a multi-agent bird's-eye-view perception environment. Any communication improves performance by about 58% AP over no communication. At low bandwidth, all selective methods perform similarly, but R2T shows clear gains under high occlusion, where information asymmetry is greatest, approaching oracle performance. All methods degrade gracefully under packet drops up to 50%, showing robustness to communication failures. These results indicate that while fusion design dominates performance, deliberative communication provides additional gains in challenging scenarios. R2T introduces a reasoning-based approach to communication, enabling more efficient and context-aware information sharing in cooperative perception.