Overcoming Obstructions via Bandwidth-Limited Multi-Agent Spatial Handshaking
Nathaniel Glaser, Yen-Cheng Liu, Junjiao Tian, Zsolt Kira

TL;DR
This paper introduces MASH, a learnable multi-agent network that enables bandwidth-efficient, obstruction-resilient collaborative perception in robotic swarms by processing raw images directly for improved semantic segmentation.
Contribution
The paper presents MASH, a novel end-to-end learnable network for multi-agent perception that operates on raw images without extra pose or depth data, improving performance under occlusions.
Findings
Achieves 11% IoU improvement over baselines.
Effective in bandwidth-limited, obstruction-prone environments.
Operates solely on raw image data without additional inputs.
Abstract
In this paper, we address bandwidth-limited and obstruction-prone collaborative perception, specifically in the context of multi-agent semantic segmentation. This setting presents several key challenges, including processing and exchanging unregistered robotic swarm imagery. To be successful, solutions must effectively leverage multiple non-static and intermittently-overlapping RGB perspectives, while heeding bandwidth constraints and overcoming unwanted foreground obstructions. As such, we propose an end-to-end learn-able Multi-Agent Spatial Handshaking network (MASH) to process, compress, and propagate visual information across a robotic swarm. Our distributed communication module operates directly (and exclusively) on raw image data, without additional input requirements such as pose, depth, or warping data. We demonstrate superior performance of our model compared against several…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Image and Video Retrieval Techniques · Advanced Neural Network Applications · Robotics and Sensor-Based Localization
