UniFusion: Unified Multi-view Fusion Transformer for Spatial-Temporal Representation in Bird's-Eye-View
Zequn Qin, Jingyu Chen, Chao Chen, Xiaozhi Chen, Xi Li

TL;DR
This paper introduces UniFusion, a unified spatial-temporal fusion transformer for bird's-eye-view perception in autonomous driving, enabling long-range, adaptive, and more comprehensive feature integration.
Contribution
It proposes a novel unified mathematical formulation for spatial and temporal fusion in BEV, supporting long-range and adaptive fusion, and achieves state-of-the-art results.
Findings
Supports long-range fusion in BEV perception
Temporal fusion weights are learnable and adaptive
Achieves state-of-the-art performance on NuScenes dataset
Abstract
Bird's eye view (BEV) representation is a new perception formulation for autonomous driving, which is based on spatial fusion. Further, temporal fusion is also introduced in BEV representation and gains great success. In this work, we propose a new method that unifies both spatial and temporal fusion and merges them into a unified mathematical formulation. The unified fusion could not only provide a new perspective on BEV fusion but also brings new capabilities. With the proposed unified spatial-temporal fusion, our method could support long-range fusion, which is hard to achieve in conventional BEV methods. Moreover, the BEV fusion in our work is temporal-adaptive and the weights of temporal fusion are learnable. In contrast, conventional methods mainly use fixed and equal weights for temporal fusion. Besides, the proposed unified fusion could avoid information lost in conventional BEV…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Vision and Imaging · Robotics and Sensor-Based Localization · Advanced Image Fusion Techniques
