STREAMINGGS: Voxel-Based Streaming 3D Gaussian Splatting with Memory Optimization and Architectural Support

TL;DR

STREAMINGGS is a novel 3D Gaussian Splatting approach that combines algorithm and architecture co-design to enable real-time rendering on mobile devices by significantly reducing memory traffic and improving efficiency.

Contribution

It introduces a streaming 3DGS algorithm-architecture co-design that enhances speed and energy efficiency for mobile 3D rendering.

Findings

Achieves up to 45.7× speedup over mobile GPUs.

Realizes 62.9× energy savings.

Enables real-time 90 FPS rendering on resource-constrained devices.

Abstract

3D Gaussian Splatting (3DGS) has gained popularity for its efficiency and sparse Gaussian-based representation. However, 3DGS struggles to meet the real-time requirement of 90 frames per second (FPS) on resource-constrained mobile devices, achieving only 2 to 9 FPS.Existing accelerators focus on compute efficiency but overlook memory efficiency, leading to redundant DRAM traffic. We introduce STREAMINGGS, a fully streaming 3DGS algorithm-architecture co-design that achieves fine-grained pipelining and reduces DRAM traffic by transforming from a tile-centric rendering to a memory-centric rendering. Results show that our design achieves up to 45.7 $\times$ speedup and 62.9 $\times$ energy savings over mobile Ampere GPUs.