Splatwizard: A Benchmark Toolkit for 3D Gaussian Splatting Compression

TL;DR

Splatwizard is a comprehensive benchmark toolkit designed to evaluate 3D Gaussian Splatting compression models across various metrics, facilitating standardized assessment and comparison of different methods in real-time view synthesis.

Contribution

It introduces a unified framework with automated metrics calculation for benchmarking 3DGS compression techniques, addressing the lack of specialized evaluation tools.

Findings

Provides a standardized evaluation framework for 3DGS compression methods.

Automates calculation of key performance metrics including quality, speed, and resource usage.

Facilitates fair comparison and development of new 3DGS compression algorithms.

Abstract

The recent advent of 3D Gaussian Splatting (3DGS) has marked a significant breakthrough in real-time novel view synthesis. However, the rapid proliferation of 3DGS-based algorithms has created a pressing need for standardized and comprehensive evaluation tools, especially for compression task. Existing benchmarks often lack the specific metrics necessary to holistically assess the unique characteristics of different methods, such as rendering speed, rate distortion trade-offs memory efficiency, and geometric accuracy. To address this gap, we introduce Splatwizard, a unified benchmark toolkit designed specifically for benchmarking 3DGS compression models. Splatwizard provides an easy-to-use framework to implement new 3DGS compression model and utilize state-of-the-art techniques proposed by previous work. Besides, an integrated pipeline that automates the calculation of key performance indicators, including image-based quality metrics, chamfer distance of reconstruct mesh, rendering frame rates, and computational resource consumption is included in the framework as well. Code is available at https://github.com/splatwizard/splatwizard