3DGS-IEval-15K: A Large-scale Image Quality Evaluation Database for 3D Gaussian-Splatting

TL;DR

This paper introduces 3DGS-IEval-15K, a large-scale dataset for evaluating image quality of compressed 3D Gaussian Splatting representations, enabling better assessment of perceptual effects and guiding future compression methods.

Contribution

It provides the first comprehensive IQA dataset for 3D Gaussian Splatting, including diverse scenes, viewpoints, and compression levels, along with benchmark evaluations and human perception data.

Findings

Validated dataset quality through scene diversity and MOS distribution.

Established a benchmark with 30 IQA metrics for 3DGS.

Facilitated development of 3DGS-specific IQA metrics.

Abstract

3D Gaussian Splatting (3DGS) has emerged as a promising approach for novel view synthesis, offering real-time rendering with high visual fidelity. However, its substantial storage requirements present significant challenges for practical applications. While recent state-of-the-art (SOTA) 3DGS methods increasingly incorporate dedicated compression modules, there is a lack of a comprehensive framework to evaluate their perceptual impact. Therefore we present 3DGS-IEval-15K, the first large-scale image quality assessment (IQA) dataset specifically designed for compressed 3DGS representations. Our dataset encompasses 15,200 images rendered from 10 real-world scenes through 6 representative 3DGS algorithms at 20 strategically selected viewpoints, with different compression levels leading to various distortion effects. Through controlled subjective experiments, we collect human perception data from 60 viewers. We validate dataset quality through scene diversity and MOS distribution analysis, and establish a comprehensive benchmark with 30 representative IQA metrics covering diverse types. As the largest-scale 3DGS quality assessment dataset to date, our work provides a foundation for developing 3DGS specialized IQA metrics, and offers essential data for investigating view-dependent quality distribution patterns unique to 3DGS. The database is publicly available at https://github.com/YukeXing/3DGS-IEval-15K.