Textured Geometry Evaluation: Perceptual 3D Textured Shape Metric via 3D Latent-Geometry Network

TL;DR

This paper introduces Textured Geometry Evaluation (TGE), a new 3D shape fidelity metric that directly assesses textured meshes using geometry and color, outperforming existing rendering-based and geometry-only methods on real-world distorted data.

Contribution

The paper presents TGE, a novel 3D textured shape metric that evaluates fidelity directly on meshes without rendering, trained on a human-annotated real-world distortion dataset.

Findings

TGE outperforms existing metrics on real-world distortion data.

TGE effectively combines geometry and color information for fidelity assessment.

The method avoids limitations of rendering-based approaches.

Abstract

Textured high-fidelity 3D models are crucial for games, AR/VR, and film, but human-aligned evaluation methods still fall behind despite recent advances in 3D reconstruction and generation. Existing metrics, such as Chamfer Distance, often fail to align with how humans evaluate the fidelity of 3D shapes. Recent learning-based metrics attempt to improve this by relying on rendered images and 2D image quality metrics. However, these approaches face limitations due to incomplete structural coverage and sensitivity to viewpoint choices. Moreover, most methods are trained on synthetic distortions, which differ significantly from real-world distortions, resulting in a domain gap. To address these challenges, we propose a new fidelity evaluation method that is based directly on 3D meshes with texture, without relying on rendering. Our method, named Textured Geometry Evaluation TGE, jointly uses the geometry and color information to calculate the fidelity of the input textured mesh with comparison to a reference colored shape. To train and evaluate our metric, we design a human-annotated dataset with real-world distortions. Experiments show that TGE outperforms rendering-based and geometry-only methods on real-world distortion dataset.