GT2-GS: Geometry-aware Texture Transfer for Gaussian Splatting

TL;DR

GT2-GS introduces a geometry-aware framework for 3D texture transfer onto Gaussian splatting scenes, improving view consistency and geometric preservation by leveraging scene geometry and adaptive control.

Contribution

The paper presents a novel geometry-aware texture transfer loss, an adaptive control module, and a geometry preservation branch, advancing 3D texture transfer quality and controllability.

Findings

Enhanced view-consistent texture transfer results

Improved geometric fidelity in transferred textures

Demonstrated effectiveness through extensive experiments

Abstract

Transferring 2D textures onto complex 3D scenes plays a vital role in enhancing the efficiency and controllability of 3D multimedia content creation. However, existing 3D style transfer methods primarily focus on transferring abstract artistic styles to 3D scenes. These methods often overlook the geometric information of the scene, which makes it challenging to achieve high-quality 3D texture transfer results. In this paper, we present GT2-GS, a geometry-aware texture transfer framework for gaussian splatting. First, we propose a geometry-aware texture transfer loss that enables view-consistent texture transfer by leveraging prior view-dependent feature information and texture features augmented with additional geometric parameters. Moreover, an adaptive fine-grained control module is proposed to address the degradation of scene information caused by low-granularity texture features. Finally, a geometry preservation branch is introduced. This branch refines the geometric parameters using additionally bound Gaussian color priors, thereby decoupling the optimization objectives of appearance and geometry. Extensive experiments demonstrate the effectiveness and controllability of our method. Through geometric awareness, our approach achieves texture transfer results that better align with human visual perception. Our homepage is available at https://vpx-ecnu.github.io/GT2-GS-website.