GOATex: Geometry & Occlusion-Aware Texturing

TL;DR

GOATex is a novel 3D mesh texturing method that effectively handles occlusions and interior surfaces using a diffusion model, multi-view ray casting, and a layered blending approach, resulting in seamless high-quality textures.

Contribution

It introduces an occlusion-aware framework with hit levels and layered texturing, enabling detailed interior and exterior mesh texturing without fine-tuning the diffusion model.

Findings

Outperforms existing methods in texture quality and seamlessness.

Successfully textures both visible and occluded interior surfaces.

Operates without costly diffusion model fine-tuning.

Abstract

We present GOATex, a diffusion-based method for 3D mesh texturing that generates high-quality textures for both exterior and interior surfaces. While existing methods perform well on visible regions, they inherently lack mechanisms to handle occluded interiors, resulting in incomplete textures and visible seams. To address this, we introduce an occlusion-aware texturing framework based on the concept of hit levels, which quantify the relative depth of mesh faces via multi-view ray casting. This allows us to partition mesh faces into ordered visibility layers, from outermost to innermost. We then apply a two-stage visibility control strategy that progressively reveals interior regions with structural coherence, followed by texturing each layer using a pretrained diffusion model. To seamlessly merge textures obtained across layers, we propose a soft UV-space blending technique that weighs each texture's contribution based on view-dependent visibility confidence. Empirical results demonstrate that GOATex consistently outperforms existing methods, producing seamless, high-fidelity textures across both visible and occluded surfaces. Unlike prior works, GOATex operates entirely without costly fine-tuning of a pretrained diffusion model and allows separate prompting for exterior and interior mesh regions, enabling fine-grained control over layered appearances. For more qualitative results, please visit our project page: https://goatex3d.github.io/.