GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representation

TL;DR

GenUDC introduces a novel 3D mesh generation framework using Unsigned Dual Contouring, enabling high-quality, complex, and detailed meshes through a two-stage coarse-to-fine process, outperforming existing methods.

Contribution

The paper presents the first application of Unsigned Dual Contouring for 3D mesh generation, addressing ambiguity issues and improving detail and complexity in generated meshes.

Findings

UDC effectively captures complex mesh structures.

GenUDC outperforms existing methods in quality and detail.

Two-stage generation improves mesh accuracy.

Abstract

Generating high-quality meshes with complex structures and realistic surfaces is the primary goal of 3D generative models. Existing methods typically employ sequence data or deformable tetrahedral grids for mesh generation. However, sequence-based methods have difficulty producing complex structures with many faces due to memory limits. The deformable tetrahedral grid-based method MeshDiffusion fails to recover realistic surfaces due to the inherent ambiguity in deformable grids. We propose the GenUDC framework to address these challenges by leveraging the Unsigned Dual Contouring (UDC) as the mesh representation. UDC discretizes a mesh in a regular grid and divides it into the face and vertex parts, recovering both complex structures and fine details. As a result, the one-to-one mapping between UDC and mesh resolves the ambiguity problem. In addition, GenUDC adopts a two-stage, coarse-to-fine generative process for 3D mesh generation. It first generates the face part as a rough shape and then the vertex part to craft a detailed shape. Extensive evaluations demonstrate the superiority of UDC as a mesh representation and the favorable performance of GenUDC in mesh generation. The code and trained models are available at https://github.com/TrepangCat/GenUDC.