SwiftTailor: Efficient 3D Garment Generation with Geometry Image Representation

TL;DR

SwiftTailor introduces a fast, scalable framework for 3D garment generation using a geometry image representation, combining sewing-pattern reasoning and mesh synthesis to achieve high accuracy with reduced inference time.

Contribution

The paper presents SwiftTailor, a novel two-stage framework that unifies pattern prediction and mesh synthesis via a compact geometry image, significantly improving efficiency over existing methods.

Findings

Achieves state-of-the-art accuracy and visual fidelity.

Reduces inference time from minutes to seconds.

Provides a scalable and interpretable 3D garment generation approach.

Abstract

Realistic and efficient 3D garment generation remains a longstanding challenge in computer vision and digital fashion. Existing methods typically rely on large vision- language models to produce serialized representations of 2D sewing patterns, which are then transformed into simulation-ready 3D meshes using garment modeling framework such as GarmentCode. Although these approaches yield high-quality results, they often suffer from slow inference times, ranging from 30 seconds to a minute. In this work, we introduce SwiftTailor, a novel two-stage framework that unifies sewing-pattern reasoning and geometry-based mesh synthesis through a compact geometry image representation. SwiftTailor comprises two lightweight modules: PatternMaker, an efficient vision-language model that predicts sewing patterns from diverse input modalities, and GarmentSewer, an efficient dense prediction transformer that converts these patterns into a novel Garment Geometry Image, encoding the 3D surface of all garment panels in a unified UV space. The final 3D mesh is reconstructed through an efficient inverse mapping process that incorporates remeshing and dynamic stitching algorithms to directly assemble the garment, thereby amortizing the cost of physical simulation. Extensive experiments on the Multimodal GarmentCodeData demonstrate that SwiftTailor achieves state-of-the-art accuracy and visual fidelity while significantly reducing inference time. This work offers a scalable, interpretable, and high-performance solution for next-generation 3D garment generation.