Make-A-Character: High Quality Text-to-3D Character Generation within Minutes

TL;DR

Make-A-Character is a user-friendly framework that rapidly generates realistic 3D characters from text descriptions within minutes, combining large language and vision models with human-centered visual modules.

Contribution

The paper introduces a novel, efficient system for text-to-3D character creation that significantly reduces production time and enhances controllability compared to traditional methods.

Findings

Creates lifelike 3D avatars from text in about 2 minutes

Integrates large language and vision models for understanding and generation

Enables easy customization and integration into existing CG pipelines

Abstract

There is a growing demand for customized and expressive 3D characters with the emergence of AI agents and Metaverse, but creating 3D characters using traditional computer graphics tools is a complex and time-consuming task. To address these challenges, we propose a user-friendly framework named Make-A-Character (Mach) to create lifelike 3D avatars from text descriptions. The framework leverages the power of large language and vision models for textual intention understanding and intermediate image generation, followed by a series of human-oriented visual perception and 3D generation modules. Our system offers an intuitive approach for users to craft controllable, realistic, fully-realized 3D characters that meet their expectations within 2 minutes, while also enabling easy integration with existing CG pipeline for dynamic expressiveness. For more information, please visit the project page at https://human3daigc.github.io/MACH/.