HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixels

TL;DR

HunyuanWorld 1.0 introduces a novel framework that generates immersive, explorable 3D worlds from text and images by combining panoramic proxies with layered mesh representations, enabling high-quality, interactive virtual environments.

Contribution

It presents a semantically layered 3D mesh approach using panoramic images, achieving state-of-the-art 3D world generation from textual and visual inputs.

Findings

Achieves state-of-the-art results in 3D world coherence and interactivity.

Supports seamless mesh export for graphics pipelines.

Enables diverse applications in VR, gaming, and content creation.

Abstract

Creating immersive and playable 3D worlds from texts or images remains a fundamental challenge in computer vision and graphics. Existing world generation approaches typically fall into two categories: video-based methods that offer rich diversity but lack 3D consistency and rendering efficiency, and 3D-based methods that provide geometric consistency but struggle with limited training data and memory-inefficient representations. To address these limitations, we present HunyuanWorld 1.0, a novel framework that combines the best of both worlds for generating immersive, explorable, and interactive 3D scenes from text and image conditions. Our approach features three key advantages: 1) 360{\deg} immersive experiences via panoramic world proxies; 2) mesh export capabilities for seamless compatibility with existing computer graphics pipelines; 3) disentangled object representations for augmented interactivity. The core of our framework is a semantically layered 3D mesh representation that leverages panoramic images as 360{\deg} world proxies for semantic-aware world decomposition and reconstruction, enabling the generation of diverse 3D worlds. Extensive experiments demonstrate that our method achieves state-of-the-art performance in generating coherent, explorable, and interactive 3D worlds while enabling versatile applications in virtual reality, physical simulation, game development, and interactive content creation.