LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratory

TL;DR

LabBuilder is an end-to-end system that generates and verifies safe, functional 3D laboratory environments from textual specifications, addressing safety and semantic constraints for scientific labs.

Contribution

It introduces a novel pipeline combining dataset curation, constraint-aware layout synthesis, and a benchmark for safe laboratory environment generation.

Findings

Outperforms existing methods in realism and safety of generated labs.

Produces functionally valid laboratory layouts suitable for complex workflows.

Demonstrates effectiveness through extensive experiments.

Abstract

Automated laboratories hold the promise of accelerating scientific discovery, yet their deployment is bottlenecked by the difficulty of designing safe and executable environments. While simulator-based design offers scalability, existing 3D scene generation methods are primarily tailored for household settings, optimizing for visual plausibility while neglecting the rigorous functional semantics and safety constraints essential for scientific experimentation. We present LabBuilder, an end-to-end system that generates and verifies 3D laboratory layouts from concise textual specifications. It operates through three tightly coupled components: LabForge first curates a meta-dataset of annotated assets and chemical knowledge, translating natural language specifications into structured protocols; building on these protocols, LabGen synthesizes laboratory layouts via an iterative, constraint-aware optimization strategy; finally, LabTouchstone evaluates the resulting layouts as a unified benchmark. Extensive experiments demonstrate that LabBuilder significantly outperforms existing state-of-the-art methods, producing laboratory environments that are not only realistic but also functionally valid and safe for complex experimental workflows.