Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenes
Jianqi Chen, Panwen Hu, Xiaojun Chang, Zhenwei Shi, Michael, Kampffmeyer, Xiaodan Liang

TL;DR
Sitcom-Crafter is a versatile system that generates diverse, plot-guided 3D human motions, including interactions and locomotion, by integrating novel collision avoidance and augmentation modules to improve realism and workflow efficiency.
Contribution
The paper introduces a comprehensive, extendable system with a novel scene-aware human interaction module using implicit SDFs for collision avoidance, enhancing 3D human motion synthesis.
Findings
Generates high-quality, diverse, and realistic motions
Effectively minimizes human-scene collisions
Enhances creative workflows for designers
Abstract
Recent advancements in human motion synthesis have focused on specific types of motions, such as human-scene interaction, locomotion or human-human interaction, however, there is a lack of a unified system capable of generating a diverse combination of motion types. In response, we introduce Sitcom-Crafter, a comprehensive and extendable system for human motion generation in 3D space, which can be guided by extensive plot contexts to enhance workflow efficiency for anime and game designers. The system is comprised of eight modules, three of which are dedicated to motion generation, while the remaining five are augmentation modules that ensure consistent fusion of motion sequences and system functionality. Central to the generation modules is our novel 3D scene-aware human-human interaction module, which addresses collision issues by synthesizing implicit 3D Signed Distance Function…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsHuman Motion and Animation · Human Pose and Action Recognition · 3D Shape Modeling and Analysis
