PromptVFX: Text-Driven Fields for Open-World 3D Gaussian Animation
Mert Kiray, Paul Uhlenbruck, Nassir Navab, Benjamin Busam

TL;DR
PromptVFX introduces a real-time, text-driven framework for 3D Gaussian animation that simplifies VFX creation by leveraging language models, eliminating complex manual processes, and enabling instant updates in volumetric scenes.
Contribution
The paper presents a novel, fast, and accessible method for text-driven 3D animation using large language and vision-language models, bypassing traditional complex workflows.
Findings
Real-time text-driven 3D VFX generation demonstrated.
Reduces manual effort in volumetric scene animation.
Accessible to both novices and experts on consumer devices.
Abstract
Visual effects (VFX) are key to immersion in modern films, games, and AR/VR. Creating 3D effects requires specialized expertise and training in 3D animation software and can be time consuming. Generative solutions typically rely on computationally intense methods such as diffusion models which can be slow at 4D inference. We reformulate 3D animation as a field prediction task and introduce a text-driven framework that infers a time-varying 4D flow field acting on 3D Gaussians. By leveraging large language models (LLMs) and vision-language models (VLMs) for function generation, our approach interprets arbitrary prompts (e.g., "make the vase glow orange, then explode") and instantly updates color, opacity, and positions of 3D Gaussians in real time. This design avoids overheads such as mesh extraction, manual or physics-based simulations and allows both novice and expert users to animate…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman Motion and Animation · Computer Graphics and Visualization Techniques · Image Processing and 3D Reconstruction
MethodsNormalizing Flows · Invertible 1x1 Convolution · Affine Coupling · Diffusion · Activation Normalization · GLOW
