FlashVideo: Flowing Fidelity to Detail for Efficient High-Resolution Video Generation

TL;DR

FlashVideo introduces a two-stage framework for high-resolution video generation that balances fidelity and efficiency, enabling detailed outputs with reduced computational costs and faster preview capabilities.

Contribution

A novel two-stage approach that strategically allocates resources to improve high-resolution video quality and computational efficiency in text-to-video generation.

Findings

Achieves state-of-the-art high-resolution video quality

Reduces computational costs significantly

Enables prompt preview and adjustment before full-resolution generation

Abstract

DiT models have achieved great success in text-to-video generation, leveraging their scalability in model capacity and data scale. High content and motion fidelity aligned with text prompts, however, often require large model parameters and a substantial number of function evaluations (NFEs). Realistic and visually appealing details are typically reflected in high-resolution outputs, further amplifying computational demands-especially for single-stage DiT models. To address these challenges, we propose a novel two-stage framework, FlashVideo, which strategically allocates model capacity and NFEs across stages to balance generation fidelity and quality. In the first stage, prompt fidelity is prioritized through a low-resolution generation process utilizing large parameters and sufficient NFEs to enhance computational efficiency. The second stage achieves a nearly straight ODE trajectory between low and high resolutions via flow matching, effectively generating fine details and fixing artifacts with minimal NFEs. To ensure a seamless connection between the two independently trained stages during inference, we carefully design degradation strategies during the second-stage training. Quantitative and visual results demonstrate that FlashVideo achieves state-of-the-art high-resolution video generation with superior computational efficiency. Additionally, the two-stage design enables users to preview the initial output and accordingly adjust the prompt before committing to full-resolution generation, thereby significantly reducing computational costs and wait times as well as enhancing commercial viability.