DiffuseSlide: Training-Free High Frame Rate Video Generation Diffusion

TL;DR

DiffuseSlide is a training-free method that enhances high frame rate video generation by leveraging pre-trained diffusion models, achieving smooth, high-quality videos with improved temporal coherence without additional training.

Contribution

It introduces a novel pipeline using key frames and noise re-injection techniques for high FPS video generation without fine-tuning pre-trained models.

Findings

Significantly improves video quality and temporal coherence.

Achieves high FPS video generation efficiently without training.

Enhances spatial fidelity in generated videos.

Abstract

Recent advancements in diffusion models have revolutionized video generation, enabling the creation of high-quality, temporally consistent videos. However, generating high frame-rate (FPS) videos remains a significant challenge due to issues such as flickering and degradation in long sequences, particularly in fast-motion scenarios. Existing methods often suffer from computational inefficiencies and limitations in maintaining video quality over extended frames. In this paper, we present a novel, training-free approach for high FPS video generation using pre-trained diffusion models. Our method, DiffuseSlide, introduces a new pipeline that leverages key frames from low FPS videos and applies innovative techniques, including noise re-injection and sliding window latent denoising, to achieve smooth, consistent video outputs without the need for additional fine-tuning. Through extensive experiments, we demonstrate that our approach significantly improves video quality, offering enhanced temporal coherence and spatial fidelity. The proposed method is not only computationally efficient but also adaptable to various video generation tasks, making it ideal for applications such as virtual reality, video games, and high-quality content creation.