VideoDiff: Human-AI Video Co-Creation with Alternatives

TL;DR

VideoDiff is an AI-powered video editing tool that helps creators generate, compare, and refine multiple editing alternatives efficiently, simplifying the decision-making process in video production.

Contribution

It introduces a novel AI tool that enables easy comparison and customization of multiple video editing suggestions, enhancing user control and satisfaction.

Findings

Participants easily compared and customized alternatives

VideoDiff improved editing efficiency and satisfaction

The tool effectively highlights differences between video options

Abstract

To make an engaging video, people sequence interesting moments and add visuals such as B-rolls or text. While video editing requires time and effort, AI has recently shown strong potential to make editing easier through suggestions and automation. A key strength of generative models is their ability to quickly generate multiple variations, but when provided with many alternatives, creators struggle to compare them to find the best fit. We propose VideoDiff, an AI video editing tool designed for editing with alternatives. With VideoDiff, creators can generate and review multiple AI recommendations for each editing process: creating a rough cut, inserting B-rolls, and adding text effects. VideoDiff simplifies comparisons by aligning videos and highlighting differences through timelines, transcripts, and video previews. Creators have the flexibility to regenerate and refine AI suggestions as they compare alternatives. Our study participants (N=12) could easily compare and customize alternatives, creating more satisfying results.