CineVision: An Interactive Pre-visualization Storyboard System for Director-Cinematographer Collaboration

TL;DR

CineVision is an AI-powered interactive platform that enhances communication and efficiency in film pre-visualization by integrating scriptwriting, real-time visual adjustments, and style emulation, thereby improving collaboration between directors and cinematographers.

Contribution

This paper introduces CineVision, a novel AI-driven system that combines script integration with real-time visual pre-visualization to improve filmmaking collaboration and streamline pre-production workflows.

Findings

CineVision reduced task completion times in user studies.

Participants rated CineVision higher in usability.

The system facilitated faster iteration on scene composition.

Abstract

Effective communication between directors and cinematographers is fundamental in film production, yet traditional approaches relying on visual references and hand-drawn storyboards often lack the efficiency and precision necessary during pre-production. We present CineVision, an AI-driven platform that integrates scriptwriting with real-time visual pre-visualization to bridge this communication gap. By offering dynamic lighting control, style emulation based on renowned filmmakers, and customizable character design, CineVision enables directors to convey their creative vision with heightened clarity and rapidly iterate on scene composition. In a 24-participant lab study, CineVision yielded shorter task times and higher usability ratings than two baseline methods, suggesting a potential to ease early-stage communication and accelerate storyboard drafts under controlled conditions. These findings underscore CineVision's potential to streamline pre-production processes and foster deeper creative synergy among filmmaking teams, particularly for new collaborators. Our code and demo are available at https://github.com/TonyHongtaoWu/CineVision.