OpenKinoAI: An Open Source Framework for Intelligent Cinematography and Editing of Live Performances

TL;DR

OpenKinoAI is an open source framework that enables advanced post-production editing, reframing, and annotation of ultra high definition live performance videos, emulating professional multiclip editing techniques.

Contribution

It introduces a comprehensive open source toolset for multiclip editing, performer recognition, and video reframing tailored for single camera recordings of live performances.

Findings

Supports uploading and processing raw footage remotely

Provides automated performer detection and tracking

Enables versatile editing and annotation of videos

Abstract

OpenKinoAI is an open source framework for post-production of ultra high definition video which makes it possible to emulate professional multiclip editing techniques for the case of single camera recordings. OpenKinoAI includes tools for uploading raw video footage of live performances on a remote web server, detecting, tracking and recognizing the performers in the original material, reframing the raw video into a large choice of cinematographic rushes, editing the rushes into movies, and annotating rushes and movies for documentation purposes. OpenKinoAI is made available to promote research in multiclip video editing of ultra high definition video, and to allow performing artists and companies to use this research for archiving, documenting and sharing their work online in an innovative fashion.