Editing Motion Graphics Video via Motion Vectorization and Transformation

TL;DR

This paper introduces a novel pipeline that converts motion graphics videos into editable SVG motion programs, enabling easier editing and creative variations through a transformation API.

Contribution

The work presents a new motion vectorization method and transformation API for editing motion graphics videos at a higher structural level.

Findings

Successfully converts videos into SVG programs

Enables retiming and appearance modifications

Supports creative effects like motion textures

Abstract

Motion graphics videos are widely used in Web design, digital advertising, animated logos and film title sequences, to capture a viewer's attention. But editing such video is challenging because the video provides a low-level sequence of pixels and frames rather than higher-level structure such as the objects in the video with their corresponding motions and occlusions. We present a motion vectorization pipeline for converting motion graphics video into an SVG motion program that provides such structure. The resulting SVG program can be rendered using any SVG renderer(e.g. most Web browsers) and edited using any SVG editor. We also introduce a program transformation API that facilitates editing of a SVG motion program to create variations that adjust the timing, motions and/or appearances of objects. We show how the API can be used to create a variety of effects including retiming object motion to match a music beat, adding motion textures to objects, and collision preserving appearance changes.