CineFilter: Unsupervised Filtering for Real Time Autonomous Camera Systems
Sudheer Achary, K L Bhanu Moorthy, Syed Ashar Javed, Nikita Shravan,, Vineet Gandhi, Anoop Namboodiri

TL;DR
This paper introduces two real-time online filtering methods, CineConvex and CineCNN, inspired by cinematographic principles, to produce smooth camera trajectories for autonomous systems, outperforming previous approaches in speed and quality.
Contribution
The paper presents novel online filtering techniques, CineConvex and CineCNN, that mimic human camera behavior and operate at high speeds for real-time autonomous camera systems.
Findings
CineConvex and CineCNN outperform previous methods on quantitative metrics.
Both filters operate at high speeds suitable for real-time applications.
The methods produce smooth trajectories with minimal latency.
Abstract
Autonomous camera systems are often subjected to an optimization/filtering operation to smoothen and stabilize the rough trajectory estimates. Most common filtering techniques do reduce the irregularities in data; however, they fail to mimic the behavior of a human cameraman. Global filtering methods modeling human camera operators have been successful; however, they are limited to offline settings. In this paper, we propose two online filtering methods called Cinefilters, which produce smooth camera trajectories that are motivated by cinematographic principles. The first filter (CineConvex) uses a sliding window-based convex optimization formulation, and the second (CineCNN) is a CNN based encoder-decoder model. We evaluate the proposed filters in two different settings, namely a basketball dataset and a stage performance dataset. Our models outperform previous methods and baselines on…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVideo Surveillance and Tracking Methods · Advanced Vision and Imaging · Image and Video Stabilization
