Joint Stabilization and Direction of 360\deg Videos
Chengzhou Tang, Oliver Wang, Feng Liu, Ping Tan

TL;DR
This paper introduces a method for jointly stabilizing and directing 360-degree videos to enhance viewer experience by emphasizing important content at the front while maintaining smooth motion.
Contribution
It proposes a novel joint optimization approach for stabilization and direction, including a new motion estimation technique tailored for 360-degree videos and a spherical warping parametrization.
Findings
Outperforms standard 5-point algorithm in motion estimation for wide-angle videos.
Effectively directs viewer attention to important content in 360 videos.
Produces smooth camera motion while emphasizing key regions.
Abstract
360{\deg} video provides an immersive experience for viewers, allowing them to freely explore the world by turning their head. However, creating high-quality 360{\deg} video content can be challenging, as viewers may miss important events by looking in the wrong direction, or they may see things that ruin the immersion, such as stitching artifacts and the film crew. We take advantage of the fact that not all directions are equally likely to be observed; most viewers are more likely to see content located at ``true north'', i.e. in front of them, due to ergonomic constraints. We therefore propose 360{\deg} video direction, where the video is jointly optimized to orient important events to the front of the viewer and visual clutter behind them, while producing smooth camera motion. Unlike traditional video, viewers can still explore the space as desired, but with the knowledge that the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage and Video Stabilization · Advanced Optical Imaging Technologies · Advanced Vision and Imaging
