Towards 3D Visualization of Video from Frames

TL;DR

This paper presents a theoretical method for reconstructing 3D scenes from video frames by extracting and matching features, using vanishing points for 3D positioning, and demonstrates initial feasibility through experiments.

Contribution

It introduces a novel approach to 3D visualization of videos from frames, including feature extraction, matching, and vanishing point utilization for 3D reconstruction.

Findings

Initial experiments demonstrate feasibility.

Method successfully reconstructs 3D structure from video frames.

Publicly available results support the approach.

Abstract

We explain theoretically how to reconstruct the 3D scene from successive frames in order to see the video in 3D. To do this, features, associated to moving rigid objects in 3D, are extracted in frames and matched. The vanishing point computed in frame corresponding to the direction of moving object is used for 3D positioning of the 3D structure of the moving object. First experiments are conducted and the obtained results are shown and publicly available. They demonstrate the feasibility of our method. We conclude this paper by future works in order to improve this method tacking into account non-rigid objects and the case of moving camera.