FullCircle: Effortless 3D Reconstruction from Casual 360$^\circ$ Captures

TL;DR

FullCircle presents a practical, robust pipeline for 3D scene reconstruction directly from casual 360-degree camera captures, eliminating the need for special protocols or pre-processing, and outperforming existing methods.

Contribution

It introduces a novel, easy-to-use reconstruction pipeline for raw 360-degree images that handles common errors and sets a new benchmark with a dedicated dataset.

Findings

Outperforms vanilla 3DGS for 360° cameras

Robust to human presence in images

Outperforms perspective baselines when simulating perspective from 360° data

Abstract

Radiance fields have emerged as powerful tools for 3D scene reconstruction. However, casual capture remains challenging due to the narrow field of view of perspective cameras, which limits viewpoint coverage and feature correspondences necessary for reliable camera calibration and reconstruction. While commercially available 360$^\circ$ cameras offer significantly broader coverage than perspective cameras for the same capture effort, existing 360$^\circ$ reconstruction methods require special capture protocols and pre-processing steps that undermine the promise of radiance fields: effortless workflows to capture and reconstruct 3D scenes. We propose a practical pipeline for reconstructing 3D scenes directly from raw 360$^\circ$ camera captures. We require no special capture protocols or pre-processing, and exhibit robustness to a prevalent source of reconstruction errors: the human operator that is visible in all 360$^\circ$ imagery. To facilitate evaluation, we introduce a multi-tiered dataset of scenes captured as raw dual-fisheye images, establishing a benchmark for robust casual 360$^\circ$ reconstruction. Our method significantly outperforms not only vanilla 3DGS for 360$^\circ$ cameras but also robust perspective baselines when perspective cameras are simulated from the same capture, demonstrating the advantages of 360$^\circ$ capture for casual reconstruction. Additional results are available at: https://theialab.github.io/fullcircle