OUGS: Active View Selection via Object-aware Uncertainty Estimation in 3DGS

TL;DR

OUGS introduces an object-aware uncertainty estimation framework for 3D Gaussian Splatting, enabling more efficient and targeted view selection for high-fidelity object reconstruction within complex scenes.

Contribution

The paper proposes a physically-grounded, object-aware uncertainty model for 3DGS that improves view selection and reconstruction quality for specific objects.

Findings

Significantly improves reconstruction efficiency for targeted objects.

Achieves higher object fidelity compared to state-of-the-art methods.

Provides a robust uncertainty estimation for scene understanding.

Abstract

Recent advances in 3D Gaussian Splatting (3DGS) have achieved state-of-the-art results for novel view synthesis. However, efficiently capturing high-fidelity reconstructions of specific objects within complex scenes remains a significant challenge. A key limitation of existing active reconstruction methods is their reliance on scene-level uncertainty metrics, which are often biased by irrelevant background clutter and lead to inefficient view selection for object-centric tasks. We present OUGS, a novel framework that addresses this challenge with a more principled, physically-grounded uncertainty formulation for 3DGS. Our core innovation is to derive uncertainty directly from the explicit physical parameters of the 3D Gaussian primitives (e.g., position, scale, rotation). By propagating the covariance of these parameters through the rendering Jacobian, we establish a highly interpretable uncertainty model. This foundation allows us to then seamlessly integrate semantic segmentation masks to produce a targeted, object-aware uncertainty score that effectively disentangles the object from its environment. This allows for a more effective active view selection strategy that prioritizes views critical to improving object fidelity. Experimental evaluations on public datasets demonstrate that our approach significantly improves the efficiency of the 3DGS reconstruction process and achieves higher quality for targeted objects compared to existing state-of-the-art methods, while also serving as a robust uncertainty estimator for the global scene.