VIRGi: View-dependent Instant Recoloring of 3D Gaussians Splats
Alessio Mazzucchelli, Ivan Ojeda-Martin, Fernando Rivas-Manzaneque, Elena Garces, Adrian Penate-Sanchez, Francesc Moreno-Noguer

TL;DR
VIRGi introduces a fast, view-dependent scene recoloring method for 3D Gaussian Splatting that enables real-time editing by separating diffuse and specular components and using multi-view training.
Contribution
The paper presents a novel architecture and training strategy for rapid, view-dependent recoloring of 3D scenes modeled by Gaussian Splatting, with minimal user input.
Findings
Enables scene recoloring in just two seconds.
Preserves view-dependent effects like specular highlights.
Outperforms Neural Radiance Field-based methods in quality.
Abstract
3D Gaussian Splatting (3DGS) has recently transformed the fields of novel view synthesis and 3D reconstruction due to its ability to accurately model complex 3D scenes and its unprecedented rendering performance. However, a significant challenge persists: the absence of an efficient and photorealistic method for editing the appearance of the scene's content. In this paper we introduce VIRGi, a novel approach for rapidly editing the color of scenes modeled by 3DGS while preserving view-dependent effects such as specular highlights. Key to our method are a novel architecture that separates color into diffuse and view-dependent components, and a multi-view training strategy that integrates image patches from multiple viewpoints. Improving over the conventional single-view batch training, our 3DGS representation provides more accurate reconstruction and serves as a solid representation for…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsComputer Graphics and Visualization Techniques · Image Enhancement Techniques · Generative Adversarial Networks and Image Synthesis
