Gbake: Baking 3D Gaussian Splats into Reflection Probes

TL;DR

Gbake is a tool that integrates reflection probes into 3D Gaussian splatting scenes, enabling realistic reflections on meshes within Unity by baking lighting information from splatted environments.

Contribution

It introduces a novel baking method for reflection probes in Gaussian-splatted scenes, improving realism when combining splats with traditional meshes.

Findings

Enables realistic reflection mapping in Gaussian-splatted scenes

Improves visual consistency of meshes in splatted environments

Integrates with Unity for practical use

Abstract

The growing popularity of 3D Gaussian Splatting has created the need to integrate traditional computer graphics techniques and assets in splatted environments. Since 3D Gaussian primitives encode lighting and geometry jointly as appearance, meshes are relit improperly when inserted directly in a mixture of 3D Gaussians and thus appear noticeably out of place. We introduce GBake, a specialized tool for baking reflection probes from Gaussian-splatted scenes that enables realistic reflection mapping of traditional 3D meshes in the Unity game engine.