FruitNinja: 3D Object Interior Texture Generation with Gaussian Splatting

TL;DR

FruitNinja introduces a novel 3D object texture generation method that creates realistic internal textures for sliced objects using Gaussian Splatting and diffusion models, enabling real-time visualization of internal structures.

Contribution

It is the first method to generate internal textures for 3D objects with geometric and topological changes, combining Gaussian Splatting with diffusion-based inpainting.

Findings

Outperforms existing methods in visual quality

Enables real-time internal texture rendering

Supports arbitrary geometry manipulations

Abstract

In the real world, objects reveal internal textures when sliced or cut, yet this behavior is not well-studied in 3D generation tasks today. For example, slicing a virtual 3D watermelon should reveal flesh and seeds. Given that no available dataset captures an object's full internal structure and collecting data from all slices is impractical, generative methods become the obvious approach. However, current 3D generation and inpainting methods often focus on visible appearance and overlook internal textures. To bridge this gap, we introduce FruitNinja, the first method to generate internal textures for 3D objects undergoing geometric and topological changes. Our approach produces objects via 3D Gaussian Splatting (3DGS) with both surface and interior textures synthesized, enabling real-time slicing and rendering without additional optimization. FruitNinja leverages a pre-trained diffusion model to progressively inpaint cross-sectional views and applies voxel-grid-based smoothing to achieve cohesive textures throughout the object. Our OpaqueAtom GS strategy overcomes 3DGS limitations by employing densely distributed opaque Gaussians, avoiding biases toward larger particles that destabilize training and sharp color transitions for fine-grained textures. Experimental results show that FruitNinja substantially outperforms existing approaches, showcasing unmatched visual quality in real-time rendered internal views across arbitrary geometry manipulations.