SketchRodGS: Sketch-based Extraction of Slender Geometries for Animating Gaussian Splatting Scenes

TL;DR

This paper introduces SketchRodGS, a method that extracts polyline representations of slender geometries from Gaussian splatting scenes using user sketches and dynamic programming, enabling physics simulation of elastic objects.

Contribution

It presents a novel approach to derive connected polyline geometries from Gaussian splatting without inherent connectivity information, leveraging screen-space shortest path analysis.

Findings

Successfully extracts slender geometries from Gaussian splatting scenes.

Robustly constructs polyline meshes using user sketches and dynamic programming.

Effective in various real-world examples.

Abstract

Physics simulation of slender elastic objects often requires discretization as a polyline. However, constructing a polyline from Gaussian splatting is challenging as Gaussian splatting lacks connectivity information and the configuration of Gaussian primitives contains much noise. This paper presents a method to extract a polyline representation of the slender part of the objects in a Gaussian splatting scene from the user's sketching input. Our method robustly constructs a polyline mesh that represents the slender parts using the screen-space shortest path analysis that can be efficiently solved using dynamic programming. We demonstrate the effectiveness of our approach in several in-the-wild examples.