Enhancing non-Rigid 3D Model Deformations Using Mesh-based Gaussian Splatting

TL;DR

This paper introduces a new framework that combines mesh representations with Gaussian splatting to improve non-rigid 3D model deformations, enabling more intuitive editing and complex shape changes.

Contribution

It embeds Gaussian kernels onto mesh surfaces, allowing for enhanced editing capabilities and supporting large-scale, non-rigid deformations in 3D models.

Findings

Supports intuitive editing operations like moving, scaling, and rotating parts.

Enables complex deformations such as bending and stretching.

Facilitates real-time rendering with improved deformation support.

Abstract

We propose a novel framework that enhances non-rigid 3D model deformations by bridging mesh representations with 3D Gaussian splatting. While traditional Gaussian splatting delivers fast, real-time radiance-field rendering, its post-editing capabilities and support for large-scale, non-rigid deformations remain limited. Our method addresses these challenges by embedding Gaussian kernels directly onto explicit mesh surfaces. This allows the mesh's inherent topological and geometric priors to guide intuitive editing operations -- such as moving, scaling, and rotating individual 3D components -- and enables complex deformations like bending and stretching. This work paves the way for more flexible 3D content-creation workflows in applications spanning virtual reality, character animation, and interactive design.