ClipGS: Clippable Gaussian Splatting for Interactive Cinematic Visualization of Volumetric Medical Data

TL;DR

ClipGS is a novel Gaussian splatting framework enabling interactive cinematic visualization of volumetric medical data with high quality and efficiency, supporting dynamic interactions and clipping planes.

Contribution

The paper introduces ClipGS, a new Gaussian splatting method with a learnable truncation scheme and adaptive deformation adjustment for real-time medical data visualization.

Findings

Achieved 36.635 PSNR rendering quality

Reached 156 FPS rendering speed

Reduced model size to 16.1 MB

Abstract

The visualization of volumetric medical data is crucial for enhancing diagnostic accuracy and improving surgical planning and education. Cinematic rendering techniques significantly enrich this process by providing high-quality visualizations that convey intricate anatomical details, thereby facilitating better understanding and decision-making in medical contexts. However, the high computing cost and low rendering speed limit the requirement of interactive visualization in practical applications. In this paper, we introduce ClipGS, an innovative Gaussian splatting framework with the clipping plane supported, for interactive cinematic visualization of volumetric medical data. To address the challenges posed by dynamic interactions, we propose a learnable truncation scheme that automatically adjusts the visibility of Gaussian primitives in response to the clipping plane. Besides, we also design an adaptive adjustment model to dynamically adjust the deformation of Gaussians and refine the rendering performance. We validate our method on five volumetric medical data (including CT and anatomical slice data), and reach an average 36.635 PSNR rendering quality with 156 FPS and 16.1 MB model size, outperforming state-of-the-art methods in rendering quality and efficiency.