3D Skew Gaussian Splatting with Any Camera Trajectory Visualization Engine

TL;DR

This paper introduces 3D Skew Gaussian Splatting (3DSGS), a novel visualization framework that enhances 3D scene representation fidelity and compactness by extending Gaussian primitives to asymmetric Skew Gaussians, enabling better detail capture and real-time rendering.

Contribution

The authors propose a new Skew Gaussian primitive and an optimized CUDA rasterization pipeline, improving 3D visualization quality and efficiency over traditional symmetric Gaussian methods.

Findings

3DSGS achieves higher structural fidelity in complex regions.

It maintains real-time rendering performance.

Enhanced transparency handling improves visual clarity.

Abstract

While 3D Gaussian Splatting (3DGS) has revolutionized real-time photorealistic view synthesis, its fundamental reliance on symmetric Gaussian distributions introduces visual artifacts that hinder accurate spatial data exploration. Specifically, symmetric kernels struggle to capture shape and color discontinuities , which cause blurriness and primitive redundancy that mislead human perception during visual analysis. To address these visualization barriers, we introduce 3D Skew Gaussian Splatting (3DSGS), a novel framework that significantly enhances the structural fidelity and compactness of explicit scene representations. Our key insight lies in extending the standard primitive to a general Skew Gaussian counterpart. This generalized primitive inherits the highly efficient rasterization properties of standard Gaussians while gaining intrinsic asymmetric modeling capabilities. We couple this with an enhanced opacity representation to better handle complex transparency, alongside a depth-aware densification strategy that intelligently manages primitive allocation. Furthermore, to make these advancements actionable for real-world visual analytics, we re-derive the CUDA rasterization pipeline to universally support both symmetric and skew Gaussians, integrating it into a decoupled, free-camera interactive visualization engine. Extensive experiments demonstrate that 3DSGS achieves superior rendering quality and structural compactness, particularly in regions with intricate details, while maintaining the real-time frame rates necessary for fluid interactive exploration. Supplementary derivations and visual results are available at \textbf{\textit{https://3d-skew-gs.github.io/}}.