CO-SNE: Dimensionality Reduction and Visualization for Hyperbolic Data

TL;DR

CO-SNE is a novel visualization method extending t-SNE to hyperbolic space, effectively reducing high-dimensional hyperbolic data into low-dimensional representations while preserving their intrinsic hyperbolic structure.

Contribution

It introduces CO-SNE, a hyperbolic space visualization tool that accounts for hyperbolic geometry's inhomogeneity, outperforming existing methods like PCA, UMAP, and HoroPCA.

Findings

CO-SNE accurately preserves hyperbolic data structures in low-dimensional visualizations.

It significantly outperforms PCA, t-SNE, UMAP, and HoroPCA in hyperbolic data visualization.

CO-SNE effectively visualizes both naturally hyperbolic data and learned hyperbolic features.

Abstract

Hyperbolic space can naturally embed hierarchies that often exist in real-world data and semantics. While high-dimensional hyperbolic embeddings lead to better representations, most hyperbolic models utilize low-dimensional embeddings, due to non-trivial optimization and visualization of high-dimensional hyperbolic data. We propose CO-SNE, which extends the Euclidean space visualization tool, t-SNE, to hyperbolic space. Like t-SNE, it converts distances between data points to joint probabilities and tries to minimize the Kullback-Leibler divergence between the joint probabilities of high-dimensional data $X$ and low-dimensional embedding $Y$. However, unlike Euclidean space, hyperbolic space is inhomogeneous: A volume could contain a lot more points at a location far from the origin. CO-SNE thus uses hyperbolic normal distributions for $X$ and hyperbolic \underline{C}auchy instead of t-SNE's Student's t-distribution for $Y$, and it additionally seeks to preserve $X$'s individual distances to the \underline{O}rigin in $Y$. We apply CO-SNE to naturally hyperbolic data and supervisedly learned hyperbolic features. Our results demonstrate that CO-SNE deflates high-dimensional hyperbolic data into a low-dimensional space without losing their hyperbolic characteristics, significantly outperforming popular visualization tools such as PCA, t-SNE, UMAP, and HoroPCA which is also designed for hyperbolic data.