
TL;DR
The paper introduces Linearized Diffusion Map (LDM), a new linear dimensionality reduction method that combines diffusion-based geometric insights with the simplicity of linear embeddings, demonstrating advantages on manifold-structured data.
Contribution
LDM provides a novel linear approximation of diffusion maps, enabling efficient, interpretable embeddings that capture geometric features better than PCA on manifold data.
Findings
LDM outperforms PCA on datasets with explicit manifold structures.
LDM's kernel matrix is positive, enabling NMF for interpretability.
LDM is effective in high-dimensional regimes with geometric features.
Abstract
We introduce the Linearized Diffusion Map (LDM), a novel linear dimensionality reduction method constructed via a linear approximation of the diffusion-map kernel. LDM integrates the geometric intuition of diffusion-based nonlinear methods with the computational simplicity, efficiency, and interpretability inherent in linear embeddings such as PCA and classical MDS. Through comprehensive experiments on synthetic datasets (Swiss roll and hyperspheres) and real-world benchmarks (MNIST and COIL-20), we illustrate that LDM captures distinct geometric features of datasets compared to PCA, offering complementary advantages. Specifically, LDM embeddings outperform PCA in datasets exhibiting explicit manifold structures, particularly in high-dimensional regimes, whereas PCA remains preferable in scenarios dominated by variance or noise. Furthermore, the complete positivity of LDM's kernel…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
