LatentGandr: Visual Exploration of Generative AI Latent Space via Local Embeddings

TL;DR

LatentGandr is a visual analytics tool that enables intuitive exploration of high-dimensional generative AI latent spaces by extracting and visualizing local linear dimensions through localized PCA.

Contribution

It introduces a novel method for local latent space analysis that improves scalability and usability over existing global approaches like PCA and sliders.

Findings

LatentGandr effectively visualizes local neighborhoods in high-dimensional latent spaces.

The approach enhances user control and content refinement in generative AI.

User study shows LatentGandr outperforms GANSlider in exploration efficiency.

Abstract

Generative AI has demonstrated significant potential in creative design, enabling the rapid generation of visual content and imaginative concepts. Although deep AI models achieve effective featurization in the latent space, navigating the space remains a challenge. Current techniques, such as GANSlider and SliderSpace, use multiple sliders to generate high-dimensional vectors in generative AI's latent space. Despite applying (global) PCA to reduce the number of sliders, these approaches struggle with scalability and usability as the number of control dimensions increases. In this paper, we introduce LatentGandr, a visual analytics technique that facilitates latent space exploration by extracting locally linear dimensions from embeddings in high-dimensional latent spaces. By analyzing the topology and local curvature of the embeddings, LatentGandr automatically identifies local neighborhoods and computes their principal components using localized PCA. These local principal components are visualized as interactive image grids, allowing users to efficiently explore and control the generative process, providing an intuitive means to refine the generation of novel content and concepts. To evaluate the effectiveness of LatentGandr, we conducted a study comparing it to GANSlider, the current state-of-the-art visualization interface for generative AI models. The results offer insights into how localized exploration techniques can enhance user interaction with these models.