MapExplorer: New Content Generation from Low-Dimensional Visualizations

TL;DR

MapExplorer introduces a method to generate coherent textual content from low-dimensional visualizations, enhancing data exploration and hypothesis generation through interactive map-based content creation.

Contribution

It presents a novel task and metric for translating projection map coordinates into meaningful text, bridging visualization and content generation.

Findings

Effective in generating scientific hypotheses

Able to craft synthetic personas

Assists in devising strategies for large language models

Abstract

Low-dimensional visualizations, or "projection maps," are widely used in scientific and creative domains to interpret large-scale and complex datasets. These visualizations not only aid in understanding existing knowledge spaces but also implicitly guide exploration into unknown areas. Although techniques such as t-SNE and UMAP can generate these maps, there exists no systematic method for leveraging them to generate new content. To address this, we introduce MapExplorer, a novel knowledge discovery task that translates coordinates within any projection map into coherent, contextually aligned textual content. This allows users to interactively explore and uncover insights embedded in the maps. To evaluate the performance of MapExplorer methods, we propose Atometric, a fine-grained metric inspired by ROUGE that quantifies logical coherence and alignment between generated and reference text. Experiments on diverse datasets demonstrate the versatility of MapExplorer in generating scientific hypotheses, crafting synthetic personas, and devising strategies for attacking large language models-even with simple baseline methods. By bridging visualization and generation, our work highlights the potential of MapExplorer to enable intuitive human-AI collaboration in large-scale data exploration.