Xtreaming: an incremental multidimensional projection technique and its application to streaming data

TL;DR

Xtreaming is a novel incremental multidimensional projection method designed for streaming data that updates visualizations efficiently without multiple data passes, accurately capturing emerging patterns in real-time.

Contribution

It introduces the first projection technique capable of evolving visualizations for streaming data without storing all data, maintaining accuracy and speed.

Findings

Competitive in global distance preservation

Orders of magnitude faster than existing methods

Effectively captures emerging structures in streaming data

Abstract

Streaming data applications are becoming more common due to the ability of different information sources to continuously capture or produce data, such as sensors and social media. Despite recent advances, most visualization approaches, in particular, multidimensional projection or dimensionality reduction techniques, cannot be directly applied in such scenarios due to the transient nature of streaming data. Currently, only a few methods address this limitation using online or incremental strategies, continuously processing data, and updating the visualization. Despite their relative success, most of them impose the need for storing and accessing the data multiple times, not being appropriate for streaming where data continuously grow. Others do not impose such requirements but are not capable of updating the position of the data already projected, potentially resulting in visual artifacts. In this paper, we present Xtreaming, a novel incremental projection technique that continuously updates the visual representation to reflect new emerging structures or patterns without visiting the multidimensional data more than once. Our tests show that Xtreaming is competitive in terms of global distance preservation if compared to other streaming and incremental techniques, but it is orders of magnitude faster. To the best of our knowledge, it is the first methodology that is capable of evolving a projection to faithfully represent new emerging structures without the need to store all data, providing reliable results for efficiently and effectively projecting streaming data.