Efficient Computation of Tucker Decomposition for Streaming Scientific Data Compression

TL;DR

This paper introduces a streaming Tucker decomposition algorithm tailored for scientific data that grows along one mode, enabling efficient, incremental analysis and compression without storing all past data.

Contribution

It proposes a novel streaming Tucker algorithm that updates decomposition components incrementally for evolving data tensors, reducing memory and computational costs.

Findings

Significant memory savings compared to batch methods

Less computational time when tensor rank stabilizes

Effective on synthetic and real scientific datasets

Abstract

The Tucker decomposition, an extension of singular value decomposition for higher-order tensors, is a useful tool in analysis and compression of large-scale scientific data. While it has been studied extensively for static datasets, there are relatively few works addressing the computation of the Tucker factorization of streaming data tensors. In this paper we propose a new streaming Tucker algorithm tailored for scientific data, specifically for the case of a data tensor whose size increases along a single streaming mode that can grow indefinitely, which is typical of time-stepping scientific applications. At any point of this growth, we seek to compute the Tucker decomposition of the data generated thus far, without requiring storing the past tensor slices in memory. Our algorithm accomplishes this by starting with an initial Tucker decomposition and updating its components--the core tensor and factor matrices--with each new tensor slice as it becomes available, while satisfying a user-specified threshold of norm error. We present an implementation within the TuckerMPI software framework, and apply it to synthetic and combustion simulation datasets. By comparing against the standard (batch) decomposition algorithm we show that our streaming algorithm provides significant improvements in memory usage. If the tensor rank stops growing along the streaming mode, the streaming algorithm also incurs less computational time compared to the batch algorithm.