Optimal Approximate Matrix Multiplication over Sliding Windows
Ziqi Yao, Mingsong Chen, Cheng Chen

TL;DR
This paper introduces a new deterministic algorithm for approximate matrix multiplication over sliding windows that achieves optimal space-error tradeoff, supported by theoretical analysis and empirical validation.
Contribution
The paper presents the DS-COD algorithm for AMM over sliding windows, establishing its optimality and introducing an adaptive version with improved efficiency.
Findings
DS-COD achieves optimal space-error tradeoff.
aDS-COD improves computational efficiency.
Experimental results validate theoretical bounds.
Abstract
We explore the problem of approximate matrix multiplication (AMM) within the sliding window model, where algorithms utilize limited space to perform large-scale matrix multiplication in a streaming manner. This model has garnered increasing attention in the fields of machine learning and data mining due to its ability to handle time sensitivity and reduce the impact of outdated data. However, despite recent advancements, determining the optimal space bound for this problem remains an open question. In this paper, we introduce the DS-COD algorithm for AMM over sliding windows. This novel and deterministic algorithm achieves optimal performance regarding the space-error tradeoff. We provide theoretical error bounds and the complexity analysis for the proposed algorithm, and establish the corresponding space lower bound for the AMM sliding window problem. Additionally, we present an…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic Gradient Optimization Techniques · Tensor decomposition and applications · Complexity and Algorithms in Graphs
MethodsSoftmax · Attention Is All You Need
