Multi-User Non-Linearly Separable Distributed Computing

TL;DR

This paper introduces a tensor-theoretic approach for efficient task allocation and communication in multi-user distributed computing of non-linear polynomial functions, reducing costs and improving performance.

Contribution

It develops a novel tensor-based scheme combining tensor factorization and graph matching to optimize task assignment and communication in distributed systems.

Findings

Achieves significant computational and communication savings over existing methods.

Provides an explicit zero-error characterization of the system rate under mild conditions.

Demonstrates effectiveness through numerical simulations across various system parameters.

Abstract

This paper considers an $N$-server distributed computing setting with $K$ users requesting functions that are arbitrary multivariable polynomial evaluations of $L$ real (potentially non-linear) basis subfunctions, where each function output is raised to a bounded power. Our aim is to seek efficient task allocation and data communication techniques that reduce computation and communication costs. To this end, we take a tensor-theoretic approach, in which we represent the requested non-linearly decomposable functions using a properly designed tensor $\bar{\mathcal{F}}$, whose sparse decomposition into a tensor $\bar{\mathcal{E}}$ and a matrix $\mathbf{D}$ directly defines the task assignment, connectivity, and communication patterns. We design a lossless achievable scheme that integrates fixed-support SVD-based tensor factorization with multi-dimensional tiling of $\bar{\mathcal{E}}$ and $\mathbf{D}$, followed by a bipartite graph matching-based recursive assignment of tiles. This step transforms an overlapping decomposition into a disjoint one and reduces the resulting sum rank of the tiles, thereby decreasing the number of required servers. Under mild dimensionality conditions, we derive an explicit zero-error characterization of the achievable system rate $K/N$. Numerical simulations demonstrate the computational and communication savings over existing state-of-the-art matrix factorization approaches across a wide range of system parameters.