Coded Elastic Computing on Machines with Heterogeneous Storage and Computation Speed
Nicholas Woolsey, Rong-Rong Chen, Mingyue Ji

TL;DR
This paper develops an optimal computation assignment strategy for heterogeneous Coded Elastic Computing networks, improving efficiency by accounting for varying machine speeds and storage capacities.
Contribution
It introduces a novel combinatorial optimization framework and a low-complexity filling algorithm for heterogeneous CEC, extending prior homogeneous network designs.
Findings
Optimal computation time minimized for heterogeneous networks
Exact solutions obtained via convex and filling problem decomposition
Algorithm complexity is manageable with iteration bounds
Abstract
We study the optimal design of heterogeneous Coded Elastic Computing (CEC) where machines have varying computation speeds and storage. CEC introduced by Yang et al. in 2018 is a framework that mitigates the impact of elastic events, where machines can join and leave at arbitrary times. In CEC, data is distributed among machines using a Maximum Distance Separable (MDS) code such that subsets of machines can perform the desired computations. However, state-of-the-art CEC designs only operate on homogeneous networks where machines have the same speeds and storage. This may not be practical. In this work, based on an MDS storage assignment, we develop a novel computation assignment approach for heterogeneous CEC networks to minimize the overall computation time. We first consider the scenario where machines have heterogeneous computing speeds but same storage and then the scenario where…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFerroelectric and Negative Capacitance Devices · Advanced Memory and Neural Computing · Stochastic Gradient Optimization Techniques
