Coded Elastic Computing
Yaoqing Yang, Matteo Interlandi, Pulkit Grover, Soummya Kar, Saeed, Amizadeh, Markus Weimer

TL;DR
This paper introduces coded elastic computing, a method that efficiently manages elastic, preemptible cloud resources for distributed tasks, maintaining performance while reducing computation time.
Contribution
It presents a novel coding-based approach that adapts workload dynamically, enabling elastic resource utilization without sacrificing algorithm accuracy.
Findings
Achieves same numerical results as noiseless methods.
Reduces computation time by 46% compared to non-adaptive schemes.
Handles preemption and resource joining seamlessly.
Abstract
Cloud providers have recently introduced new offerings whereby spare computing resources are accessible at discounts compared to on-demand computing. Exploiting such opportunity is challenging inasmuch as such resources are accessed with low-priority and therefore can elastically leave (through preemption) and join the computation at any time. In this paper, we design a new technique called coded elastic computing, enabling distributed computations over elastic resources. The proposed technique allows machines to leave the computation without sacrificing the algorithm-level performance, and, at the same time, adaptively reduce the workload at existing machines when new ones join the computation. Leveraging coded redundancy, our approach can achieve similar computational cost as the original (noiseless) method when all machines are present; the cost gracefully increases when machines are…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStochastic Gradient Optimization Techniques · Parallel Computing and Optimization Techniques · Advanced Memory and Neural Computing
