# Random Sampling for Distributed Coded Matrix Multiplication

**Authors:** Wei-Ting Chang, Ravi Tandon

arXiv: 1905.06942 · 2019-05-17

## TL;DR

This paper explores the use of random sampling combined with coding techniques to perform approximate distributed matrix multiplication efficiently, balancing recovery threshold and approximation error.

## Contribution

It introduces two novel coded randomized sampling schemes that leverage coding and randomization for approximate matrix multiplication in distributed systems.

## Key findings

- Tradeoffs between recovery threshold and approximation error are characterized.
- Proposed schemes achieve robustness to stragglers with controlled approximation.
- The methods improve efficiency in large-scale matrix computations.

## Abstract

Matrix multiplication is a fundamental building block for large scale computations arising in various applications, including machine learning. There has been significant recent interest in using coding to speed up distributed matrix multiplication, that are robust to stragglers (i.e., machines that may perform slower computations). In many scenarios, instead of exact computation, approximate matrix multiplication, i.e., allowing for a tolerable error is also sufficient. Such approximate schemes make use of randomization techniques to speed up the computation process. In this paper, we initiate the study of approximate coded matrix multiplication, and investigate the joint synergies offered by randomization and coding. Specifically, we propose two coded randomized sampling schemes that use (a) codes to achieve a desired recovery threshold and (b) random sampling to obtain approximation of the matrix multiplication. Tradeoffs between the recovery threshold and approximation error obtained through random sampling are investigated for a class of coded matrix multiplication schemes.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1905.06942/full.md

## Figures

3 figures with captions in the complete paper: https://tomesphere.com/paper/1905.06942/full.md

## References

16 references — full list in the complete paper: https://tomesphere.com/paper/1905.06942/full.md

---
Source: https://tomesphere.com/paper/1905.06942