Recent Developments in Iterative Methods for Reducing Synchronization
Qinmeng Zou, Frederic Magoules
TL;DR
This paper reviews recent advances in parallel iterative methods designed to minimize synchronization costs on modern architectures, focusing on large-scale problem solving.
Contribution
It provides an overview of recent developments in parallel iterative methods aimed at reducing synchronization overhead in large-scale computations.
Findings
Summarizes recent techniques for synchronization reduction
Highlights improvements in parallel iterative algorithms
Discusses performance implications on modern architectures
Abstract
On modern parallel architectures, the cost of synchronization among processors can often dominate the cost of floating-point computation. Several modifications of the existing methods have been proposed in order to keep the communication cost as low as possible. This paper aims at providing a brief overview of recent advances in parallel iterative methods for solving large-scale problems. We refer the reader to the related references for more details on the derivation, implementation, performance, and analysis of these techniques.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.