JACK2: a new high-level communication library for parallel iterative methods

TL;DR

JACK2 is a high-level MPI-based communication library designed to facilitate both classical and asynchronous iterative methods in distributed applications, addressing communication management and convergence detection challenges with proven low overhead and high effectiveness.

Contribution

The paper introduces JACK2, a novel MPI-based library that simplifies implementation of iterative methods and improves convergence detection reliability in parallel computing.

Findings

Low communication overhead demonstrated on supercomputers

Effective handling of asynchronous and classical iterations

Reliable convergence detection achieved

Abstract

In this paper, we address the problem of designing a distributed application meant to run both classical and asynchronous iterations. MPI libraries are very popular and widely used in the scientific community, however asynchronous iterative methods raise non-negligible difficulties about the efficient management of communication requests and buffers. Moreover, a convergence detection issue is introduced, which requires the implementation of one of the various state-of-the-art termination methods, which are not necessarily highly reliable for most computational environments. We propose here an MPI-based communication library which handles all these issues in a non-intrusive manner, providing a unique interface for implementing both classical and asynchronous iterations. Few details are highlighted about our approach to achieve best communication rates and ensure accurate convergence detection. Experimental results on two supercomputers confirmed the low overhead communication costs introduced, and the effectiveness of our library.