Automatic Tracing in Task-Based Runtime Systems

TL;DR

Apophenia automatically identifies repeated program fragments in task-based runtime systems, reducing manual effort and enabling efficient dependence analysis for complex programs, with performance close to manual tracing.

Contribution

It introduces Apophenia, a system that automatically traces dependence analysis in task-based runtimes using dynamic string analysis, eliminating manual annotations.

Findings

Achieves 0.92x--1.03x performance of manual tracing.

Enables tracing of previously untraced complex programs.

Yields speedups of 0.91x--2.82x on supercomputers.

Abstract

Implicitly parallel task-based runtime systems often perform dynamic analysis to discover dependencies in and extract parallelism from sequential programs. Dependence analysis becomes expensive as task granularity drops below a threshold. Tracing techniques have been developed where programmers annotate repeated program fragments (traces) issued by the application, and the runtime system memoizes the dependence analysis for those fragments, greatly reducing overhead when the fragments are executed again. However, manual trace annotation can be brittle and not easily applicable to complex programs built through the composition of independent components. We introduce Apophenia, a system that automatically traces the dependence analysis of task-based runtime systems, removing the burden of manual annotations from programmers and enabling new and complex programs to be traced. Apophenia identifies traces dynamically through a series of dynamic string analyses, which find repeated program fragments in the stream of tasks issued to the runtime system. We show that Apophenia is able to come between 0.92x--1.03x the performance of manually traced programs, and is able to effectively trace previously untraced programs to yield speedups of between 0.91x--2.82x on the Perlmutter and Eos supercomputers.