Automatic Tracing in Task-Based Runtime Systems
Rohan Yadav, Michael Bauer, David Broman, Michael Garland, Alex Aiken,, Fredrik Kjolstad

TL;DR
Apophenia automatically identifies repeated program fragments in task-based runtime systems, reducing manual effort and enabling efficient dependence analysis for complex programs, with performance close to manual tracing.
Contribution
It introduces Apophenia, a system that automatically traces dependence analysis in task-based runtimes using dynamic string analysis, eliminating manual annotations.
Findings
Achieves 0.92x--1.03x performance of manual tracing.
Enables tracing of previously untraced complex programs.
Yields speedups of 0.91x--2.82x on supercomputers.
Abstract
Implicitly parallel task-based runtime systems often perform dynamic analysis to discover dependencies in and extract parallelism from sequential programs. Dependence analysis becomes expensive as task granularity drops below a threshold. Tracing techniques have been developed where programmers annotate repeated program fragments (traces) issued by the application, and the runtime system memoizes the dependence analysis for those fragments, greatly reducing overhead when the fragments are executed again. However, manual trace annotation can be brittle and not easily applicable to complex programs built through the composition of independent components. We introduce Apophenia, a system that automatically traces the dependence analysis of task-based runtime systems, removing the burden of manual annotations from programmers and enabling new and complex programs to be traced. Apophenia…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSoftware System Performance and Reliability · Distributed and Parallel Computing Systems · Service-Oriented Architecture and Web Services
