Easy-to-Use On-the-Fly Binary Program Acceleration on Many-Cores
Marvin Damschen, Christian Plessl

TL;DR
This paper presents BAAR, a runtime system that automatically accelerates existing software on many-core architectures by offloading suitable code parts to an accelerator, achieving up to 5.77x speedup without developer intervention.
Contribution
Introduces BAAR, a novel on-the-fly binary acceleration framework that automatically identifies and offloads code segments to accelerators at runtime using LLVM infrastructure.
Findings
Achieves up to 5.77x speedup on real-world benchmarks.
Operates without developer-provided hints, demonstrating ease of use.
Shows practicality for stencil code applications.
Abstract
This paper introduces Binary Acceleration At Runtime (BAAR), an easy-to-use on-the-fly binary acceleration mechanism which aims to tackle the problem of enabling existent software to automatically utilize accelerators at runtime. BAAR is based on the LLVM Compiler Infrastructure and has a client-server architecture. The client runs the program to be accelerated in an environment which allows program analysis and profiling. Program parts which are identified as suitable for the available accelerator are exported and sent to the server. The server optimizes these program parts for the accelerator and provides RPC execution for the client. The client transforms its program to utilize accelerated execution on the server for offloaded program parts. We evaluate our work with a proof-of-concept implementation of BAAR that uses an Intel Xeon Phi 5110P as the acceleration target and performs…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsParallel Computing and Optimization Techniques · Cloud Computing and Resource Management · Distributed and Parallel Computing Systems
