COOK Access Control on an embedded Volta GPU
Benjamin Lesage, Fr\'ed\'eric Boniol, Claire Pagetti

TL;DR
This paper proposes an access control technique for embedded Volta GPUs on platforms like Jetson Xavier to reduce timing variability and interference between concurrent applications, enhancing predictability and isolation.
Contribution
It introduces and evaluates three novel access control strategies to improve GPU operation isolation and reduce interference in resource-constrained embedded systems.
Findings
Reduced timing variability with access control
Improved isolation between GPU operations
Small code complexity with some potential slowdowns
Abstract
The last decade has seen the emergence of a new generation of multi-core in response to advances in machine learning, and in particular Deep Neural Network (DNN) training and inference tasks. These platforms, like the JETSON AGX XAVIER, embed several cores and accelerators in a SWaP- efficient (Size Weight and Power) package with a limited set of resources. However, concurrent applications tend to interfere on shared resources, resulting in high execution time variability for applications compared to their behaviour in isolation.Access control techniques aim to selectively restrict the flow of operations executed by a resource. To reduce the impact of interference on the JETSON Volta GPU, we specify and implement an access control technique to ensure each GPU operation executes in isolation to reduce its timing variability. We implement the controller using three different strategies…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsParallel Computing and Optimization Techniques · Low-power high-performance VLSI design · Real-Time Systems Scheduling
