FlexiWalker: Extensible GPU Framework for Efficient Dynamic Random Walks with Runtime Adaptation

TL;DR

FlexiWalker is a GPU framework that efficiently supports dynamic random walks with runtime adaptation, outperforming existing CPU and GPU solutions significantly on real-world graph workloads.

Contribution

It introduces a novel GPU framework with adaptive sampling kernels and a runtime cost model for dynamic random walks, enabling workload-generic, efficient execution.

Findings

Outperforms CPU baselines by 73.44x

Outperforms GPU baselines by 5.91x

Supports workloads prior systems cannot handle

Abstract

Dynamic random walks are fundamental to various graph analysis applications, offering advantages by adapting to evolving graph properties. Their runtime-dependent transition probabilities break down the pre-computation strategy that underpins most existing CPU and GPU static random walk optimizations. This leaves practitioners suffering from suboptimal frameworks and having to write hand-tuned kernels that do not adapt to workload diversity. To handle this issue, we present FlexiWalker, the first GPU framework that delivers efficient, workload-generic support for dynamic random walks. Our design-space study shows that rejection sampling and reservoir sampling are more suitable than other sampling techniques under massive parallelism. Thus, we devise (i) new high-performance kernels for them that eliminate global reductions, redundant memory accesses, and random-number generation. Given the necessity of choosing the best-fitting sampling strategy at runtime, we adopt (ii) a lightweight first-order cost model that selects the faster kernel per node at runtime. To enhance usability, we introduce (iii) a compile-time component that automatically specializes user-supplied walk logic into optimized building blocks. On various dynamic random walk workloads with real-world graphs, FlexiWalker outperforms the best published CPU/GPU baselines by geometric means of 73.44x and 5.91x, respectively, while successfully executing workloads that prior systems cannot support. We open-source FlexiWalker in https://github.com/AIS-SNU/FlexiWalker.