ACGraph: An Efficient Asynchronous Out-of-Core Graph Processing Framework
Dechuang Chen, Sibo Wang, Qintian Guo

TL;DR
ACGraph is a new asynchronous out-of-core graph processing framework optimized for SSDs, which reduces I/O overhead and synchronization delays, enabling faster execution of large-scale graph algorithms beyond main memory capacity.
Contribution
It introduces a dynamic priority scheduler and an online asynchronous worklist, unifying I/O and computation to improve efficiency over existing synchronous systems.
Findings
Significantly faster runtime compared to state-of-the-art systems.
Reduced I/O operations through efficient block reuse.
Effective processing of large graphs with limited memory.
Abstract
Graphs are a ubiquitous data structure in diverse domains such as machine learning, social networks, and data mining. As real-world graphs continue to grow beyond the memory capacity of single machines, out-of-core graph processing systems have emerged as a viable solution. Yet, existing systems that rely on strictly synchronous, iteration-by-iteration execution incur significant overheads. In particular, their scheduling mechanisms lead to I/O inefficiencies, stemming from read and work amplification, and induce costly synchronization stalls hindering sustained disk utilization. To overcome these limitations, we present {\em ACGraph}, a novel asynchronous graph processing system optimized for SSD-based environments with constrained memory resources. ACGraph employs a dynamic, block-centric priority scheduler that adjusts in real time based on workload, along with an online asynchronous…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGraph Theory and Algorithms · Advanced Database Systems and Queries · Cloud Computing and Resource Management
