OffloadFS: Leveraging Disaggregated Storage for Computation Offloading
Sungho Moon, Daegyu Han, Hera Koo, Sangeun Chae, Duck-Ho Bae, Euiseong Seo, Beomseok Nam

TL;DR
OffloadFS is a user-level file system that leverages disaggregated storage to offload IO-intensive tasks, improving performance for databases and machine learning workloads without complex lock management.
Contribution
It introduces OffloadFS, enabling near-data processing on disaggregated storage nodes, and demonstrates its effectiveness with OffloadDB and OffloadPrep for specific workloads.
Findings
OffloadFS improves RocksDB performance by up to 3.36x.
OffloadFS enhances machine learning pre-processing tasks by up to 1.85x.
The system reduces interference between I/O operations through optimized cache management.
Abstract
Disaggregated storage systems improve resource utilization and enable independent scaling of storage and compute resources by separating storage resources from computing resources in data centers. NVMe over fabrics (NVMeoF) is a key technology that underpins the functionality and benefits of disaggregated storage systems. While NVMeoF inherently possesses substantial computing and memory capacity, these resources are often underutilized for tasks beyond simple I/O delegation. This study proposes OffloadFS, a user-level file system that enables offloaded IO-intensive tasks primarily to a disaggregated storage node for near-data processing, with the option to offload to peer compute nodes as well, without the need for distributed lock management. OffloadFS optimizes cache management by reducing interference between threads performing distinct I/O operations. On top of OffloadFS, we…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
