LMB: Augmenting PCIe Devices with CXL-Linked Memory Buffer
Jiapin Wang, Xiangping Zhang, Chenlei Tang, Xiang Chen, Tao Lu

TL;DR
This paper presents LMB, a scalable CXL-based memory expansion solution that enhances PCIe device memory capacity, addressing onboard DRAM shortages without significant performance loss.
Contribution
Introduction of LMB, a novel CXL-linked memory buffer that effectively supplements PCIe device onboard DRAM, improving capacity and performance in data center hardware.
Findings
LMB effectively increases device memory capacity.
LMB maintains low latency with minimal performance impact.
Scalable solution suitable for AI and large model workloads.
Abstract
PCIe devices, such as SSDs and GPUs, are pivotal in modern data centers, and their value is set to grow amidst the emergence of AI and large models. However, these devices face onboard DRAM shortage issue due to internal space limitation, preventing accommodation of sufficient DRAM modules alongside flash or GPU processing chips. Current solutions either curb device-internal memory usage or supplement slower non-DRAM mediums, prove inadequate or performance-compromising. This paper introduces the Linked Memory Buffer (LMB), a scalable solution utilizing the CXL memory expander to tackle device onboard memory deficiencies. The low-latency of CXL enables LMB to utilize emerging DRAM memory expander to efficiently supplement device onboard DRAM with minimal impact on performance.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Data Storage Technologies · Interconnection Networks and Systems · Parallel Computing and Optimization Techniques
