Rambrain - a library for virtually extending physical memory

TL;DR

Rambrain is a user space library that enables applications to overcommit memory beyond physical limits by managing data swapping efficiently, supporting multi-threading and asynchronous IO with minimal code modifications.

Contribution

Introduces Rambrain, a library that simplifies memory overcommitment and management in user applications with minimal programming effort.

Findings

Supports overcommitment of memory beyond physical limits

Handles data swapping with minimal performance overhead

Compatible with multi-threading and asynchronous IO

Abstract

We introduce Rambrain, a user space library that manages memory consumption of your code. Using Rambrain you can overcommit memory over the size of physical memory present in the system. Rambrain takes care of temporarily swapping out data to disk and can handle multiples of the physical memory size present. Rambrain is thread-safe, OpenMP and MPI compatible and supports Asynchronous IO. The library was designed to require minimal changes to existing programs and to be easy to use.