FLeeC: a Fast Lock-Free Application Cache
Andr\'e J. Costa, Nuno M. Pregui\c{c}a, Jo\~ao M. Louren\c{c}o

TL;DR
FLeeC is a lock-free application cache system based on Memcached that significantly improves performance through redesigned data structures and non-blocking algorithms, enabling high concurrency in shared-memory environments.
Contribution
This paper introduces FLeeC, a novel lock-free cache system with new algorithms for eviction and lookups, enhancing performance over traditional Memcached.
Findings
Up to 6x performance improvement
Supports concurrent reads and writes in high contention
Compatible as a plug-in replacement for Memcached
Abstract
When compared to blocking concurrency, non-blocking concurrency can provide higher performance in parallel shared-memory contexts, especially in high contention scenarios. This paper proposes FLeeC, an application-level cache system based on Memcached, which leverages re-designed data structures and non-blocking (or lock-free) concurrency to improve performance by allowing any number of concurrent writes and reads to its main data structures, even in high-contention scenarios. We discuss and evaluate its new algorithms, which allow a lock-free eviction policy and lock-free fast lookups. FLeeC can be used as a plug-in replacement for the original Memcached, and its new algorithms and concurrency control strategies result in considerable performance improvements (up to 6x).
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsParallel Computing and Optimization Techniques · Embedded Systems Design Techniques · Distributed and Parallel Computing Systems
