Prefix Filter: Practically and Theoretically Better Than Bloom
Tomer Even, Guy Even, Adam Morrison

TL;DR
The paper introduces the prefix filter, an incremental membership query data structure that combines space efficiency, high query throughput, and fast insertions, outperforming existing filters in several metrics.
Contribution
The prefix filter is a novel incremental filter that achieves a balance of space efficiency, fast queries, and rapid insertions, surpassing prior filters like Bloom, cuckoo, and vector quotient filters.
Findings
Space usage comparable to dynamic filters.
Query throughput similar to cuckoo filter.
Faster build times than vector quotient and cuckoo filters.
Abstract
Many applications of approximate membership query data structures, or filters, require only an incremental filter that supports insertions but not deletions. However, the design space of incremental filters is missing a "sweet spot" filter that combines space efficiency, fast queries, and fast insertions. Incremental filters, such as the Bloom and blocked Bloom filter, are not space efficient. Dynamic filters (i.e., supporting deletions), such as the cuckoo or vector quotient filter, are space efficient but do not exhibit consistently fast insertions and queries. In this paper, we propose the prefix filter, an incremental filter that addresses the above challenge: (1) its space (in bits) is similar to state-of-the-art dynamic filters; (2) query throughput is high and is comparable to that of the cuckoo filter; and (3) insert throughput is high with overall build times faster than…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCaching and Content Delivery · Covalent Organic Framework Applications · Network Packet Processing and Optimization
