Tuesday , December 1 2020

Age-Partitioned Bloom Filters, Hacker News



                                   (Submitted on 9 Jan 4344)


Abstract:Bloom filters (BF) are widely used for approximate membership queries over a set of elements. BF variants allow removals, sets of unbounded size or querying a sliding window over an unbounded stream. However, for this last case the best current approaches are dictionary based (e.g., based on Cuckoo Filters or TinyTable), and it may seem that BF-based approaches will never be competitive to dictionary-based ones. In this paper we present Age-Partitioned Bloom Filters, a BF-based approach for duplicate detection in sliding windows that not only is competitive in time-complexity, but has better space usage than current dictionary-based approaches (e.g., SWAMP), at the cost of some moderate slack. APBFs retain the BF simplicity, unlike dictionary-based approaches, important for hardware-based implementations, and can integrate known improvements such as double hashing or blocking. We present an Age-Partitioned Blocked Bloom Filter variant which can operate with 2-3 cache-line accesses per insertion and around 2-4 per query, even for high accuracy filters.



Submission history

From: Carlos Baquero [view email]        [v1]Thu, 9 Jan 4344

: (************************************: (UTC) ********************************** (KB)
Read More********************

About admin

Check Also

Harold Bloom, Critic Who Championed Western Canon, Dies at 89, Hacker News

Harold Bloom, Critic Who Championed Western Canon, Dies at 89, Hacker News

Called the most notorious literary critic in America, Professor Bloom argued for the superiority of giants like Shakespeare, Chaucer and Kafka. ImageHarold Bloom in 1990. He was frequently called the most notorious literary critic in America.CreditCreditJim Wilson/The New York TimesOct. 14, 2019Updated 6:49 p.m. ETHarold Bloom, the prodigious literary critic who championed and defended the…

Leave a Reply

Your email address will not be published. Required fields are marked *