[erlang-questions] Packets deduplication
Thu Feb 18 19:56:22 CET 2016
you'd use the bloom filter first to determine if it's possible that you've
seen it before, and then if you get a hit, just do a lookup into some other
structure. Depending on your hash functions and the sparsity, it could be
significantly faster; consider, for example, if the sequence is
just about anything except a bloom filter is going to have
possibly-interesting behavior when the 2^1024 shows up. The bloom filter
may give you some false positives and will generally be slower, but if
you're trying to maintain a packet train for, like, remote medical surgery,
you might accept the extra space and the slightly higher average latency
for less jitter.
On Thu, Feb 18, 2016 at 10:45 AM, Jesper Louis Andersen <
> On Thu, Feb 18, 2016 at 7:28 PM, <dmkolesnikov@REDACTED> wrote:
>> The right data structure is either bloom filter or scalable bloom filter.
> You also need to delete elements, which a cuckoo filter can do.
> The problem with bloom filters in this situation is the probability of
> error as far as I see. They either say NOPE or MAYBE??? The other problem
> is that it probably wont beat integer operations on 60 bit words since it
> requires a hash.
> erlang-questions mailing list
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the erlang-questions