How Cuckoo Filter Can Improve Existing Approximate Matching Techniques

Details

Serval ID
serval:BIB_7D7931246BFD
Type
Inproceedings: an article in a conference proceedings.
Collection
Publications
Title
How Cuckoo Filter Can Improve Existing Approximate Matching Techniques
Title of the conference
Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
Author(s)
Gupta Vikas, Breitinger Frank
Publisher
Springer International Publishing
ISBN
9783319255118
9783319255125
ISSN
1867-8211
1867-822X
Publication state
Published
Issued date
2015
Editor
James Joshua I., Breitinger Frank
Volume
157
Pages
39-52
Language
english
Abstract
In recent years, approximate matching algorithms have become an important component in digital forensic research and have been adopted in some other working areas as well. Currently there are several approaches but especially sdhash and mrsh-v2 attract the attention of the community because of their good overall performance (runtime, compression and detection rates). Although both approaches have a quite different proceeding, their final output (the similarity digest) is very similar as both utilize Bloom filters. This data structure was presented in 1970 and thus has been around for a while. Recently, a new data structure was proposed and claimed to be faster and have a smaller memory footprint than Bloom filter – Cuckoo filter.
In this paper we analyze the feasibility of Cuckoo filter for approximate matching algorithms and present a prototype implementation called mrsh-cf which is based on a special version of mrsh-v2 called mrsh-net. We demonstrate that by using Cuckoo filter there is a runtime improvement of approximately 37% and also a significantly better false positive rate. The memory footprint of mrsh-cf is 8 times smaller than mrsh-net, while the compression rate is twice than Bloom filter based fingerprint.
Keywords
Approximate matching, Similarity hashing, Bloom filter, Cuckoo filter, Fuzzy hashing, Similarity hashing, mrsh-v2, mrsh-net
Create date
06/05/2021 12:01
Last modification date
06/05/2021 12:38
Usage data