A fast and efficient Hamming LSH-based scheme for accurate linkage. Issue 3 (December 2016)

• Record Type: Journal Article
• Authors: Karapiperis, Dimitrios; Verykios, Vassilios
• Is Part Of: Knowledge and information systems. Volume 49:Issue 3(2016:Dec.)
• Page Start: 861
• Page End: 884
• Publication Date: 2016-12
• Subjects: Privacy-preserving record linkage -- Locality-sensitive hashing -- Blocking -- Bloom filters; Expert systems (Computer science) -- Periodicals; Information storage and retrieval systems -- Periodicals; 006.33
• DOI: 10.1007/s10115-016-0919-y
• Languages: English
• ISSNs: 0219-1377

Abstract

Abstract In this paper, we propose an efficient scheme for privacy-preserving record linkage by using the Hamming locality-sensitive hashing technique as the blocking mechanism and the Bloom filter-based encoding method for anonymizing the data sets at hand. We achieve highly accurate results and simultaneously reduce significantly the computational cost by minimizing the number of distance computations performed. Our scheme provides theoretical guarantees for identifying the similar anonymized record pairs by conducting redundant blocking and by performing a distance computation only if the corresponding anonymized record pair is formulated a specified number of times. A series of experiments illustrate the efficacy of our scheme in identifying the similar record pairs, while simultaneously keeping the running time exceptionally low.