Scalable Record Linkage and Entity Resolution
Record linkage finds records across datasets that refer to the same person or entity. At scale, two costs dominate: comparing strings, and the huge number of candidate record pairs.
- Linear-time Jaro similarity. Standard algorithms for the Jaro similarity metric take quadratic time in the worst case. We gave an O(l1 + l2) algorithm that computes the same measure (ISBRA 2023; Journal of Computational Biology 2026).
- SuperBlocking. A blocking technique that removes unnecessary comparisons while keeping likely matches, with parallel record-linkage algorithms achieving near-linear speedups (IEEE BigData 2023).
- Phonetic and LLM-era blocking. Soundex and Double Metaphone blocking (IEEE BigData 2024; ISBRA 2025), and blocking for LLM-based record linkage (Algorithms 2025).
This work is in collaboration with researchers at the U.S. Census Bureau and the University of Florida.
