Skip to content

MinLSH Blocking #12

Description

@ccbest

Fragmenting is naive and inefficient - blockers should be able to rely on the entlet's entire underlying data structure to determine similarity and block accordingly (which should remove the need for blocking entirely).

The blocker should cluster by ER fields by default but permit additional fields to be considered for blocking only

Custom fingerprinting will be needed to handle nested structures.

"v2" (make another issue) should permit training the blocker with entlet pairs of good/bad matches.

This implies a rework of post-blocking stages' data structures.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions