System and method for associating related records to common entities across multiple lists

A method for associating records across a first list and a second list to a common entity, the method comprising:

• obtaining a first list and a second list, wherein the first list and the second list both include a plurality of records, and wherein the plurality of records includes records that are associated with a respective entity and includes one or more fields;
• obtaining a sample of a plurality of pairs of records wherein each pair of the plurality of pairs of records includes a record from the first list and a record from the second list;
• labeling a subset of pairs of the sample of the plurality of pairs;
• generating a statistical model based on the labeled pairs;
• evaluating pairs of the plurality of pairs based on the statistical model;
• outputting, based on the statistical model, scores representing the likelihood that the records in each pair are related to a similar entity;
• based on the scores, resolving similar entities;
• and
• associating one or more records of the first list and one or more of the records of the second list with the similar entities based on the resolving the similar entities, wherein the one or more fields of at least one of the one or more records of the first list are different from the one or more fields of at least one of the one or more records of the second list.

A non-transitory computer-readable medium storing a set of instructions that are executable by one or more processors to cause the one or more processors to perform a method to associate related records across a first list and a second list to a common entity, the method comprising:

• obtaining a first list and a second list, wherein the first list and the second list both include a plurality of records, and wherein the plurality of records includes records that are associated with a respective entity and includes one or more fields;
• obtaining a sample of a plurality of pairs of records wherein each pair of the plurality of pairs of records includes a record from the first list and a record from the second list;
• labeling a subset of pairs of the sample of the plurality of pairs;
• generating a statistical model based on the labeled pairs;
• evaluating pairs of the plurality of pairs based on the statistical model;
• outputting, based on the statistical model, scores representing the likelihood that the records in each pair are related to a similar entity;
• based on the scores, resolving similar entities;
• and
• associating one or more records of the first list and one or more of the records of the second list with the similar entities based on the resolving the similar entities, wherein the one or more fields of at least one of the one or more records of the first list are different from the one or more fields of at least one of the one or more records of the second list.