Constructing ground truth when classifying data
AssigneeAmperity, Inc.
InventorsYan Yan, Stephen Meyles, Mona Akmal, Michael P. Fikes
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to evaluating whether two data records reflect the same entity using a classifier in the absence of ground truth. Without ground truth, it is difficult to determine the precision or recall of a classifier. The present disclosure generates a list comprising a series of unique feature signatures and a set of sample record pairs for each unique feature signature. In some embodiments, users may provide labels for the set of sample record pairs for each unique feature signature.
Claims20
A system comprising:
- a database that stores a plurality of records;
- and
- a memory coupled to a processor, the memory comprising a plurality of instructions that cause the processor to:
- perform pairwise comparisons on at least a portion of the plurality of records to generate feature signatures for the pairwise comparisons, wherein a given feature signature indicates common features between a pair of records being compared;
- classify the feature signatures using a classifier;
- and
- generate a list comprising a series of unique feature signatures and a set of sample record pairs for each of the unique feature signatures.
A system comprising:
- a memory that stores a plurality of instructions;
- a database that stores a plurality of records;
- and
- a processor in data communication with the memory, the processor being configured to:
- perform pairwise comparisons on at least a portion of the plurality of records to generate feature signatures for the pairwise comparisons, wherein a given feature signature indicates a degree of similarity of features between a pair of records being compared;
- classify the feature signatures using a classifier;
- and
- generate a list comprising a series of unique feature signatures and a set of sample record pairs for each of the unique feature signatures.
A computer implemented method comprising:
- storing a plurality of records and a plurality of features for the plurality of records in a database;
- performing pairwise comparisons on at least a portion of the plurality of records to generate feature signatures for each of the pairwise comparisons, wherein a given feature signature indicates a degree of similarity of features between a pair of records being compared;
- classifying feature signatures using a classifier;
- and
- generating a list comprising a series of unique feature signatures and a set of sample record pairs for each of the unique feature signatures.
Dependencies are inferred from the claim text.