Back to results
US 10,853,033 B1Granted
Effectively fusing database tables
AssigneeAmperity, Inc.
InventorsStephen Meyles, Yan Yan, Carlos Sakoda, Ian Wesley-Smith, Dan Suciu
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to fuse multiple database tables together. The fields of the database tables may be normalized using semantic fields. Under a first approach, database tables are deduplicated by consolidating redundant records. This may be done by performing pairwise comparisons to identify related pairs of records and then clustering the related pairs of records. Then, the deduplicated database tables are merged by performing another pairwise comparison. Under a second approach, the database tables may be concatenated. Thereafter, records are subject to pairwise comparisons and then clustered to create a merged database table.
Claims20
A system comprising:
- a database that stores a first database table and a second database table, the first database table comprising a first set of records and a first plurality of fields for the first set of records, the second database table comprising a second set of records and a second plurality of fields for the second set of records, wherein at least one field in the second plurality of fields is not included among the first plurality of fields;
- and
- a memory coupled to a processor, the memory comprising a plurality of instructions that cause the processor to:
- concatenate the first database table and the second database table to generate a concatenated table by normalizing the first plurality of fields and second plurality of fields, the concatenated table comprising the first set of records, the first plurality of fields, the second set of records, and the second plurality of fields;
- perform pairwise comparisons on the concatenated table to determine related pairs of records having a degree of similarity that exceeds a preset threshold;
- identify a plurality of clusters within the concatenated table based on the pairwise comparisons;
- and
- generate a merged table by deduplicating the concatenated table using the plurality of clusters.
5 more elements
A computer implemented method comprising:
- storing in a database a first database table and a second database table, the first database table comprising a first set of records and a first plurality of fields for the first set of records, the second database table comprising a second set of records and a second plurality of fields for the second set of records, wherein at least one field in the second plurality of fields is not included among the first plurality of fields;
- concatenating the first database table and the second database table to generate a concatenated table by normalizing the first plurality of fields and second plurality of fields, the concatenated table comprising the first set of records, the first plurality of fields, the second set of records, and the second plurality of fields;
- performing pairwise comparisons on the concatenated table to determine pairs of records having a degree of similarity that exceeds a preset threshold;
- identifying a plurality of clusters within the concatenated table based on the pairwise comparisons;
- and
- generating a merged table by deduplicating the concatenated table using the plurality of clusters.
3 more elements
A system comprising:
- a processor;
- and
- a memory coupled to the processor, the memory comprising a plurality of instructions that cause the processor to:
- access a database that is configured to store a first database table and a second database table, the first database table comprising a first set of records and a first plurality of fields for the first set of records, the second database table comprising a second set of records and a second plurality of fields for the second set of records, wherein at least one field in the second plurality of fields is not included among the first plurality of fields;
- concatenate the first database table and the second database table to generate a concatenated table by normalizing the first plurality of fields and second plurality of fields, the concatenated table comprising the first set of records, the first plurality of fields, the second set of records, and the second plurality of fields;
- perform pairwise comparisons on the concatenated table to determine pairs of records having a degree of similarity that exceeds a preset threshold;
- identify a plurality of clusters within the concatenated table based on the pairwise comparisons;
- and
- generate a merged table by deduplicating the concatenated table using the plurality of clusters.
6 more elements
Dependencies are inferred from the claim text.