Record matching in a database system
AssigneeInternational Business Machines Corporation
InventorsLars Bremer, Martin Oberhofer, Karin Steckler, Mariya Chkalova, Michael Baessler, Holger Koenig
Life of this patent
Estimating the term…
Abstract
A computer implemented method comprising processing the unstructured objects of each record of records of a database for identifying a set of one or more values of attributes in the unstructured objects of the each record. The sets of unstructured attribute values of two records of the database may be compared for determining a similarity level between the two sets. It may be determined whether the two records are representing a same entity based on the comparison result.
Claims20
A computer implemented method for record matching in a database system, the method comprising:
- identifying records representing respective entities, wherein a record of the identified records comprises structured attributes;
- assigning an initial contribution weight to the structured attributes;
- identifying one or more unstructured data objects corresponding to the records;
- processing the one or more unstructured data objects to identify unstructured attribute values corresponding to respective records of the identified records;
- identifying entity relation scores corresponding to the identified records, wherein an entity relation score indicates how often an entity represented by a record occurs alongside a selected entity;
- comparing two records based, at least in part, on the updated contribution weight of the selected structured attribute and a comparison of the entity relation scores and the unstructured attribute values of the two records to determine a similarity level between the two records;
- selecting unstructured attribute values that are present with respect to the identified records;
- and
- responsive to determining a structured attribute value of the structured attribute values does not match any of the selected unstructured attributes, replacing the contribution weight of said structured attribute by an updated contribution weight indicative of the similarity between the two records of the identified records.
A computer program product for record matching in a database system, the computer program product comprising:
- one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising instructions to:
- identify records representing respective entities wherein a record of the identified records comprises structured attributes;
- identify one or more unstructured data objects corresponding to the records;
- process the one or more unstructured data objects to identify unstructured attribute values corresponding to respective records of the identified records;
- identify entity relation scores corresponding to the identified records, wherein the entity relation score indicates how often an entity represented by a record occurs alongside a selected entity;
- compare two records based, at least in part, on the increased initial contribution weight of the selected structured attribute and a comparison of the entity relation scores and the unstructured attribute values of the two records to determine a similarity level between the two records;
- select unstructured attribute values that are present with respect to the identified records;
- and
- responsive to determining a structured attribute value of the structured attribute values does not match any of the selected unstructured attributes, replace the contribution weight of said structured attribute by an updated contribution weight indicative of the similarity between the two records of the identified records.
A computer system for record matching, wherein a record represents an entity, the record being associated with one or more unstructured data objects, the computer system comprising:
- one or more computer processors:
- one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising instructions to:
- identify records representing respective entities wherein a record of the identified records comprises structured attributes;
- identify one or more unstructured data objects corresponding to the records;
- process the one or more unstructured data objects to identify unstructured attribute values corresponding to respective records of the identified records;
- identify entity relation scores corresponding to the identified records, wherein the entity relation score indicates how often an entity represented by a record occurs alongside a selected entity;
- compare two records based, at least in part, on the increased initial contribution weight of the selected structured attribute and a comparison of the entity relation scores and the unstructured attribute values of the two records to determine a similarity level between the two records;
- select unstructured attribute values that are present with respect to the identified records;
- and
- responsive to determining a structured attribute value of the structured attribute values does not match any of the selected unstructured attributes, replace the contribution weight of said structured attribute by an updated contribution weight indicative of the similarity between the two records of the identified records.
Dependencies are inferred from the claim text.