Automated name standardization for big data
AssigneeEMC Corporation
InventorsKaushik Das, Jarrod J. Vawdrey, Robert J. Eckhardt, Yu Zhang
Life of this patent
Estimating the term…
Abstract
Distinct names of merchant entities in a transaction processing database are automatically corrected to standard names of entities by identifying non-standard features from the distinct names that do not uniquely identify the standard names of entities, and processing each distinct name with a selected regular expression tailored to remove the non-standard features and convent the names to a standard name format. Fuzzy matching is used to identify standard names of entities corresponding to the standard name formats.
Claims18
A computer-implemented method of automated standardization of distinct non-standard names in a transactions processing database to associate said distinct non-standard names with standard names of particular entities, comprising:
- identifying features of a distinct name that are non-standard features of a standard name of an entity stored in said database, the non-standard features creating ambiguity between the distinct name and the standard name, and creating a characteristic feature set for said distinct name containing said identified non-standard features;
- processing said distinct name using a regular expression rule selected based upon the characteristic feature set of said distinct name to cleanse said distinct name by removing the non-standard features of the characteristic feature set from the distinct name to convert the distinct name to a standard name format;
- comparing the standard name format to standard names of entities in the database to determine possible matches;
- and
- identifying based upon said comparing the distinct name as corresponding to the standard name of the entity.
A computer readable non-transitory storage medium for storing executable instructions for controlling a computer to perform automated standardization of distinct names in a transactions processing database to associate said distinct names with standard names of particular entities, comprising instructions for:
- creating a characteristic feature vector for features of a distinct name that are non-standard features of a standard name of an entity stored in said database, said non-standard features creating ambiguity between the distinct name and the standard name;
- processing said distinct name using a regular expression rule selected based upon the feature vector of said distinct name to cleanse said distinct name by removing the non-standard features of the feature vector from the distinct name to convert the distinct name to a standard name format;
- comparing the standard name format to standard names of entities in the database to determine possible matches;
- and
- identifying based upon said comparing the distinct name as corresponding to the standard name of the entity.
Dependencies are inferred from the claim text.