Architecture for a data cleansing application
AssigneeLockheed Martin Corporation
InventorsDouglas R. Burdick, Robert J. Szczerba, Joseph H. Visgitus
Life of this patent
Estimating the term…
Abstract
A system cleanses data. The system includes an input component, a pre-process component, an automated learning component, and a post-process component. The input component receives a collection of records. The pre-process component formats the collection of records and creates a plan for cleansing the collection of records. The automated learning component performs the plan and modifies the plan based on feedback from intermediate steps within the plan. The post-process evaluation component evaluates the result of the automated learning component. The post-process component determines whether to accept the result or to feed back the result to the automated learning component.
Claims15
A system for cleansing data, said system comprising:
- an input component for receiving a collection of records;
- a pre-process component for formatting the collection of records, said pre-process component creating a plan for cleansing said collection of records;
- an automated learning component for performing said plan, said automated learning component modifying said plan based on feedback from intermediate steps within said plan;
- and
- a post-process evaluation component for evaluating the result of said automated learning component, said post-process component determining whether to accept the result or to feed back the result to said automated learning component.
A method for cleansing data, said method comprising the steps of:
- providing a collection of records, an execution plan, and information about the collection of records;
- generating a set of rules from the execution plan;
- beginning the process of cleansing the collection of records utilizing the set of rules;
- modifying the set of rules with the information about the collection of records and feedback from said beginning step;
- and
- continuing the process of cleansing the collection of records with the modified set of rules.
A method for cleansing data, said method comprising the steps of:
- inputting a collection of records;
- formatting the collection of records so that the collection of records appears to come from a single source;
- generating information about the collection of records regarding size, composition, and type of records;
- creating an execution plan for cleansing the collection of records;
- evaluating the output from said formatting, generating, and creating steps;
- and
- determining whether to perform said formatting, generating, and creating steps again based on said evaluating step.
Dependencies are inferred from the claim text.